{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T22:11:46Z","timestamp":1776118306874,"version":"3.50.1"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2017,10,31]],"date-time":"2017-10-31T00:00:00Z","timestamp":1509408000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2017,10,31]]},"abstract":"<jats:p>\n            In the domain of literary criticism, many critics practice\n            <jats:italic>close reading<\/jats:italic>\n            , annotating by hand while performing a detailed analysis of a single text. Often this process employs the use of external resources to aid analysis. In this article, we present a study and subsequent tool design focused on leveraging a critic\u2019s annotations as implicit interactions for initiating context-specific computational support that automatically searches external resources. We observed 14 poetry critics performing a close reading, revealing a set of cognitive practices supported through free-form annotation that have not previously been discussed in this context. We used guidelines derived from our study to design a tool, Metatation, which uses a pen-and-paper system with a peripheral display to utilize reader annotations as underspecified interactions to augment close reading. By turning paper-based annotations into implicit queries, Metatation provides relevant supplemental information in a just-in-time manner and acts as a bridge between close and distant reading.\n          <\/jats:p>","DOI":"10.1145\/3131609","type":"journal-article","created":{"date-parts":[[2017,11,14]],"date-time":"2017-11-14T14:02:44Z","timestamp":1510668164000},"page":"1-41","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Metatation"],"prefix":"10.1145","volume":"24","author":[{"given":"Hrim","family":"Mehta","sequence":"first","affiliation":[{"name":"University of Ontario Institute of Technology, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Bradley","sequence":"additional","affiliation":[{"name":"University of Waterloo, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Hancock","sequence":"additional","affiliation":[{"name":"University of Waterloo, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christopher","family":"Collins","sequence":"additional","affiliation":[{"name":"University of Ontario Institute of Technology, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,11,13]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12125"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/1620754.1620799"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2133806.2133826"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143859"},{"key":"e_1_2_1_5_1","volume-title":"Blei","author":"Boyd-Graber Jordan L.","year":"2009","unstructured":"Jordan L. Boyd-Graber and David M . Blei . 2009 . Syntactic topic models. In Advances in Neural Information Processing Systems: Volume 21, D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou (Eds.). Curran Associates, Inc., Red Hook, NY , 185--192. Jordan L. Boyd-Graber and David M. Blei. 2009. Syntactic topic models. In Advances in Neural Information Processing Systems: Volume 21, D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou (Eds.). Curran Associates, Inc., Red Hook, NY, 185--192."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing.","author":"Boyd-Graber Jordan L.","year":"2007","unstructured":"Jordan L. Boyd-Graber , David M. Blei , and Xiaojin Zhu . 2007 . A Topic Model for Word Sense Disambiguation . In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Jordan L. Boyd-Graber, David M. Blei, and Xiaojin Zhu. 2007. A Topic Model for Word Sense Disambiguation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing."},{"key":"e_1_2_1_7_1","volume-title":"Blei","author":"Chang Jonathan","year":"2009","unstructured":"Jonathan Chang , Sean Gerrish , Chong Wang , Jordan L. Boyd-graber, and David M . Blei . 2009 . Reading tea leaves: How humans interpret topic models. In Advances in Neural Information Processing Systems: Volume 22, Y. Bengio, D. Schuurmans, J. D. Lafferty, C. K. I. Williams, and A. Culotta (Eds.). Curran Associates, Inc., Red Hook, NY , 288--296. Jonathan Chang, Sean Gerrish, Chong Wang, Jordan L. Boyd-graber, and David M. Blei. 2009. Reading tea leaves: How humans interpret topic models. In Advances in Neural Information Processing Systems: Volume 22, Y. Bengio, D. Schuurmans, J. D. Lafferty, C. K. I. Williams, and A. Culotta (Eds.). Curran Associates, Inc., Red Hook, NY, 288--296."},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the Conference on Digital Humanities (DH\u201912)","author":"Chaturvedi M.","unstructured":"M. Chaturvedi , G. Gannod , L. Mandell , H. Armstrong , and E. Hodgson . 2012. Myopia: A Visualization Tool in Support of Close Reading . In Proceedings of the Conference on Digital Humanities (DH\u201912) . M. Chaturvedi, G. Gannod, L. Mandell, H. Armstrong, and E. Hodgson. 2012. Myopia: A Visualization Tool in Support of Close Reading. In Proceedings of the Conference on Digital Humanities (DH\u201912)."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466237"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/288392.288605"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the Conference on Digital Humanities (DH\u201912)","author":"Clement Tanya","year":"2012","unstructured":"Tanya Clement , Loretta Auvil , David Tcheng , Boris Capitanu , Megan Monroe , and Ankita Goel . 2012 . Sounding for meaning: Analyzing aural patterns across large digital collections . In Proceedings of the Conference on Digital Humanities (DH\u201912) . Tanya Clement, Loretta Auvil, David Tcheng, Boris Capitanu, Megan Monroe, and Ankita Goel. 2012. Sounding for meaning: Analyzing aural patterns across large digital collections. In Proceedings of the Conference on Digital Humanities (DH\u201912)."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01439.x"},{"key":"e_1_2_1_13_1","volume-title":"The Merriam-Webster Dictionary. Merriam-Webster","author":"Merriam-Webster Inc. 2006.","unstructured":"Merriam-Webster Inc. 2006. The Merriam-Webster Dictionary. Merriam-Webster , Inc., Springfield, MA. Merriam-Webster Inc. 2006. The Merriam-Webster Dictionary. Merriam-Webster, Inc., Springfield, MA."},{"key":"e_1_2_1_14_1","first-page":"18","article-title":"Externalisation -- How writing changes thinking","volume":"76","author":"Dix Alan","year":"2008","unstructured":"Alan Dix . 2008 . Externalisation -- How writing changes thinking . Interfaces 76 (2008), 18 -- 19 . Alan Dix. 2008. Externalisation -- How writing changes thinking. Interfaces 76 (2008), 18--19.","journal-title":"Interfaces"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/336597.336632"},{"key":"e_1_2_1_16_1","volume-title":"Mary Jo Salter, and Jon Stallworthy","author":"Ferguson Margaret","year":"2005","unstructured":"Margaret Ferguson , Mary Jo Salter, and Jon Stallworthy . 2005 . The Norton Anthology of Poetry. WW Norton 8 Company , New York, NY. Margaret Ferguson, Mary Jo Salter, and Jon Stallworthy. 2005. The Norton Anthology of Poetry. WW Norton 8 Company, New York, NY."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/964696.964702"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04180-8_51"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/312624.312649"},{"key":"e_1_2_1_20_1","volume-title":"Digital Methods and Literary History","author":"Jockers Matthew","unstructured":"Matthew Jockers . 2013. Macroanalysis , Digital Methods and Literary History . University of Illinois Press , Champaign, IL . Matthew Jockers. 2013. Macroanalysis, Digital Methods and Literary History. University of Illinois Press, Champaign, IL."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the Eurographics Conference on Visualization (Euro Vis) -- STARs.","author":"Jnicke Stefan","year":"2015","unstructured":"Stefan Jnicke , Greta Franzini , Muhammad Faisal Cheema , and Gerik Scheuermann . 2015 . On close and distant reading in digital humanities: A survey and future challenges . In Proceedings of the Eurographics Conference on Visualization (Euro Vis) -- STARs. Stefan Jnicke, Greta Franzini, Muhammad Faisal Cheema, and Gerik Scheuermann. 2015. On close and distant reading in digital humanities: A survey and future challenges. In Proceedings of the Eurographics Conference on Visualization (Euro Vis) -- STARs."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.2965595"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1314683.1314686"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/571985.571992"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-5010"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/263690.263806"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/996350.996432"},{"key":"e_1_2_1_28_1","volume-title":"Blei","author":"Mcauliffe Jon D.","year":"2008","unstructured":"Jon D. Mcauliffe and David M . Blei . 2008 . Supervised topic models. In Advances in Neural Information Processing Systems: Volume 20, J. C. Platt, D. Koller, Y. Singer, and S. T. Roweis (Eds.). Curran Associates, Inc., Red Hook, NY , 121--128. http:\/\/papers.nips.cc\/paper\/3328-supervised-topic-models.pdf. Jon D. Mcauliffe and David M. Blei. 2008. Supervised topic models. In Advances in Neural Information Processing Systems: Volume 20, J. C. Platt, D. Koller, Y. Singer, and S. T. Roweis (Eds.). Curran Associates, Inc., Red Hook, NY, 121--128. http:\/\/papers.nips.cc\/paper\/3328-supervised-topic-models.pdf."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467811"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_2_1_31_1","volume-title":"Graphs","author":"Moretti Franco","unstructured":"Franco Moretti . 2005. Graphs , Maps, Trees : Abstract Models for a Literary History. Verso , Brooklyn, NY. Franco Moretti. 2005. Graphs, Maps, Trees: Abstract Models for a Literary History. Verso, Brooklyn, NY."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the IEEE Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP\u201907)","author":"Morris Meredith Ringel","unstructured":"Meredith Ringel Morris , A. J. Bernheim Brush , and Brian R. Meyers . 2007. Reading revisited: Evaluating the usability of digital display surfaces for active reading tasks . In Proceedings of the IEEE Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP\u201907) . ACM, 79--86. Meredith Ringel Morris, A. J. Bernheim Brush, and Brian R. Meyers. 2007. Reading revisited: Evaluating the usability of digital display surfaces for active reading tasks. In Proceedings of the IEEE Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP\u201907). ACM, 79--86."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2508212"},{"key":"e_1_2_1_34_1","volume-title":"Things that Make Us Smart: Defending Human Attributes in the Age of the Machine","author":"Norman Donald A.","unstructured":"Donald A. Norman . 1994. Things that Make Us Smart: Defending Human Attributes in the Age of the Machine . Basic Books , New York, NY . Donald A. Norman. 1994. Things that Make Us Smart: Defending Human Attributes in the Age of the Machine. Basic Books, New York, NY."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1166160.1166175"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258787"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1999.0247"},{"key":"e_1_2_1_38_1","unstructured":"W. Bradford Paley. 2002. TextArc: Showing word frequency and distribution in text. In Poster presented at the IEEE Symposium on Information Visualization (INFOVIS\u201902).  W. Bradford Paley. 2002. TextArc: Showing word frequency and distribution in text. In Poster presented at the IEEE Symposium on Information Visualization (INFOVIS\u201902)."},{"key":"e_1_2_1_39_1","volume-title":"Interaction Design: Beyond Human-Computer Interaction","author":"Preece Jenny","year":"2015","unstructured":"Jenny Preece , Helen Sharp , and Yvonne Rogers . 2015 . Interaction Design: Beyond Human-Computer Interaction . John Wiley and Sons , London . Jenny Preece, Helen Sharp, and Yvonne Rogers. 2015. Interaction Design: Beyond Human-Computer Interaction. John Wiley and Sons, London."},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50","author":"\u0158eh\u0159ek Radim","year":"2010","unstructured":"Radim \u0158eh\u0159ek and Petr Sojka . 2010 . Software framework for topic modelling with large corpora . In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50 . http:\/\/is.muni.cz\/publication\/884893\/en. Radim \u0158eh\u0159ek and Petr Sojka. 2010. Software framework for topic modelling with large corpora. In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50. http:\/\/is.muni.cz\/publication\/884893\/en."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/274644.274680"},{"key":"e_1_2_1_42_1","volume-title":"The reflective practitioner: How professionals think in action","author":"Sch\u00f6n Donald A.","unstructured":"Donald A. Sch\u00f6n . 1983. The reflective practitioner: How professionals think in action . Basic Books , New York, NY . Donald A. Sch\u00f6n. 1983. The reflective practitioner: How professionals think in action. Basic Books, New York, NY."},{"key":"e_1_2_1_43_1","volume-title":"Research and Advanced Technology for Digital Libraries","author":"Shipman Frank","unstructured":"Frank Shipman , Morgan Price , Catherine C. Marshall , and Gene Golovchinsky . 2003. Identifying useful passages in documents based on annotation patterns . In Research and Advanced Technology for Digital Libraries . Springer , New York, NY , 101--112. Frank Shipman, Morgan Price, Catherine C. Marshall, and Gene Golovchinsky. 2003. Identifying useful passages in documents based on annotation patterns. In Research and Advanced Technology for Digital Libraries. Springer, New York, NY, 101--112."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1226969.1226981"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753697"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2009.27"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/365024.365096"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979430"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518827"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2388676.2388732"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/159544.159630"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1294211.1294238"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/S8755-4615(02)00144-5"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124859"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647390"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3131609","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3131609","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:57Z","timestamp":1750212837000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3131609"}},"subtitle":["Annotation as Implicit Interaction to Bridge Close and Distant Reading"],"short-title":[],"issued":{"date-parts":[[2017,10,31]]},"references-count":55,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2017,10,31]]}},"alternative-id":["10.1145\/3131609"],"URL":"https:\/\/doi.org\/10.1145\/3131609","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,31]]},"assertion":[{"value":"2016-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-11-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}