{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,12]],"date-time":"2025-11-12T03:16:01Z","timestamp":1762917361037},"reference-count":75,"publisher":"MIT Press - Journals","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Linguistics"],"published-print":{"date-parts":[[2012,9]]},"abstract":"<jats:p> Information graphics (such as bar charts and line graphs) play a vital role in many multimodal documents. The majority of information graphics that appear in popular media are intended to convey a message and the graphic designer uses deliberate communicative signals, such as highlighting certain aspects of the graphic, in order to bring that message out. The graphic, whose communicative goal (intended message) is often not captured by the document's accompanying text, contributes to the overall purpose of the document and cannot be ignored. This article presents our approach to providing the high-level content of a non-scientific information graphic via a brief textual summary which includes the intended message and the salient features of the graphic. This work brings together insights obtained from empirical studies in order to determine what should be contained in the summaries of this form of non-linguistic input data, and how the information required for realizing the selected content can be extracted from the visual image and the textual components of the graphic. This work also presents a novel bottom\u2013up generation approach to simultaneously construct the discourse and sentence structures of textual summaries by leveraging different discourse related considerations such as the syntactic complexity of realized sentences and clause embeddings. The effectiveness of our work was validated by different evaluation studies. <\/jats:p>","DOI":"10.1162\/coli_a_00091","type":"journal-article","created":{"date-parts":[[2011,12,8]],"date-time":"2011-12-08T14:51:32Z","timestamp":1323355892000},"page":"527-574","source":"Crossref","is-referenced-by-count":22,"title":["Summarizing Information Graphics Textually"],"prefix":"10.1162","volume":"38","author":[{"given":"Seniz","family":"Demir","sequence":"first","affiliation":[{"name":"TUBITAK-BILGEM"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sandra","family":"Carberry","sequence":"additional","affiliation":[{"name":"University of Delaware"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kathleen F.","family":"McCoy","sequence":"additional","affiliation":[{"name":"University of Delaware"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"R1","doi-asserted-by":"publisher","DOI":"10.1145\/274644.274721"},{"key":"R2","first-page":"1","volume-title":"Proceedings of the 3rd Conference on Empirical Methods in Natural Language Processing","author":"Baldwin Breck","year":"1998"},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.1613\/jair.991"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.3115\/1220835.1220881"},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.3115\/1708322.1708360"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.3115\/981175.981197"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148270"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1007\/11425274_68"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511620539"},{"key":"R10","first-page":"300","volume-title":"Proceedings of 9th International Workshop on Natural Language Generation","author":"Coch Jose","year":"1998"},{"key":"R11","first-page":"49","volume-title":"Proceedings of the 7th European Workshop on Natural Language Generation","author":"Corio Marc","year":"1999"},{"key":"R14","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1902_3"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1111\/0824-7935.00099"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1075\/cilt.309.26dem"},{"key":"R19","unstructured":"Elhadad, M. and J. Robin. 1999. SURGE: a comprehensive plug-in syntactic realization component for text generation. Technical Report, Department of Computer Science, Ben Gurion University.Beersheba, Israel."},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2010.10.003"},{"key":"R21","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-006-9002-9"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1007\/PL00011645"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7287.001.0001"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-33037-0_2"},{"issue":"3","key":"R27","doi-asserted-by":"crossref","first-page":"153","DOI":"10.3233\/AIC-2009-0453","volume":"22","author":"Gatt Albert","year":"2009","journal-title":"AI Communications"},{"issue":"2","key":"R28","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/64.294135","volume":"9","author":"Goldberg Eli","year":"1994","journal-title":"IEEE Expert: Intelligent Systems and Their Applications"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.3115\/1567564.1567569"},{"key":"R30","first-page":"23","volume-title":"Proceedings of the EMNLP 2011 Workshop on Language Generation and Evaluation (UCNLG+Eval)","author":"Greenbacker Charlie","year":"2011"},{"key":"R31","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1163\/9789004368811_003","volume":"3","author":"Grice H. Paul","year":"1975","journal-title":"Speech Acts"},{"issue":"3","key":"R32","first-page":"175","volume":"12","author":"Grosz Barbara","year":"1986","journal-title":"Computational Linguistics"},{"issue":"2","key":"R33","first-page":"203","volume":"21","author":"Grosz Barbara J.","year":"1995","journal-title":"Computational Linguistics"},{"key":"R34","doi-asserted-by":"publisher","DOI":"10.3115\/1119089.1119121"},{"key":"R36","first-page":"197","volume-title":"Proceedings of the Workshop on TIPSTER Text program","author":"Hovy Eduard","year":"1993"},{"key":"R37","doi-asserted-by":"publisher","DOI":"10.1145\/231674.231677"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.1145\/1296843.1296858"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008386826277"},{"key":"R40","first-page":"169","volume-title":"Proceedings of the National Conference on Artificial Intelligence","author":"Joshi Aravind","year":"1984"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.1162\/coli.07-036-R2-06-22"},{"key":"R42","doi-asserted-by":"publisher","DOI":"10.1145\/228347.228357"},{"key":"R43","doi-asserted-by":"publisher","DOI":"10.1145\/325737.325814"},{"key":"R44","doi-asserted-by":"publisher","DOI":"10.1162\/0891201042544893"},{"key":"R45","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021265021141"},{"key":"R46","first-page":"233","volume-title":"Information Sharing: Reference and Presupposition in Language Generation and Interpretation, Center for the Study of Language and Information-Lecture Notes","author":"Krahmer E.","year":"2002"},{"key":"R47","doi-asserted-by":"publisher","DOI":"10.1162\/089120103321337430"},{"key":"R48","doi-asserted-by":"publisher","DOI":"10.3115\/981311.981340"},{"key":"R49","volume-title":"Proceedings of the Software-Ergonomie Workshop","author":"Kurze Martin","year":"1995"},{"key":"R50","doi-asserted-by":"publisher","DOI":"10.3115\/974557.974596"},{"key":"R51","doi-asserted-by":"publisher","DOI":"10.1080\/10447310709336964"},{"issue":"1","key":"R52","first-page":"65","volume":"23","author":"Lester James C.","year":"1997","journal-title":"Computational Linguistics"},{"key":"R53","doi-asserted-by":"publisher","DOI":"10.3115\/993268.993295"},{"key":"R54","volume-title":"The Structure of Discourse","author":"Mann William C.","year":"1987"},{"key":"R56","first-page":"695","volume-title":"Proceedings of the 1st International Conference on Universal Access in Human-Computer Interaction","author":"McCoy Kathleen F.","year":"2001"},{"key":"R57","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-5945-7_4"},{"key":"R58","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(85)90082-7"},{"key":"R59","doi-asserted-by":"publisher","DOI":"10.3115\/974557.974598"},{"key":"R60","doi-asserted-by":"publisher","DOI":"10.1109\/10.121642"},{"key":"R61","first-page":"98","volume-title":"Proceedings of the 9th International Workshop on Natural Language Generation","author":"Mellish Chris","year":"1998"},{"issue":"4","key":"R62","first-page":"651","volume":"19","author":"Moore Johanna D.","year":"1993","journal-title":"Computational Linguistics"},{"key":"R63","doi-asserted-by":"publisher","DOI":"10.3115\/1073483.1073507"},{"key":"R64","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324901002698"},{"issue":"3","key":"R65","first-page":"64","volume":"14","author":"Paris Cecile","year":"1988","journal-title":"Computational Linguistics"},{"key":"R66","doi-asserted-by":"publisher","DOI":"10.1016\/S0950-7051(03)00033-9"},{"key":"R67","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2008.12.002"},{"key":"R68","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2003.10.006"},{"key":"R69","doi-asserted-by":"publisher","DOI":"10.1145\/354324.354330"},{"key":"R70","doi-asserted-by":"publisher","DOI":"10.3115\/1610163.1610180"},{"key":"R71","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511519857"},{"key":"R72","doi-asserted-by":"publisher","DOI":"10.3115\/1289189.1289254"},{"key":"R73","first-page":"138","volume-title":"Proceedings of the 9th International Workshop on Natural Language Generation","author":"Shaw James","year":"1998"},{"issue":"3","key":"R74","first-page":"4","volume":"6","author":"Somayajulu Sripada","year":"2003","journal-title":"Expert Update"},{"key":"R75","doi-asserted-by":"publisher","DOI":"10.3115\/1218955.1218966"},{"key":"R76","first-page":"178","volume-title":"Proceedings of the International Natural Language Generation Conference","author":"Stone Matthew","year":"1998"},{"issue":"2","key":"R77","first-page":"301","volume":"20","author":"Suri Linda Z.","year":"1994","journal-title":"Computational Linguistics"},{"key":"R78","doi-asserted-by":"publisher","DOI":"10.3115\/1610195.1610202"},{"key":"R79","doi-asserted-by":"publisher","DOI":"10.1016\/S0885-2308(02)00027-X"},{"key":"R80","doi-asserted-by":"publisher","DOI":"10.1613\/jair.2329"},{"key":"R81","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14600-8_21"},{"key":"R82","first-page":"444","volume":"104","author":"Yngve Victor H.","year":"1960","journal-title":"American Philosophical Society"},{"key":"R83","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324905004031"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/COLI_a_00091","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:27:11Z","timestamp":1615584431000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/38\/3\/527-574\/2163"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,9]]},"references-count":75,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2012,9]]}},"alternative-id":["10.1162\/COLI_a_00091"],"URL":"https:\/\/doi.org\/10.1162\/coli_a_00091","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,9]]}}}