{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T00:21:13Z","timestamp":1767918073464,"version":"3.49.0"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2010,11,1]],"date-time":"2010-11-01T00:00:00Z","timestamp":1288569600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000146","name":"Division of Chemical, Bioengineering, Environmental, and Transport Systems","doi-asserted-by":"publisher","award":["CBET-0754525"],"award-info":[{"award-number":["CBET-0754525"]}],"id":[{"id":"10.13039\/100000146","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Access. Comput."],"published-print":{"date-parts":[[2010,11]]},"abstract":"<jats:p>\n            Several solutions, based on aural and haptic feedback, have been developed to enable access to complex on-line and digital information contents for people with visual impairment. Nevertheless, there are several components of widely used software applications that are still beyond the reach of traditional screen readers and Braille displays. This article investigates the nonvisual accessibility issues associated with the graphing component of Microsoft Excel and proposes a novel approach and system. The goal is to provide flexible multi-modal presentation schemes which can help visually impaired users in comprehending the most commonly used two dimensional business charts, demonstrated within the familiar context of Excel charts. The methodology identifies the need for three distinct strategies used in the user interaction with a chart:\n            <jats:italic>exploratory, guided<\/jats:italic>\n            , and\n            <jats:italic>summarization<\/jats:italic>\n            . These methodologies have been implemented using a multimodal approach, which combines aural cues, speech commentaries, and 3-dimensional haptic feedback. The prototype implementation and the preliminary studies suggest that the multimodality can be effectively realized and users denote preferences in intertwining these methodologies to gain understanding of the content of charts. These methodologies have been implemented in a system, which makes use of the Novint Falcon haptic device and integrated as a plug-in in Microsoft Excel.\n          <\/jats:p>","DOI":"10.1145\/1857920.1857925","type":"journal-article","created":{"date-parts":[[2010,11,30]],"date-time":"2010-11-30T15:03:23Z","timestamp":1291129403000},"page":"1-50","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["Multimodal Presentation of Two-Dimensional Charts"],"prefix":"10.1145","volume":"3","author":[{"given":"Iyad","family":"Abu Doush","sequence":"first","affiliation":[{"name":"New Mexico State University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enrico","family":"Pontelli","sequence":"additional","affiliation":[{"name":"New Mexico State University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tran Cao","family":"Son","sequence":"additional","affiliation":[{"name":"New Mexico State University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dominic","family":"Simon","sequence":"additional","affiliation":[{"name":"New Mexico State University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ou","family":"Ma","sequence":"additional","affiliation":[{"name":"New Mexico State University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2010,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1639642.1639669"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2004.08.003"},{"key":"e_1_2_1_3_1","unstructured":"American Foundation for the Blind. 2010. Braille technology. http:\/\/www.afb.org\/Section.asp?SectionID=4&amp;TopicID=31&amp;DocumentID=1282. American Foundation for the Blind . 2010. Braille technology. http:\/\/www.afb.org\/Section.asp?SectionID=4&amp;TopicID=31&amp;DocumentID=1282."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the Human Factors and Ergonomics Society. 922--926","author":"Barraza P.","unstructured":"Barraza , P. , Gillan , D. , Karshmer , A. , and Pazuchanics , S . 2004. A cognitive analysis of equation reading applied to the development of assistive technology for visually-impaired students . In Proceedings of the Human Factors and Ergonomics Society. 922--926 . Barraza, P., Gillan, D., Karshmer, A., and Pazuchanics, S. 2004. A cognitive analysis of equation reading applied to the development of assistive technology for visually-impaired students. In Proceedings of the Human Factors and Ergonomics Society. 922--926."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 7th European Workshop on Natural Language Generation. 49--58","author":"Corio M.","unstructured":"Corio , M. and Lapalme , G . 1999. Generation of texts for information graphics . In Proceedings of the 7th European Workshop on Natural Language Generation. 49--58 . Corio, M. and Lapalme, G. 1999. Generation of texts for information graphics. In Proceedings of the 7th European Workshop on Natural Language Generation. 49--58."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/1708322.1708327"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/1873738.1873744"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1805986.1806009"},{"key":"e_1_2_1_9_1","volume-title":"Tactile Graphics","author":"Edman P.","unstructured":"Edman , P. 1991. Tactile Graphics . American Foundation for the Blind, New York . Edman, P. 1991. Tactile Graphics. American Foundation for the Blind, New York."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/1759957.1759979"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 3rd International Conference on Web Information Systems and Technology (WebIST). 59--65","author":"Elzer S.","unstructured":"Elzer , S. , Schwartz , E. , Carberry , S. , Chester , D. , Demir , S. , and Wu , P . 2007. A browser extension for providing visually impaired users access to the content of bar charts on the web . In Proceedings of the 3rd International Conference on Web Information Systems and Technology (WebIST). 59--65 . Elzer, S., Schwartz, E., Carberry, S., Chester, D., Demir, S., and Wu, P. 2007. A browser extension for providing visually impaired users access to the content of bar charts on the web. In Proceedings of the 3rd International Conference on Web Information Systems and Technology (WebIST). 59--65."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1296843.1296857"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1878803.1878820"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/638249.638254"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 7th International Conference on Information Visualization.","author":"Franklin K. M.","unstructured":"Franklin , K. M. and Roberts , J. C . 2003. Pie chart sonification . In Proceedings of the 7th International Conference on Information Visualization. Vol. IV . IEEE Computer Society. Franklin, K. M. and Roberts, J. C. 2003. Pie chart sonification. In Proceedings of the 7th International Conference on Information Visualization. Vol. IV. IEEE Computer Society."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/86.788473"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the International Conference on Technology and Persons with Disabilities (CSUN).","author":"Gardner J. A.","unstructured":"Gardner , J. A. and Bulatov , V . 2004. Complete access to all paper and computer forms, tables, and charts . In Proceedings of the International Conference on Technology and Persons with Disabilities (CSUN). Gardner, J. A. and Bulatov, V. 2004. Complete access to all paper and computer forms, tables, and charts. In Proceedings of the International Conference on Technology and Persons with Disabilities (CSUN)."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the International Conference on Technology and Persons with Disabilities (CSUN).","author":"Gardner J. A.","unstructured":"Gardner , J. A. , Lundquist , R. , and Sahyun , S . 1998. Triangle: A tri-modal access program for reading, writing, and doing math . In Proceedings of the International Conference on Technology and Persons with Disabilities (CSUN). Gardner, J. A., Lundquist, R., and Sahyun, S. 1998. Triangle: A tri-modal access program for reading, writing, and doing math. In Proceedings of the International Conference on Technology and Persons with Disabilities (CSUN)."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the Human Factors and Ergonomics Society. 1152--1155","author":"Gillan D.","unstructured":"Gillan , D. and Barraza , P . 2006. A few seconds of equation reading: A process model of equation reading and its applications . In Proceedings of the Human Factors and Ergonomics Society. 1152--1155 . Gillan, D. and Barraza, P. 2006. A few seconds of equation reading: A process model of equation reading and its applications. In Proceedings of the Human Factors and Ergonomics Society. 1152--1155."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.333677"},{"key":"e_1_2_1_22_1","unstructured":"Gunther E. 2001. Skinscape: A tool for composition in the tactile modality. M.S. thesis Massachusetts Institute of Technology. Gunther E. 2001. Skinscape: A tool for composition in the tactile modality. M.S. thesis Massachusetts Institute of Technology."},{"key":"e_1_2_1_23_1","volume-title":"Data Mining: Concepts and Techniques","author":"Han J.","year":"2005","unstructured":"Han , J. and Kamber , M . 2005 . Data Mining: Concepts and Techniques , 2 nd Ed. The Morgan Kaufmann Series in Data Management Systems. Morgan Kaufmann . Han, J. and Kamber, M. 2005. Data Mining: Concepts and Techniques, 2nd Ed. The Morgan Kaufmann Series in Data Management Systems. Morgan Kaufmann.","edition":"2"},{"key":"e_1_2_1_24_1","unstructured":"iFeelPixel Association. 2009. iFeelPixel: Universal digital access. http:\/\/www.ifeelpixel.com\/. iFeelPixel Association . 2009. iFeelPixel: Universal digital access. http:\/\/www.ifeelpixel.com\/."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications (HAVE\u201904)","author":"Iglesias R.","unstructured":"Iglesias , R. , Casado , S. , Gutierrez , T. , Barbero , J. , Avizzano , C. , Marcheschi , S. , and Bergamasco , M . 2004. Computer graphics access for blind people through a haptic and audio virtual environment . In Proceedings of the 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications (HAVE\u201904) . 13--18. Iglesias, R., Casado, S., Gutierrez, T., Barbero, J., Avizzano, C., Marcheschi, S., and Bergamasco, M. 2004. Computer graphics access for blind people through a haptic and audio virtual environment. In Proceedings of the 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications (HAVE\u201904). 13--18."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1279920.1279922"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1089\/cyber.2009.0098"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125634"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the 12th International Conference on Auditory Display (ICAD\u201906)","author":"Kildal J.","unstructured":"Kildal , J. and Brewster , S. A . 2006b. Providing a size-independent overview of non-visual tables . In Proceedings of the 12th International Conference on Auditory Display (ICAD\u201906) . 8--15. Kildal, J. and Brewster, S. A. 2006b. Providing a size-independent overview of non-visual tables. In Proceedings of the 12th International Conference on Auditory Display (ICAD\u201906). 8--15."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1080\/01449290600636694"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the Software Ergonomie Workshop.","author":"Kurze M.","year":"1995","unstructured":"Kurze , M. 1995 . Giving blind people access to graphics . In Proceedings of the Software Ergonomie Workshop. Kurze, M. 1995. Giving blind people access to graphics. In Proceedings of the Software Ergonomie Workshop."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1090785.1090814"},{"key":"e_1_2_1_33_1","unstructured":"Lighthouse Inc. 2009. Lighthouse International report. World Wide Web electronic publication. http:\/\/www.lighthouse.org\/. Lighthouse Inc. 2009. Lighthouse International report. World Wide Web electronic publication. http:\/\/www.lighthouse.org\/."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00996201"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the Australasian Conference on Robotics and Automation.","author":"Marint S.","unstructured":"Marint , S. and Hillier , N . 2009. Characterization of the Novint Falcon haptic device for application as a robot manipulator . In Proceedings of the Australasian Conference on Robotics and Automation. Marint, S. and Hillier, N. 2009. Characterization of the Novint Falcon haptic device for application as a robot manipulator. In Proceedings of the Australasian Conference on Robotics and Automation."},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 12th International Conference on Auditory Display (ICAD\u201906)","author":"McGookin D. K.","unstructured":"McGookin , D. K. and Brewster , S. A . 2006. Contextual audio in haptic graph browsing . In Proceedings of the 12th International Conference on Auditory Display (ICAD\u201906) . 91--94. McGookin, D. K. and Brewster, S. A. 2006. Contextual audio in haptic graph browsing. In Proceedings of the 12th International Conference on Auditory Display (ICAD\u201906). 91--94."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/972749.972754"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the International Conference on Auditory Display.","author":"Neuhoff J. G.","unstructured":"Neuhoff , J. G. and Wayand , J . 2002. Pitch change, sonification, and musical expertise: Which way is up? In Proceedings of the International Conference on Auditory Display. Neuhoff, J. G. and Wayand, J. 2002. Pitch change, sonification, and musical expertise: Which way is up? In Proceedings of the International Conference on Auditory Display."},{"key":"e_1_2_1_39_1","unstructured":"Nielsen J. 1995. Usability Enrineering. AP Professional. Nielsen J. 1995. Usability Enrineering . AP Professional."},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Noyes J. and Baber C. 1999. User-Centered Design of Systems. Springer. Noyes J. and Baber C. 1999. User-Centered Design of Systems . Springer.","DOI":"10.1007\/978-1-4471-0537-4"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/274497.274521"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2004.04.006"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1201\/9781420064995-c51"},{"key":"e_1_2_1_44_1","volume-title":"Joint Proceedings of IHM and HCI. 515--530","author":"Ramloll R.","unstructured":"Ramloll , R. , Brewster , S. , Yu , W. , and Riedel , B . 2001. Using non-speech sounds to improve access to 2d tabular numerical information for visually impaired users . In Joint Proceedings of IHM and HCI. 515--530 . Ramloll, R., Brewster, S., Yu, W., and Riedel, B. 2001. Using non-speech sounds to improve access to 2d tabular numerical information for visually impaired users. In Joint Proceedings of IHM and HCI. 515--530."},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Reiter E. and Dale R. 2000. Building Natural Language Generation Systems. Cambridge University Press. Reiter E. and Dale R. 2000. Building Natural Language Generation Systems . Cambridge University Press.","DOI":"10.1017\/CBO9780511519857"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145482X0209600605"},{"key":"e_1_2_1_48_1","first-page":"53546","article-title":"Web-based consumer productivity applications are a threat in waiting to Microsoft","volume":"7211","author":"Safiran N.","year":"2009","unstructured":"Safiran , N. , Gownder , J. , Wilkos , D. , and Tincher , C. 2009 . Web-based consumer productivity applications are a threat in waiting to Microsoft Office. Tech. rep., Forrester. http:\/\/www.forrester.com\/Research\/Document\/Excerpt\/0 , 7211 , 53546 ,00.html. Safiran, N., Gownder, J., Wilkos, D., and Tincher, C. 2009. Web-based consumer productivity applications are a threat in waiting to Microsoft Office. Tech. rep., Forrester. http:\/\/www.forrester.com\/Research\/Document\/Excerpt\/0,7211,53546,00.html.","journal-title":"Office. Tech. rep., Forrester. http:\/\/www.forrester.com\/Research\/Document\/Excerpt\/0"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1076\/vimr.5.1.13.15972"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/3227209.3227318"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 11th International Conference on Auditory Display (ICAD\u201905)","author":"Stockman T.","unstructured":"Stockman , T. , Hind , G. , and Frauenberger , C . 2005. Interactive sonification of spreadsheets . In Proceedings of the 11th International Conference on Auditory Display (ICAD\u201905) . 134--139. Stockman, T., Hind, G., and Frauenberger, C. 2005. Interactive sonification of spreadsheets. In Proceedings of the 11th International Conference on Auditory Display (ICAD\u201905). 134--139."},{"key":"e_1_2_1_52_1","unstructured":"VanDrimmelen J. 2007. Haptic novint falcon navigates virtual spaces. http:\/\/edutechie.com\/2007\/12\/haptic-novint-falcon-navigates-virtual-space\/. VanDrimmelen J. 2007. Haptic novint falcon navigates virtual spaces. http:\/\/edutechie.com\/2007\/12\/haptic-novint-falcon-navigates-virtual-space\/."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028630.1028634"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the 11th Meeting of the International Conference on Auditory Display (ICAD). 428--432","author":"Walker B. N.","unstructured":"Walker , B. N. and Nees , M. A . 2005. An agenda for research and development of multimodal graphs . In Proceedings of the 11th Meeting of the International Conference on Auditory Display (ICAD). 428--432 . Walker, B. N. and Nees, M. A. 2005. An agenda for research and development of multimodal graphs. In Proceedings of the 11th Meeting of the International Conference on Auditory Display (ICAD). 428--432."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1182475.1182477"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324905004031"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-002-0042-6"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the 1st International Workshop on Haptic Human-Computer Interaction.","volume":"2058","author":"Yu W.","unstructured":"Yu , W. , Ramloll , R. , and Brewster , S. A . 2000. Haptic graphs for blind computer users . In Proceedings of the 1st International Workshop on Haptic Human-Computer Interaction. Vol. 2058 , 41--51. Yu, W., Ramloll, R., and Brewster, S. A. 2000. Haptic graphs for blind computer users. In Proceedings of the 1st International Workshop on Haptic Human-Computer Interaction. Vol. 2058, 41--51."}],"container-title":["ACM Transactions on Accessible Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1857920.1857925","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1857920.1857925","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T12:09:10Z","timestamp":1750248550000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1857920.1857925"}},"subtitle":["An Investigation Using Open Office XML and Microsoft Excel"],"short-title":[],"issued":{"date-parts":[[2010,11]]},"references-count":56,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2010,11]]}},"alternative-id":["10.1145\/1857920.1857925"],"URL":"https:\/\/doi.org\/10.1145\/1857920.1857925","relation":{},"ISSN":["1936-7228","1936-7236"],"issn-type":[{"value":"1936-7228","type":"print"},{"value":"1936-7236","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,11]]},"assertion":[{"value":"2009-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}