{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:55:35Z","timestamp":1776106535857,"version":"3.50.1"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,8,11]],"date-time":"2017-08-11T00:00:00Z","timestamp":1502409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Access. Comput."],"published-print":{"date-parts":[[2017,8,11]]},"abstract":"<jats:p>Audio-only interfaces, facilitated through text-to-speech screen reading software, have been the primary mode of computer interaction for blind and low-vision computer users for more than four decades. During this time, the advances that have made visual interfaces faster and easier to use, from direct manipulation to skeuomorphic design, have not been paralleled in nonvisual computing environments. The screen reader\u2013dependent community is left with no alternatives to engage with our rapidly advancing technological infrastructure. In this article, we describe our efforts to understand the problems that exist with audio-only interfaces. Based on observing screen reader use for 4 months at a computer training school for blind and low-vision adults, we identify three problem areas within audio-only interfaces: ephemerality, linear interaction, and unidirectional communication. We then evaluated a multimodal approach to computer interaction called the Tangible Desktop\u00a0that addresses these problems by moving semantic information from the auditory to the tactile channel. Our evaluation demonstrated that among novice screen reader users, Tangible Desktop\u00a0improved task completion times by an average of 6 minutes when compared to traditional audio-only computer systems.<\/jats:p>","DOI":"10.1145\/3075222","type":"journal-article","created":{"date-parts":[[2017,8,11]],"date-time":"2017-08-11T12:17:17Z","timestamp":1502453837000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["The Tangible Desktop"],"prefix":"10.1145","volume":"10","author":[{"given":"Mark S.","family":"Baldwin","sequence":"first","affiliation":[{"name":"University of California, Irvine, CA"}]},{"given":"Gillian R.","family":"Hayes","sequence":"additional","affiliation":[{"name":"University of California, Irvine, CA"}]},{"given":"Oliver L.","family":"Haimson","sequence":"additional","affiliation":[{"name":"University of California, Irvine, CA"}]},{"given":"Jennifer","family":"Mankoff","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA"}]},{"given":"Scott E.","family":"Hudson","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA"}]}],"member":"320","published-online":{"date-parts":[[2017,8,11]]},"reference":[{"key":"e_1_2_1_1_1","article-title":"Implementation of assistive technology with students who are visually impaired: Teachers\u2019 readiness","volume":"96","author":"Abner G.","year":"2002","journal-title":"J. Vis. Impair. Blind."},{"key":"e_1_2_1_2_1","unstructured":"Afb.org. 2015. Statistical Snapshots from the American Foundation for the Blind. Retrieved from http:\/\/www.afb.org\/info\/blindness-statistics\/2. Afb.org. 2015. Statistical Snapshots from the American Foundation for the Blind. Retrieved from http:\/\/www.afb.org\/info\/blindness-statistics\/2."},{"key":"e_1_2_1_3_1","first-page":"2","article-title":"Body mnemonics portable device interaction design concept","volume":"3","author":"\u00c4ngeslev\u00e4 Jussi","year":"2003","journal-title":"Proceedings of UIST"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/638249.638263"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866074"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Meera M. Blattner Denise A. Sumikawa and Robert M. Greenberg. 1989. Earcons and icons: Their structure and common design principles. Hum.\u2013Comput. Interact. 4 1 (1989) 11\u201344. Meera M. Blattner Denise A. Sumikawa and Robert M. Greenberg. 1989. Earcons and icons: Their structure and common design principles. Hum.\u2013Comput. Interact. 4 1 (1989) 11\u201344.","DOI":"10.1207\/s15327051hci0401_1"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1805986.1806005"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the Australasian User Interface Conference (AUIC\u201904)","author":"Brewster Stephen"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/WHC.2005.6"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979405"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/572020.572038"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/191028.191041"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2148131.2148161"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0027575"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985707"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493463"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/353485.353487"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2049536.2049541"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073323"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258715"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Roberta L. Klatzky and Susan J. Lederman. 2003. Touch. Handbook of Psychology. Roberta L. Klatzky and Susan J. Lederman. 2003. Touch. Handbook of Psychology.","DOI":"10.1002\/0471264385.wei0406"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Susanne Klein Guy Adams Fraser Dickin and Steve Simske. 2013. 3D Printing: When and Where Does It Make Sense? Vol. 2013. Society for Imaging Science and Technology 5\u20138. Susanne Klein Guy Adams Fraser Dickin and Steve Simske. 2013. 3D Printing: When and Where Does It Make Sense? Vol. 2013. Society for Imaging Science and Technology 5\u20138.","DOI":"10.2352\/ISSN.2169-4451.2013.29.1.art00005_1"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15841-4_9"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-01516-8_12"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447310709336964"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1054979"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557204"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci1201&2_2"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/191666.191732"},{"key":"e_1_2_1_30_1","first-page":"25","article-title":"Heuristic evaluation","volume":"17","author":"Nielsen J","year":"1994","journal-title":"Usabil. Inspect. Methods"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1060745.1060799"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/86.372894"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1878803.1878821"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/238386.238405"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145482X0509900202"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2384916.2384931"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0926-6410(01)00002-7"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145482X1010400604"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380189"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/228347.228366"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/288392.288597"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2013.15"},{"key":"e_1_2_1_43_1","unstructured":"Section508.gov. 1998. Section 508 Law and Related Laws and Policies. Retrieved from https:\/\/www.section508.gov\/content\/learn\/laws-and-policies. Section508.gov. 1998. Section 508 Law and Related Laws and Policies. Retrieved from https:\/\/www.section508.gov\/content\/learn\/laws-and-policies."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1561\/1100000026"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462007"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2481492.2481499"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2014.01.045"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 5th International ACM Conference on Assistive Technologies. ACM, 49\u201356","author":"Vitense Holly S."},{"key":"e_1_2_1_49_1","unstructured":"W3C. 2014. Web Accessibility Initiative (WAI). Retrieved from http:\/\/www.w3.org\/WAI\/. W3C. 2014. Web Accessibility Initiative (WAI). Retrieved from http:\/\/www.w3.org\/WAI\/."},{"key":"e_1_2_1_50_1","unstructured":"W3C. 2014. Web Content Accessibility Guidelines (WCAG). Retrieved from https:\/\/www.w3.org\/WAI\/intro\/wcag. W3C. 2014. Web Content Accessibility Guidelines (WCAG). Retrieved from https:\/\/www.w3.org\/WAI\/intro\/wcag."},{"key":"e_1_2_1_51_1","unstructured":"Webaim.org. 2016. Web Accessibility in Mind. Retrieved from http:\/\/webaim.org\/. Webaim.org. 2016. Web Accessibility in Mind. Retrieved from http:\/\/webaim.org\/."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047277"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518779"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-012-0285-9"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1979742.1979705"},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Yeliz Yesilada Simon Harper Carole Goble and Robert Stevens. 2004. Screen Readers Cannot See. Springer 445\u2013458. Yeliz Yesilada Simon Harper Carole Goble and Robert Stevens. 2004. Screen Readers Cannot See. Springer 445\u2013458.","DOI":"10.1007\/978-3-540-27834-4_55"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1075\/pc.14.2.12zha"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145482X1110500402"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2013.04.003"}],"container-title":["ACM Transactions on Accessible Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3075222","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3075222","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:03:42Z","timestamp":1750215822000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3075222"}},"subtitle":["A Multimodal Approach to Nonvisual Computing"],"short-title":[],"issued":{"date-parts":[[2017,8,11]]},"references-count":59,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,8,11]]}},"alternative-id":["10.1145\/3075222"],"URL":"https:\/\/doi.org\/10.1145\/3075222","relation":{},"ISSN":["1936-7228","1936-7236"],"issn-type":[{"value":"1936-7228","type":"print"},{"value":"1936-7236","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,8,11]]},"assertion":[{"value":"2016-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-08-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}