{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T17:30:38Z","timestamp":1783359038528,"version":"3.54.6"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T00:00:00Z","timestamp":1573084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2019,11,7]]},"abstract":"<jats:p>Nonvisually Accessible Video Calling (NAVC) is a prototype that detects visual conversation cues in a video call and uses audio cues to convey them to a user who is blind or low-vision. NAVC uses audio cues inspired by movie soundtracks to convey Attention, Agreement, Disagreement, Happiness, Thinking, and Surprise. When designing NAVC, we partnered with people who are blind or low-vision through a user-centered design process that included need-finding interviews and design reviews. To evaluate NAVC, we conducted a user study with 16 participants. The study provided feedback on the NAVC prototype and showed that the participants could easily discern some cues, like Attention and Agreement, but had trouble distinguishing others. The accuracy of the prototype in detecting conversation cues emerged as a key concern, especially in avoiding false positives and in detecting negative emotions, which tend to be masked in social conversations. This research identified challenges and design opportunities in using AI models to enable accessible video calling.<\/jats:p>","DOI":"10.1145\/3359233","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T13:40:21Z","timestamp":1573220421000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Accessible Video Calling"],"prefix":"10.1145","volume":"3","author":[{"given":"Lei","family":"Shi","sequence":"first","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brianna J.","family":"Tomlinson","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Tang","sequence":"additional","affiliation":[{"name":"Microsoft, Mountain View, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edward","family":"Cutrell","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"McDuff","sequence":"additional","affiliation":[{"name":"Microsoft, redmond, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gina","family":"Venolia","sequence":"additional","affiliation":[{"name":"Microsoft, Redmond, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Johns","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kael","family":"Rowan","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,7]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Proceedings of the Mobile Computing, Applications and Services (MobiCASE 2014","author":"Iftekhar Anam ASM","year":"2014","unstructured":"ASM Iftekhar Anam , Shahinur Alam , Mohammed Yeasin . 2014 . Expression: A dyadic conversation aid using Google Glass for people who are blind or visually impaired . In Proceedings of the Mobile Computing, Applications and Services (MobiCASE 2014 ), 57--64. http:\/\/dx.doi.org\/10.4108\/icst.mobicase.2014.257780 10.4108\/icst.mobicase.2014.257780 ASM Iftekhar Anam, Shahinur Alam, Mohammed Yeasin. 2014. Expression: A dyadic conversation aid using Google Glass for people who are blind or visually impaired. In Proceedings of the Mobile Computing, Applications and Services (MobiCASE 2014), 57--64. http:\/\/dx.doi.org\/10.4108\/icst.mobicase.2014.257780"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1463689.1463754"},{"key":"e_1_2_2_3_1","first-page":"1","article-title":"Background to Kinesics","volume":"13","author":"Birdwhistell Ray L.","year":"1955","unstructured":"Ray L. Birdwhistell . 1955 . Background to Kinesics . ETC: A Review of General Semantics 13 , 1 (Autumn 1955), 10--18. Ray L. Birdwhistell. 1955. Background to Kinesics. ETC: A Review of General Semantics 13, 1 (Autumn 1955), 10--18.","journal-title":"ETC: A Review of General Semantics"},{"key":"e_1_2_2_4_1","volume-title":"Kinesics and Context: Essays on Body Motion Communication","author":"Birdwhistell Ray L.","unstructured":"Ray L. Birdwhistell . 1970. Kinesics and Context: Essays on Body Motion Communication . University of Pennsylvania Press. Ray L. Birdwhistell. 1970. Kinesics and Context: Essays on Body Motion Communication. University of Pennsylvania Press."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0401_1"},{"key":"e_1_2_2_6_1","volume-title":"Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems, 222--227","author":"Brewster Stephen A.","unstructured":"Stephen A. Brewster , Peter C. Wright , and Alistair D. N. Edwards . 1993. An evaluation of earcons for use in auditory human-computer interfaces . In Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems, 222--227 . Stephen A. Brewster, Peter C. Wright, and Alistair D. N. Edwards. 1993. An evaluation of earcons for use in auditory human-computer interfaces. In Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems, 222--227."},{"key":"e_1_2_2_7_1","volume-title":"Corbin and Anselm Strauss","author":"Juliet","year":"2008","unstructured":"Juliet M. Corbin and Anselm Strauss . 2008 . Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, Sage Publications . Juliet M. Corbin and Anselm Strauss. 2008. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, Sage Publications."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2543581.2543586"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0401_2"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1178823.1178887"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145482X9108500906"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2010.04.004"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518932"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0202_3"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2371456.2371469"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1386\/st.7.1.5_1"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01274181"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874202"},{"key":"e_1_2_2_19_1","unstructured":"Daniel McDuff Kael Rowan Piali Choudhury Jessica Wolk ThuVan Pham Mary Czerwinski M. 2019. A Multimodal Emotion Sensing Platform for Building Emotion-Aware Applications. arXiv preprint arXiv:1903.12133.  Daniel McDuff Kael Rowan Piali Choudhury Jessica Wolk ThuVan Pham Mary Czerwinski M. 2019. A Multimodal Emotion Sensing Platform for Building Emotion-Aware Applications. arXiv preprint arXiv:1903.12133."},{"key":"e_1_2_2_20_1","volume-title":"Retrieved","author":"Azure Microsoft","year":"2018","unstructured":"Microsoft Azure . 2018 . Emotion API . Retrieved September 14, 2018 from https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/emotion\/ Microsoft Azure. 2018. Emotion API. Retrieved September 14, 2018 from https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/emotion\/"},{"key":"e_1_2_2_21_1","volume-title":"Retrieved","author":"Azure Microsoft","year":"2018","unstructured":"Microsoft Azure . 2018 . Face API . Retrieved September 14, 2018 from https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/face\/ Microsoft Azure. 2018. Face API. Retrieved September 14, 2018 from https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/face\/"},{"key":"e_1_2_2_22_1","volume-title":"Retrieved","author":"Azure Microsoft","year":"2018","unstructured":"Microsoft Azure . 2018 . Service Bus . Retrieved September 14, 2018 from https:\/\/azure.microsoft.com\/en-us\/services\/service-bus\/ Microsoft Azure. 2018. Service Bus. Retrieved September 14, 2018 from https:\/\/azure.microsoft.com\/en-us\/services\/service-bus\/"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3157075"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.1996.546990"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-014-0369-9"},{"key":"e_1_2_2_26_1","volume-title":"Proceedings of International Conference on Enabling Access for Persons with Visual Impairment, 157--165","author":"Qiu Shi","year":"2015","unstructured":"Shi Qiu , Jun Hu , and Matthias Rauterberg . 2015 . Nonverbal Signals for Face-to-Face Communication between the Blind and the Sighted . In Proceedings of International Conference on Enabling Access for Persons with Visual Impairment, 157--165 . Shi Qiu, Jun Hu, and Matthias Rauterberg. 2015. Nonverbal Signals for Face-to-Face Communication between the Blind and the Sighted. In Proceedings of International Conference on Enabling Access for Persons with Visual Impairment, 157--165."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-3295-4"},{"key":"e_1_2_2_28_1","volume-title":"Sound Design: The Expressive Power of Music, Voice and Sound Effects in Cinema. Michael Wiese Productions.","author":"Sonnenschein David","year":"2001","unstructured":"David Sonnenschein . 2001 . Sound Design: The Expressive Power of Music, Voice and Sound Effects in Cinema. Michael Wiese Productions. David Sonnenschein. 2001. Sound Design: The Expressive Power of Music, Voice and Sound Effects in Cinema. Michael Wiese Productions."},{"key":"e_1_2_2_29_1","volume-title":"Aquarium sonification: Soundscapes for accessible dynamic informal learning environments.\" In Proceedings of the International Conference on Auditory Display (ICAD","author":"Walker Bruce N.","year":"2006","unstructured":"Bruce N. Walker , Mark T. Godfrey , Jason E. Orlosky , Carrie Bruce , & Jon Sanford 2006. Aquarium sonification: Soundscapes for accessible dynamic informal learning environments.\" In Proceedings of the International Conference on Auditory Display (ICAD 2006 ), 238--241. Bruce N. Walker, Mark T. Godfrey, Jason E. Orlosky, Carrie Bruce, & Jon Sanford 2006. Aquarium sonification: Soundscapes for accessible dynamic informal learning environments.\" In Proceedings of the International Conference on Auditory Display (ICAD 2006), 238--241."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173789"},{"key":"e_1_2_2_31_1","volume-title":"Meeting. 2018","author":"Zoom","year":"2018","unstructured":"Zoom Meeting. 2018 . Retrieved August 21, 2018 from https:\/\/zoom.us\/. Zoom Meeting. 2018. Retrieved August 21, 2018 from https:\/\/zoom.us\/."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359233","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359233","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:12:54Z","timestamp":1750201974000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359233"}},"subtitle":["Enabling Nonvisual Perception of Visual Conversation Cues"],"short-title":[],"issued":{"date-parts":[[2019,11,7]]},"references-count":31,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2019,11,7]]}},"alternative-id":["10.1145\/3359233"],"URL":"https:\/\/doi.org\/10.1145\/3359233","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,7]]},"assertion":[{"value":"2019-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}