{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T17:05:47Z","timestamp":1771952747195,"version":"3.50.1"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"MHCI","license":[{"start":{"date-parts":[[2023,9,11]],"date-time":"2023-09-11T00:00:00Z","timestamp":1694390400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,9,11]]},"abstract":"<jats:p>Soon, smartphones may be capable of allowing American Sign Language (ASL) signing and\/or fingerspelling for text entry. To explore the usefulness of this approach, we compared emulated fingerspelling recognition with a virtual keyboard for 12 Deaf participants. With practice, fingerspelling is faster (42.5 wpm), potentially has fewer errors (4.02% corrected error rate) and higher throughput (14.2 bits\/second), and is as desired as virtual keyboard texting (31.9 wpm; 6.46% corrected error rate; 10.9 bits\/second throughput). Our second study recruits another 12 Deaf users at the 2022 National Association for the Deaf conference to compare the walk-up usability of fingerspelling alone, signing, and virtual keyboard text entry for interacting with an emulated mobile assistant. Both signing and virtual keyboard text entry were preferred over fingerspelling.<\/jats:p>","DOI":"10.1145\/3604274","type":"journal-article","created":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T11:16:20Z","timestamp":1694603780000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Tap to Sign: Towards using American Sign Language for Text Entry on Smartphones"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2792-2964","authenticated-orcid":false,"given":"Saad","family":"Hassan","sequence":"first","affiliation":[{"name":"Tulane University, New Orleans, LA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1763-4352","authenticated-orcid":false,"given":"Abraham","family":"Glasser","sequence":"additional","affiliation":[{"name":"Gallaudet University, Washington, DC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6940-6784","authenticated-orcid":false,"given":"Max","family":"Shengelia","sequence":"additional","affiliation":[{"name":"Rochester Institute of Technology, Rochester, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8442-7842","authenticated-orcid":false,"given":"Thad","family":"Starner","sequence":"additional","affiliation":[{"name":"Google Research, Atlanta, GA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0900-2507","authenticated-orcid":false,"given":"Sean","family":"Forbes","sequence":"additional","affiliation":[{"name":"DPAN, Ferndale, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1548-4242","authenticated-orcid":false,"given":"Nathan","family":"Qualls","sequence":"additional","affiliation":[{"name":"DPAN, Ferndale, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8689-4804","authenticated-orcid":false,"given":"Sam S.","family":"Sepah","sequence":"additional","affiliation":[{"name":"Google Research, Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,9,13]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2021. International Day of Sign Languages. https:\/\/www.un.org\/en\/observances\/sign-languages-day"},{"key":"e_1_2_1_2_1","unstructured":"2022. Deafness and hearing loss. https:\/\/www.who.int\/health-topics\/hearing-loss#tab=tab_1"},{"key":"e_1_2_1_3_1","volume-title":"An experimental evaluation of apple siri and google speech recognition. Proccedings of the 2015 ISCA SEDE 118","author":"Assefi Mehdi","year":"2015","unstructured":"Mehdi Assefi, Guangchi Liu, Mike P Wittie, and Clemente Izurieta. 2015. An experimental evaluation of apple siri and google speech recognition. Proccedings of the 2015 ISCA SEDE 118 (2015)."},{"key":"e_1_2_1_4_1","volume-title":"Technologies for Communication. Oxford Handbook of Deaf Studies, Language, and Education","author":"Harkins St Matthew Bakke Judith E","year":"2003","unstructured":"Judith E Harkins St Matthew Bakke. 2003. Technologies for Communication. Oxford Handbook of Deaf Studies, Language, and Education (2003), 406."},{"key":"e_1_2_1_5_1","unstructured":"F Bakken. 2004. The Inside Text: Social Cultural and Design Perspectives on SMS chapter SMS Use Among Deaf Teens and Young Adults in Norway."},{"key":"e_1_2_1_6_1","volume-title":"The inside text","author":"Bakken Fr\u00f8ydis","unstructured":"Fr\u00f8ydis Bakken. 2005. SMS use among deaf teens and young adults in Norway. In The inside text. Springer, 161--174."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/2835587.2835589"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10590-021-09273-1"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314205"},{"key":"e_1_2_1_10_1","unstructured":"Harry Bornstein. 1965. READING THE MANUAL ALPHABET--A RESEARCH PROGRAM FOR DEVELOPING A FILMED PROGRAM FOR TEACHING THE MANUAL ALPHABET. (1965)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308561.3353774"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1168987.1169001"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s42979-021-00544-5"},{"key":"e_1_2_1_14_1","volume-title":"Mobile text entry: An empirical study and analysis of mini--qwerty keyboards. Submitted to the Transaction on Computer Human Interaction Journal","author":"Clawson JAMES","year":"2006","unstructured":"JAMES Clawson, Kent Lyons, Edward Clarkson, and Thad Starner. 2006. Mobile text entry: An empirical study and analysis of mini--qwerty keyboards. Submitted to the Transaction on Computer Human Interaction Journal (2006)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2005.49"},{"key":"e_1_2_1_16_1","volume-title":"Why Sign-Language Gloves Don't Help Deaf People. The Atlantic (Nov","author":"Erard Michael","year":"2017","unstructured":"Michael Erard. 2017. Why Sign-Language Gloves Don't Help Deaf People. The Atlantic (Nov 2017)."},{"key":"e_1_2_1_17_1","volume-title":"Sign languages in the world. Sociolinguistics and deaf communities 1","author":"Fenlon Jordan","year":"2015","unstructured":"Jordan Fenlon and Erin Wilkinson. 2015. Sign languages in the world. Sociolinguistics and deaf communities 1 (2015), 5."},{"key":"e_1_2_1_18_1","volume-title":"A Fine-Grained Visual Attention Approach for Finger spelling Recognition in the Wild. CoRR abs\/2105.07625","author":"Gajurel Kamala","year":"2021","unstructured":"Kamala Gajurel, Cuncong Zhong, and Guanghui Wang. 2021. A Fine-Grained Visual Attention Approach for Finger spelling Recognition in the Wild. CoRR abs\/2105.07625 (2021). arXiv:2105.07625 https:\/\/arxiv.org\/abs\/2105.07625"},{"key":"e_1_2_1_19_1","volume-title":"ASL fingerspelling: Comparing native and non-native signers. Unpublished manuscript Gallaudet University","author":"Geer Leah","year":"2010","unstructured":"Leah Geer. 2010. ASL fingerspelling: Comparing native and non-native signers. Unpublished manuscript Gallaudet University (2010)."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3430263.3452428"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501987"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501987"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1302\/0301-620X.96B5.32434"},{"key":"e_1_2_1_24_1","first-page":"145","article-title":"When a word is not the sum of its letters: Fingerspelling and spelling","volume":"65","author":"Hanson Vicki L","year":"1981","unstructured":"Vicki L Hanson. 1981. When a word is not the sum of its letters: Fingerspelling and spelling. Haskins Laboratories Status Report on Speech Research 65 (1981), 145--155.","journal-title":"Haskins Laboratories Status Report on Speech Research"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41928-020-0451-7"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the North East Linguistic Society","volume":"42","author":"Keane Jonathan","year":"2012","unstructured":"Jonathan Keane, Diane Brentari, and Jason Riggle. 2012. Coarticulation in ASL fingerspelling. In Proceedings of the North East Linguistic Society, Vol. 42."},{"key":"e_1_2_1_27_1","volume-title":"Unpublished conference presentation, Texas Linguistics Society","volume":"14","author":"Keane Jonathan","year":"2013","unstructured":"Jonathan Keane, Jason Riggle, and Diane Brentari. 2013. The timing of ASL fingerspelling. In Unpublished conference presentation, Texas Linguistics Society, Vol. 14."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0047404503325047"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2017.05.009"},{"key":"e_1_2_1_30_1","volume-title":"Quantitative survey of the state of the art in sign language recognition. arXiv preprint arXiv:2008.09918","author":"Koller Oscar","year":"2020","unstructured":"Oscar Koller. 2020. Quantitative survey of the state of the art in sign language recognition. arXiv preprint arXiv:2008.09918 (2020)."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-020-09994-0"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2004.19"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985777"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415196"},{"key":"e_1_2_1_35_1","unstructured":"I Scott MacKenzie. 2012. Human-computer interaction: An empirical research perspective. (2012)."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/765891.765971"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451592"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1353\/sls.2006.0019"},{"key":"e_1_2_1_39_1","volume-title":"How Sign Language Evolves as Our World Does. The New York Times (Jul","author":"Morris Amanda","year":"2022","unstructured":"Amanda Morris. 2022. How Sign Language Evolves as Our World Does. The New York Times (Jul 2022)."},{"key":"e_1_2_1_40_1","volume-title":"How the alphabet came to be used in a sign language. Sign Language Studies","author":"Padden Carol A","year":"2003","unstructured":"Carol A Padden and Darline Clark Gunsauls. 2003. How the alphabet came to be used in a sign language. Sign Language Studies (2003), 10--33."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338286.3340120"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338286.3340120"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Katerina Papadimitriou and Gerasimos Potamianos. 2019. End-to-End Convolutional Sequence Learning for ASL Fingerspelling Recognition. In INTERSPEECH.","DOI":"10.21437\/Interspeech.2019-2422"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1093\/deafed\/enh042"},{"key":"e_1_2_1_45_1","volume-title":"West Lafayette","volume":"30","author":"Quinto-Pozos David","year":"2010","unstructured":"David Quinto-Pozos. 2010. Rates of fingerspelling in american sign language. In Poster presented at 10th Theoretical Issues in Sign Language Research conference, West Lafayette, Indiana, Vol. 30."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113794"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1353\/sls.1977.0022"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161187"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-021-10768-5"},{"key":"e_1_2_1_51_1","first-page":"120","article-title":"The Enron email dataset database schema and brief statistical report. Information sciences institute technical report","volume":"4","author":"Shetty Jitesh","year":"2004","unstructured":"Jitesh Shetty and Jafar Adibi. 2004. The Enron email dataset database schema and brief statistical report. Information sciences institute technical report, University of Southern California 4, 1 (2004), 120--128.","journal-title":"University of Southern California"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/SLT.2018.8639639"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00550"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702136"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2004.1321035"},{"key":"e_1_2_1_56_1","unstructured":"Thad E Starner. 1995. Visual Recognition of American Sign Language Using Hidden Markov Models. Technical Report. Massachusetts inst of tech Cambridge dept of brain and cognitive sciences."},{"key":"e_1_2_1_57_1","volume-title":"Discourse of text messaging: Analysis of SMS communication","author":"Tagg Caroline","unstructured":"Caroline Tagg. 2012. Discourse of text messaging: Analysis of SMS communication. Bloomsbury Publishing."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-08599-9_82"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460421.3480428"},{"key":"e_1_2_1_60_1","volume-title":"Typing on a smartwatch while mobile: a comparison of input methods. Human factors 63, 6","author":"Turner Colton J","year":"2021","unstructured":"Colton J Turner, Barbara S Chaparro, and Jibo He. 2021. Typing on a smartwatch while mobile: a comparison of input methods. Human factors 63, 6 (2021), 974--986."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201329"},{"key":"e_1_2_1_62_1","volume-title":"Multiple resources and mental workload. Human factors 50, 3","author":"Wickens Christopher D","year":"2008","unstructured":"Christopher D Wickens. 2008. Multiple resources and mental workload. Human factors 50, 3 (2008), 449--455."},{"key":"e_1_2_1_63_1","volume-title":"The phonetics of fingerspelling","author":"Wilcox Sherman","unstructured":"Sherman Wilcox. 1992. The phonetics of fingerspelling. Vol. 4. John Benjamins Publishing."},{"key":"e_1_2_1_64_1","volume-title":"Measures of text entry performance. Text entry systems: Mobility, accessibility, universality","author":"Wobbrock Jacob O","year":"2007","unstructured":"Jacob O Wobbrock. 2007. Measures of text entry performance. Text entry systems: Mobility, accessibility, universality (2007), 47--74."},{"key":"e_1_2_1_65_1","volume-title":"Universal Access in Human-Computer Interaction. Access to Today's Technologies","author":"Wolfe Rosalee","unstructured":"Rosalee Wolfe, John McDonald, Jorge Toro, Souad Baowidan, Robyn Moncrief, and Jerry Schnepp. 2015. Promoting Better Deaf\/Hearing Communication Through an Improved Interaction Design for Fingerspelling Practice. In Universal Access in Human-Computer Interaction. Access to Today's Technologies, Margherita Antona and Constantine Stephanidis (Eds.). Springer International Publishing, Cham, 495--505."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2017.05.001"},{"key":"e_1_2_1_67_1","volume-title":"Mediapipe hands: On-device real-time hand tracking. arXiv preprint arXiv:2006.10214","author":"Zhang Fan","year":"2020","unstructured":"Fan Zhang, Valentin Bazarevsky, Andrey Vakunov, Andrei Tkachenka, George Sung, Chuo-Ling Chang, and Matthias Grundmann. 2020. Mediapipe hands: On-device real-time hand tracking. arXiv preprint arXiv:2006.10214 (2020)."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300866"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604274","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3604274","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T22:03:28Z","timestamp":1755813808000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604274"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,11]]},"references-count":68,"journal-issue":{"issue":"MHCI","published-print":{"date-parts":[[2023,9,11]]}},"alternative-id":["10.1145\/3604274"],"URL":"https:\/\/doi.org\/10.1145\/3604274","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,11]]},"assertion":[{"value":"2023-09-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}