{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T08:58:15Z","timestamp":1773392295975,"version":"3.50.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T00:00:00Z","timestamp":1736467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2236352"],"award-info":[{"award-number":["2236352"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,1,10]]},"abstract":"<jats:p>Autistic children face significant challenges in vocal communication and social interaction, often leading to social isolation. There is evidence that Augmentative and Alternative Communication (AAC) offers support to mitigate these challenges, enabling them to communicate with non-vocal means through forms of AAC, such as speech-generation devices (SGDs). However, the adoption and use of SGDs are hindered by several factors, including the large amount of practice required to learn to use SGDs and the limited options for highly engaging social learning contexts. Our study introduces the novel approach of using SGDs as game controller for digital and interactive games. With three design goals guiding our work, we conducted a Wizard-of-Oz formative case study with five participants aged 3-5 years, who were learning to use their SGD. We simulated a digital coloring game, integrating the speech-generated output of the participant's SGD to function as the game's controller. From this case study, we observed that all participants engaged with the game using their SGD for at least one turn, and two participants also engaged in emerging joint attention responses with the game and game's facilitator. This paper discusses these findings and contributes directions for future research, with suggestions for the design of future SGD-controlled games and exploration of social connection and collaboration between autistic children who use AAC and their caregivers, siblings, and peers.<\/jats:p>","DOI":"10.1145\/3701193","type":"journal-article","created":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T16:06:46Z","timestamp":1736525206000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Exploring Engagement Opportunities for Autistic Children: Using AAC as a Controller in a Wizard-of-Oz Coloring Game"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1413-8575","authenticated-orcid":false,"given":"Elizabeth","family":"Garrison","sequence":"first","affiliation":[{"name":"Temple University, Philadelphia, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2781-6619","authenticated-orcid":false,"given":"Stephen","family":"MacNeil","sequence":"additional","affiliation":[{"name":"Temple University, Philadelphia, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4183-4410","authenticated-orcid":false,"given":"Elizabeth R.","family":"Lorah","sequence":"additional","affiliation":[{"name":"University of Arkansas, Fayetteville, Arkansas, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1057-5599","authenticated-orcid":false,"given":"Christine","family":"Holyfield","sequence":"additional","affiliation":[{"name":"University of Arkansas, Fayetteville, Arkansas, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5884-6293","authenticated-orcid":false,"given":"Slobodan","family":"Vucetic","sequence":"additional","affiliation":[{"name":"Temple University, Philadelphia, PA, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,1,10]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1519\/JPT.0b013e3182191d98"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1177\/1555412017746305"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242671.3242712"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207687"},{"key":"e_1_2_1_5_1","volume-title":"Diagnostic and statistical manual of mental disorders","author":"American Psychiatric Association","unstructured":"American Psychiatric Association. 2013. Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association.","edition":"5"},{"key":"e_1_2_1_6_1","volume-title":"Human-computer interaction","author":"Blomberg Jeanette","unstructured":"Jeanette Blomberg and Mark Burrel. 2009. An ethnographic approach to design. In Human-computer interaction. CRC Press, 87--110."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.2752\/089279315X14129350721939"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1080\/17483107.2017.1324526"},{"key":"e_1_2_1_9_1","volume-title":"Ecology of the family as a context for human development: Research perspectives. Adolescents and Their Families","author":"Bronfenbrenner Urie","year":"2013","unstructured":"Urie Bronfenbrenner. 2013. Ecology of the family as a context for human development: Research perspectives. Adolescents and Their Families (2013), 1--20."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-34644-7_28"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.heliyon.2022.e11482"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/0898264314551171"},{"key":"e_1_2_1_13_1","volume-title":"Advanced Technologies, Embedded and Multimedia for Human-centric Computing: HumanCom and EMC","author":"Chung Ching","year":"2013","unstructured":"I-Ching Chung, Chien-Yu Huang, Shyh-Ching Yeh, Wei-Chi Chiang, and Mei-Hui Tseng. 2014. Developing kinect games integrated with virtual reality on activities of daily living for children with developmental delay. In Advanced Technologies, Embedded and Multimedia for Human-centric Computing: HumanCom and EMC 2013. Springer, 1091--1097."},{"key":"e_1_2_1_14_1","volume-title":"Examining executive functioning in children with autism spectrum disorder, attention deficit hyperactivity disorder and typical development. Psychiatry research","author":"Corbett Blythe A","year":"2009","unstructured":"Blythe A Corbett, Laura J Constantine, Robert Hendren, David Rocke, and Sally Ozonoff. 2009. Examining executive functioning in children with autism spectrum disorder, attention deficit hyperactivity disorder and typical development. Psychiatry research, Vol. 166, 2--3 (2009), 210--222."},{"key":"e_1_2_1_15_1","volume-title":"Teleoperated Voice Agents in Kid-Driven Moments in Play Among Families with Neurodivergent Children. Proceedings of the ACM on Human-Computer Interaction","volume":"8","author":"Currin Flannery Hope","year":"2024","unstructured":"Flannery Hope Currin, Cassidy Kilcoin, Kerry Peterman, Kyle Rector, and Juan Pablo Hourcade. 2024. Opportunities and Challenges in Using Tangible, Teleoperated Voice Agents in Kid-Driven Moments in Play Among Families with Neurodivergent Children. Proceedings of the ACM on Human-Computer Interaction, Vol. 8, CSCW1 (2024), 1--25."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3586182.3615780"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Yao Du Sarah Choe Jennifer Vega Yusa Liu Adrienne Trujillo et al. 2022. Listening to stakeholders involved in speech-language therapy for children with communication disorders: content analysis of Apple app store reviews. JMIR pediatrics and parenting Vol. 5 1 (2022) e28661.","DOI":"10.2196\/28661"},{"key":"e_1_2_1_18_1","volume-title":"International Journal of Language & Communication Disorders","author":"Du Yao","year":"2023","unstructured":"Yao Du, Kathryn Lubniewski, Lori Price, Grace Breslin, Paula Thomson, Natashka Jinadasa, and Nikita Soni. 2023. \"They Can't Believe They're a Tiger\": Insights from pediatric speech-language pathologists mobile app users and app designers. International Journal of Language & Communication Disorders (2023)."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/0014402920953761"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555557"},{"key":"e_1_2_1_21_1","volume-title":"Technological evolvement in AAC modalities to Foster communications of verbally challenged ASD children: A systematic review","author":"Farzana Walia","year":"2021","unstructured":"Walia Farzana, Farhana Sarker, Tom Chau, and Khondaker A Mamun. 2021. Technological evolvement in AAC modalities to Foster communications of verbally challenged ASD children: A systematic review. IEEE Access (2021)."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_AJSLP-17-0073"},{"key":"e_1_2_1_23_1","volume-title":"Dignity and respect: Why therapeutic assent matters. Behavior analysis in practice","author":"Flowers Jaime","year":"2023","unstructured":"Jaime Flowers and Jillian Dawes. 2023. Dignity and respect: Why therapeutic assent matters. Behavior analysis in practice, Vol. 16, 4 (2023), 913--920."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3116595.3116610"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Robert M Gagne Walter W Wager Katharine C Golas John M Keller and James D Russell. 2005. Principles of instructional design.","DOI":"10.1002\/pfi.4140440211"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-011-1212-2"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-008-0602-6"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40489-022-00314-w"},{"key":"e_1_2_1_29_1","volume-title":"The 9th Annual Conference of Association for Simulated Practice in Healthcare.","author":"Gough Suzanne","year":"2018","unstructured":"Suzanne Gough and Nicola Dutton. 2018. The novel use of LEGO\u00ae-based therapy to develop communicative competence in children who use augmentative and alternative communication (AAC) systems. In The 9th Annual Conference of Association for Simulated Practice in Healthcare."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702395"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957276.2957315"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23774-4_4"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10882-022-09858-5"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1044\/2023_AJSLP-23-00224"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/mono.12296"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3474661"},{"key":"e_1_2_1_37_1","unstructured":"Barbara B Kawulich et al. 2005. Participant observation as a data collection method. In Forum qualitative sozialforschung\/forum: Qualitative social research Vol. 6."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/1098300712437042"},{"key":"e_1_2_1_39_1","volume-title":"Parents' Perspectives on Communication and AAC Use for Beginning Communicators on the Autism Spectrum. American Journal of Speech-Language Pathology","author":"Laubscher Emily","year":"2023","unstructured":"Emily Laubscher, Lauramarie Pope, and Janice Light. 2023. \"You Just Want to Be Able to Communicate With Your Child\": Parents' Perspectives on Communication and AAC Use for Beginning Communicators on the Autism Spectrum. American Journal of Speech-Language Pathology (2023), 1--20."},{"key":"e_1_2_1_40_1","volume-title":"Design and User Experience: 6th International Conference, ITAP 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19--24, 2020, Proceedings, Part I 22","author":"Lee Lina","year":"2020","unstructured":"Lina Lee, Johanna Okerlund, Mary Lou Maher, and Thomas Farina. 2020. Embodied interaction design to promote creative social engagement for older adults. In Human Aspects of IT for the Aged Population. Technologies, Design and User Experience: 6th International Conference, ITAP 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19--24, 2020, Proceedings, Part I 22. Springer, 164--183."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2556954"},{"key":"e_1_2_1_42_1","volume-title":"Ann Marie Gardner, and Molly Flynn","author":"Light Janice","year":"2021","unstructured":"Janice Light, Allison Barwise, Ann Marie Gardner, and Molly Flynn. 2021. Personalized early AAC intervention to build language and literacy skills: A case study of a 3-year-old with complex communication needs. Topics in language disorders, Vol. 41, 3 (2021), 209--231."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361311402230"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10882-021-09803-y"},{"key":"e_1_2_1_45_1","volume-title":"Prolonged neural encoding of visual information in autism. Autism Research","author":"Marsicano Gianluca","year":"2023","unstructured":"Gianluca Marsicano, Luca Casartelli, Alessandra Federici, Sara Bertoni, Lorenzo Vignali, Massimo Molteni, Andrea Facoetti, and Luca Ronconi. 2023. Prolonged neural encoding of visual information in autism. Autism Research (2023)."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169215"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaac.2013.05.006"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359174"},{"key":"e_1_2_1_49_1","volume-title":"Using reading times and eye-movements to measure cognitive engagement. Educational psychologist","author":"Miller Brian W","year":"2015","unstructured":"Brian W Miller. 2015. Using reading times and eye-movements to measure cognitive engagement. Educational psychologist, Vol. 50, 1 (2015), 31--42."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968120.2987730"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRAIE47735.2019.9037765"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12212"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957276.2996289"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.3390\/mti4030041"},{"key":"e_1_2_1_55_1","volume-title":"Electronics & Mobile Communication Conference (UEMCON). IEEE, 0780--0784","author":"Piotrowski JP","year":"2019","unstructured":"JP Piotrowski, Evangelos A Yfantis, A Campagna, Q Cornu, and GM Gallitano. 2019. Voice Interactive Games. In 2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON). IEEE, 0780--0784."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517685"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.3390\/app13053159"},{"key":"e_1_2_1_58_1","volume-title":"Measuring children's engagement in early childhood education and care settings: A scoping literature review. Educational psychology review","author":"Ritovsa Andrea","year":"2023","unstructured":"Andrea Ritovsa, Frida \u00c5str\u00f6m, Eva Bj\u00f6rck, Lisa Borglund, Elin Karlsson, Elaine McHugh, and Elisabeth Nylander. 2023. Measuring children's engagement in early childhood education and care settings: A scoping literature review. Educational psychology review, Vol. 35, 4 (2023), 99."},{"key":"e_1_2_1_59_1","volume-title":"Rod Seung-Hwan Lim, and Judith Fullerton","author":"Sadler Georgia Robins","year":"2010","unstructured":"Georgia Robins Sadler, Hau-Chen Lee, Rod Seung-Hwan Lim, and Judith Fullerton. 2010. Recruitment of hard-to-reach population subgroups via adaptations of the snowball sampling strategy. Nursing & health sciences, Vol. 12, 3 (2010), 369--374."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3148330.3154509"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1347390.1347395"},{"key":"e_1_2_1_62_1","unstructured":"Kurt Schoch et al. 2020. Case study research. Research design and methods: An applied guide for the scholar-practitioner Vol. 31 1 (2020) 245--258."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517428.3544813"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1274940.1274966"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1177\/13623613221130845"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.3109\/07434618.2010.546810"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274444"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3148330.3154506"},{"key":"e_1_2_1_69_1","unstructured":"United States Society for Augmentative and Alternative Communication. 2022. United States Society for Augmentative and Alternative Communication (USSAAC). https:\/\/www.nidcd.nih.gov\/directory\/united-states-society-augmentative-and-alternative-communication-ussaac. Accessed: 2024-01--22."},{"key":"e_1_2_1_70_1","volume-title":"A demonstration project for the utility of kinect-based educational games to benefit motor skills of children with ASD. Perceptual and motor skills","author":"Vuki\u0107evi\u0107 Sanja","year":"2019","unstructured":"Sanja Vuki\u0107evi\u0107, Mirjana DJordjevi\u0107, Nenad Glumbi\u0107, Zorica Bogdanovi\u0107, and Milica DJuri\u0107 Jovivci\u0107. 2019. A demonstration project for the utility of kinect-based educational games to benefit motor skills of children with ASD. Perceptual and motor skills, Vol. 126, 6 (2019), 1117--1144."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-60149-2_32"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1097\/MD.0000000000021228"},{"key":"e_1_2_1_73_1","volume-title":"How Game Tutorials in Mobile Online Games Affect User Adoption. In 2021 10th International Conference on Educational and Information Technology (ICEIT). IEEE, 264--268","author":"Zhiyong Xiong","year":"2021","unstructured":"Xiong Zhiyong, Wang Jiani, and Jiang Lijun. 2021. How Game Tutorials in Mobile Online Games Affect User Adoption. In 2021 10th International Conference on Educational and Information Technology (ICEIT). IEEE, 264--268."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701193","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3701193","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T14:23:07Z","timestamp":1755872587000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701193"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,10]]},"references-count":73,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1,10]]}},"alternative-id":["10.1145\/3701193"],"URL":"https:\/\/doi.org\/10.1145\/3701193","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,10]]},"assertion":[{"value":"2025-01-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}