{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:59:18Z","timestamp":1750309158350,"version":"3.41.0"},"reference-count":24,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T00:00:00Z","timestamp":1734652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Fonds de Recherche du Qu\u00e9bec-Nature et Technologies"},{"name":"Natural Sciences and Engineering Research Council of Canada","award":["RGPIN-2018-06130"],"award-info":[{"award-number":["RGPIN-2018-06130"]}]},{"name":"Canada Research Chairs Program"},{"name":"AGE-WELL NCE"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Commun. ACM"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:p>Traditional symbol-based AAC devices impose meta-linguistic and memory demands on individuals with complex communication needs and hinder conversation partners from stimulating symbolic language in meaningful moments. This work presents a prototype application that generates situation-specific communication boards formed by a combination of descriptive, narrative, and semantic related words and phrases inferred automatically from photographs. Through semi-structured interviews with AAC professionals, we investigate how this prototype was used to support communication and language learning in naturalistic school and therapy settings. We find that the immediacy of vocabulary reduces conversation partners\u2019 workload, opens up opportunities for AAC stimulation, and facilitates symbolic understanding and sentence construction. We contribute a nuanced understanding of how vocabularies generated automatically from photographs can support individuals with complex communication needs in using and learning symbolic AAC, offering insights into the design of automatic vocabulary generation methods and interfaces to better support various scenarios of use and goals.<\/jats:p>","DOI":"10.1145\/3623505","type":"journal-article","created":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T16:09:26Z","timestamp":1734710966000},"page":"89-96","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["AAC with Automated Vocabulary from Photographs: Insights from School and Speech-Language Therapy Settings"],"prefix":"10.1145","volume":"68","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1594-8318","authenticated-orcid":false,"given":"Mauricio","family":"Fontana de Vargas","sequence":"first","affiliation":[{"name":"McGill University, School of Information Studies, Montreal, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4934-2760","authenticated-orcid":false,"given":"Jiamin","family":"Dai","sequence":"additional","affiliation":[{"name":"McGill University, School of Information Studies, Montreal, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7081-0709","authenticated-orcid":false,"given":"Karyn","family":"Moffatt","sequence":"additional","affiliation":[{"name":"McGill University, School of Information Studies, Montreal, Canada"}]}],"member":"320","published-online":{"date-parts":[[2024,12,20]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"crossref","unstructured":"Barsalou L.W. Language Comprehension: Archival Memory Or Preparation for Situated Action? 1999.","DOI":"10.1080\/01638539909545069"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.3109\/07434618.2015.1052152"},{"key":"e_1_3_1_4_2","volume-title":"Augmentative and Alternative Communication","author":"Beukelman D.R.","year":"1998","unstructured":"Beukelman, D.R. et al. Augmentative and Alternative Communication. Paul H. Brookes Baltimore, 1998."},{"issue":"2","key":"e_1_3_1_5_2","first-page":"1","article-title":"Visual scene displays","volume":"16","author":"Blackstone S.","year":"2004","unstructured":"Blackstone, S., Light, J., Beukelman, D., and Shane, H. Visual scene displays. Augmentative Communication News 16, 2 (2004), 1\u201316.","journal-title":"Augmentative Communication News"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1080\/02687038.2016.1274874"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X018001032"},{"key":"e_1_3_1_8_2","doi-asserted-by":"crossref","unstructured":"Fontana de Vargas M. and Moffatt K. Automated generation of storytelling vocabulary from photographs for use in AAC. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th Intern. Joint Conf. on Natural Language Processing (Volume 1: Long Papers) 2021 1353\u20131364.","DOI":"10.18653\/v1\/2021.acl-long.108"},{"key":"e_1_3_1_9_2","doi-asserted-by":"crossref","unstructured":"Fang H. et al. From captions to visual concepts and back. In Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition 2015 1473\u20131482.","DOI":"10.1109\/CVPR.2015.7298754"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1080\/07434618912331274926"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.4004.514"},{"key":"e_1_3_1_12_2","unstructured":"Huang T. et al. Visual storytelling. In Proceedings of the 2016 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies 2016 1233\u20131239."},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1080\/00220270210125583"},{"key":"e_1_3_1_14_2","doi-asserted-by":"crossref","unstructured":"Kristensson P.O. Lilley J. Black R. and Waller A. A design engineering approach for quantitatively exploring context-aware sentence retrieval for nonspeaking individuals with motor disabilities. In Proceedings of the 2020 CHI Conf. on Human Factors in Computing Systems 2020 1\u201311.","DOI":"10.1145\/3313831.3376525"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1080\/07434618912331275126"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1080\/07434610410001655553"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1080\/07434618.2018.1557251"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1080\/07434618.2018.1558283"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2017.290"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10882-015-9452-2"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.3109\/07434618.2013.815800"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511844492.011"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.3109\/17483107.2013.799237"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2019.01.079"},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","unstructured":"Zheng Y. et al. Cartoon face recognition: A benchmark dataset. In Proceedings of the 28th ACM Intern. Conf. on Multimedia 2020 2264\u20132272.","DOI":"10.1145\/3394171.3413726"}],"container-title":["Communications of the ACM"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3623505","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3623505","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:51:01Z","timestamp":1750287061000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3623505"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,20]]},"references-count":24,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["10.1145\/3623505"],"URL":"https:\/\/doi.org\/10.1145\/3623505","relation":{},"ISSN":["0001-0782","1557-7317"],"issn-type":[{"type":"print","value":"0001-0782"},{"type":"electronic","value":"1557-7317"}],"subject":[],"published":{"date-parts":[[2024,12,20]]},"assertion":[{"value":"2024-12-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}