{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T09:34:57Z","timestamp":1763458497652,"version":"3.45.0"},"reference-count":86,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2009,6,1]],"date-time":"2009-06-01T00:00:00Z","timestamp":1243814400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["NSF-0643502"],"award-info":[{"award-number":["NSF-0643502"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Access. Comput."],"published-print":{"date-parts":[[2009,6]]},"abstract":"<jats:p>HCI studies assessing nonverbal individuals (especially those who do not communicate through traditional linguistic means: spoken, written, or sign) are a daunting undertaking. Without the use of directed tasks, interviews, questionnaires, or question-answer sessions, researchers must rely fully upon observation of behavior, and the categorization and quantification of the participant\u2019s actions. This problem is compounded further by the lack of metrics to quantify the behavior of nonverbal subjects in computer-based intervention contexts. We present a set of dependent variables called A3 (pronounced A-Cubed) or Annotation for ASD Analysis, to assess the behavior of this demographic of users, specifically focusing on engagement and vocalization. This paper demonstrates how theory from multiple disciplines can be brought together to create a set of dependent variables, as well as demonstration of these variables, in an experimental context. Through an examination of the existing literature, and a detailed analysis of the current state of computer vision and speech detection, we present how computer automation may be integrated with the A3 guidelines to reduce coding time and potentially increase accuracy. We conclude by presenting how and where these variables can be used in multiple research areas and with varied target populations.<\/jats:p>","DOI":"10.1145\/1530064.1530066","type":"journal-article","created":{"date-parts":[[2009,6,9]],"date-time":"2009-06-09T08:44:12Z","timestamp":1244537052000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["A3"],"prefix":"10.1145","volume":"2","author":[{"given":"Joshua","family":"Hailpern","sequence":"first","affiliation":[{"name":"University of Illinois"}]},{"given":"Karrie","family":"Karahalios","sequence":"additional","affiliation":[{"name":"University of Illinois"}]},{"given":"James","family":"Halle","sequence":"additional","affiliation":[{"name":"University of Illinois"}]},{"given":"Laura","family":"Dethorne","sequence":"additional","affiliation":[{"name":"University of Illinois"}]},{"given":"Mary-Kelsey","family":"Coletto","sequence":"additional","affiliation":[{"name":"University of Illinois"}]}],"member":"320","published-online":{"date-parts":[[2009,6]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Alberto P. and Troutman A. 2005. Applied Behavior Analysis for Teachers. Prentice Hall Upper Saddle River NJ."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/1204461"},{"key":"e_1_2_1_3_1","unstructured":"Attainment Company 2008. GoTalk. http:\/\/www.attainmentcompany.com\/xcart\/home.php."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248618"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the ICASSP Meeting Recognition Workshop.","author":"Banerjee S.","year":"2004","unstructured":"Banerjee, S., Cohen, J., et al. 2004. Creating multi-modal, user-centric records of meetings with the Carnegie Mellon meeting recorder architecture. In Proceedings of the ICASSP Meeting Recognition Workshop."},{"key":"e_1_2_1_6_1","unstructured":"Baskett C. B. 1996. The effect of live interactive video on the communicative behavior in children with autism. M.S. Thesis University of North Carolina at Chapel Hill."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1026711.1026758"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1968.1-175"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1979.12-523"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/026565909801400203"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125580"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001648-199609000-00030"},{"key":"e_1_2_1_13_1","volume-title":"Trading Spaces: How Humans and Humanoids Use Speech and Gesture to Give Directions. Conversational Informatics","author":"Cassell J.","year":"2007","unstructured":"Cassell, J., Kopp, S., Tepper, P., Ferriman, K., and Striegnitz, K. 2007. Trading Spaces: How Humans and Humanoids Use Speech and Gesture to Give Directions. Conversational Informatics. John Wiley &amp; Sons, New York, 133--160."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/1289189.1289225"},{"volume-title":"Proceedings of the IEEE International Conference On Multimedia and Expo (ICME\u201902)","author":"Chen S.","key":"e_1_2_1_15_1","unstructured":"Chen, S., Shyu, M., Liao, W., and Zhang, C. 2002. Scene change detection by audio and video clues. In Proceedings of the IEEE International Conference On Multimedia and Expo (ICME\u201902)."},{"volume-title":"University of California Press","author":"Clifford J.","key":"e_1_2_1_16_1","unstructured":"Clifford, J., Marcus, G. E. and School of American Research. 1986. Writing Culture. University of California Press, Berkeley, CA."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0163-6383(99)00017-X"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240866.1240958"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/1032641.1033044"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361301005003008"},{"key":"e_1_2_1_21_1","unstructured":"Gathercole S. and Baddeley A. 1993. Working Memory and Language Psychology Pr."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1996.29-291"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240866.1240960"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","unstructured":"Hagedorn J. Hailpern J. et al. 2008. VCode and VData: Illustrating a New Framework for Supporting the Video Annotation Work? Advanced Visual Interfaces. Napoli Italy ACM-PRESS. 10.1145\/1385569.1385622","DOI":"10.1145\/1385569.1385622"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518774"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1414471.1414476"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/154079698701200105"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-7687.00125"},{"volume-title":"Automatic syllable detection for vowel landmarks","author":"Howitt A. W.","key":"e_1_2_1_29_1","unstructured":"Howitt, A. W. 2000. Automatic syllable detection for vowel landmarks, Massachusetts Institute of Technology 1."},{"volume-title":"An Overview of Social Behavior in Autism. Social Behavior in Autism. E. Schopler and G. B. Mesibov","author":"Howlin P.","key":"e_1_2_1_30_1","unstructured":"Howlin, P. 1986. An Overview of Social Behavior in Autism. Social Behavior in Autism. E. Schopler and G. B. Mesibov. New York, NY, Plenum. 113--115."},{"key":"e_1_2_1_31_1","unstructured":"IBM. 2005. IBM ViaVoice."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/123078.128728"},{"key":"e_1_2_1_33_1","volume-title":"About vprism video data analysis software","author":"Johnson A.","year":"2007","unstructured":"Johnson, A. 2007. About vprism video data analysis software. 2007, from http:\/\/www.camse.org\/andy\/VP\/vprism.htm."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1324892.1324929"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1322192.1322203"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1977.10-141"},{"volume-title":"Single-Case Research Designs: Methods for Clinical and Applied Setting. USA","author":"Kazdin A. E.","key":"e_1_2_1_37_1","unstructured":"Kazdin, A. E. 1982. Single-Case Research Designs: Methods for Clinical and Applied Setting. USA, Oxford University Press."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/638249.638269"},{"key":"e_1_2_1_39_1","unstructured":"Kipp M. 2007. Anvil - the video annotation research tool."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026073522897"},{"volume-title":"Speaker Model Quantization for Unsupervised Speaker Indexing International Conference Spoken Language Processing Jeju, Korea.","author":"Kwon S.","key":"e_1_2_1_41_1","unstructured":"Kwon, S. and Narayanan, S. 2004. Speaker Model Quantization for Unsupervised Speaker Indexing International Conference Spoken Language Processing Jeju, Korea."},{"volume-title":"Developmental Sentence Analysis","author":"Lee L.","key":"e_1_2_1_42_1","unstructured":"Lee, L. 1974. Developmental Sentence Analysis. Evanston, IL, Northwestern University Press."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1005592401947"},{"volume-title":"Teaching Individuals with Developmental Delays: Basic Intervention Techniques","author":"Lovaas O. I.","key":"e_1_2_1_44_1","unstructured":"Lovaas, O. I. 2003. Teaching Individuals with Developmental Delays: Basic Intervention Techniques. Austin, TX, PRO-ED, Inc."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.2005.01582.x"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1414471.1414477"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0163-6383(99)00004-1"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1290128.1290134"},{"volume-title":"Socially Intelligent Agents - Creating Relationships with Computers and Robots","author":"Michaud F.","key":"e_1_2_1_49_1","unstructured":"Michaud, F. and Th\u00e9berge-Turmel, C. 2002. Mobile robotic toys and autism. In Socially Intelligent Agents - Creating Relationships with Computers and Robots. K. Dautenhahn Ed., Springer, 125--132."},{"volume-title":"Proceedings of the 5th International Conference on Spoken Language Processing.","author":"Nishida M.","key":"e_1_2_1_50_1","unstructured":"Nishida, M. and Ariki, Y. 1998. Real time speaker indexing based on subspace method-application to TV News Articles and Debate. In Proceedings of the 5th International Conference on Spoken Language Processing."},{"key":"e_1_2_1_51_1","unstructured":"Noldus Information Technology. 2007. The observer. www.noldus.com\/."},{"key":"e_1_2_1_52_1","unstructured":"Nuance Communications 2008. Dragon NaturallySpeaking. www.nuance.com\/naturallyspeaking\/."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248639"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248659.1248700"},{"key":"e_1_2_1_55_1","volume-title":"Language Development: An Introduction","author":"Owens R. E.","year":"2007","unstructured":"Owens, R. E. 2007. Language Development: An Introduction 7th Ed. Allyn &amp; Bacon, Boston, MA.","edition":"7"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1109540.1109555"},{"volume-title":"Speech and hearing science proseminar","author":"Perlman A.","key":"e_1_2_1_57_1","unstructured":"Perlman, A. 2008. Speech and hearing science proseminar. University of Illinois, Champaign, IL."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1386352.1386396"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180875.1180877"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/502585.502668"},{"key":"e_1_2_1_61_1","unstructured":"Prizant B. M. Schuler A. L. Wetherby A. M. and Rydell P. 1997. Enhancing language and communication: Language approaches. In Handbook of Autism and Pervasive Developmental Disorders 2nd Ed. D. Cohen and F. Volkmar Eds. Wiley New York."},{"volume-title":"Proceedings of the NIST Meeting Room Workshop.","author":"Quek F.","key":"e_1_2_1_62_1","unstructured":"Quek, F., McNeill, D., Rose, T., and Shi, Y. 2003. A coding tool for multimodal analysis of meeting video. In Proceedings of the NIST Meeting Room Workshop."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1071-9091(97)80024-1"},{"key":"e_1_2_1_64_1","unstructured":"Reichle J. Beukelman D. and Light J. 2002. Implementing an Augmentative Communication System: Exemplary Strategies for Beginning Communicators. Brookes Publishing Company Baltimore MD."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1985.18-289"},{"key":"e_1_2_1_66_1","unstructured":"Retherford K. Sewards D. and Hess L. 1993. Guide to Analysis of Language Transcripts Thinking Publications Eau Claire WI."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infbeh.2004.04.001"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1972.5-163"},{"key":"e_1_2_1_69_1","unstructured":"SALT Software 2007. www.languageanalysislab.com\/salt\/."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.2307\/1131913"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/987657.987670"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1005531501155"},{"key":"e_1_2_1_73_1","unstructured":"Studiocode Business Group. 2007. Studiocode business group - supplier of studiocode and stream video analysis and distribution software. http:\/\/www.studiocodegroup.com."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.5555\/38407"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.5555\/1599871.1599919"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1322192.1322202"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180995.1181031"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/1314303.1314306"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360.0702.79"},{"volume-title":"The Social Life of Small Urban Spaces","author":"Whyte W.","key":"e_1_2_1_80_1","unstructured":"Whyte, W. 1980. The Social Life of Small Urban Spaces. Conservation Foundation, Washington, DC."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1044\/0161-1461(2003\/015)"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.5555\/1363217.1363225"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.130.1.29"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/1322192.1322216"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/982452.982457"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/954339.954342"}],"container-title":["ACM Transactions on Accessible Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1530064.1530066","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1530064.1530066","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1530064.1530066","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T09:25:09Z","timestamp":1763457909000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1530064.1530066"}},"subtitle":["HCI Coding Guideline for Research Using Video Annotation to Assess Behavior of Nonverbal Subjects with Computer-Based Intervention"],"short-title":[],"issued":{"date-parts":[[2009,6]]},"references-count":86,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2009,6]]}},"alternative-id":["10.1145\/1530064.1530066"],"URL":"https:\/\/doi.org\/10.1145\/1530064.1530066","relation":{},"ISSN":["1936-7228","1936-7236"],"issn-type":[{"type":"print","value":"1936-7228"},{"type":"electronic","value":"1936-7236"}],"subject":[],"published":{"date-parts":[[2009,6]]},"assertion":[{"value":"2008-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-02-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-06-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}