{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T09:11:37Z","timestamp":1771233097689,"version":"3.50.1"},"reference-count":83,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T00:00:00Z","timestamp":1646352000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["1R21MH111548-01"],"award-info":[{"award-number":["1R21MH111548-01"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Access. Comput."],"published-print":{"date-parts":[[2022,3,31]]},"abstract":"<jats:p>Collaborative Virtual Environments (CVE) have shown potential to be an effective social skill training platform for children with Autism Spectrum Disorders (ASD) to learn and practice collaborative and communication skills through peer interactions. However, most existing CVE systems require that appropriately matched partners be available at the same time to promote interaction, which limits their applicability to some community settings due to scheduling constraints. A second shortcoming of these more naturalistic peer-based designs is the intensive resources required to manually code the unrestricted conversations that occurred during the peer-based interactions. To preserve the benefits of CVE-based platforms and mitigate some of the resource limitations related to peer availability, we developed an Intelligent Collaborative Haptic-Gripper System (INC-Hg). This system provides an intelligent agent partner who can understand, communicate, and haptically interact with the user, without requiring the presence of another human peer. The INC-Hg operates in real time and thus is able to perform collaborative training tasks at any time and at the user's pace. INC-Hg can also record the real-time data regarding spoken language and task performance, thereby greatly reducing the resource burden of communication and interaction performance analysis. A preliminary usability study with 10 participants with ASD (ages 8\u201312 years) indicated that the system could classify the participant's utterances into five classes with an accuracy of 70.34%, which suggested the potential of INC-Hg to automatically recognize and analyze conversational content. The results also indicated high accuracies of the agent to initiate a conversation (97.56%) and respond to the participants (86.52%), suggesting the capability of the agent to conduct proper conversations with the participants. Compared to the results of human-to-human collaborative tasks, the human-to-agent mode achieved higher average collaborative operation ratio (61% compared to 40%) and comparable average frequencies for Initiations and Responses among the participants with ASD. These results offer preliminary support as well as areas of improvement regarding the agent's ability to respond to participants, work with participants to complete tasks, engage in back-and-forth conversations, and support the potential of the agent to be a useful partner for individuals with ASD completing CVE tasks.<\/jats:p>","DOI":"10.1145\/3487606","type":"journal-article","created":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T10:04:27Z","timestamp":1646388267000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["INC-Hg: An Intelligent Collaborative Haptic-Gripper Virtual Reality System"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0013-1030","authenticated-orcid":false,"given":"Huan","family":"Zhao","sequence":"first","affiliation":[{"name":"Treatment and Research Institute for Autism Spectrum Disorders, Vanderbilt University, Nashville, Tennessee"}]},{"given":"Ashwaq","family":"Zaini Amat","sequence":"additional","affiliation":[{"name":"Treatment and Research Institute for Autism Spectrum Disorders, Vanderbilt University, Nashville, Tennessee Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, Tennessee"}]},{"given":"Miroslava","family":"Migovich","sequence":"additional","affiliation":[{"name":"Treatment and Research Institute for Autism Spectrum Disorders, Vanderbilt University, Nashville, Tennessee Department of Mechanical Engineering, Vanderbilt University, Nashville, Tennessee"}]},{"given":"Amy","family":"Swanson","sequence":"additional","affiliation":[{"name":"Treatment and Research Institute for Autism Spectrum Disorders, Vanderbilt University, Nashville, Tennessee"}]},{"given":"Amy S.","family":"Weitlauf","sequence":"additional","affiliation":[{"name":"Treatment and Research Institute for Autism Spectrum Disorders, Vanderbilt University, Nashville, Tennessee"}]},{"given":"Zachary","family":"Warren","sequence":"additional","affiliation":[{"name":"Treatment and Research Institute for Autism Spectrum Disorders, Vanderbilt University, Nashville, Tennessee"}]},{"given":"Nilanjan","family":"Sarkar","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, Vanderbilt University, Nashville, Tennessee"}]}],"member":"320","published-online":{"date-parts":[[2022,3,4]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.15585\/mmwr.ss6706a1"},{"issue":"3","key":"e_1_3_2_3_1","article-title":"Prevalence of autism spectrum disorders: Autism and developmental disabilities monitoring network, 14 Sites, United States","volume":"61","author":"Baio J.","year":"2012","unstructured":"J. Baio. 2012. Prevalence of autism spectrum disorders: Autism and developmental disabilities monitoring network, 14 Sites, United States, 2008. Morbidity and Mortality Weekly Report. Surveillance Summaries. Centers for Disease Control and Prevention, 61, 3.","journal-title":"Morbidity and Mortality Weekly Report. Surveillance Summaries"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1097\/WCO.0b013e32833e99a4"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2013.10.027"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2010.4"},{"issue":"20","key":"e_1_3_2_7_1","first-page":"1","article-title":"Changes in prevalence of parent-reported autism spectrum disorder in school-aged US children: 2007 to 2011\u20132012","volume":"65","author":"Blumberg S. J.","year":"2013","unstructured":"S. J. Blumberg et al. 2013. Changes in prevalence of parent-reported autism spectrum disorder in school-aged US children: 2007 to 2011\u20132012. National Health Statistics Reports 65, 20 (2013), 1\u20137.","journal-title":"National Health Statistics Reports"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:JADD.0000006002.82367.4f"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2005.06.015"},{"key":"e_1_3_2_10_1","volume-title":"Proceedings of the 11th International Conference on Disability","author":"Bresnahan T.","year":"2016","unstructured":"T. Bresnahan et al. 2016. Using virtual interactive training agents with adults with autism and other developmental disabilities. In Proceedings of the 11th International Conference on Disability."},{"key":"e_1_3_2_11_1","volume-title":"Proceedings of the Conference on Future Play","author":"Brusk J.","unstructured":"J. Brusk et al. DEAL: dialogue management in SCXML for believable game characters. In Proceedings of the Conference on Future Play. ACM."},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361315598634"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/0741932513514618"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2009.10.011"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01409793"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2017.05.030"},{"key":"e_1_3_2_17_1","volume-title":"Social Responsiveness Scale (SRS)","author":"Constantino J. N.","year":"2007","unstructured":"J. N. Constantino, and C. P. Gruber. 2007. Social Responsiveness Scale (SRS). Western Psychological Services, Los Angeles, CA."},{"key":"e_1_3_2_18_1","unstructured":"H. Cuay\u00e1huitl S. Keizer and O. Lemon. 2015. Strategic dialogue management via deep reinforcement learning. Retrieved from https:\/\/arXiv:1511.08099."},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2009.04.005"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/WHC.2009.4810879"},{"key":"e_1_3_2_21_1","first-page":"1","article-title":"A study using n-gram features for text categorization","volume":"3","author":"F\u00fcrnkranz J.","year":"1998","unstructured":"J. F\u00fcrnkranz. 1998. A study using n-gram features for text categorization. Austrian Res. Inst. Artific. Intell. 3, 1998 (1998), 1\u201310.","journal-title":"Austrian Res. Inst. Artific. Intell."},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267851.3267896"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2018.02683"},{"key":"e_1_3_2_24_1","unstructured":"Google. 2020. Speech-to-Text. Retrieved from https:\/\/cloud.google.com\/speech-to-text\/."},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(97)00040-X"},{"key":"e_1_3_2_26_1","volume-title":"Proceedings of the AISB Symposium: AI & Games","author":"Grey J.","unstructured":"J. Grey and J. J. Bryson. Procedural quests: A focus for agent interaction in role-playing-games. In Proceedings of the AISB Symposium: AI & Games."},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/11550617_4"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-017-3455-z"},{"key":"e_1_3_2_29_1","volume-title":"Proceedings of the International Summer Workshop on Multimodal Interfaces","author":"Huisman G.","year":"2013","unstructured":"G. Huisman et al. 2013. Touching virtual agents: embodiment and mind. In Proceedings of the International Summer Workshop on Multimodal Interfaces. Springer."},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0049945"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2007-2361"},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-012-1544-6"},{"key":"e_1_3_2_33_1","doi-asserted-by":"crossref","unstructured":"M. Kaur S. M. Srinivasan and A. N. Bhat. (2018). Comparing motor performance praxis coordination and interpersonal synchrony between children with and without Autism Spectrum Disorder (ASD). Res. Dev. Disabil . 72 79\u201395.","DOI":"10.1016\/j.ridd.2017.10.025"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2011.10101532"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/11550617_28"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2009.4811019"},{"key":"e_1_3_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-014-2240-5"},{"key":"e_1_3_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2011.11.001"},{"key":"e_1_3_2_39_1","first-page":"284","volume-title":"Autism Diagnostic Observation Schedule","author":"Lord C.","year":"2012","unstructured":"C. Lord, M. Rutter, P. DiLavore, S. Risi, K. Gotham, and S. Bishop. 2012. Autism Diagnostic Observation Schedule, 2nd ed. (ADOS-2). Western Psychological Services, Los Angeles, CA, 284.","edition":"2"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1053\/apmr.2001.33101"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1123\/apaq.30.3.271"},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1123\/apaq.2013-0068"},{"key":"e_1_3_2_43_1","volume-title":"Proceedings of the Association for the Advancememnt of Artificial Intelligence (AAAI\u201904","author":"Magerko B.","year":"2004","unstructured":"B. Magerko et al. 2004. AI characters and directors for interactive computer games. In Proceedings of the Association for the Advancememnt of Artificial Intelligence (AAAI\u201904)."},{"key":"e_1_3_2_44_1","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2012-0900O"},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.2190\/BRCJ-P9K5-9E1D-2ALC"},{"key":"e_1_3_2_46_1","unstructured":"Microsoft. 2020. Text-to-Speech. Retrieved from https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/text-to-speech\/."},{"key":"e_1_3_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2010.5596584"},{"key":"e_1_3_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2011.6011990"},{"key":"e_1_3_2_49_1","unstructured":"Natural Language Toolkit (NLTK). 2019. Retrieved from http:\/\/www.nltk.org\/."},{"key":"e_1_3_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/HAPTIC.2010.5444628"},{"key":"e_1_3_2_51_1","doi-asserted-by":"publisher","DOI":"10.5014\/ajot.2012.004556"},{"key":"e_1_3_2_52_1","volume-title":"Alexa Prize Proceedings","author":"Papaioannou I.","year":"2017","unstructured":"I. Papaioannou et al. 2017. Alana: Social dialogue using an ensemble model and a ranker trained on user feedback. Alexa Prize Proceedings."},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2788.2002.00425.x"},{"key":"e_1_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.1080\/08856257.2011.593831"},{"key":"e_1_3_2_55_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361315569745"},{"key":"e_1_3_2_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-012-1571-3"},{"key":"e_1_3_2_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-007-0402-4"},{"key":"e_1_3_2_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-009-0842-0"},{"key":"e_1_3_2_59_1","volume-title":"Stanford-Binet Intelligence Scales","author":"Roid G. H.","unstructured":"G. H. Roid. Stanford-Binet Intelligence Scales. Riverside Publishing, Itasca, IL."},{"key":"e_1_3_2_60_1","volume-title":"The Social Communication Questionnaire Manual","author":"Rutter M.","year":"2003","unstructured":"M. Rutter, A. Bailey, and C. Lord. 2003. The Social Communication Questionnaire Manual. Western Psychological Services."},{"key":"e_1_3_2_61_1","volume-title":"Proceedings of the ANLP\/NAACL Workshop on Conversational Systems","author":"Seneff S.","year":"2000","unstructured":"S. Seneff and J. Polifroni. 2000. Dialogue management in the Mercury flight reservation system. Proceedings of the ANLP\/NAACL Workshop on Conversational Systems. Association for Computational Linguistics."},{"key":"e_1_3_2_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF03325096"},{"key":"e_1_3_2_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0097-8493(97)00030-7"},{"key":"e_1_3_2_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-011-1249-2"},{"key":"e_1_3_2_65_1","doi-asserted-by":"publisher","DOI":"10.1162\/089120100561737"},{"key":"e_1_3_2_66_1","first-page":"81","article-title":"Virtual reality for the treatment of autism","author":"Strickland D.","year":"1997","unstructured":"D. Strickland. 1997. Virtual reality for the treatment of autism. Studies Health Technol. Inform. (1997), 81\u201386.","journal-title":"Studies Health Technol. Inform."},{"key":"e_1_3_2_67_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0182151"},{"key":"e_1_3_2_68_1","volume-title":"Proceedings of the 8th International Conference on International Conference for the Learning Sciences. International Society of the Learning Sciences","author":"Tartaro A.","unstructured":"A. Tartaro and J. Cassell. Playing with virtual peers: Bootstrapping contingent discourse in children with autism. In Proceedings of the 8th International Conference on International Conference for the Learning Sciences. International Society of the Learning Sciences."},{"key":"e_1_3_2_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.rasd.2021.101824"},{"key":"e_1_3_2_70_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-014-2203-x"},{"key":"e_1_3_2_71_1","unstructured":"The Geomagic Touch Haptic Device. [n.d.]. Retrieved from http:\/\/www.geomagic.com\/en\/products\/phantom-omni\/overview."},{"key":"e_1_3_2_72_1","unstructured":"Unity. [n.d.]. Retrieved from https:\/\/unity3d.com\/."},{"key":"e_1_3_2_73_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361313512902"},{"key":"e_1_3_2_74_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07440-5_43"},{"key":"e_1_3_2_75_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-012-1577-x"},{"key":"e_1_3_2_76_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-21996-7_3"},{"key":"e_1_3_2_77_1","article-title":"Cooperative works by a human and a humanoid robot","author":"Yokoyama K.","year":"2003","unstructured":"K. Yokoyama et al. 2003. Cooperative works by a human and a humanoid robot. IEEE International Conference on Robotics and Automation. 2003. IEEE.","journal-title":"IEEE International Conference on Robotics and Automation"},{"key":"e_1_3_2_78_1","volume-title":"Proceedings of the World Haptics Conference (WHC\u201913)","year":"2013","unstructured":"Kim, Younq-Seok et al. 2013. Haptics assisted training (HAT) system for children's handwriting. In Proceedings of the World Haptics Conference (WHC\u201913). IEEE."},{"key":"e_1_3_2_79_1","doi-asserted-by":"publisher","DOI":"10.1177\/1545968308323692"},{"key":"e_1_3_2_80_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ps.201900058"},{"key":"e_1_3_2_81_1","volume-title":"Proceedings of the International Conference on Universal Access in Human-Computer Interaction","author":"Zhao H.","unstructured":"H. Zhao et al. Understanding fine motor patterns in children with autism using a Haptic-Gripper virtual reality system. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction. Springer."},{"key":"e_1_3_2_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2018.2791562"},{"key":"e_1_3_2_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3231938"},{"key":"e_1_3_2_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3459608"}],"container-title":["ACM Transactions on Accessible Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3487606","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3487606","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:21Z","timestamp":1750188681000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3487606"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,4]]},"references-count":83,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,3,31]]}},"alternative-id":["10.1145\/3487606"],"URL":"https:\/\/doi.org\/10.1145\/3487606","relation":{},"ISSN":["1936-7228","1936-7236"],"issn-type":[{"value":"1936-7228","type":"print"},{"value":"1936-7236","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,4]]},"assertion":[{"value":"2020-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}