{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T11:35:42Z","timestamp":1768908942656,"version":"3.49.0"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation Expedition in Computing","award":["IIS-1139148"],"award-info":[{"award-number":["IIS-1139148"]}]},{"name":"European Union H2020, Marie Curie Action - Individual Fellowship","award":["2016-2019 (EngageMe 701236)"],"award-info":[{"award-number":["2016-2019 (EngageMe 701236)"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>\n            Affect-aware socially assistive robotics (SAR) has shown great potential for augmenting interventions for children with autism spectrum disorders (ASD). However, current SAR cannot yet perceive the unique and diverse set of atypical cognitive-affective behaviors from children with ASD in an automatic and personalized fashion in long-term (multi-session) real-world interactions. To bridge this gap, this work designed and validated personalized models of arousal and valence for children with ASD using a multi-session in-home dataset of SAR interventions. By training machine learning (ML) algorithms with supervised domain adaptation (s-DA), the personalized models were able to tradeoff between the limited individual data and the more abundant less personal data pooled from other study participants. We evaluated the effects of personalization on a long-term multimodal dataset consisting of four children with ASD with a total of 19 sessions, and derived inter-rater reliability (IR) scores for binary arousal (IR = 83%) and valence (IR = 81%) labels between human annotators. Our results show that personalized Gradient Boosted Decision Trees (XGBoost) models with s-DA outperformed two non-personalized individualized and generic model baselines not only on the weighted average of all sessions, but also statistically (\n            <jats:italic>p<\/jats:italic>\n            &lt; .05) across individual sessions. This work paves the way for the development of personalized autonomous SAR systems tailored toward individuals with atypical cognitive-affective and socio-emotional needs.\n          <\/jats:p>","DOI":"10.1145\/3526111","type":"journal-article","created":{"date-parts":[[2022,4,30]],"date-time":"2022-04-30T11:13:01Z","timestamp":1651317181000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Toward Personalized Affect-Aware Socially Assistive Robot Tutors for Long-Term Interventions with Children with Autism"],"prefix":"10.1145","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2855-5863","authenticated-orcid":false,"given":"Zhonghao","family":"Shi","sequence":"first","affiliation":[{"name":"University of Southern California, Los Angeles, CA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2933-1228","authenticated-orcid":false,"given":"Thomas R.","family":"Groechel","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5232-3264","authenticated-orcid":false,"given":"Shomik","family":"Jain","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0634-8222","authenticated-orcid":false,"given":"Kourtney","family":"Chima","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1165-6075","authenticated-orcid":false,"given":"Ognjen (Oggi)","family":"Rudovic","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8958-6666","authenticated-orcid":false,"given":"Maja J.","family":"Matari\u0107","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA"}]}],"member":"320","published-online":{"date-parts":[[2022,9,8]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"arXiv preprint arXiv:1603.04467 2016 Tensorflow: Large-scale machine learning on heterogeneous distributed systems"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1176\/appi.books.9780890425596"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00019"},{"key":"e_1_3_2_5_2","unstructured":"Paul Boersma and David Weenink. 2001. PRAAT a system for doing phonetics by computer. Glot International. 5 (2001) 341\u2013345."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1071-5819(03)00018-1"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-013-0202-2"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2019.2929257"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/1647314.1647336"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-813445-0.00010-1"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3329486.3329491"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_2_14_2","article-title":"Keras","author":"Chollet Francois","year":"2015","unstructured":"Francois Chollet. 2015. Keras. https:\/\/keras.io.","journal-title":"https:\/\/keras.io"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.15585\/mmwr.ss6513a1"},{"key":"e_1_3_2_16_2","volume-title":"Proceedings of the 2018 International Symposium on Experimental Robotics","unstructured":"Caitlyn Clabaugh, Shomik Jain, Balasubramanian Thiagarajan, Zhonghao Shi, Leena Mathur, Kartik Mahajan, Gisele Ragusa, and Maja Mataric. 2018. Attentiveness of children with diverse needs to a socially assistive robot in the home. In Proceedings of the 2018 International Symposium on Experimental Robotics."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2019.00110"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2019.00110"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-control-060117-104911"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3319502.3374834"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1080\/02699931.2011.613668"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2007.79"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICORR.2005.1501143"},{"key":"e_1_3_2_24_2","volume-title":"Proceedings of the 2014 AAAI Fall Symposium Series","author":"Greczek Jillian","year":"2014","unstructured":"Jillian Greczek, Elaine Short, Caitlyn E. Clabaugh, Katelyn Swift-Spong, and Maja Mataric\u0107. 2014. Socially assistive robotics for personalized education for children. In Proceedings of the 2014 AAAI Fall Symposium Series."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2018.0026"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.4018\/jse.2010101605"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-005-3298-x"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2559636.2559668"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-018-0508-1"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aaz3791"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2020.00043"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1044\/2018_JSLHR-L-RSAUT-18-0029"},{"key":"e_1_3_2_33_2","unstructured":"Ron Kohavi. 1995. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence - Volume 2 (IJCAI\u201995) . Morgan Kaufmann Publishers Inc. San Francisco CA 1137\u20131143."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.5555\/876869.878064"},{"key":"e_1_3_2_35_2","article-title":"Detection of social signals for recognizing engagement in human-robot interaction","author":"Lala Divesh","year":"2017","unstructured":"Divesh Lala, Koji Inoue, Pierrick Milhorat, and Tatsuya Kawahara. 2017. Detection of social signals for recognizing engagement in human-robot interaction. arXiv preprint arXiv:1709.10257 (2017).","journal-title":"arXiv preprint arXiv:1709.10257"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4684-6350-7_10"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3283453"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-32552-1_73"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/RO-MAN46459.2019.8956468"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2013.00345"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","unstructured":"Rosalind W. Picard. 1997. Affective Computing . MIT Press Cambridge MA.","DOI":"10.1037\/e526112012-054"},{"key":"e_1_3_2_43_2","first-page":"5","volume-title":"Proceedings of the ICRA Workshop on Open Source Software","volume":"3","author":"Quigley Morgan","year":"2009","unstructured":"Morgan Quigley, Ken Conley, Brian Gerkey, Josh Faust, Tully Foote, Jeremy Leibs, Rob Wheeler, and Andrew Y. Ng. 2009. ROS: An open-source robot operating system. In Proceedings of the ICRA Workshop on Open Source Software, Vol. 3. Kobe, Japan, 5."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aao6760"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2017.00036"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2019.00031"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2018.8594177"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/1957656.1957781"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-bioeng-071811-150036"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aat7544"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2014.6926371"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2019.8925515"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.5555\/2936924.2937050"},{"issue":"2","key":"e_1_3_2_54_2","article-title":"Sensory characteristics in ASD","volume":"12","author":"Stewart Mary E.","year":"2009","unstructured":"Mary E. Stewart, Natalie Russo, Jennifer Banks, Louisa Miller, and Jacob A. Burack. 2009. Sensory characteristics in ASD. McGill Journal of Medicine: MJM 12, 2 (2009).","journal-title":"McGill Journal of Medicine: MJM"},{"key":"e_1_3_2_55_2","article-title":"Return of frustratingly easy domain adaptation","author":"Sun Baochen","year":"2015","unstructured":"Baochen Sun, Jiashi Feng, and Kate Saenko. 2015. Return of frustratingly easy domain adaptation. arXiv preprint arXiv:1511.05547 (2015).","journal-title":"arXiv preprint arXiv:1511.05547"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3400066"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJLT.2009.028804"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/2663204.2663247"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3526111","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3526111","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T18:43:46Z","timestamp":1750272226000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3526111"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,8]]},"references-count":57,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3526111"],"URL":"https:\/\/doi.org\/10.1145\/3526111","relation":{},"ISSN":["2573-9522","2573-9522"],"issn-type":[{"value":"2573-9522","type":"print"},{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,8]]},"assertion":[{"value":"2020-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-09-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}