{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T11:19:44Z","timestamp":1773141584653,"version":"3.50.1"},"reference-count":109,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2020,2,1]],"date-time":"2020-02-01T00:00:00Z","timestamp":1580515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100011273","name":"FP7 Information and Communication Technologies","doi-asserted-by":"publisher","award":["611391"],"award-info":[{"award-number":["611391"]}],"id":[{"id":"10.13039\/100011273","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>The last few decades have seen widespread advances in technological means to characterise observable aspects of human behaviour such as gaze or posture. Among others, these developments have also led to significant advances in social robotics. At the same time, however, social robots are still largely evaluated in idealised or laboratory conditions, and it remains unclear whether the technological progress is sufficient to let such robots move \u201cinto the wild\u201d. In this paper, we characterise the problems that a social robot in the real world may face, and review the technological state of the art in terms of addressing these. We do this by considering what it would entail to automate the diagnosis of Autism Spectrum Disorder (ASD). Just as for social robotics, ASD diagnosis fundamentally requires the ability to characterise human behaviour from observable aspects. However, therapists provide clear criteria regarding what to look for. As such, ASD diagnosis is a situation that is both relevant to real-world social robotics and comes with clear metrics. Overall, we demonstrate that even with relatively clear therapist-provided criteria and current technological progress, the need to interpret covert behaviour cannot yet be fully addressed. Our discussions have clear implications for ASD diagnosis, but also for social robotics more generally. For ASD diagnosis, we provide a classification of criteria based on whether or not they depend on covert information and highlight present-day possibilities for supporting therapists in diagnosis through technological means. For social robotics, we highlight the fundamental role of covert behaviour, show that the current state-of-the-art is unable to characterise this, and emphasise that future research should tackle this explicitly in realistic settings.<\/jats:p>","DOI":"10.3390\/info11020081","type":"journal-article","created":{"date-parts":[[2020,2,3]],"date-time":"2020-02-03T11:28:31Z","timestamp":1580729311000},"page":"81","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Requirements for Robotic Interpretation of Social Signals \u201cin the Wild\u201d: Insights from Diagnostic Criteria of Autism Spectrum Disorder"],"prefix":"10.3390","volume":"11","author":[{"given":"Madeleine E.","family":"Bartlett","sequence":"first","affiliation":[{"name":"Centre for Robotics and Neural Systems, University of Plymouth, Plymouth PL4 8AA, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9329-9918","authenticated-orcid":false,"given":"Cristina","family":"Costescu","sequence":"additional","affiliation":[{"name":"Department of Clinical Psychology and Psychotherapy, Babes-Bolyai University, Cluj-Napoca 400000, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7299-9234","authenticated-orcid":false,"given":"Paul","family":"Baxter","sequence":"additional","affiliation":[{"name":"Lincoln Centre for Autonomous Systems, School of Computer Science, University of Lincoln, Lincoln LN6 7TS, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1177-4119","authenticated-orcid":false,"given":"Serge","family":"Thill","sequence":"additional","affiliation":[{"name":"Donders Institute for Brain, Cognition, and Behaviour, Radboud University Nijmegen, 6525 XZ Nijmegen, The Netherlands"},{"name":"Interaction Lab, School of Informatics, University of Sk\u00f6vde, 541 28 Sk\u00f6vde, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Carruthers, P., and Smith, P.K. (1996). Theories of Theories of Mind, Cambridge University Press.","DOI":"10.1017\/CBO9780511597985"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.cogsys.2016.06.003","article-title":"Beyond bodily anticipation: internal simulations in social interaction","volume":"40","author":"Svensson","year":"2016","journal-title":"Cognit. Syst. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1016\/j.robot.2006.02.003","article-title":"Hierarchical attentive multiple models for execution and recognition of actions","volume":"54","author":"Demiris","year":"2006","journal-title":"Robot. Auton. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/s10339-007-0168-9","article-title":"Prediction of intent in robotics and multi-agent systems","volume":"8","author":"Demiris","year":"2007","journal-title":"Cognit. Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2201","DOI":"10.1162\/089976601750541778","article-title":"MOSAIC Model for Sensorimotor Learning and Control","volume":"13","author":"Haruno","year":"2001","journal-title":"Neural Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1075\/is.7.2.06met","article-title":"Understanding mirror neurons: A bio-robotic approach","volume":"7","author":"Metta","year":"2006","journal-title":"Interact. Stud."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"49","DOI":"10.3389\/frobt.2019.00049","article-title":"What Can You See? Identifying Cues on Internal States From the Movements of Natural Social Interactions","volume":"6","author":"Bartlett","year":"2019","journal-title":"Front. Robot. AI"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bradwell, H.L., Edwards, K.J., Winnington, R., Thill, S., and Jones, R.B. (2019). Companion robots for older people: importance of user-centred design demonstrated through observations and focus groups comparing preferences of older people and roboticists in South West England. BMJ Open.","DOI":"10.1136\/bmjopen-2019-032468"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Vollmer, A.L., Read, R., Trippas, D., and Belpaeme, T. (2018). Children conform, adults resist: A robot group induced peer pressure on normative social conformity. Sci. Robot.","DOI":"10.1126\/scirobotics.aat7111"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., and Tanaka, F. (2018). Social robots for education: A review. Sci. Robot.","DOI":"10.1126\/scirobotics.aat5954"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/MRA.2019.2904121","article-title":"Robot-Enhanced Therapy: Development and Validation of Supervised Autonomous Robotic System for Autism Spectrum Disorders Therapy","volume":"26","author":"Cao","year":"2019","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1075\/pc.12.1.03dau","article-title":"Towards interactive robots in autism therapy: Background, motivation and challenges","volume":"12","author":"Dautenhahn","year":"2004","journal-title":"Pragmat. Cognit."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1146\/annurev-bioeng-071811-150036","article-title":"Robots for Use in Autism Research","volume":"14","author":"Scassellati","year":"2012","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders (DSM-5\u00ae), American Psychiatric Publishing.","DOI":"10.1176\/appi.books.9780890425596"},{"key":"ref_15","first-page":"217","article-title":"Autistic disturbances of affective contact","volume":"2","author":"Kanner","year":"1943","journal-title":"Nerv. Child"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/BF01537953","article-title":"Follow-up study of eleven autistic children originally reported in 1943","volume":"1","author":"Kanner","year":"1971","journal-title":"J. Autism Child. Schizophr."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/2040-2392-4-12","article-title":"DSM-5 and autism spectrum disorders (ASDs): an opportunity for identifying ASD subtypes","volume":"4","author":"Grzadzinski","year":"2013","journal-title":"Mol. Autism"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.pcl.2011.10.018","article-title":"Diagnostic Evaluation of Autism Spectrum Disorders","volume":"59","author":"Huerta","year":"2012","journal-title":"Pediatr. Clin. N. Am."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/j.paed.2012.09.008","article-title":"Diagnosing autism","volume":"23","author":"Yates","year":"2013","journal-title":"Paediatr. Child Health"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"820","DOI":"10.1177\/1362361315611109","article-title":"Experiences of diagnosing autism spectrum disorder: A survey of professionals in the United Kingdom","volume":"20","author":"Rogers","year":"2016","journal-title":"Autism"},{"key":"ref_21","unstructured":"Le Couteur, A., Lord, C., and Rutter, M. (2003). The Autism Diagnostic Interview-Revised (ADI-R), Western Psychological Services."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/BF02408436","article-title":"Toward objective classification of childhood autism: Childhood Autism Rating Scale (CARS)","volume":"10","author":"Schopler","year":"1980","journal-title":"J. Autism Dev. Disord."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1023\/A:1005592401947","article-title":"The Autism Diagnostic Observation Schedule\u2013Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism","volume":"30","author":"Lord","year":"2000","journal-title":"J. Autism Dev. Disord."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.bbr.2013.04.004","article-title":"Early identification of autism spectrum disorders","volume":"251","author":"Zwaigenbaum","year":"2013","journal-title":"Behav. Brain Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1007\/s00787-013-0375-0","article-title":"Diagnostic procedures in autism spectrum disorders: a systematic literature review","volume":"22","author":"Falkmer","year":"2013","journal-title":"Eur. Child Adolesc. Psychiatry"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1177\/1362361315573636","article-title":"Experiences of autism diagnosis: A survey of over 1000 parents in the United Kingdom","volume":"20","author":"Crane","year":"2015","journal-title":"Autism"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.compmedimag.2007.02.002","article-title":"Computer-aided diagnosis in medical imaging: Historical review, current status and future potential","volume":"31","author":"Doi","year":"2007","journal-title":"Comput. Med Imaging Graph."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.ultrasmedbio.2013.09.032","article-title":"Computer-Aided Diagnosis Based on Quantitative Elastographic Features with Supersonic Shear Wave Imaging","volume":"40","author":"Xiao","year":"2014","journal-title":"Ultrasound Med. Biol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"23","DOI":"10.20982\/tqmp.08.1.p023","article-title":"Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial","volume":"8","author":"Hallgren","year":"2012","journal-title":"Tutor. Quant. Methods Psychol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1159\/000474949","article-title":"The Interrater Reliability of the Autism Diagnostic Interview-Revised (ADI-R) in Clinical Settings","volume":"50","author":"Zander","year":"2017","journal-title":"Psychopathol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"769","DOI":"10.1007\/s00787-015-0793-2","article-title":"The objectivity of the Autism Diagnostic Observation Schedule (ADOS) in naturalistic clinical settings","volume":"25","author":"Zander","year":"2015","journal-title":"Eur. Child Adolesc. Psychiatry"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"O\u2019Brien, J., Spencer, J., Girges, C., Johnston, A., and Hill, H. (2014). Impaired Perception of Facial Motion in Autism Spectrum Disorder. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0102173"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1162\/089892901564289","article-title":"Abnormal Processing of Social Information from Faces in Autism","volume":"13","author":"Adolphs","year":"2001","journal-title":"J. Cognit. Neurosci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1016\/j.neubiorev.2014.10.011","article-title":"Impairments to visual disengagement in autism spectrum disorder: A review of experimental studies from infancy to adulthood","volume":"47","author":"Sacrey","year":"2014","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"eaat7544","DOI":"10.1126\/scirobotics.aat7544","article-title":"Improving social skills in children with ASD using a long-term, in-home social robot","volume":"3","author":"Scassellati","year":"2018","journal-title":"Sci. Robot."},{"key":"ref_36","unstructured":"Washington, P., Wall, D., Voss, C., Kline, A., Haber, N., Daniels, J., Fazel, A., De, T., Feinstein, C., and Winograd, T. (2020, January 31). SuperpowerGlass: A Wearable Aid for the At-Home Therapy of Children with Autism. Available online: https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130977."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1007\/s10803-014-2221-8","article-title":"Reducing the Need for Personal Supports Among Workers with Autism Using an iPod Touch as an Assistive Technology: Delayed Randomized Control Trial","volume":"45","author":"Gentry","year":"2014","journal-title":"J. Autism Dev. Disord."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Tang, Z., Guo, J., Miao, S., Acharya, S., and Feng, J.H. (2016, January 5\u20138). Ambient Intelligence Based Context-Aware Assistive System to Improve Independence for People with Autism Spectrum Disorder. Proceedings of the 2016 49th Hawaii International Conference on System Sciences (HICSS), Koloa, HI, USA.","DOI":"10.1109\/HICSS.2016.417"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Nakano, Y., and Ishii, R. (2010, January 7\u201310). Estimating user\u2019s engagement from eye-gaze behaviors in human-agent conversations. Proceedings of the 15th international conference on Intelligent user interfaces, Hong Kong, China.","DOI":"10.1145\/1719970.1719990"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Morency, L.P., Christoudias, C.M., and Darrell, T. (2006, January 2\u20134). Recognizing gaze aversion gestures in embodied conversational discourse. Proceedings of the 8th international conference on Multimodal interfaces, Banff, AB, Canada.","DOI":"10.1145\/1180995.1181051"},{"key":"ref_41","unstructured":"Zhu, X., and Ramanan, D. (2012, January 16\u201321). Face detection, pose estimation, and landmark localization in the wild. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1001\/archpsyc.65.8.946","article-title":"Absence of Preferential Looking to the Eyes of Approaching Adults Predicts Level of Social Disability in 2-Year-Old Toddlers With Autism Spectrum Disorder","volume":"65","author":"Jones","year":"2008","journal-title":"Arch. Gen. Psychiatry"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1038\/nature07868","article-title":"Two-year-olds with autism orient to non-social contingencies rather than biological motion","volume":"459","author":"Klin","year":"2009","journal-title":"Nature"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1016\/j.rasd.2013.05.007","article-title":"Patterns of gaze behavior during an eye-tracking measure of joint attention in typically developing children and children with autism spectrum disorder","volume":"7","author":"Swanson","year":"2013","journal-title":"Res. Autism Spectr. Disord."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Magrelli, S., Jermann, P., Noris, B., Ansermet, F., Hentsch, F., Nadel, J., and Billard, A. (2013). Social orienting of children with autism to facial expressions and speech: a study with a wearable eye-tracker in naturalistic settings. Front. Psychol., 4.","DOI":"10.3389\/fpsyg.2013.00840"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/j.jaac.2016.01.011","article-title":"Development of an Objective Autism Risk Index Using Remote Eye Tracking","volume":"55","author":"Frazier","year":"2016","journal-title":"J. Am. Acad. Child Adolesc. Psychiatry"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Noris, B., Nadel, J., Barker, M., Hadjikhani, N., and Billard, A. (2012). Investigating Gaze of Children with ASD in Naturalistic Settings. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0044144"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Petrushin, V.A. (2000, January 16\u201320). Emotion recognition in speech signal: experimental study, development, and application. Proceedings of the Sixth International Conference on Spoken Language Processing, Beijing, China.","DOI":"10.21437\/ICSLP.2000-791"},{"key":"ref_49","first-page":"38","article-title":"Recognizing emotion in speech using neural networks","volume":"31","author":"Dai","year":"2008","journal-title":"Telehealth Assist. Technol."},{"key":"ref_50","unstructured":"Li, Y., and Zhao, Y. (December, January 30). Recognizing emotions in speech using short-term and long-term features. Proceedings of the Fifth International Conference on Spoken Language Processing, Sydney, Australia."},{"key":"ref_51","unstructured":"Litman, D., and Forbes, K. (December, January 30). Recognizing emotions from student speech in tutoring dialogues. Proceedings of the 2003 IEEE Workshop on Automatic Speech Recognition and Understanding, St Thomas, VI, USA."},{"key":"ref_52","unstructured":"Hsiao, J.C.y., Jih, W.r., and Hsu, J.Y.j. (2012, January 22\u201326). Recognizing continuous social engagement level in dyadic conversation by using turn-taking and speech emotion patterns. Proceedings of the Workshops at the Twenty-Sixth AAAI Conference on Artificial Intelligence, Toronto, ON, Canada."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"13354","DOI":"10.1073\/pnas.1003882107","article-title":"Automated vocal analysis of naturalistic recordings from children with autism, language delay, and typical development","volume":"107","author":"Oller","year":"2010","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1016\/j.specom.2007.02.006","article-title":"Automatic speech recognition and speech variability: A review","volume":"49","author":"Benzeghiba","year":"2007","journal-title":"Speech Commun."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1016\/j.specom.2007.01.002","article-title":"Acoustic Variability and Automatic Recognition of Children\u2019s Speech","volume":"49","author":"Gerosa","year":"2007","journal-title":"Speech Commun."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Kennedy, J., Lemaignan, S., Montassier, C., Lavalade, P., Irfan, B., Papadopoulos, F., Senft, E., and Belpaeme, T. (2017, January 6\u20139). Child Speech Recognition in Human-Robot Interaction. Proceedings of the 2017 ACM\/IEEE International Conference on Human-Robot Interaction, Vienna, Austria.","DOI":"10.1145\/2909824.3020229"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2000000001","article-title":"Introduction to Digital Speech Processing","volume":"1","author":"Rabiner","year":"2007","journal-title":"Found. Trends Signal Process."},{"key":"ref_58","first-page":"1","article-title":"Voice Activity Detection. Fundamentals and Speech Recognition System Robustness","volume":"Volume 6","author":"Ramirez","year":"2007","journal-title":"Robust Speech Recognition and Understanding"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","article-title":"Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups","volume":"29","author":"Hinton","year":"2012","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1016\/j.specom.2007.01.011","article-title":"Spoken language processing: Piecing together the puzzle","volume":"49","author":"Moore","year":"2007","journal-title":"Speech Commun."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.csl.2015.03.009","article-title":"Robust speaker localization for real-world robots","volume":"34","author":"Athanasopoulos","year":"2015","journal-title":"Comput. Speech Lang."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1044\/1092-4388(2001\/087)","article-title":"Speech and Prosody Characteristics of Adolescents and Adults With High-Functioning Autism and Asperger Syndrome","volume":"44","author":"Shriberg","year":"2001","journal-title":"J. Speech Lang. Hear. Res."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/S1071-9091(97)80024-1","article-title":"Language disorders in children with autism","volume":"4","author":"Rapin","year":"1997","journal-title":"Semin. Pediatr. Neurol."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1023\/A:1005531501155","article-title":"Vocal Atypicalities of Preverbal Autistic Children","volume":"30","author":"Sheinkopf","year":"2000","journal-title":"J. Autism Dev. Disord."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/s10803-004-1999-1","article-title":"Perception and Production of Prosody by Speakers with Autism Spectrum Disorders","volume":"35","author":"Paul","year":"2005","journal-title":"J. Autism Dev. Disord."},{"key":"ref_66","unstructured":"Centres for Disease Control and Prevention (2020, January 31). Autism Spectrum Disorder (ASD): Data and Statistics, Available online: https:\/\/www.cdc.gov\/ncbddd\/autism\/data.html."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1007\/s10803-009-0902-5","article-title":"What Automated Vocal Analysis Reveals About the Vocal Production and Language Learning Environment of Young Children with Autism","volume":"40","author":"Warren","year":"2009","journal-title":"J. Autism Dev. Disord."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.cviu.2006.08.002","article-title":"A survey of advances in vision-based human motion capture and analysis","volume":"104","author":"Moeslund","year":"2006","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1318","DOI":"10.1109\/TCYB.2013.2265378","article-title":"Enhanced Computer Vision With Microsoft Kinect Sensor: A Review","volume":"43","author":"Han","year":"2013","journal-title":"IEEE Trans. Cybern."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Suarez, J., and Murphy, R.R. (2012, January 9\u201313). Hand gesture recognition with depth images: A review. Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication, Paris, France.","DOI":"10.1109\/ROMAN.2012.6343787"},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1109\/TSMCC.2007.893280","article-title":"Gesture Recognition: A Survey","volume":"37","author":"Mitra","year":"2007","journal-title":"IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.)"},{"key":"ref_72","unstructured":"Castellano, G., Villalba, S.D., and Camurri, A. (2007, January 12\u201314). Recognising human emotions from body movement and gesture dynamics. Proceedings of the International Conference on Affective Computing and Intelligent Interaction, Lisbon, Portugal."},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Saha, S., Datta, S., Konar, A., and Janarthanan, R. (2014, January 10\u201312). A study on emotion recognition from body gestures using Kinect sensor. Proceedings of the 2014 International Conference on Communication and Signal Processing, Bangkok, Thailan.","DOI":"10.1109\/ICCSP.2014.6949798"},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Elfaramawy, N., Barros, P., Parisi, G.I., and Wermter, S. (2017, January 17\u201320). Emotion recognition from body expressions with a neural network architecture. Proceedings of the 5th International Conference on Human Agent Interaction, Bielefeld, Germany.","DOI":"10.1145\/3125739.3125772"},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Sanghvi, J., Castellano, G., Leite, I., Pereira, A., McOwan, P.W., and Paiva, A. (2011, January 6\u20139). Automatic analysis of affective postures and body motion to detect engagement with a game companion. Proceedings of the 6th International Conference on Human-Robot Interaction, Lausanne, Switzerland.","DOI":"10.1145\/1957656.1957781"},{"key":"ref_76","first-page":"7","article-title":"Recognition of emotions by the emotional feedback through behavioral human poses","volume":"12","author":"Larsson","year":"2015","journal-title":"Int. J. Comput. Sci. Issues"},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Okada, S., Aran, O., and Gatica-Perez, D. (2015, January 9\u201313). Personality trait classification via co-occurrent multiparty multimodal event discovery. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, WA, USA.","DOI":"10.1145\/2818346.2820757"},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Ramey, A., Gonz\u00e1lez-Pacheco, V., and Salichs, M.A. (2011, January 6\u20139). Integration of a low-cost RGB-D sensor in a social robot for gesture recognition. Proceedings of the 6th ACM\/IEEE International Conference on Human-Robot Interaction (HRI), Lausanne, Switzerland.","DOI":"10.1145\/1957656.1957745"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1002\/aur.1587","article-title":"Early gross motor skills predict the subsequent development of language in children with autism spectrum disorder","volume":"9","author":"Bedford","year":"2015","journal-title":"Autism Res."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.rasd.2014.12.012","article-title":"Predicting the rate of language development from early motor skills in at-risk infants who develop autism spectrum disorder","volume":"13\u201314","author":"Leonard","year":"2015","journal-title":"Res. Autism Spectr. Disord."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"1383","DOI":"10.1016\/j.rasd.2013.07.020","article-title":"The relationship of motor skills and adaptive behavior skills in young children with autism spectrum disorders","volume":"7","author":"MacDonald","year":"2013","journal-title":"Res. Autism Spectr. Disord."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1111\/infa.12242","article-title":"Walking Ability is Associated with Social Communication Skills in Infants at High Risk for Autism Spectrum Disorder","volume":"23","author":"Bradshaw","year":"2018","journal-title":"Infancy"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1016\/j.braindev.2007.03.002","article-title":"Prevalence of motor impairment in autism spectrum disorders","volume":"29","author":"Ming","year":"2007","journal-title":"Brain Dev."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"57","DOI":"10.5014\/ajot.2014.008664","article-title":"Effects of Exergaming on Executive Function and Motor Skills in Children With Autism Spectrum Disorder: A Pilot Study","volume":"68","author":"Hilton","year":"2013","journal-title":"Am. J. Occup. Ther."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1007\/s10803-010-0981-3","article-title":"Motor Coordination in Autism Spectrum Disorders: A Synthesis and Meta-Analysis","volume":"40","author":"Fournier","year":"2010","journal-title":"J. Autism Dev. Disord."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1016\/S0006-3223(00)01008-8","article-title":"Evidence for a cerebellar role in reduced exploration and stereotyped behavior in autism","volume":"49","author":"Pierce","year":"2001","journal-title":"Biol. Psychiatry"},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"2056","DOI":"10.1212\/01.WNL.0000145771.98657.62","article-title":"Underdevelopment of the postural control system in autism","volume":"63","author":"Minshew","year":"2004","journal-title":"Neurology"},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1023\/A:1005617831035","article-title":"Movement Preparation in High-Functioning Autism and Asperger Disorder: A Serial Choice Reaction Time Task Involving Motor Reprogramming","volume":"31","author":"Rinehart","year":"2001","journal-title":"J. Autism Dev. Disord."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"2816","DOI":"10.1093\/brain\/awt208","article-title":"Atypical basic movement kinematics in autism spectrum conditions","volume":"136","author":"Cook","year":"2013","journal-title":"Brain"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"31107","DOI":"10.1038\/srep31107","article-title":"Toward the Autism Motor Signature: Gesture patterns during smart tablet gameplay identify children with autism","volume":"6","author":"Anzulewicz","year":"2016","journal-title":"Sci. Rep."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"1216","DOI":"10.1016\/j.jaac.2014.08.004","article-title":"Repetitive Behavior in 12-Month-Olds Later Classified With Autism Spectrum Disorder","volume":"53","author":"Elison","year":"2014","journal-title":"J. Am. Acad. Child Adolesc. Psychiatry"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Petric, F., Hrvatinic, K., Babic, A., Malovan, L., Miklic, D., Kovacic, Z., Cepanec, M., Stosic, J., and Simlesa, S. (2014, January 10\u201313). Four tasks of a robot-assisted autism spectrum disorder diagnostic protocol: First clinical tests. Proceedings of the IEEE Global Humanitarian Technology Conference (GHTC 2014), San Francisco, CA, USA.","DOI":"10.1109\/GHTC.2014.6970331"},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014, January 1\u20134). Caffe: Convolutional Architecture for Fast Feature Embedding. Proceedings of the ACM International Conference on Multimedia, Glasgow, UK.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Michel, P., and El Kaliouby, R. (2003, January 5\u20137). Real time facial expression recognition in video using support vector machines. Proceedings of the 5th international conference on Multimodal interfaces, Vancouver, BC, Canada.","DOI":"10.1145\/958432.958479"},{"key":"ref_95","unstructured":"Bartlett, M.S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., and Movellan, J. (2005, January 20\u201325). Recognizing facial expression: machine learning and application to spontaneous behavior. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Bargal, S.A., Barsoum, E., Ferrer, C.C., and Zhang, C. (2016, January 12\u201316). Emotion recognition in the wild from videos using images. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.","DOI":"10.1145\/2993148.2997627"},{"key":"ref_97","unstructured":"Littlewort, G., Bartlett, M.S., Fasel, I.R., Chenu, J., Kanda, T., Ishiguro, H., and Movellan, J.R. (2004). Towards social robots: Automatic evaluation of human-robot interaction by facial expression classification. Adv. Neural Inf. Process. Syst., 1563\u20131570."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"5160","DOI":"10.1016\/j.eswa.2013.03.016","article-title":"Intelligent facial emotion recognition and semantic-based topic detection for a humanoid robot","volume":"40","author":"Zhang","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"1548","DOI":"10.1109\/TPAMI.2016.2515606","article-title":"Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications","volume":"38","author":"Corneanu","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_100","unstructured":"Nezami, O.M., Dras, M., Hamey, L., Richards, D., Wan, S., and Paris, C. (2018). Automatic Recognition of Student Engagement using Deep Learning and Facial Expression. arXiv."},{"key":"ref_101","unstructured":"Liu, T., and Kappas, A. (2018, January 2\u20137). Predicting Engagement Breakdown in HRI Using Thin-slices of Facial Expressions. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA."},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1037\/a0022758","article-title":"Happy mouth and sad eyes: Scanning emotional facial expressions","volume":"11","author":"Eisenbarth","year":"2011","journal-title":"Emotion"},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1002\/aur.1730","article-title":"Autism and emotional face-viewing","volume":"10","author":"Hovey","year":"2017","journal-title":"Autism Res."},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1037\/h0030377","article-title":"Constants across cultures in the face and emotion","volume":"17","author":"Ekman","year":"1971","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"1424","DOI":"10.1109\/34.895976","article-title":"Automatic analysis of facial expressions: the state of the art","volume":"22","author":"Pantie","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/TPAMI.2008.52","article-title":"A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions","volume":"31","author":"Zeng","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1177\/1362361313476767","article-title":"Innovative technology-based interventions for autism spectrum disorders: A meta-analysis","volume":"18","author":"Grynszpan","year":"2013","journal-title":"Autism"},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.neubiorev.2019.01.022","article-title":"Attention-deficit\/hyperactivity disorder and task-related heart rate variability: A systematic review and meta-analysis","volume":"99","author":"Robe","year":"2019","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_109","doi-asserted-by":"crossref","unstructured":"Baxter, P., Lemaignan, S., and Trafton, J.G. (2016, January 7\u201310). Cognitive Architectures for Social Human-Robot Interaction. Proceedings of the Eleventh ACM\/IEEE International Conference on Human Robot Interaction, Christchurch, New Zealand.","DOI":"10.1109\/HRI.2016.7451865"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/2\/81\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:53:42Z","timestamp":1760172822000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/2\/81"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,1]]},"references-count":109,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["info11020081"],"URL":"https:\/\/doi.org\/10.3390\/info11020081","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,1]]}}}