{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,3]],"date-time":"2026-01-03T15:21:13Z","timestamp":1767453673344,"version":"3.37.3"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"11-12","license":[{"start":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T00:00:00Z","timestamp":1731024000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T00:00:00Z","timestamp":1731024000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100010790","name":"Erasmus+","doi-asserted-by":"publisher","award":["2019-1-PL01-KA203-065096"],"award-info":[{"award-number":["2019-1-PL01-KA203-065096"]}],"id":[{"id":"10.13039\/501100010790","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J of Soc Robotics"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper concerns the methodology of multi-modal data acquisition in observing emotions experienced by children with autism while they interact with a social robot. As robot-enhanced therapy gains more and more attention and proved to be effective in autism, such observations might influence the future development and use of such technologies. The paper is based on an observational study of child-robot interaction, during which multiple modalities were captured and then analyzed to retrieve information on a child\u2019s emotional state. Over 30 children on the autism spectrum from Macedonia, Turkey, Poland, and the United Kingdom took part in our study and interacted with the social robot Kaspar. We captured facial expressions\/body posture, voice\/vocalizations, physiological signals, and eyegaze-related data. The main contribution of the paper is reporting challenges and lessons learned with regard to interaction, its environment, and observation channels typically used for emotion estimation. The main challenge is the limited availability of channels, especially eyegaze-related (29%) and voice-related (6%) data are not available throughout the entire session. The challenges are of a diverse nature\u2014we distinguished task-based, child-based, and environment-based ones. Choosing the tasks (scenario) and adapting environment, such as room, equipment, accompanying person, is crucial but even with those works done, the child-related challenge is the most important one. Therapists have pointed out to a good potential of those technologies, however, the main challenge to keep a child engaged and focused, remains. The technology must follow a child\u2019s interest, movement, and mood. The main observations are the necessity to train personalized models of emotions as children with autism differ in level of skills and expressions, and emotion recognition technology adaptation in real time (e.\u00a0g., switching modalities) to capture variability in emotional outcomes.<\/jats:p>","DOI":"10.1007\/s12369-024-01185-3","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T17:23:15Z","timestamp":1731086595000},"page":"2261-2276","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Challenges in Observing the Emotions of Children with Autism Interacting with a Social Robot"],"prefix":"10.1007","volume":"16","author":[{"given":"Duygun","family":"Erol Barkana","sequence":"first","affiliation":[]},{"given":"Katrin D.","family":"Bartl-Pokorny","sequence":"additional","affiliation":[]},{"given":"Hatice","family":"Kose","sequence":"additional","affiliation":[]},{"given":"Agnieszka","family":"Landowska","sequence":"additional","affiliation":[]},{"given":"Manuel","family":"Milling","sequence":"additional","affiliation":[]},{"given":"Ben","family":"Robins","sequence":"additional","affiliation":[]},{"given":"Bj\u00f6rn W.","family":"Schuller","sequence":"additional","affiliation":[]},{"given":"Pinar","family":"Uluer","sequence":"additional","affiliation":[]},{"given":"Michal R.","family":"Wrobel","sequence":"additional","affiliation":[]},{"given":"Tatjana","family":"Zorcec","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"issue":"02","key":"1185_CR1","first-page":"52","volume":"2","author":"SMSA Abdullah","year":"2021","unstructured":"Abdullah SMSA, Ameen SYA, Sadeeq MA et al (2021) Multimodal emotion recognition using deep learning. J Appl Sci Technol Trends 2(02):52\u201358","journal-title":"J Appl Sci Technol Trends"},{"key":"1185_CR2","doi-asserted-by":"publisher","unstructured":"Akta\u015f SNB, Uluer P, Co\u015fkun B, et\u00a0al. (2022) Stress detection of children with asd using physiological signals. In: 2022 30th Signal Processing and Communications Applications Conference (SIU), pp 1\u20134, https:\/\/doi.org\/10.1109\/SIU55565.2022.9864668","DOI":"10.1109\/SIU55565.2022.9864668"},{"issue":"8","key":"1185_CR3","doi-asserted-by":"publisher","first-page":"618","DOI":"10.3390\/bs13080618","volume":"13","author":"A Al-Nafjan","year":"2023","unstructured":"Al-Nafjan A, Alhakbani N, Alabdulkareem A (2023) Measuring engagement in robot-assisted therapy for autistic children. Behav Sci 13(8):618. https:\/\/doi.org\/10.3390\/bs13080618","journal-title":"Behav Sci"},{"issue":"4","key":"1185_CR4","first-page":"1324","volume":"8","author":"MF Alghifari","year":"2019","unstructured":"Alghifari MF, Gunawan TS, Qadri SAA et al (2019) On the use of voice activity detection in speech emotion recognition. Bull Electr Eng Inf 8(4):1324\u20131332","journal-title":"Bull Electr Eng Inf"},{"key":"1185_CR5","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1007\/s12369-020-00639-8","volume":"13","author":"F Alnajjar","year":"2021","unstructured":"Alnajjar F, Cappuccio M, Renawi A et al (2021) Personalized robot interventions for autistic children: an automated methodology for attention assessment. Int J Soc Robot 13:67\u201382. https:\/\/doi.org\/10.1007\/s12369-020-00639-8","journal-title":"Int J Soc Robot"},{"key":"1185_CR6","doi-asserted-by":"publisher","DOI":"10.1176\/appi.books.9780890425596","volume-title":"Diagnostic and statistical manual of mental disorders: DSM-5","author":"D American Psychiatric Association","year":"2013","unstructured":"American Psychiatric Association D, Association AP et al (2013) Diagnostic and statistical manual of mental disorders: DSM-5, vol 5. American psychiatric association Washington, DC, USA"},{"issue":"4","key":"1185_CR7","doi-asserted-by":"publisher","first-page":"2296","DOI":"10.1166\/asl.2018.10939","volume":"24","author":"AA Aziz","year":"2018","unstructured":"Aziz AA, Mokhsin M, Moganan FFM et al (2018) Humanoid-robot as teaching mediator: Research model in demonstrating the autistic children learning motivation based on the emotional responses. Adv Sci Lett 24(4):2296\u20132300. https:\/\/doi.org\/10.1166\/asl.2018.10939","journal-title":"Adv Sci Lett"},{"key":"1185_CR8","doi-asserted-by":"publisher","unstructured":"Banire B, Al\u00a0Thani D, Qaraqe M (2023) One size does not fit all: detecting attention in children with autism using machine learning. User Modeling and User-Adapted Interaction pp 1\u201333. https:\/\/doi.org\/10.1007\/s11257-023-09371-0","DOI":"10.1007\/s11257-023-09371-0"},{"key":"1185_CR9","doi-asserted-by":"publisher","first-page":"165433","DOI":"10.1109\/ACCESS.2021.3132785","volume":"9","author":"KD Bartl-Pokorny","year":"2021","unstructured":"Bartl-Pokorny KD, Pyka\u0142a M, Uluer P et al (2021) Robot-based intervention for children with autism spectrum disorder: a systematic literature review. IEEE Access 9:165433\u2013165450. https:\/\/doi.org\/10.1109\/ACCESS.2021.3132785","journal-title":"IEEE Access"},{"key":"1185_CR10","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1519\/R-20135.1","volume":"21","author":"D Berkoff","year":"2007","unstructured":"Berkoff D, Cairns C, Sanchez L et al (2007) Heart rate variability in elite American track and field athletes. J Strength Cond Res\/ Natl Strength Cond Assoc 21:227\u201331. https:\/\/doi.org\/10.1519\/R-20135.1","journal-title":"J Strength Cond Res\/ Natl Strength Cond Assoc"},{"key":"1185_CR11","doi-asserted-by":"publisher","unstructured":"Brodny G, Ko\u0142akowska A, Landowska A, et\u00a0al. (2016) Comparison of selected off-the-shelf solutions for emotion recognition based on facial expressions. In: 2016 9th International Conference on Human System Interactions (HSI), IEEE, pp 397\u2013404, https:\/\/doi.org\/10.1109\/HSI.2016.7529664","DOI":"10.1109\/HSI.2016.7529664"},{"key":"1185_CR12","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1007\/s12369-013-0202-2","volume":"5","author":"JJ Cabibihan","year":"2013","unstructured":"Cabibihan JJ, Javed H, Ang M et al (2013) Why robots? a survey on the roles and benefits of social robots in the therapy of children with autism. Int J Soc Robot 5:593\u2013618. https:\/\/doi.org\/10.1007\/s12369-013-0202-2","journal-title":"Int J Soc Robot"},{"key":"1185_CR13","doi-asserted-by":"publisher","first-page":"13229","DOI":"10.1109\/ACCESS.2022.3146729","volume":"10","author":"J Chen","year":"2022","unstructured":"Chen J, Ro T, Zhu Z (2022) Emotion recognition with audio, video, EEG, and EMG: a dataset and baseline approaches. IEEE Access 10:13229\u201313242. https:\/\/doi.org\/10.1109\/ACCESS.2022.3146729","journal-title":"IEEE Access"},{"key":"1185_CR14","doi-asserted-by":"publisher","unstructured":"Co\u015fkun B, Uluer P, Toprak E, et\u00a0al. (2022) Stress detection of children with autism using physiological signals in kaspar robot-based intervention studies. In: 2022 9th IEEE RAS\/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob), pp 01\u201307, https:\/\/doi.org\/10.1109\/BioRob52689.2022.9925485","DOI":"10.1109\/BioRob52689.2022.9925485"},{"key":"1185_CR15","doi-asserted-by":"publisher","unstructured":"English BA, Coates A, Howard A (2017) Recognition of gestural behaviors expressed by humanoid robotic platforms for teaching affect recognition to children with autism-a healthy subjects pilot study. In: Social Robotics: 9th International Conference, ICSR 2017, Tsukuba, Japan, November 22-24, 2017, Proceedings 9, Springer, pp 567\u2013576, https:\/\/doi.org\/10.1007\/978-3-319-70022-9_56","DOI":"10.1007\/978-3-319-70022-9_56"},{"key":"1185_CR16","doi-asserted-by":"publisher","unstructured":"Fazli C (2019) Pediatric heart rate variability normative values related to average heart rate and age in a developing country. J Cardiovas Res 2. https:\/\/doi.org\/10.33552\/OJCR.2019.02.000547","DOI":"10.33552\/OJCR.2019.02.000547"},{"key":"1185_CR17","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-022-05796-5","author":"V Holeva","year":"2022","unstructured":"Holeva V, Nikopoulou V, Lytridis C et al (2022) Effectiveness of a robot-assisted psychological intervention for children with autism spectrum disorder. J Autism Dev Disord. https:\/\/doi.org\/10.1007\/s10803-022-05796-5","journal-title":"J Autism Dev Disord"},{"key":"1185_CR18","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1007\/s12369-018-0508-1","volume":"11","author":"LI Ismail","year":"2019","unstructured":"Ismail LI, Verhoeven T, Dambre J et al (2019) Leveraging robotics research for children with autism: a review. Int J Soc Robot 11:389\u2013410. https:\/\/doi.org\/10.1007\/s12369-018-0508-1","journal-title":"Int J Soc Robot"},{"key":"1185_CR19","first-page":"152","volume":"20","author":"M Karabulut","year":"2015","unstructured":"Karabulut M (2015) Sal\u0131kl\u0131 \u00c7ocuklarda kalp h\u0131z\u0131 dei\u015fkenlii. F\u0131rat Med J 20:152\u201355","journal-title":"F\u0131rat Med J"},{"issue":"01","key":"1185_CR20","doi-asserted-by":"publisher","first-page":"1450003","DOI":"10.1142\/S0219843614500030","volume":"11","author":"H Kose","year":"2014","unstructured":"Kose H, Akalin N, Uluer P (2014) Socially interactive robotic platforms as sign language tutors. Int J Humanoid Rob 11(01):1450003. https:\/\/doi.org\/10.1142\/S0219843614500030","journal-title":"Int J Humanoid Rob"},{"issue":"6","key":"1185_CR21","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0269800","volume":"17","author":"A Kouroupa","year":"2022","unstructured":"Kouroupa A, Laws KR, Irvine K et al (2022) The use of social robots with children and young people on the autism spectrum: A systematic review and meta-analysis. PLoS ONE 17(6):e0269800. https:\/\/doi.org\/10.1371\/journal.pone.0269800","journal-title":"PLoS ONE"},{"key":"1185_CR22","doi-asserted-by":"publisher","unstructured":"Landowska A, Robins B (2020) Robot eye perspective in perceiving facial expressions in interaction with children with autism. In: Web, Artificial Intelligence and Network Applications: Proceedings of the Workshops of the 34th International Conference on Advanced Information Networking and Applications (WAINA-2020), Springer, pp 1287\u20131297, https:\/\/doi.org\/10.1007\/978-3-030-44038-1_117","DOI":"10.1007\/978-3-030-44038-1_117"},{"issue":"4","key":"1185_CR23","doi-asserted-by":"publisher","first-page":"1649","DOI":"10.3390\/s22041649","volume":"22","author":"A Landowska","year":"2022","unstructured":"Landowska A, Karpus A, Zawadzka T et al (2022) Automatic emotion recognition in children with autism: a systematic literature review. Sensors 22(4):1649. https:\/\/doi.org\/10.3390\/s22041649","journal-title":"Sensors"},{"issue":"8","key":"1185_CR24","doi-asserted-by":"publisher","first-page":"2384","DOI":"10.3390\/s20082384","volume":"20","author":"JZ Lim","year":"2020","unstructured":"Lim JZ, Mountstephens J, Teo J (2020) Emotion recognition using eye-tracking: taxonomy, review and current challenges. Sensors 20(8):2384. https:\/\/doi.org\/10.3390\/s20082384","journal-title":"Sensors"},{"issue":"4","key":"1185_CR25","doi-asserted-by":"publisher","first-page":"883","DOI":"10.1109\/tro.2008.2001362","volume":"24","author":"C Liu","year":"2008","unstructured":"Liu C, Conn K, Sarkar N et al (2008) Online affect detection and robot behavior adaptation for intervention of children with autism. IEEE Trans Rob 24(4):883\u2013896. https:\/\/doi.org\/10.1109\/tro.2008.2001362","journal-title":"IEEE Trans Rob"},{"key":"1185_CR26","doi-asserted-by":"publisher","DOI":"10.3390\/electronics9020367","author":"E Martinez-Martin","year":"2020","unstructured":"Martinez-Martin E, Escalona F, Cazorla M (2020) Socially assistive robots for older adults and people with autism: an overview. Electronics. https:\/\/doi.org\/10.3390\/electronics9020367","journal-title":"Electronics"},{"key":"1185_CR27","doi-asserted-by":"publisher","DOI":"10.3389\/fcomp.2022.837269","author":"M Milling","year":"2022","unstructured":"Milling M, Baird A, Bartl-Pokorny KD et al (2022) Evaluating the impact of voice activity detection on speech emotion recognition for autistic children. Front Comput Sci. https:\/\/doi.org\/10.3389\/fcomp.2022.837269","journal-title":"Front Comput Sci"},{"key":"1185_CR28","doi-asserted-by":"publisher","unstructured":"Milling M, Bartl-Pokorny KD, Schuller BW (2022b) Investigating automatic speech emotion recognition for children with autism spectrum disorder in interactive intervention sessions with the social robot kaspar. medRxiv pp 2022\u201302. https:\/\/doi.org\/10.1101\/2022.02.24.22271443","DOI":"10.1101\/2022.02.24.22271443"},{"key":"1185_CR29","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2022.886615","volume":"4","author":"M Milling","year":"2022","unstructured":"Milling M, Pokorny FB, Bartl-Pokorny KD et al (2022) Is speech the new blood? recent progress in ai-based disease detection from audio in a nutshell. Front Digit Health 4:886615. https:\/\/doi.org\/10.3389\/fdgth.2022.886615","journal-title":"Front Digit Health"},{"issue":"2","key":"1185_CR30","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1002\/aur.1527","volume":"9","author":"P Pennisi","year":"2016","unstructured":"Pennisi P, Tonacci A, Tartarisco G et al (2016) Autism and social robotics: A systematic review. Autism Res 9(2):165\u2013183. https:\/\/doi.org\/10.1002\/aur.1527","journal-title":"Autism Res"},{"issue":"03","key":"1185_CR31","doi-asserted-by":"publisher","first-page":"1350025","DOI":"10.1142\/s0219843613500254","volume":"10","author":"CA Pop","year":"2013","unstructured":"Pop CA, Simut R, Pintea S et al (2013) Can the social robot probo help children with autism to identify situation-based emotions? a series of single case experiments. Int J Humanoid Rob 10(03):1350025. https:\/\/doi.org\/10.1142\/s0219843613500254","journal-title":"Int J Humanoid Rob"},{"key":"1185_CR32","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2017.00036","author":"O Rudovic","year":"2017","unstructured":"Rudovic O, Lee J, Mascarell-Maricic L et al (2017) Measuring engagement in robot-assisted autism therapy: A cross-cultural study. Front Robot AI. https:\/\/doi.org\/10.3389\/frobt.2017.00036","journal-title":"Front Robot AI"},{"issue":"19","key":"1185_CR33","doi-asserted-by":"publisher","first-page":"eaao6760","DOI":"10.1126\/scirobotics.aao6760","volume":"3","author":"O Rudovic","year":"2018","unstructured":"Rudovic O, Lee J, Dai M et al (2018) Personalized machine learning for robot perception of affect and engagement in autism therapy. Sci Robot 3(19):eaao6760. https:\/\/doi.org\/10.1126\/scirobotics.aao6760","journal-title":"Sci Robot"},{"issue":"5","key":"1185_CR34","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1080\/1034912X.2021.1905153","volume":"70","author":"S Sani-Bozkurt","year":"2023","unstructured":"Sani-Bozkurt S, Bozkus-Genc G (2023) Social robots for joint attention development in autism spectrum disorder: A systematic review. Int J Disabil Dev Educ 70(5):625\u2013643. https:\/\/doi.org\/10.1080\/1034912X.2021.1905153","journal-title":"Int J Disabil Dev Educ"},{"key":"1185_CR35","doi-asserted-by":"publisher","DOI":"10.1111\/cpf.12096","author":"S Sepp\u00e4l\u00e4","year":"2013","unstructured":"Sepp\u00e4l\u00e4 S, Laitinen T, Tarvainen M et al (2013) Normal values for heart rate variability parameters in children 6\u20138 years of age: The panic study. Clin Physiol Funct Imag. https:\/\/doi.org\/10.1111\/cpf.12096","journal-title":"Clin Physiol Funct Imag"},{"issue":"4","key":"1185_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3526111","volume":"11","author":"Z Shi","year":"2022","unstructured":"Shi Z, Groechel TR, Jain S et al (2022) Toward personalized affect-aware socially assistive robot tutors for long-term interventions with children with autism. ACM Trans Human-Robot Interact (THRI) 11(4):1\u201328. https:\/\/doi.org\/10.1145\/3526111","journal-title":"ACM Trans Human-Robot Interact (THRI)"},{"key":"1185_CR37","doi-asserted-by":"publisher","unstructured":"Silva S, Soares F, Costa S, et\u00a0al. (2012) Development of skills in children with ASD using a robotic platform. In: 2012 IEEE 2nd Portuguese Meeting in Bioengineering (ENBENG). IEEE, pp 1\u20134, https:\/\/doi.org\/10.1109\/enbeng.2012.6331347","DOI":"10.1109\/enbeng.2012.6331347"},{"key":"1185_CR38","doi-asserted-by":"publisher","unstructured":"Silvetti M, Drago F, Ragonese P (2002) Heart rate variability in healthy children and adolescents is partially related to age and gender. Int J Cardiol 81:169\u201374. https:\/\/doi.org\/10.1016\/S0167-5273(01)00537-X","DOI":"10.1016\/S0167-5273(01)00537-X"},{"key":"1185_CR39","doi-asserted-by":"publisher","unstructured":"Stappen L, Baird A, Christ L, et\u00a0al. (2021) The MuSe 2021 multimodal sentiment analysis challenge: sentiment, emotion, physiological-emotion, and stress. In: Proceedings of the 2nd on Multimodal Sentiment Analysis Challenge. p 5\u201314, https:\/\/doi.org\/10.1145\/3475957.3484450","DOI":"10.1145\/3475957.3484450"},{"key":"1185_CR40","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/2909267","author":"P Tarnowski","year":"2020","unstructured":"Tarnowski P, Ko\u0142odziej M, Majkowski A et al (2020) Eye-tracking analysis for emotion recognition. Comput Intell Neurosci. https:\/\/doi.org\/10.1155\/2020\/2909267","journal-title":"Comput Intell Neurosci"},{"key":"1185_CR41","doi-asserted-by":"publisher","unstructured":"Tiinanen S, M\u00e4tt\u00e4 A, Silfverhuth M, et\u00a0al. (2011) HRV and EEG based indicators of stress in children with Asperger syndrome in audio-visual stimulus test. In: 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, IEEE, pp 2021\u20132024, https:\/\/doi.org\/10.1109\/IEMBS.2011.6090371","DOI":"10.1109\/IEMBS.2011.6090371"},{"key":"1185_CR42","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2023.3263585","author":"J Wagner","year":"2023","unstructured":"Wagner J, Triantafyllopoulos A, Wierstorf H et al (2023) Dawn of the transformer era in speech emotion recognition: closing the valence gap. IEEE Trans Pattern Anal Mach Intell. https:\/\/doi.org\/10.1109\/TPAMI.2023.3263585","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"1185_CR43","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1007\/s12369-019-00563-6","volume":"13","author":"LJ Wood","year":"2021","unstructured":"Wood LJ, Zaraki A, Robins B et al (2021) Developing kaspar: a humanoid robot for children with autism. Int J Soc Robot 13:491\u2013508. https:\/\/doi.org\/10.1007\/s12369-019-00563-6","journal-title":"Int J Soc Robot"},{"key":"1185_CR44","doi-asserted-by":"publisher","unstructured":"Yun SS, Choi J, Park SK (2016) Robotic behavioral intervention to facilitate eye contact and reading emotions of children with autism spectrum disorders. In: 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp 694\u2013699, https:\/\/doi.org\/10.1109\/ROMAN.2016.7745194","DOI":"10.1109\/ROMAN.2016.7745194"},{"key":"1185_CR45","doi-asserted-by":"publisher","unstructured":"Zeng Z, Pantic M, Roisman GI, et\u00a0al. (2007) A survey of affect recognition methods: audio, visual and spontaneous expressions. In: Proceedings of the 9th international conference on Multimodal interfaces, pp 126\u2013133, https:\/\/doi.org\/10.1145\/1322192.1322216","DOI":"10.1145\/1322192.1322216"},{"key":"1185_CR46","doi-asserted-by":"publisher","unstructured":"Zheng WL, Dong BN, Lu BL (2014) Multimodal emotion recognition using eeg and eye tracking data. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp 5040\u20135043, https:\/\/doi.org\/10.1109\/EMBC.2014.6944757","DOI":"10.1109\/EMBC.2014.6944757"}],"container-title":["International Journal of Social Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-024-01185-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12369-024-01185-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-024-01185-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,19]],"date-time":"2024-12-19T17:11:16Z","timestamp":1734628276000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12369-024-01185-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,8]]},"references-count":46,"journal-issue":{"issue":"11-12","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["1185"],"URL":"https:\/\/doi.org\/10.1007\/s12369-024-01185-3","relation":{},"ISSN":["1875-4791","1875-4805"],"issn-type":[{"type":"print","value":"1875-4791"},{"type":"electronic","value":"1875-4805"}],"subject":[],"published":{"date-parts":[[2024,11,8]]},"assertion":[{"value":"14 October 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 November 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}