{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T09:07:43Z","timestamp":1789117663496,"version":"build-2803163510"},"reference-count":138,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T00:00:00Z","timestamp":1789084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Physical human\u2013robot interaction involves a tightly coupled cognitive interaction with the user. The emotional state of the user is therefore a key factor influencing engagement, motivation, and long-term acceptance. This review explores recent developments in emotion-aware technologies, particularly facial expression recognition and multimodal affect detection, and their potential to make assistive robots more adaptive and human-centred. By analysing current methodologies, emerging trends, and ethical considerations, we show how the integration of emotional intelligence can transform robotic assistance, shifting from reactive mechanisms to genuinely empathetic, socio-psychological, and context-aware assistive partners.<\/jats:p>","DOI":"10.3389\/frobt.2026.1891746","type":"journal-article","created":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T08:29:21Z","timestamp":1789115361000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Emotion recognition and human-robot interaction: a systematic review of methods and applications"],"prefix":"10.3389","volume":"13","author":[{"given":"Iraide","family":"Seijo Barquin","sequence":"first","affiliation":[{"name":"Robotics and Automation Department, Faculty of Engineering, Mondragon Unibertsitatea","place":["Bilbao, Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan Alejandro","family":"Castano","sequence":"additional","affiliation":[{"name":"Applied Mathematics, Materials Science and Electronic Technology Department, Bioengineering Systems and Technologies Research Group (BeST), Rey Juan Carlos University","place":["M\u00f3stoles, Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Virginia","family":"Ruiz Garate","sequence":"additional","affiliation":[{"name":"Robotics and Automation Department, Faculty of Engineering, Mondragon Unibertsitatea","place":["Bilbao, Spain"]},{"name":"Ikerbasque, Basque Foundation for Science","place":["Bilbao, Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonio J.","family":"del-Ama","sequence":"additional","affiliation":[{"name":"Applied Mathematics, Materials Science and Electronic Technology Department, Bioengineering Systems and Technologies Research Group (BeST), Rey Juan Carlos University","place":["M\u00f3stoles, Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,11]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","first-page":"1651","DOI":"10.1109\/RO-MAN60168.2024.10731253","article-title":"Robotising psychometrics: validating wellbeing assessment tools in child-robot interactions","volume-title":"2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)","author":"Abbasi","year":"2024"},{"key":"B2","doi-asserted-by":"publisher","first-page":"62233","DOI":"10.1109\/ACCESS.2023.3284457","article-title":"Henry gas solubility optimization with deep learning based facial emotion recognition for human computer interface","volume":"11","author":"AlEisa","year":"2023","journal-title":"IEEE Access"},{"key":"B3","doi-asserted-by":"publisher","first-page":"1259","DOI":"10.12785\/ijcds\/160193","article-title":"Generative adversarial networks for facial expression recognition in the wild","volume":"16","author":"Alharbawee","year":"2024","journal-title":"Int. J. Comput. Digital Syst."},{"key":"B4","doi-asserted-by":"publisher","first-page":"35089","DOI":"10.1109\/ACCESS.2023.3264260","article-title":"Modified earthworm optimization with deep learning assisted emotion recognition for human computer interface","volume":"11","author":"Alrowais","year":"2023","journal-title":"IEEE Access"},{"key":"B5","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1080\/1364557032000119616","article-title":"Scoping studies: towards a methodological framework","volume":"8","author":"Arksey","year":"2005","journal-title":"Int. J. Soc. Res. Methodol."},{"key":"B6","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1007\/s11571-020-09638-x","article-title":"Geometrical features of lips using the properties of parabola for recognizing facial expression","volume":"15","author":"Avani","year":"2021","journal-title":"Cogn. Neurodynamics"},{"key":"B7","doi-asserted-by":"publisher","first-page":"50949","DOI":"10.1109\/ACCESS.2024.3384303","article-title":"Developing an eeg-based emotion recognition using ensemble deep learning methods and fusion of brain effective connectivity maps","volume":"12","author":"Bagherzadeh","year":"2024","journal-title":"IEEE Access"},{"key":"B8","doi-asserted-by":"publisher","first-page":"143831","DOI":"10.1109\/ACCESS.2025.3598019","article-title":"Smile-vlm: self-supervised multi-view representation learning using vision-language model for 3d\/4d facial expression recognition","volume":"13","author":"Behzad","year":"2025","journal-title":"IEEE Access"},{"key":"B9","doi-asserted-by":"publisher","first-page":"104724","DOI":"10.1016\/j.imavis.2023.104724","article-title":"Emotion recognition at a distance: the robustness of machine learning based on hand-crafted facial features vs deep learning models","volume":"136","author":"Bisogni","year":"2023","journal-title":"Image Vis. Comput."},{"key":"B10","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1109\/10.1007\/s42979-022-01619-7","article-title":"Emotion detection-based video recommendation system using machine learning and deep learning framework","volume":"4","author":"Bokhare","year":"2023","journal-title":"SN Comput. Sci."},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1109\/10.26583\/sv.14.1.06","article-title":"Facial emotion recognition through detection of facial action units and their intensity","volume":"14","author":"Borgalli","year":"2022","journal-title":"Sci. Vis."},{"key":"B12","volume-title":"Intention, Plans, and Practical Reason","author":"Bratman","year":"1987"},{"key":"B13","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1016\/j.neunet.2005.03.003","article-title":"Emotion understanding from the perspective of autonomous robots research","volume":"18","author":"Ca\u00f1amero","year":"2005","journal-title":"Neural Networks"},{"key":"B14","doi-asserted-by":"publisher","first-page":"121351","DOI":"10.1109\/ACCESS.2025.3587607","article-title":"A lightweight tri-stream feature fusion network for speech emotion recognition","volume":"13","author":"Cao","year":"2025","journal-title":"IEEE Access"},{"key":"B15","doi-asserted-by":"publisher","first-page":"3426","DOI":"10.1109\/10.1152\/jn.00081.2006","article-title":"Motor patterns in human walking and running","volume":"95","author":"Cappellini","year":"2006","journal-title":"J. Neurophysiology"},{"key":"B16","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1109\/MCOM.001.2300003","article-title":"Catching elusive depression via facial micro-expression recognition","volume":"61","author":"Chen","year":"2023","journal-title":"IEEE Commun. Mag."},{"key":"B17","doi-asserted-by":"publisher","first-page":"110157","DOI":"10.1016\/j.patcog.2023.110157","article-title":"Dual subspace manifold learning based on GCN for intensity-invariant facial expression recognition","volume":"148","author":"Chen","year":"","journal-title":"Pattern Recognit."},{"key":"B18","doi-asserted-by":"publisher","first-page":"102880","DOI":"10.1109\/ACCESS.2024.3432860","article-title":"Intelligent human-computer interaction dialog model based on end to end neural networks and emotion information","volume":"12","author":"Chen","year":"","journal-title":"IEEE Access"},{"key":"B19","doi-asserted-by":"publisher","first-page":"121549","DOI":"10.1109\/ACCESS.2020.3006958","article-title":"Facial micro-expression recognition using two-dimensional landmark feature maps","volume":"8","author":"Choi","year":"2020","journal-title":"IEEE Access"},{"key":"B20","doi-asserted-by":"publisher","first-page":"20778","DOI":"10.1109\/ACCESS.2025.3534328","article-title":"Scalable context-based facial emotion recognition using facial landmarks and attention mechanism","volume":"13","author":"Colaco","year":"2025","journal-title":"IEEE Access"},{"key":"B21","doi-asserted-by":"publisher","first-page":"116638","DOI":"10.1109\/ACCESS.2023.3326071","article-title":"Speech emotion recognition and deep learning: an extensive validation using convolutional neural networks","volume":"11","author":"Dal R\u00ed","year":"2023","journal-title":"IEEE Access"},{"key":"B22","doi-asserted-by":"publisher","first-page":"71311","DOI":"10.1109\/ACCESS.2022.3188730","article-title":"Efficient-swishnet based system for facial emotion recognition","volume":"10","author":"Dar","year":"2022","journal-title":"IEEE Access"},{"key":"B23","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1098\/rstb.2006.2004","article-title":"Socially intelligent robots: dimensions of human\u2013robot interaction","volume":"362","author":"Dautenhahn","year":"2007","journal-title":"Philosophical Trans. Royal Soc. B Biol. Sci."},{"key":"B24","doi-asserted-by":"publisher","first-page":"56283","DOI":"10.1109\/ACCESS.2025.3554454","article-title":"Enhancing emotion recognition in speech based on self-supervised learning: Cross-attention fusion of acoustic and semantic features","volume":"13","author":"Deeb","year":"2025","journal-title":"IEEE Access"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00500-023-08458-5","article-title":"Feature extraction model for speech emotion detection with prodigious precedence assortment model using fuzzy-based convolution neural networks","author":"Deepika","year":"2023","journal-title":"Soft Comput."},{"key":"B26","doi-asserted-by":"publisher","first-page":"9848","DOI":"10.1109\/10.1109\/ACCESS.2019.2891668","article-title":"Cgan based facial expression recognition for human-robot interaction","volume":"7","author":"Deng","year":"2019","journal-title":"IEEE Access"},{"key":"B27","doi-asserted-by":"publisher","first-page":"64330","DOI":"10.1109\/ACCESS.2025.3559339","article-title":"Bimer: design and implementation of a bimodal emotion recognition system enhanced by data augmentation techniques","volume":"13","author":"Dikbiyik","year":"2025","journal-title":"IEEE Access"},{"key":"B28","doi-asserted-by":"publisher","first-page":"118533","DOI":"10.1109\/ACCESS.2024.3422383","article-title":"A multimodal driver anger recognition method based on context-awareness","volume":"12","author":"Ding","year":"2024","journal-title":"IEEE Access"},{"key":"B29","doi-asserted-by":"publisher","first-page":"93804","DOI":"10.1109\/ACCESS.2023.3310398","article-title":"Multi-net fusion: exploring a brain-inspired neural network model for facial expression recognition","volume":"11","author":"Dong","year":"2023","journal-title":"IEEE Access"},{"key":"B30","doi-asserted-by":"publisher","first-page":"384","DOI":"10.1037\/0003-066X.48.4.384","article-title":"Facial expression and emotion","volume":"48","author":"Ekman","year":"1993","journal-title":"Am. Psychologist"},{"key":"B31","doi-asserted-by":"publisher","first-page":"221640","DOI":"10.1109\/ACCESS.2020.3043201","article-title":"A novel approach for classification of speech emotions based on deep and acoustic features","volume":"8","author":"Er","year":"2020","journal-title":"IEEE Access"},{"key":"B32","first-page":"465","article-title":"Defining socially assistive robotics","author":"Feil-Seifer","year":"2005"},{"key":"B33","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1109\/MRA.2010.940150","article-title":"Socially assistive robotics","volume":"18","author":"Feil-Seifer","year":"2011","journal-title":"IEEE Robot. Autom. Mag."},{"key":"B34","doi-asserted-by":"publisher","first-page":"809","DOI":"10.1016\/j.jad.2022.12.029","article-title":"A method for diagnosing depression: facial expression mimicry is evaluated by facial expression recognition","volume":"323","author":"Fu","year":"2023","journal-title":"J. Affect. Disord."},{"key":"B35","doi-asserted-by":"publisher","first-page":"104342","DOI":"10.1016\/j.imavis.2021.104342","article-title":"Facial expression recognition using densely connected convolutional neural network and hierarchical spatial attention","volume":"117","author":"Gan","year":"2022","journal-title":"Image Vis. Comput."},{"key":"B36","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.cogsys.2022.11.007","article-title":"Design and user experience analysis of AR intelligent virtual agents on smartphones","volume":"78","author":"Gan","year":"2023","journal-title":"Cognitive Syst. Res."},{"key":"B37","doi-asserted-by":"publisher","first-page":"857","DOI":"10.1016\/j.procs.2020.04.093","article-title":"Emotion recognition in valence-arousal space from multi-channel EEG data and wavelet based deep learning framework","volume":"171","author":"Garg","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"B38","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1186\/s12984-025-01709-6","article-title":"The interplay between haptic guidance and personality traits in robotic-assisted motor learning","volume":"22","author":"Garz\u00e1s-Villar","year":"2025","journal-title":"J. NeuroEngineering Rehabilitation"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1909.11004","article-title":"Fuzzy knowledge-based architecture for learning and interaction in social robots","author":"Ghayoumi","year":"2019"},{"key":"B40","doi-asserted-by":"publisher","first-page":"69369","DOI":"10.1109\/ACCESS.2025.3561137","article-title":"Attention-driven emotion recognition in eeg: a transformer-based approach with cross-dataset fine-tuning","volume":"13","author":"Ghous","year":"2025","journal-title":"IEEE Access"},{"key":"B41","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1109\/ACCESS.2023.3344476","article-title":"A graph neural network for eeg-based emotion recognition with contrastive learning and generative adversarial neural network data augmentation","volume":"12","author":"Gilakjani","year":"2023","journal-title":"IEEE Access"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/10447318.2026.2630068","article-title":"Visual factors and sub-factors for triggering positive emotions in natural hyper-realistic virtual reality environments: a systematic literature review","author":"Goates","year":"2026","journal-title":"Int. J. Human\u2013Computer Interact."},{"key":"B43","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1109\/OJSP.2025.3530274","article-title":"Jointly learning from unimodal and multimodal-rated labels in audio-visual emotion recognition","volume":"6","author":"Goncalves","year":"2025","journal-title":"IEEE Open J. Signal Process."},{"key":"B44","doi-asserted-by":"publisher","first-page":"105316","DOI":"10.1016\/j.bspc.2023.105316","article-title":"Enhanced spatial-temporal learning network for dynamic facial expression recognition","volume":"88","author":"Gong","year":"2024","journal-title":"Biomed. Signal Process. Control"},{"key":"B45","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1016\/j.cmpb.2013.02.003","article-title":"Using \u201chuman state aware\u201d robots to enhance physical human\u2013robot interaction in a cooperative scenario","volume":"112","author":"Guerrero","year":"2013","journal-title":"Comput. Methods Programs Biomed."},{"key":"B46","doi-asserted-by":"publisher","first-page":"24587","DOI":"10.1109\/ACCESS.2025.3538642","article-title":"Multimodal emotion recognition: emotion classification through the integration of eeg and facial expressions","volume":"13","author":"G\u00fcler","year":"2025","journal-title":"IEEE Access"},{"key":"B47","doi-asserted-by":"publisher","first-page":"86013","DOI":"10.1109\/ACCESS.2023.3299822","article-title":"A multi-feature fusion speech emotion recognition method based on frequency band division and improved residual network","volume":"11","author":"Guo","year":"2023","journal-title":"IEEE Access"},{"key":"B48","article-title":"Learning both weights and connections for efficient neural network","volume":"28","author":"Han","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"B49","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1007\/s12652-020-02851-w","article-title":"Simultaneous prediction of valence\/arousal and emotion categories and its application in an hrc scenario","volume":"12","author":"Handrich","year":"2021","journal-title":"J. Ambient Intell. Humaniz. Comput."},{"key":"B50","doi-asserted-by":"publisher","first-page":"20727","DOI":"10.1109\/ACCESS.2022.3149214","article-title":"enAdaptive multimodal emotion detection architecture for social robots","volume":"10","author":"Heredia","year":"2022","journal-title":"IEEE Access"},{"key":"B51","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1186\/s12984-023-01264-y","article-title":"A qualitative study to elicit user requirements for lower limb wearable exoskeletons for gait rehabilitation in spinal cord injury","volume":"20","author":"Herrera-Valenzuela","year":"2023","journal-title":"J. NeuroEngineering Rehabilitation"},{"key":"B52","first-page":"2066","article-title":"Accommodating human variability in human-robot teams through theory of mind","author":"Hiatt","year":"2011"},{"key":"B53","doi-asserted-by":"publisher","first-page":"61672","DOI":"10.1109\/ACCESS.2020.2984368","article-title":"Multimodal approach of speech emotion recognition using multi-level multi-head fusion attention-based recurrent neural network","volume":"8","author":"Ho","year":"2020","journal-title":"IEEE Access"},{"key":"B54","doi-asserted-by":"publisher","first-page":"109997","DOI":"10.1016\/j.asoc.2023.109997","article-title":"Fine-grained image analysis for facial expression recognition using deep convolutional neural networks with bilinear pooling","volume":"134","author":"Hossain","year":"2023","journal-title":"Appl. Soft Comput."},{"key":"B55","doi-asserted-by":"publisher","first-page":"107480","DOI":"10.1016\/j.cmpb.2023.107480","article-title":"Emotion recognition in doctor-patient interactions from real-world clinical video database: initial development of artificial empathy","volume":"233","author":"Huang","year":"2023","journal-title":"Comput. Methods Programs Biomed."},{"key":"B56","doi-asserted-by":"publisher","first-page":"107491","DOI":"10.1016\/j.asoc.2021.107491","article-title":"Multi-level transfer learning for improving the performance of deep neural networks: theory and practice from the tasks of facial emotion recognition and named entity recognition","volume":"109","author":"Hung","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"B57","doi-asserted-by":"publisher","first-page":"37269","DOI":"10.1109\/ACCESS.2022.3228825","article-title":"Human\u2013robot collaboration using sequential-recurrent-convolution-network-based dynamic face emotion and wireless speech command recognitions","volume":"11","author":"Hwang","year":"2022","journal-title":"Ieee Access"},{"key":"B58","doi-asserted-by":"publisher","first-page":"84261","DOI":"10.1109\/ACCESS.2024.3412931","article-title":"A comprehensive multimodal humanoid system for personality assessment based on the big five model","volume":"12","author":"Jaffar","year":"2024","journal-title":"IEEE Access"},{"key":"B59","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1016\/j.neucom.2021.07.079","article-title":"MiniExpNet: a small and effective facial expression recognition network based on facial local regions","volume":"462","author":"Jin","year":"2021","journal-title":"Neurocomputing"},{"key":"B60","first-page":"543","article-title":"Combining modality specific deep neural networks for emotion recognition in video","author":"Kahou","year":"2013"},{"key":"B61","doi-asserted-by":"publisher","first-page":"91332","DOI":"10.1109\/ACCESS.2022.3201342","article-title":"1d convolutional autoencoder-based ppg and gsr signals for real-time emotion classification","volume":"10","author":"Kang","year":"2022","journal-title":"IEEe Access"},{"key":"B62","doi-asserted-by":"publisher","first-page":"59","DOI":"10.3390\/technologies10030059","article-title":"Continuous emotion recognition for long-term behavior modeling through recurrent neural networks","volume":"10","author":"Kansizoglou","year":"2022","journal-title":"Technologies"},{"key":"B63","doi-asserted-by":"publisher","first-page":"1963","DOI":"10.47836\/pjst.32.5.02","article-title":"Facial emotion recognition with deep neural network: a study of visual geometry group-16 (vgg16) technique with data augmentation for improved precision","volume":"32","author":"Kapaliya","year":"2024","journal-title":"Pertanika J. Sci. and Technol."},{"key":"B64","doi-asserted-by":"publisher","first-page":"927","DOI":"10.1007\/s43681-023-00307-3","article-title":"Ethical considerations in emotion recognition technologies: a review of the literature","volume":"4","author":"Katirai","year":"2023","journal-title":"AI Ethics"},{"key":"B65","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1109\/TASE.2014.2376492","article-title":"A survey of research on cloud robotics and automation","volume":"12","author":"Kehoe","year":"2015","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"B66","doi-asserted-by":"publisher","first-page":"112164","DOI":"10.1016\/j.patcog.2025.112164","article-title":"Triple-branch attention network with multiscale facial region feature selection for facial emotion recognition","volume":"112164","author":"Kim","year":"2025","journal-title":"Pattern Recognit."},{"key":"B67","doi-asserted-by":"publisher","first-page":"39218","DOI":"10.1109\/ACCESS.2021.3064934","article-title":"Metric-based attention feature learning for video action recognition","volume":"9","author":"Kim","year":"2021","journal-title":"IEEE Access"},{"key":"B68","doi-asserted-by":"publisher","first-page":"107659","DOI":"10.1016\/j.jfranklin.2025.107659","article-title":"Improving facial emotion recognition through dataset merging and balanced training strategies","volume":"362","author":"K\u0131rb\u0131z","year":"2025","journal-title":"J. Frankl. Inst."},{"key":"B69","article-title":"Guidelines for performing systematic literature reviews in software engineering","author":"Kitchenham","year":"2007","journal-title":"Tech. Rep. EBSE-2007-01"},{"key":"B70","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1109\/ACCESS.2025.3593168","article-title":"Hope predicts positive functional role outcomes in acute rehabilitation populations","volume":"57","author":"Kortte","year":"2012","journal-title":"Rehabil. Psychol."},{"key":"B71","doi-asserted-by":"publisher","first-page":"119516","DOI":"10.1109\/ACCESS.2020.3005664","article-title":"Different contextual window sizes based rnns for multimodal emotion detection in interactive conversations","volume":"8","author":"Lai","year":"2020","journal-title":"IEEE Access"},{"key":"B72","doi-asserted-by":"publisher","first-page":"107623","DOI":"10.1016\/j.asoc.2021.107623","article-title":"WOA-TLBO: whale optimization algorithm with teaching-learning-based optimization for global optimization and facial emotion recognition","volume":"110","author":"Lakshmi","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"B73","doi-asserted-by":"publisher","DOI":"10.1016\/j.array.2026.100818","article-title":"Benchmark analysis of deep learning algorithms for edge-based robotic applications","volume":"100818","author":"Le","year":"2026","journal-title":"Array"},{"key":"B74","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/s12369-013-0178-y","article-title":"Social robots for long-term interaction: a survey","volume":"5","author":"Leite","year":"2013","journal-title":"Int. J. Soc. Robot."},{"key":"B75","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.neucom.2020.12.076","article-title":"LBAN-IL: a novel method of high discriminative representation for facial expression recognition","volume":"432","author":"Li","year":"2021","journal-title":"Neurocomputing"},{"key":"B76","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1109\/TNSRE.2022.3225948","article-title":"Emotion recognition of subjects with hearing impairment based on fusion of facial expression and eeg topographic map","volume":"31","author":"Li D","year":"2022","journal-title":"IEEE Trans. Neural Syst. Rehabilitation Eng."},{"key":"B77","doi-asserted-by":"publisher","first-page":"3031","DOI":"10.1109\/TAFFC.2022.3182342","article-title":"4dme: a spontaneous 4d micro-expression dataset with multimodalities","volume":"14","author":"Li X","year":"2022","journal-title":"IEEE Trans. Affect. Comput."},{"key":"B78","doi-asserted-by":"publisher","first-page":"1383","DOI":"10.20965\/jrm.2022.p1383","article-title":"Development of automatic controlled walking assistive device based on fatigue and emotion detection","volume":"34","author":"Li Y","year":"2022","journal-title":"J. Robot. Mechatron."},{"key":"B79","doi-asserted-by":"publisher","first-page":"130228","DOI":"10.1109\/ACCESS.2024.3432813","article-title":"A lightweight multi-scale model for speech emotion recognition","volume":"12","author":"Li","year":"2024","journal-title":"IEEE Access"},{"key":"B80","doi-asserted-by":"publisher","first-page":"14946","DOI":"10.1038\/s41598-025-97922-3","article-title":"Multi-anchor adaptive fusion and bi-focus attention for enhanced gait-based emotion recognition","volume":"15","author":"Li","year":"2025","journal-title":"Sci. Rep."},{"key":"B81","doi-asserted-by":"publisher","first-page":"102367","DOI":"10.1016\/j.inffus.2024.102367","article-title":"GPT-4V with emotion: a zero-shot benchmark for generalized emotion recognition","volume":"108","author":"Lian","year":"2024","journal-title":"Inf. Fusion"},{"key":"B82","doi-asserted-by":"publisher","first-page":"103594","DOI":"10.1016\/j.infrared.2020.103594","article-title":"Facial expression recognition method with multi-label distribution learning for non-verbal behavior understanding in the classroom","volume":"112","author":"Liu","year":"2021","journal-title":"Infrared Phys. Technol."},{"key":"B83","doi-asserted-by":"publisher","first-page":"112599","DOI":"10.1016\/j.knosys.2024.112599","article-title":"MAS-DGAT-Net: a dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition","volume":"305","author":"Liu","year":"2024","journal-title":"Knowledge-Based Syst."},{"key":"B84","doi-asserted-by":"publisher","first-page":"2053","DOI":"10.1161\/STROKEAHA.114.004695","article-title":"Is more better? Using metadata to explore dose\u2013response relationships in stroke rehabilitation","volume":"45","author":"Lohse","year":"2014","journal-title":"Stroke"},{"key":"B85","doi-asserted-by":"publisher","first-page":"327","DOI":"10.3390\/app12010327","article-title":"A proposal for multimodal emotion recognition using aural transformers and action units on ravdess dataset","volume":"12","author":"Luna-Jim\u00e9nez","year":"2021","journal-title":"Appl. Sci."},{"key":"B86","doi-asserted-by":"publisher","first-page":"104418","DOI":"10.1016\/j.bspc.2022.104418","article-title":"A randomized deep neural network for emotion recognition with landmarks detection","volume":"81","author":"Luzio","year":"2023","journal-title":"Biomed. Signal Process. Control"},{"key":"B87","doi-asserted-by":"publisher","first-page":"200094","DOI":"10.1016\/j.iswa.2022.200094","article-title":"Emotion recognition in the times of COVID19: coping with face masks","volume":"15","author":"Magherini","year":"2022","journal-title":"Intelligent Syst. Appl."},{"key":"B88","doi-asserted-by":"publisher","first-page":"140239","DOI":"10.1109\/ACCESS.2025.3594671","article-title":"Eeg-skdnet: a self-knowledge distillation model with scaled weights for emotion recognition from eeg signals","volume":"13","author":"Mai","year":"2025","journal-title":"IEEE Access"},{"key":"B89","doi-asserted-by":"publisher","first-page":"110951","DOI":"10.1016\/j.patcog.2024.1109513","article-title":"POSTER++: a simpler and stronger facial expression recognition network","volume":"157","author":"Mao","year":"2025","journal-title":"Pattern Recognit."},{"key":"B90","doi-asserted-by":"publisher","first-page":"170928","DOI":"10.1109\/ACCESS.2020.3025370","article-title":"A multiplex connectivity map of valence-arousal emotional model","volume":"8","author":"Marimpis","year":"2020","journal-title":"Ieee Access"},{"key":"B91","doi-asserted-by":"publisher","first-page":"7067","DOI":"10.1109\/LRA.2022.3180442","article-title":"Head and eye egocentric gesture recognition for human-robot interaction using eyewear cameras","volume":"7","author":"Marina-Miranda","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"B92","doi-asserted-by":"publisher","first-page":"48257","DOI":"10.1109\/ACCESS.2025.3551610","article-title":"Deep learning for facial expression and human activity recognition using smart glasses","volume":"13","author":"Marinova","year":"2025","journal-title":"IEEE Access"},{"key":"B93","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1007\/s42452-020-2234-1","article-title":"enFacial emotion recognition using convolutional neural networks (FERC)","volume":"2","author":"Mehendale","year":"2020","journal-title":"SN Appl. Sci."},{"key":"B94","doi-asserted-by":"publisher","first-page":"101518","DOI":"10.1016\/j.jenvp.2020.101518","article-title":"Emotion recognition changes in a confinement situation due to COVID-19","volume":"72","author":"Mel\u00e9ndez","year":"2020","journal-title":"J. Environ. Psychol."},{"key":"B95","doi-asserted-by":"publisher","first-page":"104141","DOI":"10.1016\/j.bspc.2022.104141","article-title":"A multiple frequency bands parallel spatial\u2013temporal 3D deep residual learning framework for EEG-based emotion recognition","volume":"79","author":"Miao","year":"2023","journal-title":"Biomed. Signal Process. Control"},{"key":"B96","first-page":"1339","article-title":"enFacial emotion recognition using convolution neural network","author":"Modi","year":"2021"},{"key":"B97","doi-asserted-by":"publisher","first-page":"e1000097","DOI":"10.1371\/journal.pmed.1000097","article-title":"Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement","volume":"6","author":"Moher","year":"2009","journal-title":"PLoS Med."},{"key":"B98","doi-asserted-by":"publisher","first-page":"e0223563","DOI":"10.1371\/journal.pone.0223563","article-title":"On the use of action units and fuzzy explanatory models for facial expression recognition","volume":"14","author":"Morales-Vargas","year":"2019","journal-title":"PloS One"},{"key":"B99","doi-asserted-by":"publisher","first-page":"105942","DOI":"10.1016\/j.bspc.2023.105942","article-title":"Multimodal real-time patient emotion recognition system using facial expressions and brain EEG signals based on machine learning and log-sync methods","volume":"91","author":"Mutawa","year":"2024","journal-title":"Biomed. Signal Process. Control"},{"key":"B100","doi-asserted-by":"publisher","first-page":"e13810","DOI":"10.2196\/13810","article-title":"Toward continuous social phenotyping: analyzing gaze patterns in an emotion recognition task for children with autism through wearable smart glasses","volume":"22","author":"Nag","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"B101","doi-asserted-by":"publisher","first-page":"56485","DOI":"10.1109\/ACCESS.2025.3555510","article-title":"A novel transformer-based approach for adult\u2019s facial emotion recognition","volume":"13","author":"Nawaz","year":"2025","journal-title":"IEEE Access"},{"key":"B102","doi-asserted-by":"publisher","first-page":"107280","DOI":"10.1016\/j.compeleceng.2021.107280","article-title":"A human\u2013computer interaction framework for emotion recognition through time-series thermal video sequences","volume":"93","author":"Nayak","year":"2021","journal-title":"Comput. and Electr. Eng."},{"key":"B103","first-page":"5","article-title":"Towards robust deep neural networks for affect and depression recognition from speech","author":"Othmani","year":"2021"},{"key":"B104","doi-asserted-by":"publisher","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The prisma 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"Bmj"},{"key":"B105","first-page":"68","article-title":"Systematic mapping studies in software engineering","author":"Petersen","year":"2008"},{"key":"B106","doi-asserted-by":"publisher","first-page":"5200","DOI":"10.1109\/ACCESS.2018.2889852","article-title":"Facial action units-based image retrieval for facial expression recognition","volume":"7","author":"Pham","year":"2019","journal-title":"IEEE Access"},{"key":"B107","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/1140.003.0008","volume-title":"Affective Computing","author":"Picard","year":"2000"},{"key":"B108","doi-asserted-by":"publisher","first-page":"101842","DOI":"10.1109\/ACCESS.2024.3427822","article-title":"Human brain waves study using eeg and deep learning for emotion recognition","volume":"12","author":"Priyadarshani","year":"2024","journal-title":"IEEE Access"},{"key":"B109","doi-asserted-by":"publisher","first-page":"129412","DOI":"10.1109\/ACCESS.2023.3333381","article-title":"Convolutional channel attentional facial expression recognition network and its application in human\u2013computer interaction","volume":"11","author":"Pu","year":"2023","journal-title":"IEEE Access"},{"key":"B110","doi-asserted-by":"publisher","first-page":"120362","DOI":"10.1109\/ACCESS.2024.3450674","article-title":"Uncertainty-based learning of a lightweight model for multimodal emotion recognition","volume":"12","author":"Radoi","year":"2024","journal-title":"IEEE Access"},{"key":"B111","doi-asserted-by":"publisher","first-page":"79861","DOI":"10.1109\/ACCESS.2020.2990405","article-title":"Clustering-based speech emotion recognition by incorporating learned features and deep bilstm","volume":"8","author":"Sajjad","year":"2020","journal-title":"IEEE Access"},{"key":"B112","doi-asserted-by":"publisher","first-page":"120844","DOI":"10.1109\/ACCESS.2021.3108029","article-title":"Facial expression recognition using dynamic local ternary patterns with kernel extreme learning machine classifier","volume":"9","author":"Saurav","year":"2021","journal-title":"IEEE Access"},{"key":"B113","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1146\/annurev-bioeng-071811-150036","article-title":"Robots for use in autism research","volume":"14","author":"Scassellati","year":"2012","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"B114","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1016\/j.jphys.2016.08.006","article-title":"Increasing the amount of usual rehabilitation improves activity after stroke: a systematic review","volume":"62","author":"Schneider","year":"2016","journal-title":"J. Physiotherapy"},{"key":"B115","doi-asserted-by":"publisher","first-page":"94281","DOI":"10.1109\/ACCESS.2023.3310428","article-title":"Multi-modal cnn features fusion for emotion recognition: a modified xception model","volume":"11","author":"Shahzad","year":"2023","journal-title":"IEEE Access"},{"key":"B116","doi-asserted-by":"publisher","first-page":"103970","DOI":"10.1016\/j.bspc.2022.103970","article-title":"A novel spatio-temporal convolutional neural framework for multimodal emotion recognition","volume":"78","author":"Sharafi","year":"2022","journal-title":"Biomed. Signal Process. Control"},{"key":"B117","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1111\/inm.12678","article-title":"Vocal pattern detection of depression among older adults","volume":"29","author":"Smith","year":"2020","journal-title":"Int. J. Ment. Health Nurs."},{"key":"B118","doi-asserted-by":"publisher","first-page":"26046","DOI":"10.1109\/ACCESS.2024.3366451","article-title":"Deep learning based multi pose human face matching system","volume":"12","author":"Sohail","year":"2024","journal-title":"IEEE Access"},{"key":"B119","doi-asserted-by":"publisher","first-page":"50321","DOI":"10.1109\/ACCESS.2021.3069468","article-title":"Facial expression recognition with confidence guided refined horizontal pyramid network","volume":"9","author":"Su","year":"2021","journal-title":"IEEE Access"},{"key":"B120","doi-asserted-by":"publisher","first-page":"81155","DOI":"10.1109\/ACCESS.2022.3193941","article-title":"Digital twin model: a real-time emotion recognition system for personalized healthcare","volume":"10","author":"Subramanian","year":"2022","journal-title":"IEEE Access"},{"key":"B121","doi-asserted-by":"publisher","first-page":"10520","DOI":"10.3390\/app142210520","article-title":"Research on an eye control method based on the fusion of facial expression and gaze intention recognition","volume":"14","author":"Sun","year":"2024","journal-title":"Appl. Sci."},{"key":"B122","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1016\/j.neucom.2019.11.127","article-title":"Multi-attention based deep neural network with hybrid features for dynamic sequential facial expression recognition","volume":"444","author":"Sun","year":"2021","journal-title":"Neurocomputing"},{"key":"B123","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/j.neucom.2020.12.098","article-title":"NeuroSense: short-Term emotion recognition and understanding based on spiking neural network modelling of spatio-temporal EEG patterns","volume":"434","author":"Tan","year":"2021","journal-title":"Neurocomputing"},{"key":"B124","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1016\/j.neunet.2023.11.033","article-title":"Hierarchical attention network with progressive feature fusion for facial expression recognition","volume":"170","author":"Tao","year":"2024","journal-title":"Neural Netw."},{"key":"B125","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1109\/MRA.2007.339605","article-title":"Socially assistive robotics [grand challenges of robotics]","volume":"14","author":"Tapus","year":"2007","journal-title":"IEEE Robot. Autom. Mag."},{"key":"B126","doi-asserted-by":"publisher","first-page":"93259","DOI":"10.1109\/ACCESS.2025.3572583","article-title":"Emotion recognition through advanced signal fusion and kolmogorov-arnold networks","volume":"13","author":"Thant","year":"2025","journal-title":"IEEE Access"},{"key":"B127","doi-asserted-by":"publisher","first-page":"110463","DOI":"10.1016\/j.pnpbp.2021.110463","article-title":"Relationships between social withdrawal and facial emotion recognition in neuropsychiatric disorders","volume":"113","author":"Torre-Luque","year":"2022","journal-title":"Prog. Neuro-Psychopharmacol. Biol. Psychiatry"},{"key":"B128","doi-asserted-by":"publisher","first-page":"105486","DOI":"10.1016\/j.engappai.2022.105486","article-title":"Improved deep CNN-based two stream super resolution and hybrid deep model-based facial emotion recognition","volume":"116","author":"Ullah","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"B129","first-page":"408","article-title":"The \u201cmedical exception\u201d to emotion detection algorithms within the EU\u2019s forthcoming AI Act: regulatory implications for therapeutical smart cobotics","author":"Vecellio Segate","year":"2024"},{"key":"B130","doi-asserted-by":"publisher","first-page":"131988","DOI":"10.1109\/ACCESS.2020.3010018","article-title":"Pyramid with super resolution for in-the-wild facial expression recognition","volume":"8","author":"Vo","year":"2020","journal-title":"IEEE Access"},{"key":"B131","doi-asserted-by":"publisher","first-page":"33061","DOI":"10.1109\/ACCESS.2023.3263670","article-title":"Multimodal emotion recognition from eeg signals and facial expressions","volume":"11","author":"Wang","year":"2023","journal-title":"IEEE Access"},{"key":"B132","doi-asserted-by":"publisher","first-page":"121419","DOI":"10.1016\/j.eswa.2023.121419","article-title":"Learning facial expression and body gesture visual information for video emotion recognition","volume":"237","author":"Wei","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"B133","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1016\/j.jclinepi.2015.06.005","article-title":"Robis: a new tool to assess risk of bias in systematic reviews was developed","volume":"69","author":"Whiting","year":"2016","journal-title":"J. Clin. Epidemiol."},{"key":"B134","doi-asserted-by":"publisher","first-page":"9326695","DOI":"10.1155\/2021\/9326695","article-title":"Expression recognition method using improved vgg16 network model in robot interaction","volume":"2021","author":"Wu","year":"2021","journal-title":"J. Robotics"},{"key":"B135","doi-asserted-by":"publisher","first-page":"133180","DOI":"10.1109\/ACCESS.2020.3010311","article-title":"Multimodal fused emotion recognition about expression-eeg interaction and collaboration using deep learning","volume":"8","author":"Wu","year":"2020","journal-title":"IEEE Access"},{"key":"B136","doi-asserted-by":"publisher","first-page":"106217","DOI":"10.1016\/j.knosys.2020.106217","article-title":"A novel feature separation model exchange-GAN for facial expression recognition","volume":"204","author":"Yang","year":"2020","journal-title":"Knowledge-Based Syst."},{"key":"B137","doi-asserted-by":"publisher","first-page":"109889","DOI":"10.1109\/ACCESS.2021.3100638","article-title":"A channel selection method for emotion recognition from eeg based on swarm-intelligence algorithms","volume":"9","author":"Yildirim","year":"2021","journal-title":"IEEE Access"},{"key":"B138","doi-asserted-by":"publisher","first-page":"108737","DOI":"10.1016\/j.patcog.2022.108737","article-title":"Improving the facial expression recognition and its interpretability via generating expression pattern-map","volume":"129","author":"Zhang","year":"2022","journal-title":"Pattern Recognit."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1891746\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T08:29:23Z","timestamp":1789115363000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1891746\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,11]]},"references-count":138,"alternative-id":["10.3389\/frobt.2026.1891746"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2026.1891746","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,11]]},"article-number":"1891746"}}