{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T02:52:13Z","timestamp":1777949533187,"version":"3.51.4"},"reference-count":33,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T00:00:00Z","timestamp":1777766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Recovery and Resilience Plan","award":["7113"],"award-info":[{"award-number":["7113"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Facial expression recognition (FER) for assistive and telepresence robotics remains challenging under resource-constrained conditions because landmark normalization is often unstable, many datasets have limited variability, and full facial landmark sets introduce redundancy. This paper proposes a lightweight, privacy-preserving FER framework for assistive healthcare robotics based on geometric facial landmarks rather than raw RGB images. The objective is to improve recognition robustness and deployment suitability on low-power edge devices through two complementary contributions: a revised nose-centered landmark normalization method and an optimized Facial Feature Mapping, FFM-L03. The proposed normalization replaces the expression-sensitive upper-lip reference with a geometrically stable nose-center anchor, while FFM-L03 combines FACS-guided anatomical priors with ANOVA F-score, LASSO, PCA, and t-SNE\/UMAP to retain 60 informative landmarks. In addition, a heterogeneous Freepik dataset was constructed to increase variability in lighting, background, resolution, and subject appearance. Experimental evaluation across 15 landmark groups, four datasets, and four classifiers shows that the proposed method consistently improves performance over prior landmark configurations, achieving gains of up to 22.4 percentage points over the Ciraolo baseline and 22.1 percentage points over the full-landmark baseline in accuracy, precision, recall, and F1-score, while maintaining lightweight operation. These results demonstrate that principled normalization and targeted landmark selection can substantially improve FER for real-time, privacy-aware assistive robotic systems.<\/jats:p>","DOI":"10.3390\/s26092865","type":"journal-article","created":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T01:12:09Z","timestamp":1777857129000},"page":"2865","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Lightweight Vision-Based Emotion Sensing Framework for Assistive Healthcare Robotics"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4149-8269","authenticated-orcid":false,"given":"Hosam","family":"Zolfonoon","sequence":"first","affiliation":[{"name":"Institute of Systems and Robotics, University of Coimbra, 3030-290 Coimbra, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9544-424X","authenticated-orcid":false,"given":"Helder Jesus","family":"Ara\u00fajo","sequence":"additional","affiliation":[{"name":"Institute of Systems and Robotics, University of Coimbra, 3030-290 Coimbra, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9396-986X","authenticated-orcid":false,"given":"Lino","family":"Marques","sequence":"additional","affiliation":[{"name":"Institute of Systems and Robotics, University of Coimbra, 3030-290 Coimbra, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,5,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e3710","DOI":"10.1002\/ett.3710","article-title":"Edge computing in smart health care systems: Review, challenges, and research directions","volume":"33","author":"Hartmann","year":"2022","journal-title":"Trans. Emerg. Telecommun. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/MCOM.2018.1700707","article-title":"Fog Computing Architecture, Evaluation, and Future Research Directions","volume":"56","author":"Aazam","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1016\/j.future.2017.02.014","article-title":"Exploiting smart e-Health gateways at the edge of healthcare Internet-of-Things: A fog computing approach","volume":"78","author":"Rahmani","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"7457","DOI":"10.1109\/JIOT.2020.2984887","article-title":"Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence","volume":"7","author":"Deng","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Huang, Y., Chen, F., Lv, S., and Wang, X. (2019). Facial Expression Recognition: A Survey. Symmetry, 11.","DOI":"10.3390\/sym11101189"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Baltrusaitis, T., Zadeh, A., Lim, Y.C., and Morency, L.-P. (2018, January 15\u201319). OpenFace 2.0: Facial Behavior Analysis Toolkit. Proceedings of the 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00019"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1109\/TAFFC.2020.2981446","article-title":"Deep Facial Expression Recognition: A Survey","volume":"13","author":"Li","year":"2022","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102218","DOI":"10.1016\/j.inffus.2023.102218","article-title":"Multimodal Emotion Recognition with Deep Learning: Advancements, Challenges, and Future Directions","volume":"105","author":"Geetha","year":"2024","journal-title":"Inf. Fusion"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"106096","DOI":"10.1016\/j.bspc.2024.106096","article-title":"Facial expression recognition based on emotional artificial intelligence for tele-rehabilitation","volume":"92","author":"Ciraolo","year":"2024","journal-title":"Biomed. Signal Process. Control."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MRA.2020.3044906","article-title":"Mental and Emotional Health Care for COVID-19 Patients: Employing Pudu, a Telepresence Robot","volume":"28","author":"Salazar","year":"2021","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yuan, B., and Li, J. (2019). The policy effect of the General Data Protection Regulation (GDPR) on the digital public health sector in the European Union: An empirical investigation. Int. J. Environ. Res. Public Health, 16.","DOI":"10.3390\/ijerph16061070"},{"key":"ref_12","unstructured":"(2026, April 04). General Data Protection Regulation (GDPR). GDPR for Healthcare: Complete Compliance Guide for Medical Providers, Clinics, and Digital Health Services. Available online: https:\/\/gdpr.eu\/."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ekundayo, O., and Viriri, S. (2019, January 6\u20138). Facial expression recognition: A review of methods, performances and limitations. Proceedings of the 2019 Conference on Information Communications Technology and Society (ICTAS), Durban, South Africa.","DOI":"10.1109\/ICTAS.2019.8703619"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Almeida, L., Menezes, P., and Dias, J. (2022). Telepresence Social Robotics towards Co-Presence: A Review. Appl. Sci., 12.","DOI":"10.3390\/app12115557"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Vasylkiv, Y., Ma, Z., Li, G., Sandry, E., Brock, H., Nakamura, K., Pourang, I., and Gomez, R. (June, January 30). Automating behavior selection for affective telepresence robot. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9560755"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"11365","DOI":"10.1007\/s11042-022-13558-9","article-title":"Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning models","volume":"82","author":"Gupta","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mukhiddinov, M., Djuraev, O., Akhmedov, F., Mukhamadiyev, A., and Cho, J. (2023). Masked face emotion recognition based on facial landmarks and deep learning approaches for visually impaired people. Sensors, 23.","DOI":"10.3390\/s23031080"},{"key":"ref_18","first-page":"6623","article-title":"Telepresence robots and controlling techniques in healthcare system","volume":"74","author":"Naseer","year":"2022","journal-title":"Comput. Mater. Contin."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"P\u0103v\u0103loiu, I.-B., Vasil\u0103\u021beanu, A., Popa, R., Scurtu, D., Hang, A., and Goga, N. (2021, January 1\u20133). Healthcare Robotic Telepresence. Proceedings of the 2021 13th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), Pitesti, Romania.","DOI":"10.1109\/ECAI52376.2021.9515025"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.csbj.2024.01.004","article-title":"Testing scenarios for using telepresence robots in healthcare settings","volume":"24","author":"Leoste","year":"2024","journal-title":"Comput. Struct. Biotechnol. J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1651","DOI":"10.1080\/10447318.2021.2009673","article-title":"Telepresence robots for people with special needs: A systematic review","volume":"38","author":"Zhang","year":"2022","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_22","first-page":"205566832110723","article-title":"Facilitators and barriers to using telepresence robots in aged care settings: A scoping review","volume":"9","author":"Hung","year":"2022","journal-title":"J. Rehabil. Assist. Technol. Eng."},{"key":"ref_23","unstructured":"Lyons, M., Akamatsu, S., Kamachi, M., and Gyoba, J. (1998, January 14\u201316). Coding facial expressions with Gabor wavelets. Proceedings of the Third IEEE International Conference on Automatic Face & Gesture Recognition, Nara, Japan."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lyons, M.J. (2021). Excavating AI Re-Excavated: Debunking a Fallacious Account of the Jaffe Dataset. arXiv.","DOI":"10.31234\/osf.io\/bvf2s"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Canedo, D., and Neves, A.J.R. (2019). Facial Expression Recognition Using Computer Vision: A Systematic Review. Appl. Sci., 9.","DOI":"10.3390\/app9214678"},{"key":"ref_26","unstructured":"Rajasekera, J., and Thiha, S. (2026, April 17). An Efficient Facial Expression Recognition Algorithm on the Edge. Available online: https:\/\/ssrn.com\/abstract=4622700."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Al Fatih Abil Fida, M., Ahmad, T., and Ntahobari, M. (2021, January 20\u201321). Variance Threshold as Early Screening to Boruta Feature Selection for Intrusion Detection System. Proceedings of the 13th International Conference on Information & Communication Technology and System (ICTS), Surabaya, Indonesia.","DOI":"10.1109\/ICTS52701.2021.9608852"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Luong, H.H., Tran, T.T., Nguyen, N.V., Duc, L.A., Nguyen, H.T.T., Nguyen, K.D., Tran, N.C., and Thanh, N.H. (2022). Feature selection using correlation matrix on metagenomic data with Pearson enhancing inflammatory bowel disease prediction. Proceedings of the International Conference on Artificial Intelligence for Smart Community, Springer.","DOI":"10.1007\/978-981-16-2183-3_102"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1080\/13506280444000030","article-title":"Adaptation effects in facial expression recognition","volume":"11","author":"Hsu","year":"2004","journal-title":"Vis. Cogn."},{"key":"ref_30","unstructured":"Goodfellow, I.J., Erhan, D., Carrier, P.L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., and Lee, D.-H. (2013). Challenges in representation learning: A report on three machine learning contests. Neural Information Processing: 20th International Conference on Neural Information Processing (ICONIP 2013), Daegu, Korea, 3\u20137 November 2013; Proceedings, Part III.; Lecture Notes in Computer Science, Springer."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lundqvist, D., Flykt, A., and \u00d6hman, A. (1998). The Karolinska Directed Emotional Faces, Department of Clinical Neuroscience, Psychology Section, Karolinska Institutet.","DOI":"10.1037\/t27732-000"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Savin, A.V., Sablina, V.A., and Nikiforov, M.B. (2021, January 7\u201310). Comparison of facial landmark detection methods for micro-expressions analysis. Proceedings of the 2021 10th Mediterranean Conference on Embedded Computing (MECO), Budva, Montenegro.","DOI":"10.1109\/MECO52532.2021.9460191"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Akhmedov, F., Abdusalomov, A.B., Mukhiddinov, M., and Cho, Y.-I. (2022). Development of Real-Time Landmark-Based Emotion Recognition CNN for Masked Faces. Sensors, 22.","DOI":"10.3390\/s22228704"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/9\/2865\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T01:18:14Z","timestamp":1777857494000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/9\/2865"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,3]]},"references-count":33,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,5]]}},"alternative-id":["s26092865"],"URL":"https:\/\/doi.org\/10.3390\/s26092865","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,3]]}}}