{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T22:46:26Z","timestamp":1769640386551,"version":"3.49.0"},"reference-count":36,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2021,9,21]],"date-time":"2021-09-21T00:00:00Z","timestamp":1632182400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Recently, robot services have been widely applied in many fields. To provide optimum service, it is essential to maintain good acceptance of the robot for more effective interaction with users. Previously, we attempted to implement facial expressions by synchronizing an estimated human emotion on the face of a robot. The results revealed that the robot could present different perceptions according to individual preferences. In this study, we considered individual differences to improve the acceptance of the robot by changing the robot\u2019s expression according to the emotion of its interacting partner. The emotion was estimated using biological signals, and the robot changed its expression according to three conditions: synchronized with the estimated emotion, inversely synchronized, and a funny expression. During the experiment, the participants provided feedback regarding the robot\u2019s expression by choosing whether they \u201clike\u201d or \u201cdislike\u201d the expression. We investigated individual differences in the acceptance of the robot expression using the Semantic Differential scale method. In addition, logistic regression was used to create a classification model by considering individual differences based on the biological data and feedback from each participant. We found that the robot expression based on inverse synchronization when the participants felt a negative emotion could result in impression differences among individuals. Then, the robot\u2019s expression was determined based on the classification model, and the Semantic Differential scale on the impression of the robot was compared with the three conditions. Overall, we found that the participants were most accepting when the robot expression was calculated using the proposed personalized method.<\/jats:p>","DOI":"10.3390\/s21186322","type":"journal-article","created":{"date-parts":[[2021,9,21]],"date-time":"2021-09-21T22:35:20Z","timestamp":1632263720000},"page":"6322","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["The Implementation and Evaluation of Individual Preference in Robot Facial Expression Based on Emotion Estimation Using Biological Signals"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8753-734X","authenticated-orcid":false,"given":"Peeraya","family":"Sripian","sequence":"first","affiliation":[{"name":"College of Engineering, Shibaura Institute of Technology, Tokyo 135-8548, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6715-2701","authenticated-orcid":false,"given":"Muhammad Nur Adilin Mohd","family":"Anuardi","sequence":"additional","affiliation":[{"name":"College of Engineering, Shibaura Institute of Technology, Tokyo 135-8548, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiawei","family":"Yu","sequence":"additional","affiliation":[{"name":"College of Engineering, Shibaura Institute of Technology, Tokyo 135-8548, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Midori","family":"Sugaya","sequence":"additional","affiliation":[{"name":"College of Engineering, Shibaura Institute of Technology, Tokyo 135-8548, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,21]]},"reference":[{"key":"ref_1","unstructured":"(2021, July 30). Unlocking the Potential of Service Robots, Available online: https:\/\/www.meti.go.jp\/english\/mobile\/2019\/20190726001en.html."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/s10846-015-0259-2","article-title":"A Survey of Autonomous Human Affect Detection Methods for Social Robots Engaged in Natural HRI","volume":"82","author":"McColl","year":"2016","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1080\/026999399379168","article-title":"Social Functions of Emotions at Four Levels of Analysis","volume":"13","author":"Keltner","year":"1999","journal-title":"Cogn. Emot."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Picard, R.W. (2000). Affective Computing, MIT Press.","DOI":"10.1007\/978-3-540-45012-2_2"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1329","DOI":"10.1016\/j.robot.2014.03.017","article-title":"Telenoid android robot as an embodied perceptual social regulation medium engaging natural human\u2013humanoid interaction","volume":"62","author":"Sorbello","year":"2014","journal-title":"Robot. Auton. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/TPAMI.2008.52","article-title":"A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions","volume":"31","author":"Zeng","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/S0031-3203(02)00052-3","article-title":"Automatic facial expression analysis: A survey","volume":"36","author":"Fasel","year":"2003","journal-title":"Pattern Recognit."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/T-AFFC.2010.1","article-title":"Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications","volume":"1","author":"Calvo","year":"2010","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/T-AFFC.2012.16","article-title":"Affective Body Expression Perception and Recognition: A Survey","volume":"4","author":"Kleinsmith","year":"2013","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1589","DOI":"10.1016\/j.procs.2017.08.198","article-title":"Estimating Emotion with Biological Information for Robot Interaction","volume":"112","author":"Ikeda","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., and Yang, X. (2018). A Review of Emotion Recognition Using Physiological Signals. Sensors, 18.","DOI":"10.3390\/s18072074"},{"key":"ref_12","unstructured":"Yamano, M., Usui, T., and Hashimoto, M. (2008). A Proposal of Human-Robot Interaction Design Based on Emotional Synchronization, Human-Agent Interaction (HAI) Symposium."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Li, Y., and Hashimoto, M. (2011, January 7\u201311). Effect of emotional synchronization using facial expression recognition in human-robot communication. Proceedings of the 2011 IEEE International Conference on Robotics and Biomimetics, Karon Beach, Thailand.","DOI":"10.1109\/ROBIO.2011.6181741"},{"key":"ref_14","first-page":"700","article-title":"Effects of Collaborative Learning with Robots using Model of Emotional Expressions","volume":"28","author":"Jimenez","year":"2016","journal-title":"J. Jpn. Soc. Fuzzy Theory Intell. Inf."},{"key":"ref_15","first-page":"700","article-title":"Impression Effects of Educational Support Robots using Sympathy Expressions Method by Body Movement and Facial Expression","volume":"30","author":"Tanizaki","year":"2018","journal-title":"J. Jpn. Soc. Fuzzy Theory Intell. Inf."},{"key":"ref_16","first-page":"133","article-title":"A Preliminary Experiment on the Estimation of Emotion Using Facial Expression and Biological Signals","volume":"11567","author":"Kurono","year":"2019","journal-title":"Trans. Petri Nets Other Models Concurr. XV"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sripian, P., Kurono, Y., Yoshida, R., and Sugaya, M. (2019, January 14\u201318). Study of Empathy on Robot Expression Based on Emotion Estimated from Facial Expression and Biological Signals. Proceedings of the 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), New Delhi, India.","DOI":"10.1109\/RO-MAN46459.2019.8956353"},{"key":"ref_18","first-page":"644","article-title":"Emotion Synchronization Method for Robot Facial Expression","volume":"12182","author":"Kajihara","year":"2020","journal-title":"Trans. Petri Nets Other Models Concurr. XV"},{"key":"ref_19","first-page":"81","article-title":"Toward an Empathetic Robot: Synchronization of Emotion Based on Biological Signals and Facial Expression","volume":"119","author":"Kajihara","year":"2020","journal-title":"IEICE Tech. Rep."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.bbe.2019.01.004","article-title":"A survey of machine learning techniques in physiology based mental stress detection systems","volume":"39","author":"Panicker","year":"2019","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/978-3-319-60639-2_2","article-title":"Emotion Recognition Using Physiological Signals: Laboratory vs. Wearable Sensors","volume":"608","author":"Ragot","year":"2018","journal-title":"Adv. Intell. Syst. Comput."},{"key":"ref_22","first-page":"85","article-title":"Method for Improving EEG Based Emotion Recognition by Combining It with Synchronized Biometric and Eye Tracking Technologies in a Noninvasive and Low Cost Way","volume":"10","author":"Gil","year":"2016","journal-title":"Front. Comput. Neurosci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"Russell","year":"1980","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Suzuki, K., Laohakangvalvit, T., Matsubara, R., and Sugaya, M. (2021). Constructing an Emotion Estimation Model Based on EEG\/HRV Indexes Using Feature Extraction and Feature Selection Algorithms. Sensors, 21.","DOI":"10.3390\/s21092910"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Dzedzickis, A., Kaklauskas, A., and Bucinskas, V. (2020). Human Emotion Recognition: Review of Sensors and Methods. Sensors, 20.","DOI":"10.3390\/s20030592"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"235","DOI":"10.30773\/pi.2017.08.17","article-title":"Stress and Heart Rate Variability: A Meta-Analysis and Review of the Literature","volume":"15","author":"Kim","year":"2018","journal-title":"Psychiatry Investig."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Feng, C., Sripian, P., and Sugay, M. (2019, January 3\u20136). Feedback of Physiological-Based Emotion before Publishing Emotional Expression on Social Media. Proceedings of the 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), Cambridge, UK.","DOI":"10.1109\/ACIIW.2019.8925097"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Sugaya, M., Nishida, Y., Yoshida, R., and Takahashi, Y. (2018, January 23\u201327). An Experiment of Human Feeling for Hospitality Robot Measured with Biological Information. Proceedings of the 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), Tokyo, Japan.","DOI":"10.1109\/COMPSAC.2018.10305"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sugaya, M., Hiramatsu, T., Yoshida, R., and Chen, F. (2018, January 23\u201327). Preliminary Reaction Analysis of Audience with Bio-Emotion Estimation Method. Proceedings of the 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), Tokyo, Japan.","DOI":"10.1109\/COMPSAC.2018.10303"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sugaya, M., Watanabe, I., Yoshida, R., and Chen, F. (2018, January 23\u201327). Human Emotional State Analysis During Driving Simulation Experiment Using Bio-Emotion Estimation Method. Proceedings of the 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), Tokyo, Japan.","DOI":"10.1109\/COMPSAC.2018.10301"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Serrano-Barroso, A., Siugzdaite, R., Guerrero-Cubero, J., Molina-Cantero, A., Gomez-Gonzalez, I., Lopez, J., and Vargas, J. (2021). Detecting Attention Levels in ADHD Children with a Video Game and the Measurement of Brain Activity with a Single-Channel BCI Headset. Sensors, 21.","DOI":"10.3390\/s21093221"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"258","DOI":"10.3389\/fpubh.2017.00258","article-title":"An Overview of Heart Rate Variability Metrics and Norms","volume":"5","author":"Shaffer","year":"2017","journal-title":"Front. Public Health"},{"key":"ref_33","unstructured":"(2021, March 21). Three Points to Improve Your First Impression and Seize the Opportunity. Akita, M. Nippon Telegraph and Telephone East Corporation. Available online: https:\/\/bizdrive.ntt-east.co.jp\/articles\/dr00002-069.html."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1177\/0305735610362821","article-title":"A comparison of the discrete and dimensional models of emotion in music","volume":"39","author":"Eerola","year":"2011","journal-title":"Psychol. Music."},{"key":"ref_35","first-page":"233","article-title":"The fundamental dimensions of interpersonal cognitive structure","volume":"25","author":"Hayashi","year":"1978","journal-title":"Bull. Fac. Educ. Nagoya Univ."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1525\/aa.1964.66.3.02a00880","article-title":"Semantic Differential Technique in the Comparative Study of Cultures1","volume":"66","author":"Osgood","year":"2009","journal-title":"Am. Anthropol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/18\/6322\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:02:57Z","timestamp":1760166177000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/18\/6322"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,21]]},"references-count":36,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["s21186322"],"URL":"https:\/\/doi.org\/10.3390\/s21186322","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,21]]}}}