{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T17:10:02Z","timestamp":1779383402294,"version":"3.53.1"},"reference-count":44,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2014,4,28]],"date-time":"2014-04-28T00:00:00Z","timestamp":1398643200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents a multi-sensor humanoid robotic head for human robot interaction. The design of the robotic head, Muecas, is based on ongoing research on the mechanisms of perception and imitation of human expressions and emotions. These mechanisms allow direct interaction between the robot and its human companion through the different natural language modalities: speech, body language and facial expressions. The robotic head has 12 degrees of freedom, in a human-like configuration, including eyes, eyebrows, mouth and neck, and has been designed and built entirely by IADeX (Engineering, Automation and Design of Extremadura) and RoboLab. A detailed description of its kinematics is provided along with the design of the most complex controllers. Muecas can be directly controlled by FACS (Facial Action Coding System), the de facto standard for facial expression recognition and synthesis. This feature facilitates its use by third party platforms and encourages the development of imitation and of goal-based systems. Imitation systems learn from the user, while goal-based ones use planning techniques to drive the user towards a final desired state. To show the flexibility and reliability of the robotic head, the paper presents a software architecture that is able to detect, recognize, classify and generate facial expressions in real time using FACS. This system has been implemented using the robotics framework, RoboComp, which provides hardware-independent access to the sensors in the head. Finally, the paper presents experimental results showing the real-time functioning of the whole system, including recognition and imitation of human facial expressions.<\/jats:p>","DOI":"10.3390\/s140507711","type":"journal-article","created":{"date-parts":[[2014,4,28]],"date-time":"2014-04-28T11:40:09Z","timestamp":1398685209000},"page":"7711-7737","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Muecas: A Multi-Sensor Robotic Head for Affective Human Robot Interaction and Imitation"],"prefix":"10.3390","volume":"14","author":[{"given":"Felipe","family":"Cid","sequence":"first","affiliation":[{"name":"RoboLab, Robotics and Artificial Vision Laboratory, University of Extremadura, Escuela Polit\u00e9cnica, Avenida de la Universidad s\/n, C\u00e1ceres, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jose","family":"Moreno","sequence":"additional","affiliation":[{"name":"RoboLab, Robotics and Artificial Vision Laboratory, University of Extremadura, Escuela Polit\u00e9cnica, Avenida de la Universidad s\/n, C\u00e1ceres, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pablo","family":"Bustos","sequence":"additional","affiliation":[{"name":"RoboLab, Robotics and Artificial Vision Laboratory, University of Extremadura, Escuela Polit\u00e9cnica, Avenida de la Universidad s\/n, C\u00e1ceres, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pedro","family":"N\u00fa\u00f1ez","sequence":"additional","affiliation":[{"name":"RoboLab, Robotics and Artificial Vision Laboratory, University of Extremadura, Escuela Polit\u00e9cnica, Avenida de la Universidad s\/n, C\u00e1ceres, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2014,4,28]]},"reference":[{"key":"ref_1","unstructured":"Pavia, A., Dias, J., Sobral, D., Woods, S., Aylett, R., Sobreperez, P., Zoll, C., and Hall, L. (2004, January 19\u201323). Caring for Agents that Care: Building Empathic Relations with Synthetic Agents. New York, NY, USA."},{"key":"ref_2","unstructured":"Tapus, A., and Mataric, M.J. (2007, January 26\u201328,). Emulating Empathy in Socially Assistive Robotics. Palo Alto, CA, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Picard, R.W. (2000). Affective Computing, MIT Press.","DOI":"10.7551\/mitpress\/1140.001.0001"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1007\/s12369-011-0134-7","article-title":"Visual-auditory Multimodal Emotional Structure to Improve Human-Robot-Interaction","volume":"4","author":"Prado","year":"2011","journal-title":"Int. J. Soc. Robot"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1109\/5.664274","article-title":"Audio-Visual Integration in Multimodal Communication","volume":"86","author":"Chen","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_6","unstructured":"Bandera, J.P. (2009). Vision-Based Gesture Recognition in a Robot Learning by Imitation Framework. [Ph.D. Thesis, University of Malaga]."},{"key":"ref_7","first-page":"22","article-title":"Imitation System for Humanoid Robotics Head","volume":"1","author":"Cid","year":"2013","journal-title":"J. Phys. Agents"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/TPAMI.2008.52","article-title":"A Survey of Affect Recognition Methods: Audio, Visual and Spontaneous Expressions","volume":"31","author":"Zeng","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ge, S.S., Wang, C., and Hang, C.C. (2008, January 1\u20133). Facial Expression Imitation in Human Robot Interaction. Munich, Germany.","DOI":"10.1109\/ROMAN.2008.4600668"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Mayer, C., Wimmer, M., Eggers, M., and Radig, B. (2009, January 1\u20137). Facial Expression Recognition with 3D Deformable Models. Cancun, Mexico.","DOI":"10.1109\/ACHI.2009.33"},{"key":"ref_11","unstructured":"Riaz, Z., Mayer, C., Beetz, M., and Radig, B. (2009). Computer Analysis of Images and Patterns, Springer."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1109\/72.536309","article-title":"Human expression recognition from motion using a radial basis function network architecture","volume":"7","author":"Rosenblum","year":"1996","journal-title":"IEEE Trans. Neural Netw"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hegel, F., Krach, S., Kircher, T., Wrede, B., and Sagerer, G. (2008, January 12\u201315). Theory of Mind (ToM) on Robots: A Functional Neuroimaging Study. Amsterdam, The Netherlands.","DOI":"10.1145\/1349822.1349866"},{"key":"ref_14","unstructured":"Mitchell, R.W., Thompson, N.S., and Miles, H.L. Anthropomorphism, Anecdotes, and Animals, States University of New York Press."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1023\/A:1013215010749","article-title":"Recognition of Affective Communicative Intent in Robot-Directed Speech","volume":"12","author":"Breazeal","year":"2002","journal-title":"Autonomous Robots"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C.M., Kazemzadeh, A., Lee, S., Neumann, U., and Narayanan, S. (2004, January 13\u201315). Analysis of Emotion Recognition using Facial Expressions, Speech and Multimodal Information. State College, PA, USA.","DOI":"10.1145\/1027933.1027968"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s12193-009-0025-5","article-title":"Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis","volume":"3","author":"Kessous","year":"2010","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_18","unstructured":"Sebe, N., Cohen, I., Gevers, T., and Huang, T.S. (2005). Internet Imaging VI, SPIE'05, SPIE."},{"key":"ref_19","unstructured":"Ekman, P., Friesen, W.V., and Hager, J.C. (2002). Facial Action Coding System (FACS) Manual, A Human Face."},{"key":"ref_20","unstructured":"Ekman, P., and Rosenberg, E. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS), Oxford Press. [2nd ed.]."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/S0921-8890(02)00372-X","article-title":"A survey of socially interactive robots","volume":"42","author":"Fong","year":"2003","journal-title":"Robot. Auton. Syst"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Siegel, M., Breazeal, C., and Norton, M.I. (2009, January 10\u201315). Persuasive robotics: The influence of robot gender on human behavior. St. Louis, MO, USA.","DOI":"10.1109\/IROS.2009.5354116"},{"key":"ref_23","unstructured":"Beira, R., Lopes, M., Praga, M., Santos-Victor, J., Bernardino, A., Metta, G., Becchi, F., and Saltaren, R. (2006, January 15\u201319). Design of the Robot-Cub (iCub) Head. Orlando, FL, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"60","DOI":"10.20965\/jrm.2002.p0060","article-title":"Personal Robot PaPeRo","volume":"14","author":"Fujita","year":"2002","journal-title":"J. Robot. Mechatron"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Breazeal, C. (2002). Designing Sociable Robots, MIT Press.","DOI":"10.1007\/0-306-47373-9_18"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hirth, J., Schmitz, N., and Berns, K. (2007, January 10\u201315). Emotional Architecture for the Humanoid Robot Head ROMAN. Roma, Italy.","DOI":"10.1109\/ROBOT.2007.363639"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Berns, K., and Hirth, J. (2006, January 9\u201315). Control of facial expressions of the humanoid robot head ROMAN. Beijing, China.","DOI":"10.1109\/IROS.2006.282331"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Asfour, T., Welke, K., Azad, P., Ude, A., and Dillmann, R. (2008, January 1\u20133). The Karlsruhe Humanoid Head. Daejeon, South Korea.","DOI":"10.1109\/ICHR.2008.4755993"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zecca, M., Chaminade, T., Umilta, M.A., Itoh, K., Saito, M., and Endo, N. (2007, January 10\u201312). Emotional Expression Humanoid Robot WE-4RII- Evaluation of the perception of facial emotional expressions by using fMRI. Akita, Japan.","DOI":"10.1299\/jsmermd.2007._2A1-O10_1"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hashimoto, T., Hitramatsu, S., Tsuji, T., and Kobayashi, H. (2006, January 18\u201321). Development of the Face Robot SAYA for Rich Facial Expressions. Busan, Korea.","DOI":"10.1109\/SICE.2006.315537"},{"key":"ref_31","unstructured":"Hashimoto, T., and Kobayashi, H. (2, January 30). Study on Natural Head Motion in Waiting State with Receptionist Robot SAYA that has human-like Appearance. Nashville, TN, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1109\/TRO.2007.904903","article-title":"Human-Oriented Interaction With an Anthropomorphic Robot","volume":"5","author":"Spexard","year":"2007","journal-title":"IEEE Trans. Robot"},{"key":"ref_33","first-page":"33","article-title":"Bukimi No Tani (The Uncanny Valley)","volume":"7","author":"Mori","year":"1970","journal-title":"Energy"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"van Breemen, A., Yan, X., and Meerbeek, B. (2005, January 25\u201329). iCat: An animated user-interface robot with personality. Utrecht, The Netherlands.","DOI":"10.1145\/1082473.1082823"},{"key":"ref_35","first-page":"3","article-title":"On the Design of the Huggable Robot Probo","volume":"2","author":"Saldien","year":"2008","journal-title":"J. Phys. Agents"},{"key":"ref_36","unstructured":"L\u00fctkebohle, I., Hegel, F., Schulz, S., Hackel, M., Wrede, B., Wachsmuth, S., and Sagerer, G. (2010, January 3\u20137). The Bielefeld Anthropomorphic Robot Head \u201cFlobi\u201d. Anchorage, AK, USA."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1162\/pres.16.4.337","article-title":"The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces","volume":"16","author":"Seyama","year":"2007","journal-title":"Presence Teleoper. Virtual Environ"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, S., Yin, B., Li, H., and Yang, Q. (2011, January 12\u201314). Multi-motor control system design based on Can bus. Harbin, China.","DOI":"10.1109\/EMEIT.2011.6024064"},{"key":"ref_39","unstructured":"Manso, L.J., Bachiller, P., Bustos, P., Nu\u00f1ez, P., Cintas, R., and Calderita, L. (2010). Simulation, Modeling and Programming for Autonomous Robots, Springer."},{"key":"ref_40","unstructured":"Internet, Communications Engine Middleware, ICE. Available online: http:\/\/www.zeroc.com\/ice.html."},{"key":"ref_41","first-page":"3","article-title":"Engaging human-to-robot attention using conversational gestures and lip-synchronization","volume":"6","author":"Cid","year":"2012","journal-title":"J. Phys. Agents"},{"key":"ref_42","unstructured":"Romero, P., Cid, F., and N\u00fa\u00f1ez, P. (2013, January 18\u201319). A Novel Real Time Facial Expression Recognition System Based on Candide-3 Reconstruction Model. Madrid, Spain."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Cid, F., Prado, J.A., Bustos, P., and N\u00fa\u00f1ez, P. (2013, January 3\u20138). A Real Time and Robust Facial Expression Recognition and Imitation Approach for Affective Human-Robot Interaction Using Gabor Filtering. Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696662"},{"key":"ref_44","unstructured":"Noll, M. (1970). Proceedings of the Symposium on Computer Processing in Communications, Vol. XIX, Polytechnic Press."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/5\/7711\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:10:47Z","timestamp":1760217047000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/5\/7711"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,4,28]]},"references-count":44,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2014,5]]}},"alternative-id":["s140507711"],"URL":"https:\/\/doi.org\/10.3390\/s140507711","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,4,28]]}}}