{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T18:38:15Z","timestamp":1761676695072,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2018,8,16]],"date-time":"2018-08-16T00:00:00Z","timestamp":1534377600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003329","name":"Ministerio de Econom\u00eda y Competitividad","doi-asserted-by":"publisher","award":["DPI2014-57684-R"],"award-info":[{"award-number":["DPI2014-57684-R"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012818","name":"Comunidad de Madrid","doi-asserted-by":"publisher","award":["S2013\/MIT-2748"],"award-info":[{"award-number":["S2013\/MIT-2748"]}],"id":[{"id":"10.13039\/100012818","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Nowadays, many robotic applications require robots making their own decisions and adapting to different conditions and users. This work presents a biologically inspired decision making system, based on drives, motivations, wellbeing, and self-learning, that governs the behavior of the robot considering both internal and external circumstances. In this paper we state the biological foundations that drove the design of the system, as well as how it has been implemented in a real robot. Following a homeostatic approach, the ultimate goal of the robot is to keep its wellbeing as high as possible. In order to achieve this goal, our decision making system uses learning mechanisms to assess the best action to execute at any moment. Considering that the proposed system has been implemented in a real social robot, human-robot interaction is of paramount importance and the learned behaviors of the robot are oriented to foster the interactions with the user. The operation of the system is shown in a scenario where the robot Mini plays games with a user. In this context, we have included a robust user detection mechanism tailored for short distance interactions. After the learning phase, the robot has learned how to lead the user to interact with it in a natural way.<\/jats:p>","DOI":"10.3390\/s18082691","type":"journal-article","created":{"date-parts":[[2018,8,16]],"date-time":"2018-08-16T11:39:08Z","timestamp":1534419548000},"page":"2691","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["A Bio-inspired Motivational Decision Making System for Social Robots Based on the Perception of the User"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9576-1731","authenticated-orcid":false,"given":"Marcos","family":"Maroto-G\u00f3mez","sequence":"first","affiliation":[{"name":"Department of Systems Engineering and Automation, Universidad Carlos III de Madrid, 28911 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5189-0002","authenticated-orcid":false,"given":"\u00c1lvaro","family":"Castro-Gonz\u00e1lez","sequence":"additional","affiliation":[{"name":"Department of Systems Engineering and Automation, Universidad Carlos III de Madrid, 28911 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0454-9466","authenticated-orcid":false,"given":"Jos\u00e9 Carlos","family":"Castillo","sequence":"additional","affiliation":[{"name":"Department of Systems Engineering and Automation, Universidad Carlos III de Madrid, 28911 Madrid, Spain"}]},{"given":"Mar\u00eda","family":"Malfaz","sequence":"additional","affiliation":[{"name":"Department of Systems Engineering and Automation, Universidad Carlos III de Madrid, 28911 Madrid, Spain"}]},{"given":"Miguel A.","family":"Salichs","sequence":"additional","affiliation":[{"name":"Department of Systems Engineering and Automation, Universidad Carlos III de Madrid, 28911 Madrid, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Magrini, E., and De Luca, A. (2017, January 24\u201328). Human-robot coexistence and contact handling with redundant robots. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206331"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MTS.2018.2795095","article-title":"Humanizing Human-Robot Interaction: On the Importance of Mutual Understanding","volume":"37","author":"Sciutti","year":"2018","journal-title":"IEEE Technol. Soc. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1145\/2366316.2366335","article-title":"The Challenges Ahead for Bio-inspired \u2018Soft\u2019 Robotics","volume":"55","author":"Pfeifer","year":"2012","journal-title":"Commun. ACM"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1126\/science.1145803","article-title":"Self-Organization, Embodiment, and Biologically Inspired Robotics","volume":"318","author":"Pfeifer","year":"2007","journal-title":"Science"},{"key":"ref_5","unstructured":"Kandel, E., Schwartz, J., and Jessell, T. (1991). Principles of Neural Science, Elsevier."},{"key":"ref_6","unstructured":"Veldhuis, A. (2011). Reviewing Decision Making: From Awareness to Social Decision Making. [Master\u2019s Thesis, University Utrech]."},{"key":"ref_7","unstructured":"Bear, M., Connors, B., and Paradiso, M. (2001). Neuroscience: Exploring the Brain, Lippincott Williams & Wilkin."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.physbeh.2004.02.004","article-title":"Motivation concepts in behavioral neuroscience","volume":"81","author":"Berridge","year":"2004","journal-title":"Physiol. Behav."},{"key":"ref_9","unstructured":"Hull, C.L. (1943). Principles of Behavior: An Introduction to Behavior Theory, Appleton-Century."},{"key":"ref_10","unstructured":"Cherry, K. (2018, August 15). Drive-Reduction Theory and Human Behavior Biological Need Motivates Behavior. Available online: https:\/\/www.verywellmind.com\/drive-reduction-theory-2795381."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1037\/h0058665","article-title":"The conflicting psychologies of learning\u2014A way out","volume":"42","author":"Hull","year":"1935","journal-title":"Psychol. Rev."},{"key":"ref_12","unstructured":"Schultz, D.P., and Schultz, S.E. (2005). A History of Modern Psychology, Thomson\/Wadsworth."},{"key":"ref_13","unstructured":"Santa-Cruz, J., Tobal, J.M., Vindel, A.C., and Fernndez, E.G. (1989). Introduccin a La Psicologa, Facultad de Psicologa, Universidad Complutense de Madrid."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1037\/h0058775","article-title":"Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain","volume":"47","author":"Olds","year":"1954","journal-title":"J. Comp. Physiol. Psychol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1037\/h0044297","article-title":"Some tests of a theory of intracranial self-stimulation","volume":"70","author":"Deutsch","year":"1963","journal-title":"Psychol. Rev."},{"key":"ref_16","unstructured":"Vel\u00e1squez, J.D. (1997, January 27\u201331). Modeling Emotions and Other Motivations in Synthetic Agents. Proceedings of the Fourteenth National Conference on Artificial Intelligence, Providence, RI, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/S0921-8890(99)00121-9","article-title":"Behavioral models of the praying mantis as a basis for robotic behavior","volume":"32","author":"Arkin","year":"2000","journal-title":"Robot. Auton. Syst."},{"key":"ref_18","unstructured":"Arkin, R.C., Fujita, M., Tagaki, T., and Hasegawa, R. (October, January 30). An Ethological and Emotional Basis for Human- Robot Interaction. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS 2002), Lausanne, Switzerland."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"269","DOI":"10.20965\/jaciii.2004.p0269","article-title":"Incorporating Motivation in a Hybrid Robot Architecture","volume":"8","author":"Stoytchev","year":"2004","journal-title":"J. Adv. Comput. Intell. Intell. Inform."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ca\u00f1amero, D. (2003). Designing Emotions for Activity Selection. Emotions in Humans and Artifacts, MIT Press.","DOI":"10.7551\/mitpress\/2705.003.0005"},{"key":"ref_21","first-page":"1","article-title":"A hormonal model of emotions for behavior control","volume":"2006","author":"Canamero","year":"1997","journal-title":"VUB AI-Lab Memo"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Breazeal, C.L. (2004). Designing Sociable Robots, MIT Press.","DOI":"10.7551\/mitpress\/2376.001.0001"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1080\/09540090412331314768","article-title":"Internal robotics","volume":"16","author":"Parisi","year":"2004","journal-title":"Connect. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1007\/978-3-642-39802-5_25","article-title":"Modulating behaviors using allostatic control","volume":"8064 LNAI","author":"Vouloutsi","year":"2013","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1007\/s12369-017-0405-z","article-title":"A Collaborative Homeostatic-Based Behavior Controller for Social Robots in Human\u2014Robot Interaction Experiments","volume":"9","author":"Cao","year":"2017","journal-title":"Int. J. Soc. Robot."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hieida, C., Horii, T., and Nagai, T. (2018, January 5\u20138). Decision-Making in Emotion Model. Proceedings of the Companion of the 2018 ACM\/IEEE International Conference on Human-Robot Interaction, Chicago, IL, USA.","DOI":"10.1145\/3173386.3177048"},{"key":"ref_27","unstructured":"Balkenius, C. (1995). Natural Intelligence in Artificial Creatures. [Ph.D. Thesis, Lund University]."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Avila-Garcia, O., and Ca\u00f1amero, L. (,  2004). Using Hormonal Feedback to Modulate Action Selection in a Competitive Scenario. Proceedings of the 8th International Conference on Simulation of Adaptive Behavior (SAB\u201904), Los Angeles, CA, USA.","DOI":"10.7551\/mitpress\/3122.003.0031"},{"key":"ref_29","unstructured":"Lorenz, K., and Leyhausen, P. (1973). Motivation of Human and Animal Behaviour; An Ethological View, VanNostrand-Reinhold."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Blumberg, B.M., Todd, P.M., and Maes, P. (1996). No Bad Dogs: Ethological Lessons for Learning in Hamsterdam, MIT Press. Collection.","DOI":"10.7551\/mitpress\/3118.003.0037"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ca\u00f1amero, L. (1997, January 5\u20138). Modeling Motivations and Emotions as a Basis for Intelligent Behavior. Proceedings of the First International Symposium on Autonomous Agents (Agents\u201997), Marina del Rey, CA, USA.","DOI":"10.1145\/267658.267688"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sutton, R.S., Barto, A.G., and Bach, F. (1998). Reinforcement Learning: An Introduction, MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_33","unstructured":"NASA (2018, August 15). Man-Systems Integration Standards, Available online: https:\/\/msis.jsc.nasa.gov\/sections\/Section03.htm."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_35","first-page":"64","article-title":"Multidomain Voice Activity Detection during Human-Robot Interaction","volume":"Volume 8239","author":"Herrmann","year":"2013","journal-title":"Social Robotics. ICSR 2013. Lecture Notes in Computer Science"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1007\/s12369-011-0113-z","article-title":"Learning the Selection of Actions for an Autonomous Social Robot by Reinforcement Learning Based on Motivations","volume":"3","author":"Malfaz","year":"2011","journal-title":"Int. J. Soc. Robot."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1109\/TAMD.2012.2234120","article-title":"An Autonomous Social Robot in Fear","volume":"5","author":"Malfaz","year":"2013","journal-title":"IEEE Trans. Auton. Mental Dev."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1080\/01969722.2014.945321","article-title":"Learning Behaviors by an Autonomous Social Robot with Motivations","volume":"45","author":"Malfaz","year":"2014","journal-title":"Cybern. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Cercignani, C. (1988). The boltzmann equation. The Boltzmann Equation and Its Applications, Springer.","DOI":"10.1007\/978-1-4612-1039-9"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2691\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:19:03Z","timestamp":1760195943000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2691"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,16]]},"references-count":39,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,8]]}},"alternative-id":["s18082691"],"URL":"https:\/\/doi.org\/10.3390\/s18082691","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,8,16]]}}}