{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T04:21:45Z","timestamp":1777522905647,"version":"3.51.4"},"reference-count":39,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2019,10,13]],"date-time":"2019-10-13T00:00:00Z","timestamp":1570924800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010664","name":"H2020 Future and Emerging Technologies","doi-asserted-by":"publisher","award":["720270"],"award-info":[{"award-number":["720270"]}],"id":[{"id":"10.13039\/100010664","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010664","name":"H2020 Future and Emerging Technologies","doi-asserted-by":"publisher","award":["785907"],"award-info":[{"award-number":["785907"]}],"id":[{"id":"10.13039\/100010664","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Adaptive Behavior"],"published-print":{"date-parts":[[2021,2]]},"abstract":"<jats:p>Biological agents need to complete perception-action cycles to perform various cognitive and biological tasks such as maximizing their wellbeing and their chances of genetic continuation. However, the processes performed in these cycles come at a cost. Such costs force the agent to evaluate a tradeoff between the optimality of the decision making and the time and computational effort required to make it. Several cognitive mechanisms that play critical roles in managing this tradeoff have been identified. These mechanisms include adaptation, learning, memory, attention, and planning. One of the often overlooked outcomes of these cognitive mechanisms, in spite of the critical effect that they may have on the perception-action cycle of organisms, is \u201cemotion.\u201d In this study, we hold that emotion can be considered as an emergent phenomenon of a plausible neurocomputational energy regulation mechanism, which generates an internal reward signal to minimize the neural energy consumption of a sequence of actions (decisions), where each action triggers a visual memory recall process. To realize an optimal action selection over a sequence of actions in a visual recalling task, we adopted a model-free reinforcement learning framework, in which the reward signal\u2014that is, the cost\u2014was based on the iteration steps of the convergence state of an associative memory network. The proposed mechanism has been implemented in simulation and on a robotic platform: the iCub humanoid robot. The results show that the computational energy regulation mechanism enables the agent to modulate its behavior to minimize the required neurocomputational energy in performing the visual recalling task.<\/jats:p>","DOI":"10.1177\/1059712319880649","type":"journal-article","created":{"date-parts":[[2019,10,14]],"date-time":"2019-10-14T02:26:32Z","timestamp":1571019992000},"page":"55-71","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":12,"title":["Emotion as an emergent phenomenon of the neurocomputational energy regulation mechanism of a cognitive agent in a decision-making task"],"prefix":"10.1177","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5524-8220","authenticated-orcid":false,"given":"Murat","family":"Kirtay","sequence":"first","affiliation":[{"name":"Scuola Superiore Sant\u2019Anna, The BioRobotics Institute, Pontedera, Italy"}]},{"given":"Lorenzo","family":"Vannucci","sequence":"additional","affiliation":[{"name":"Scuola Superiore Sant\u2019Anna, The BioRobotics Institute, Pontedera, Italy"}]},{"given":"Ugo","family":"Albanese","sequence":"additional","affiliation":[{"name":"Scuola Superiore Sant\u2019Anna, The BioRobotics Institute, Pontedera, Italy"}]},{"given":"Cecilia","family":"Laschi","sequence":"additional","affiliation":[{"name":"Scuola Superiore Sant\u2019Anna, The BioRobotics Institute, Pontedera, Italy"}]},{"given":"Erhan","family":"Oztop","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Ozyegin University, Istanbul, Turkey"}]},{"given":"Egidio","family":"Falotico","sequence":"additional","affiliation":[{"name":"Scuola Superiore Sant\u2019Anna, The BioRobotics Institute, Pontedera, Italy"}]}],"member":"179","published-online":{"date-parts":[[2019,10,13]]},"reference":[{"key":"bibr1-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2004.10.004"},{"key":"bibr2-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1007\/BF00344274"},{"key":"bibr3-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32375-1_2"},{"key":"bibr4-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-009-9094-9"},{"key":"bibr5-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-2236(03)00233-9"},{"key":"bibr6-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1016\/j.brainresbull.2008.01.016"},{"key":"bibr7-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(02)00963-7"},{"key":"bibr8-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1109\/TAMD.2013.2277589"},{"key":"bibr9-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1145\/336595.337516"},{"key":"bibr10-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2009.129"},{"key":"bibr11-1059712319880649","volume-title":"Introduction to the theory of neural computation","volume":"1","author":"Hertz J.","year":"1991"},{"key":"bibr12-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2013.7030013"},{"key":"bibr13-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2016.7803408"},{"key":"bibr14-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2006.07.004"},{"key":"bibr15-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1038\/236"},{"key":"bibr16-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2009.03.003"},{"key":"bibr17-1059712319880649","volume-title":"Proceedings of the Twenty-Fourth International Florida Artificial Intelligence Research Society Conference","author":"Lin J.","year":"2011"},{"key":"bibr18-1059712319880649","first-page":"172","author":"Marinier R. P.","year":"2004","journal-title":"ICCM"},{"key":"bibr19-1059712319880649","volume-title":"Proceedings of the annual meeting of the cognitive science society (Vol. 30, No. 30), CogSci 2008","author":"Marinier R. P.","year":"2008"},{"key":"bibr20-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-017-5666-0"},{"key":"bibr21-1059712319880649","volume-title":"Emotion and learning","author":"Moren J.","year":"2002"},{"key":"bibr22-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2007.08.013"},{"key":"bibr23-1059712319880649","volume-title":"Shaping and policy search in reinforcement learning","author":"Ng A. Y.","year":"2003"},{"key":"bibr24-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1242\/jeb.017574"},{"key":"bibr25-1059712319880649","volume":"1","author":"Oudeyer P. Y.","year":"2009","journal-title":"Frontiers in Neurorobotics"},{"key":"bibr26-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1038\/nature04490"},{"key":"bibr27-1059712319880649","first-page":"42","volume":"5","author":"Paul F.","year":"2014","journal-title":"Journal of Software Engineering for Robotics"},{"key":"bibr28-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2018.10.028"},{"key":"bibr29-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2317"},{"key":"bibr30-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1176\/ajp.2006.163.9.1652"},{"key":"bibr31-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1006\/ceps.1999.1020"},{"key":"bibr32-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.32"},{"key":"bibr33-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.051508.135256"},{"key":"bibr34-1059712319880649","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195130072.001.0001","volume-title":"Series in affective science. Appraisal processes in emotion: Theory, methods, research","author":"Scherer K. R.","year":"2001"},{"key":"bibr35-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-24600-5_36"},{"key":"bibr36-1059712319880649","doi-asserted-by":"publisher","DOI":"10.21236\/ADA440280"},{"key":"bibr37-1059712319880649","volume-title":"Reinforcement learning: An introduction","volume":"1","author":"Sutton R. S.","year":"1998"},{"key":"bibr38-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2014.7041415"},{"key":"bibr39-1059712319880649","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-22979-9_26"}],"container-title":["Adaptive Behavior"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712319880649","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1059712319880649","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712319880649","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:19:00Z","timestamp":1777393140000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1059712319880649"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,13]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,2]]}},"alternative-id":["10.1177\/1059712319880649"],"URL":"https:\/\/doi.org\/10.1177\/1059712319880649","relation":{},"ISSN":["1059-7123","1741-2633"],"issn-type":[{"value":"1059-7123","type":"print"},{"value":"1741-2633","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,13]]}}}