{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T19:09:08Z","timestamp":1783537748402,"version":"3.55.0"},"reference-count":62,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,2,6]],"date-time":"2023-02-06T00:00:00Z","timestamp":1675641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002661","name":"Fonds De La Recherche Scientifique - FNRS","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Self-organized groups of robots have generally coordinated their behaviors using quite simple social interactions. Although simple interactions are sufficient for some group behaviors, future research needs to investigate more elaborate forms of coordination, such as social cognition, to progress towards real deployments. In this perspective, we define social cognition among robots as the combination of social inference, social learning, social influence, and knowledge transfer, and propose that these abilities can be established in robots by building underlying mechanisms based on behaviors observed in humans. We review key social processes observed in humans that could inspire valuable capabilities in robots and propose that relevant insights from human social cognition can be obtained by studying human-controlled avatars in virtual environments that have the correct balance of embodiment and constraints. Such environments need to allow participants to engage in embodied social behaviors, for instance through situatedness and bodily involvement, but, at the same time, need to artificially constrain humans to the operational conditions of robots, for instance in terms of perception and communication. We illustrate our proposed experimental method with example setups in a multi-user virtual environment.<\/jats:p>","DOI":"10.3389\/frobt.2023.1030416","type":"journal-article","created":{"date-parts":[[2023,2,6]],"date-time":"2023-02-06T05:30:31Z","timestamp":1675661431000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Learning from humans to build social cognition among robots"],"prefix":"10.3389","volume":"10","author":[{"given":"Nicolas","family":"Coucke","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary Katherine","family":"Heinrich","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Axel","family":"Cleeremans","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco","family":"Dorigo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,2,6]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.artint.2018.01.002","article-title":"Autonomous agents modelling other agents: A comprehensive survey and open problems","volume":"258","author":"Albrecht","year":"2018","journal-title":"Artif. Intell."},{"key":"B2","doi-asserted-by":"publisher","first-page":"e00050","DOI":"10.1016\/j.ohx.2018.e00050","article-title":"An open-source multi-robot construction system","volume":"5","author":"Allwright","year":"2019","journal-title":"HardwareX"},{"key":"B3","doi-asserted-by":"publisher","first-page":"11379","DOI":"10.1073\/pnas.1917687117","article-title":"Adaptive social networks promote the wisdom of crowds","volume":"117","author":"Almaatouq","year":"2020","journal-title":"Proc. Natl. Acad. Sci."},{"key":"B4","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1016\/j.cognition.2009.07.005","article-title":"Action understanding as inverse planning","volume":"113","author":"Baker","year":"2009","journal-title":"Cognition"},{"key":"B5","doi-asserted-by":"publisher","first-page":"103216","DOI":"10.1016\/j.artint.2019.103216","article-title":"The hanabi challenge: A new frontier for ai research","volume":"280","author":"Bard","year":"2020","journal-title":"Artif. Intell."},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.3389\/fcomp.2022.846440","article-title":"Social neuro AI: Social interaction as the \u201cdark matter\u201d of AI","volume":"4","author":"Bolotta","year":"2022","journal-title":"Front. Comput. Sci."},{"key":"B7","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1037\/0033-295x.108.3.624","article-title":"Conflict monitoring and cognitive control","volume":"108","author":"Botvinick","year":"2001","journal-title":"Psychol. Rev."},{"key":"B8","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780190905385.001.0001","volume-title":"The brain from inside out","author":"Buzs\u00e1ki","year":"2019"},{"key":"B9","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/13780.001.0001","volume-title":"Cognitive robotics","author":"Cangelosi","year":"2022"},{"key":"B10","first-page":"161","article-title":"Hugos: A multi-user virtual environment for studying human\u2013human swarm intelligence","volume-title":"ANTS 2020\u2013International conference on swarm intelligence","author":"Coucke","year":"2020"},{"key":"B11","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1007\/s11721-021-00199-1","article-title":"HuGoS: A virtual environment for studying collective human behavior from a swarm intelligence perspective","volume":"15","author":"Coucke","year":"2021","journal-title":"Swarm Intell."},{"key":"B12","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/B978-0-12-407187-2.00002-2","article-title":"The self organization of human interaction","volume":"59","author":"Dale","year":"2013","journal-title":"Psychol. Learn. Motivation"},{"key":"B13","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1007\/s10514-015-9454-z","article-title":"Active reward learning with a novel acquisition function","volume":"39","author":"Daniel","year":"2015","journal-title":"Aut. Robots"},{"key":"B14","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1098\/rstb.2006.2004","article-title":"Socially intelligent robots: Dimensions of human\u2013robot interaction","volume":"362","author":"Dautenhahn","year":"2007","journal-title":"Philosophical Trans. R. Soc. B Biol. Sci."},{"key":"B15","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1016\/j.tics.2010.06.009","article-title":"Can social interaction constitute social cognition?","volume":"14","author":"De Jaegher","year":"2010","journal-title":"Trends cognitive Sci."},{"key":"B16","doi-asserted-by":"publisher","first-page":"eabe4385","DOI":"10.1126\/scirobotics.abe4385","article-title":"Reflections on the future of swarm robotics","volume":"5","author":"Dorigo","year":"2020","journal-title":"Sci. Robotics"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1152","DOI":"10.1109\/jproc.2021.3072740","article-title":"Swarm robotics: Past, present, and future [point of view]","volume":"109","author":"Dorigo","year":"2021","journal-title":"Proc. IEEE"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1098\/rsos.210138","article-title":"Reciprocity and alignment: Quantifying coupling in dynamic interactions","volume":"8","author":"Dumas","year":"2021","journal-title":"R. Soc. Open Sci."},{"key":"B19","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1016\/j.concog.2014.12.003","article-title":"A duet for one","volume":"36","author":"Friston","year":"2015","journal-title":"Conscious. Cognition"},{"key":"B20","doi-asserted-by":"publisher","first-page":"2033","DOI":"10.1098\/rstb.2008.0005","article-title":"Social cognition","volume":"363","author":"Frith","year":"2008","journal-title":"Philosophical Trans. R. Soc. B Biol. Sci."},{"key":"B21","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1146\/annurev-psych-120710-100449","article-title":"Mechanisms of social cognition","volume":"63","author":"Frith","year":"2012","journal-title":"Annu. Rev. Psychol."},{"key":"B22","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1002\/jeab.193","article-title":"Using robots to understand animal cognition","volume":"105","author":"Frohnwieser","year":"2016","journal-title":"J. Exp. analysis Behav."},{"key":"B23","doi-asserted-by":"publisher","first-page":"722","DOI":"10.1016\/j.neubiorev.2021.09.034","article-title":"The road towards understanding embodied decisions","volume":"131","author":"Gordon","year":"2021","journal-title":"Neurosci. Biobehav. Rev."},{"key":"B24","doi-asserted-by":"publisher","first-page":"R390","DOI":"10.1016\/j.cub.2012.02.040","article-title":"Sense of agency","volume":"22","author":"Haggard","year":"2012","journal-title":"Curr. Biol."},{"key":"B25","first-page":"1804","article-title":"Opponent modeling in deep reinforcement learning","volume-title":"International conference on machine learning","author":"He","year":"2016"},{"key":"B26","doi-asserted-by":"crossref","first-page":"77","DOI":"10.7551\/mitpress\/13780.003.0009","article-title":"Swarm robotics","volume-title":"Cognitive robotics","author":"Heinrich","year":"2022"},{"key":"B27","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1016\/j.tins.2020.03.013","article-title":"Social cognition in the age of human\u2013robot interaction","volume":"43","author":"Henschel","year":"2020","journal-title":"Trends Neurosci."},{"key":"B28","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1521\/soco.2009.27.5.661","article-title":"Fast and frugal heuristics: Tools of social rationality","volume":"27","author":"Hertwig","year":"2009","journal-title":"Soc. Cogn."},{"key":"B29","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1038\/s44159-022-00054-y","article-title":"Information aggregation and collective intelligence beyond the wisdom of crowds","volume":"1","author":"Kameda","year":"2022","journal-title":"Nat. Rev. Psychol."},{"key":"B30","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/978-3-319-25524-8_13","article-title":"Potential of heterogeneity in collective behaviors: A case study on heterogeneous swarms","volume-title":"Prima 2015: Principles and practice of multi-agent systems","author":"Kengyel","year":"2015"},{"key":"B31","doi-asserted-by":"publisher","first-page":"16","DOI":"10.3389\/frobt.2019.00016","article-title":"The neglected pieces of designing collective decision-making processes","volume":"6","author":"Khaluf","year":"2019","journal-title":"Front. Robotics AI"},{"key":"B32","doi-asserted-by":"publisher","first-page":"8806","DOI":"10.1038\/s41598-022-12662-y","article-title":"Humans utilize sensory evidence of others\u2019 intended action to make online decisions","volume":"12","author":"Lokesh","year":"2022","journal-title":"Sci. Rep."},{"key":"B33","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1038\/s41467-017-00109-2","article-title":"Mergeable nervous systems for robots","volume":"8","author":"Mathews","year":"2017","journal-title":"Nat. Commun."},{"key":"B34","doi-asserted-by":"publisher","first-page":"6884","DOI":"10.1073\/pnas.1016507108","article-title":"How simple rules determine pedestrian behavior and crowd disasters","volume":"108","author":"Moussaid","year":"2011","journal-title":"Proc. Natl. Acad. Sci."},{"key":"B35","doi-asserted-by":"publisher","first-page":"830","DOI":"10.1109\/tnnls.2015.2492140","article-title":"Learning to perceive the world as probabilistic or deterministic via interaction with others: A neuro-robotics experiment","volume":"28","author":"Murata","year":"2015","journal-title":"IEEE Trans. neural Netw. Learn. Syst."},{"key":"B36","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1038\/nn1911","article-title":"The mirror neuron system is more active during complementary compared with imitative action","volume":"10","author":"Newman-Norlund","year":"2007","journal-title":"Nat. Neurosci."},{"key":"B37","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1109\/TEVC.2008.2011746","article-title":"Teamwork in self-organized robot colonies","volume":"13","author":"Nouyan","year":"2009","journal-title":"IEEE Trans. Evol. Comput."},{"key":"B38","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1038\/s41583-020-0276-4","article-title":"The neural and computational systems of social learning","volume":"21","author":"Olsson","year":"2020","journal-title":"Nat. Rev. Neurosci."},{"key":"B39","doi-asserted-by":"publisher","first-page":"4853","DOI":"10.1098\/rspb.2012.1847","article-title":"Inferring subjective states through the observation of actions","volume":"279","author":"Patel","year":"2012","journal-title":"Proc. R. Soc. B"},{"key":"B40","doi-asserted-by":"publisher","first-page":"eaau8479","DOI":"10.1126\/scirobotics.aau8479","article-title":"A review of collective robotic construction","volume":"4","author":"Petersen","year":"2019","journal-title":"Sci. Robotics"},{"key":"B41","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1007\/s00221-011-2712-1","article-title":"What should i do next? Using shared representations to solve interaction problems","volume":"211","author":"Pezzulo","year":"2011","journal-title":"Exp. Brain Res."},{"key":"B42","first-page":"4218","article-title":"Machine theory of mind","author":"Rabinowitz","year":"2018"},{"key":"B43","first-page":"4257","article-title":"Modeling others using oneself in multi-agent reinforcement learning","volume-title":"Proceedings of the 35th international conference on machine learning","author":"Raileanu","year":"2018"},{"key":"B44","doi-asserted-by":"publisher","first-page":"873","DOI":"10.1162\/neco.2008.12-06-420","article-title":"The diffusion decision model: Theory and data for two-choice decision tasks","volume":"20","author":"Ratcliff","year":"2008","journal-title":"Neural Comput."},{"key":"B45","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1146\/annurev.neuro.27.070203.144230","article-title":"The mirror-neuron system","volume":"27","author":"Rizzolatti","year":"2004","journal-title":"Annu. Rev. Neurosci."},{"key":"B46","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/VR.2016.7504761","article-title":"Avatar realism and social interaction quality in virtual reality","volume-title":"2016 IEEE virtual reality (VR)","author":"Roth","year":"2016"},{"key":"B47","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1126\/science.1254295","article-title":"Programmable self-assembly in a thousand-robot swarm","volume":"345","author":"Rubenstein","year":"2014","journal-title":"Science"},{"key":"B48","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1016\/j.tics.2005.01.012","article-title":"Against simulation: The argument from error","volume":"9","author":"Saxe","year":"2005","journal-title":"Trends Cognitive Sci."},{"key":"B49","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1017\/s0140525x12000660","article-title":"Toward a second-person neuroscience","volume":"36","author":"Schilbach","year":"2013","journal-title":"Behav. Brain Sci."},{"key":"B50","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.tics.2005.12.009","article-title":"Joint action: Bodies and minds moving together","volume":"10","author":"Sebanz","year":"2006","journal-title":"Trends Cognitive Sci."},{"key":"B51","doi-asserted-by":"publisher","first-page":"662","DOI":"10.1016\/j.neuron.2008.05.020","article-title":"Emotion, decision making, and the amygdala","volume":"58","author":"Seymour","year":"2008","journal-title":"Neuron"},{"key":"B52","doi-asserted-by":"publisher","first-page":"434","DOI":"10.3758\/s13423-020-01845-1","article-title":"Social agency as a continuum","volume":"28","author":"Silver","year":"2020","journal-title":"Psychonomic Bull. Rev."},{"key":"B53","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1017\/s0140525x05000129","article-title":"Understanding and sharing intentions: The origins of cultural cognition","volume":"28","author":"Tomasello","year":"2005","journal-title":"Behav. Brain Sci."},{"key":"B54","doi-asserted-by":"publisher","first-page":"eabb0266","DOI":"10.1126\/sciadv.abb0266","article-title":"Wise or mad crowds? The cognitive mechanisms underlying information cascades","volume":"6","author":"Tump","year":"2020","journal-title":"Sci. Adv."},{"key":"B55","first-page":"1874","article-title":"Help or hinder: Bayesian models of social goal inference","volume-title":"Advances in neural information processing systems","author":"Ullman","year":"2009"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2017.00009","article-title":"The best-of-n problem in robot swarms: Formalization, state of the art, and novel perspectives","volume":"4","author":"Valentini","year":"2017","journal-title":"Front. Robotics AI"},{"key":"B57","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1007\/s10458-015-9323-3","article-title":"Collective decision with 100 kilobots: Speed versus accuracy in binary discrimination problems","volume":"30","author":"Valentini","year":"2016","journal-title":"Aut. agents multi-agent Syst."},{"key":"B58","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1207\/s15327957pspr1004_5","article-title":"Evolutionary origins of leadership and followership","volume":"10","author":"Van Vugt","year":"2006","journal-title":"Personality Soc. Psychol. Rev."},{"key":"B59","volume-title":"Artificial cognitive systems: A primer","author":"Vernon","year":"2014"},{"key":"B60","doi-asserted-by":"publisher","first-page":"625","DOI":"10.3758\/bf03196322","article-title":"Six views of embodied cognition","volume":"9","author":"Wilson","year":"2002","journal-title":"Psychonomic Bull. Rev."},{"key":"B61","doi-asserted-by":"publisher","first-page":"20150375","DOI":"10.1098\/rstb.2015.0375","article-title":"Embodied artificial agents for understanding human social cognition","volume":"371","author":"Wykowska","year":"2016","journal-title":"Philosophical Trans. R. Soc. B Biol. Sci."},{"key":"B62","first-page":"306","article-title":"Formation control of uavs and mobile robots using self-organized communication topologies","volume-title":"ANTS 2020\u2013International conference on swarm intelligence","author":"Zhu","year":"2020"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1030416\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,6]],"date-time":"2023-02-06T05:30:45Z","timestamp":1675661445000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1030416\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,6]]},"references-count":62,"alternative-id":["10.3389\/frobt.2023.1030416"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2023.1030416","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,6]]},"article-number":"1030416"}}