{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T12:24:25Z","timestamp":1753878265151,"version":"3.41.2"},"reference-count":67,"publisher":"The Royal Society","issue":"2009","license":[{"start":{"date-parts":[[2023,10,25]],"date-time":"2023-10-25T00:00:00Z","timestamp":1698192000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/royalsociety.org\/journals\/ethics-policies\/data-sharing-mining\/"}],"funder":[{"name":"Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government","award":["No. RS-2023-00233251","No.2019-0-00075"],"award-info":[{"award-number":["No. RS-2023-00233251","No.2019-0-00075"]}]},{"name":"National Research Foundation of Korea (NRF) grant funded by the Korea government","award":["NRF-2019M3E5D2A01066267"],"award-info":[{"award-number":["NRF-2019M3E5D2A01066267"]}]}],"content-domain":{"domain":["royalsocietypublishing.org"],"crossmark-restriction":true},"short-container-title":["Proc. R. Soc. B."],"published-print":{"date-parts":[[2023,10,25]]},"abstract":"<jats:p>Human ecological success relies on our characteristic ability to flexibly self-organize into cooperative social groups, the most successful of which employ substantial specialization and division of labour. Unlike most other animals, humans learn by trial and error during their lives what role to take on. However, when some critical roles are more attractive than others, and individuals are self-interested, then there is a social dilemma: each individual would prefer others take on the critical but unremunerative roles so they may remain free to take one that pays better. But disaster occurs if all act thus and a critical role goes unfilled. In such situations learning an optimum role distribution may not be possible. Consequently, a fundamental question is: how can division of labour emerge in groups of self-interested lifetime-learning individuals? Here, we show that by introducing a model of social norms, which we regard as emergent patterns of decentralized social sanctioning, it becomes possible for groups of self-interested individuals to learn a productive division of labour involving all critical roles. Such social norms work by redistributing rewards within the population to disincentivize antisocial roles while incentivizing prosocial roles that do not intrinsically pay as well as others.<\/jats:p>","DOI":"10.1098\/rspb.2023.1716","type":"journal-article","created":{"date-parts":[[2023,10,25]],"date-time":"2023-10-25T07:05:24Z","timestamp":1698217524000},"update-policy":"https:\/\/doi.org\/10.1098\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["The emergence of division of labour through decentralized social sanctioning"],"prefix":"10.1098","volume":"290","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1379-3778","authenticated-orcid":true,"given":"Anil","family":"Yaman","sequence":"first","affiliation":[{"name":"Computer Science Department, Vrije Universiteit Amsterdam, 1081 HV Amsterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joel Z.","family":"Leibo","sequence":"additional","affiliation":[{"name":"DeepMind, London N1C 4AG, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni","family":"Iacca","sequence":"additional","affiliation":[{"name":"Department of Information Engineering and Computer Science, University of Trento, Trento, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sang","family":"Wan Lee","sequence":"additional","affiliation":[{"name":"Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"175","published-online":{"date-parts":[[2023,10,25]]},"reference":[{"key":"e_1_3_7_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2008.08.003"},{"key":"e_1_3_7_3_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-neuro-062111-150512"},{"key":"e_1_3_7_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2018.12.012"},{"key":"e_1_3_7_5_2","volume-title":"Reinforcement learning: an introduction","author":"Sutton RS","year":"2018","unstructured":"Sutton RS, Barto AG. 2018 Reinforcement learning: an introduction. Cambridge, MA: MIT Press."},{"key":"e_1_3_7_6_2","doi-asserted-by":"publisher","DOI":"10.3390\/g9030054"},{"key":"e_1_3_7_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/0162-3095(92)90032-Y"},{"key":"e_1_3_7_8_2","doi-asserted-by":"publisher","DOI":"10.1257\/aer.90.4.980"},{"key":"e_1_3_7_9_2","doi-asserted-by":"publisher","DOI":"10.1038\/415137a"},{"key":"e_1_3_7_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10955-018-2012-2"},{"key":"e_1_3_7_11_2","unstructured":"Bicchieri C Muldoon R Sontuoso A. 2018 Social norms. In The Stanford encyclopedia of philosophy winter 2018 edn (ed. EN Zalta). Stanford CA: Metaphysics Research Lab Stanford University. See https:\/\/plato.stanford.edu\/archives\/win2018\/entries\/social-norms\/."},{"key":"e_1_3_7_12_2","doi-asserted-by":"publisher","DOI":"10.2307\/1960858"},{"key":"e_1_3_7_13_2","doi-asserted-by":"publisher","DOI":"10.1177\/1043463189001001006"},{"key":"e_1_3_7_14_2","doi-asserted-by":"publisher","DOI":"10.1177\/1043463102014003002"},{"key":"e_1_3_7_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2016.04.011"},{"key":"e_1_3_7_16_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-04775-8"},{"key":"e_1_3_7_17_2","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.51.1.110"},{"key":"e_1_3_7_18_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-21602-9"},{"key":"e_1_3_7_19_2","doi-asserted-by":"publisher","DOI":"10.1257\/aer.p20171090"},{"key":"e_1_3_7_20_2","doi-asserted-by":"publisher","DOI":"10.1901\/jeab.2004.82-317"},{"key":"e_1_3_7_21_2","doi-asserted-by":"crossref","unstructured":"Erez T Smart WD. 2008 What does shaping mean for computational reinforcement learning? In Proc. 7th IEEE Int. Conf. Development and Learning Monterey California 9\u201312 August 2008 pp. 215\u2013219. New York NY: IEEE.","DOI":"10.1109\/DEVLRN.2008.4640832"},{"key":"e_1_3_7_22_2","volume-title":"The grammar of society: the nature and dynamics of social norms","author":"Bicchieri C","year":"2006","unstructured":"Bicchieri C 2006 The grammar of society: the nature and dynamics of social norms. Cambridge, UK: Cambridge University Press."},{"key":"e_1_3_7_23_2","doi-asserted-by":"publisher","DOI":"10.1111\/jtsb.12357"},{"key":"e_1_3_7_24_2","doi-asserted-by":"publisher","DOI":"10.2307\/1123430"},{"key":"e_1_3_7_25_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-polisci-100711-135226"},{"key":"e_1_3_7_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2016.08.015"},{"key":"e_1_3_7_27_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature01963"},{"key":"e_1_3_7_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7"},{"key":"e_1_3_7_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/0022-0531(86)90021-9"},{"key":"e_1_3_7_30_2","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2020.0291"},{"key":"e_1_3_7_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.copsyc.2015.09.003"},{"key":"e_1_3_7_32_2","volume-title":"The collapse of complex societies","author":"Tainter J.","year":"1988","unstructured":"Tainter J. 1988 The collapse of complex societies. Cambridge, UK: Cambridge University Press."},{"key":"e_1_3_7_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-2681(03)00094-5"},{"key":"e_1_3_7_34_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X1400106X"},{"key":"e_1_3_7_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11625-017-0501-x"},{"key":"e_1_3_7_36_2","unstructured":"Louizos C Welling M Kingma DP. 2018 Learning sparse neural networks through L 0 regularization. arXiv 1712.01312v2 [stat.ML]. (doi:10.48550\/arXiv.1712.01312)"},{"key":"e_1_3_7_37_2","doi-asserted-by":"publisher","DOI":"10.1038\/380121a0"},{"key":"e_1_3_7_38_2","doi-asserted-by":"publisher","DOI":"10.1086\/664079"},{"key":"e_1_3_7_39_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.162.3859.1243"},{"key":"e_1_3_7_40_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511807763"},{"key":"e_1_3_7_41_2","unstructured":"Lupu A Precup D. 2020 Gifting in multi-agent reinforcement learning. In Proc.19th Int. Conf. Autonomous Agents and MultiAgent Systems (AAMAS2020) 9\u201313 May 2020 Auckland NewZealand (eds B An N Yorke-Smith A El Fallah Seghrouchni G Sukthankar) pp. 789\u2013797. International Foundation for Autonomous Agents and Multiagent Systems."},{"key":"e_1_3_7_42_2","doi-asserted-by":"crossref","unstructured":"Wang WZ Beliaev M B\u0131y\u0131k E Lazar DA Pedarsani R Sadigh D. 2021 Emergent prosociality in multi-agent games through gifting. arXiv 2105.06593v1 [cs.MA]. (doi:10.48550\/arXiv.2105.06593)","DOI":"10.24963\/ijcai.2021\/61"},{"key":"e_1_3_7_43_2","unstructured":"Willis R Luck M. 2023 Resolving social dilemmas through reward transfer commitments. In Proc. Adaptive and Learning Agents Workshop (ALA2023) 29\u201330 May 2023 London UK (eds F Cruz CF Hayes C Wang C Yates)."},{"key":"e_1_3_7_44_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2106028118"},{"key":"e_1_3_7_45_2","doi-asserted-by":"publisher","DOI":"10.1177\/26339137231162025"},{"key":"e_1_3_7_46_2","doi-asserted-by":"crossref","unstructured":"Wilcoxon F. 1992 Individual comparisons by ranking methods. In Breakthroughs in statistics (eds S Kotz NL Johnson) pp. 196\u2013202. New York NY: Springer.","DOI":"10.1007\/978-1-4612-4380-9_16"},{"key":"e_1_3_7_47_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.7466396"},{"key":"e_1_3_7_48_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1133755"},{"key":"e_1_3_7_49_2","doi-asserted-by":"publisher","DOI":"10.1038\/35106555"},{"key":"e_1_3_7_50_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.91.11.4877"},{"key":"e_1_3_7_51_2","doi-asserted-by":"publisher","DOI":"10.1038\/359826a0"},{"key":"e_1_3_7_52_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.85.026104"},{"key":"e_1_3_7_53_2","unstructured":"Wang JX Hughes E Fernando C Czarnecki WM Du\u00e9\u00f1ez-Guzm\u00e1n EA Leibo JZ. 2019 Evolving intrinsic motivations for altruistic behavior. In Proc. 18th Int. Conf. Autonomous Agents and MultiAgent Systems (ALA2023) 9\u201310 May 2023 London UK (eds N Agmon ME Taylor E Elkind M Veloso) pp. 683\u2013692. Richland SC: International Foundation for Autonomous Agents and Multiagent Systems."},{"key":"e_1_3_7_54_2","volume-title":"Evolutionary game theory","author":"Weibull JW.","year":"1997","unstructured":"Weibull JW. 1997 Evolutionary game theory. Cambridge, MA: MIT Press."},{"key":"e_1_3_7_55_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0808450106"},{"key":"e_1_3_7_56_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1009882"},{"key":"e_1_3_7_57_2","doi-asserted-by":"publisher","DOI":"10.1086\/587889"},{"key":"e_1_3_7_58_2","doi-asserted-by":"publisher","DOI":"10.1086\/209890"},{"key":"e_1_3_7_59_2","volume-title":"An atlas of interpersonal situations","author":"Kelley HH","year":"2003","unstructured":"Kelley HH, Holmes JG, Kerr NL, Reis HT, Rusbult CE, Van Lange PAM. 2003 An atlas of interpersonal situations. Cambridge, UK: Cambridge University Press."},{"volume-title":"The emergence of norms","author":"Ullmann-Margalit E.","key":"e_1_3_7_60_2","unstructured":"Ullmann-Margalit E. 1977\/2015 The emergence of norms. Oxford, UK: Oxford University Press."},{"key":"e_1_3_7_61_2","doi-asserted-by":"crossref","unstructured":"Axtell RL Epstein JM Young HP. 2001 The emergence of classes in a multi-agent bargaining model. In Social dynamics (eds SN Durlauf HP Young) pp. 177\u2013195. Cambridge MA: MIT Press. (doi:10.7551\/mitpress\/6294.003.0009)","DOI":"10.1515\/9781400842872.177"},{"key":"e_1_3_7_62_2","doi-asserted-by":"publisher","DOI":"10.1177\/1470594X09345474"},{"key":"e_1_3_7_63_2","doi-asserted-by":"publisher","DOI":"10.1093\/jla\/las008"},{"key":"e_1_3_7_64_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF01666812"},{"key":"e_1_3_7_65_2","volume-title":"The strategy of conflict","author":"Schelling TC","year":"1960","unstructured":"Schelling TC. 1960 The strategy of conflict. Cambridge, MA: Harvard University Press."},{"key":"e_1_3_7_66_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-020-01008-1"},{"key":"e_1_3_7_67_2","unstructured":"Yaman A Leibo JZ Iacca G Wan Lee S. 2023 Data from: The emergence of division of labor through decentralized social sanctioning. Dryad Digital Repository. (doi:10.5061\/dryad.dv41ns24r)"},{"key":"e_1_3_7_68_2","unstructured":"Yaman A Leibo JZ Iacca G Wan Lee S. 2023 The emergence of division of labour through decentralized social sanctioning. Figshare. (doi:10.6084\/m9.figshare.c.6879576)"}],"container-title":["Proceedings of the Royal Society B: Biological Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/royalsocietypublishing.org\/doi\/pdf\/10.1098\/rspb.2023.1716","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/royalsocietypublishing.org\/doi\/full-xml\/10.1098\/rspb.2023.1716","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/royalsocietypublishing.org\/doi\/pdf\/10.1098\/rspb.2023.1716","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,25]],"date-time":"2023-10-25T07:05:36Z","timestamp":1698217536000},"score":1,"resource":{"primary":{"URL":"https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rspb.2023.1716"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,25]]},"references-count":67,"journal-issue":{"issue":"2009","published-print":{"date-parts":[[2023,10,25]]}},"alternative-id":["10.1098\/rspb.2023.1716"],"URL":"https:\/\/doi.org\/10.1098\/rspb.2023.1716","relation":{},"ISSN":["0962-8452","1471-2954"],"issn-type":[{"type":"print","value":"0962-8452"},{"type":"electronic","value":"1471-2954"}],"subject":[],"published":{"date-parts":[[2023,10,25]]},"assertion":[{"value":"2023-07-31","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"20231716"}}