{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,8]],"date-time":"2025-11-08T22:52:57Z","timestamp":1762642377874,"version":"3.37.3"},"reference-count":83,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2020,5,25]],"date-time":"2020-05-25T00:00:00Z","timestamp":1590364800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,5,25]],"date-time":"2020-05-25T00:00:00Z","timestamp":1590364800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000913","name":"James S. McDonnell Foundation","doi-asserted-by":"publisher","award":["220020555"],"award-info":[{"award-number":["220020555"]}],"id":[{"id":"10.13039\/100000913","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["PTDC\/MAT\/STA\/3358\/2014","PTDC\/EEI-SII\/5081\/2014"],"award-info":[{"award-number":["PTDC\/MAT\/STA\/3358\/2014","PTDC\/EEI-SII\/5081\/2014"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["SFRH\/BD\/118031\/2016","PTDC\/EEISII\/7174\/2014"],"award-info":[{"award-number":["SFRH\/BD\/118031\/2016","PTDC\/EEISII\/7174\/2014"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UIDB\/50021\/2020"],"award-info":[{"award-number":["UIDB\/50021\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton Agent Multi-Agent Syst"],"published-print":{"date-parts":[[2020,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Understanding how to design agents that sustain cooperation in multi-agent systems has been a long-lasting goal in distributed artificial intelligence. Proposed solutions rely on identifying free-riders and avoiding cooperating or interacting with them. These mechanisms of social control are traditionally studied in games with linear and deterministic payoffs, such as the prisoner\u2019s dilemma or the public goods game. In reality, however, agents often face dilemmas in which payoffs are uncertain and non-linear, as collective success requires a minimum number of cooperators. The collective risk dilemma (CRD) is one of these games, and it is unclear whether the known mechanisms of cooperation remain effective in this case. Here we study the emergence of cooperation in CRD through partner-based selection. First, we discuss an experiment in which groups of humans and robots play a CRD. This experiment suggests that people only prefer cooperative partners when they lose a previous game (i.e., when collective success was not previously achieved). Secondly, we develop an evolutionary game theoretical model pointing out the evolutionary advantages of preferring cooperative partners only when a previous game was lost. We show that this strategy constitutes a favorable balance between strictness (only interact with cooperators) and softness (cooperate and interact with everyone), thus suggesting a new way of designing agents that promote cooperation in CRD. We confirm these theoretical results through computer simulations considering a more complex strategy space. Third, resorting to online human\u2013agent experiments, we observe that participants are more likely to accept playing in a group with one defector when they won in a previous CRD, when compared to participants that lost the game. These empirical results provide additional support to the human predisposition to use outcome-based partner selection strategies in human\u2013agent interactions.<\/jats:p>","DOI":"10.1007\/s10458-020-09463-w","type":"journal-article","created":{"date-parts":[[2020,5,25]],"date-time":"2020-05-25T03:23:48Z","timestamp":1590377028000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Picky losers and carefree winners prevail in collective risk dilemmas with partner selection"],"prefix":"10.1007","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2310-6444","authenticated-orcid":false,"given":"Fernando P.","family":"Santos","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Samuel","family":"Mascarenhas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9103-2862","authenticated-orcid":false,"given":"Francisco C.","family":"Santos","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1592-9694","authenticated-orcid":false,"given":"Filipa","family":"Correia","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8374-5064","authenticated-orcid":false,"given":"Samuel","family":"Gomes","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ana","family":"Paiva","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,5,25]]},"reference":[{"key":"9463_CR1","volume-title":"The biology of moral systems","author":"RD Alexander","year":"1987","unstructured":"Alexander, R. D. (1987). The biology of moral systems. Piscataway: Transaction Publishers."},{"issue":"4","key":"9463_CR2","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1086\/341653","volume":"43","author":"MS Alvard","year":"2002","unstructured":"Alvard, M. S., Nolin, D. A., Brosius, P., Kuznar, L. A., Rousseau, J., Ruttan, L. M., et al. (2002). Rousseau\u2019s whale hunt? Coordination among big-game hunters. Current Anthropology, 43(4), 533\u2013559.","journal-title":"Current Anthropology"},{"key":"9463_CR3","doi-asserted-by":"crossref","unstructured":"Anastassacos, N., Hailes, S., & Musolesi, M. (2020). Partner selection for the emergence of cooperation in multi-agent systems using reinforcement learning. In Proceedings of AAAI\u201920. AAAI Press","DOI":"10.1609\/aaai.v34i05.6190"},{"key":"9463_CR4","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1613\/jair.4818","volume":"53","author":"D Bloembergen","year":"2015","unstructured":"Bloembergen, D., Tuyls, K., Hennes, D., & Kaisers, M. (2015). Evolutionary dynamics of multi-agent learning: A survey. Journal of Artificial Intelligence Research, 53, 659\u2013697.","journal-title":"Journal of Artificial Intelligence Research"},{"issue":"1","key":"9463_CR5","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/s12110-002-1013-6","volume":"13","author":"C Boesch","year":"2002","unstructured":"Boesch, C. (2002). Cooperative hunting roles among tai chimpanzees. Human Nature, 13(1), 27\u201346.","journal-title":"Human Nature"},{"key":"9463_CR6","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1002652","author":"MA Chakra","year":"2012","unstructured":"Chakra, M. A., & Traulsen, A. (2012). Evolutionary dynamics of strategic behavior in a collective-risk dilemma. PLoS Computational Biology,. https:\/\/doi.org\/10.1371\/journal.pcbi.1002652.","journal-title":"PLoS Computational Biology"},{"issue":"102","key":"9463_CR7","doi-asserted-by":"crossref","first-page":"20140935","DOI":"10.1098\/rsif.2014.0935","volume":"12","author":"X Chen","year":"2015","unstructured":"Chen, X., Sasaki, T., Br\u00e4nnstr\u00f6m, \u00c5., & Dieckmann, U. (2015). First carrot, then stick: How the adaptive hybridization of incentives promotes cooperation. Journal of the Royal Society Interface, 12(102), 20140935.","journal-title":"Journal of the Royal Society Interface"},{"key":"9463_CR8","doi-asserted-by":"crossref","first-page":"866","DOI":"10.1109\/TEVC.2017.2769081","volume":"22","author":"M Chica","year":"2017","unstructured":"Chica, M., Chiong, R., Kirley, M., & Ishibuchi, H. (2017). A networked n-player trust game and its evolutionary dynamics. IEEE Transactions on Evolutionary Computation, 22, 866\u2013878.","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"9463_CR9","doi-asserted-by":"crossref","unstructured":"Correia, F., Mascarenhas, S., Gomes, S., Arriaga, P., Leite, I., Prada, R., Melo, F. S., & Paiva, A. (2019). Exploring prosociality in human\u2013robot teams. In Proceedings of HRI\u201919. IEEE Press","DOI":"10.1109\/HRI.2019.8673299"},{"key":"9463_CR10","unstructured":"Correia, F., Mascarenhas, S., Gomes, S., Tulli, S., Santos, F. P., Santos, F. C., et al. (2019). For the record\u2014A public goods game for exploring human\u2013robot collaboration. In Proceedings of AAMAS\u201919 (pp. 2351\u20132353). IFAAMAS"},{"issue":"1","key":"9463_CR11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-017-02597-8","volume":"9","author":"JW Crandall","year":"2018","unstructured":"Crandall, J. W., Oudah, M., Ishowo-Oloko, F., Abdallah, S., Bonnefon, J. F., Cebrian, M., et al. (2018). Cooperating with machines. Nature Communications, 9(1), 1\u201312.","journal-title":"Nature Communications"},{"key":"9463_CR12","unstructured":"Crawford, C., Nanda\u00a0Kumar, R., & Sen, S. (2018). Resisting exploitation through rewiring in social networks: Social welfare increase using parity, sympathy and reciprocity. In Proceedings of AAMAS\u201918 (pp. 1915\u20131917). IFAAMAS."},{"key":"9463_CR13","unstructured":"De, S., Nau, D. S., & Gelfand, M. J. (2017). Understanding norm change: An evolutionary game-theoretic approach. In Proceedings of AAMAS\u201917 (pp. 1433\u20131441). IFAAMAS."},{"key":"9463_CR14","unstructured":"Domingos, E. F., Burguillo, J. C., & Lenaerts, T. (2017). Reactive versus anticipative decision making in a novel gift-giving game. In Proceedings of AAAI\u201917 (Vol.\u00a017, pp. 4399\u20134405). AAAI Press."},{"issue":"6","key":"9463_CR15","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1111\/j.1461-0248.2011.01615.x","volume":"14","author":"K Fehl","year":"2011","unstructured":"Fehl, K., van der Post, D. J., & Semmann, D. (2011). Co-evolution of behaviour and social network structure promotes human cooperation. Ecology Letters, 14(6), 546\u2013551.","journal-title":"Ecology Letters"},{"issue":"6868","key":"9463_CR16","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1038\/415137a","volume":"415","author":"E Fehr","year":"2002","unstructured":"Fehr, E., & G\u00e4chter, S. (2002). Altruistic punishment in humans. Nature, 415(6868), 137.","journal-title":"Nature"},{"issue":"156","key":"9463_CR17","doi-asserted-by":"crossref","first-page":"20190127","DOI":"10.1098\/rsif.2019.0127","volume":"16","author":"J Garc\u00eda","year":"2019","unstructured":"Garc\u00eda, J., & Traulsen, A. (2019). Evolution of coordinated punishment to enforce cooperation from an unbiased strategy space. Journal of the Royal Society Interface, 16(156), 20190127.","journal-title":"Journal of the Royal Society Interface"},{"key":"9463_CR18","unstructured":"Genesereth, M. R., Ginsberg, M. L., & Rosenschein, J. S. (1986). Cooperation without communication. In Proceedings of AAAI\u201986 (pp. 51\u201357). Elsevier."},{"key":"9463_CR19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jtbi.2014.09.036","volume":"365","author":"W Ghang","year":"2015","unstructured":"Ghang, W., & Nowak, M. A. (2015). Indirect reciprocity with optional interactions. Journal of Theoretical Biology, 365, 1\u201311.","journal-title":"Journal of Theoretical Biology"},{"key":"9463_CR20","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/4771.001.0001","volume-title":"Moral sentiments and material interests: The foundations of cooperation in economic life","author":"H Gintis","year":"2005","unstructured":"Gintis, H., Bowles, S., Boyd, R. T., Fehr, E., et al. (2005). Moral sentiments and material interests: The foundations of cooperation in economic life (Vol. 6). Cambridge: MIT Press."},{"issue":"1","key":"9463_CR21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-37186-2","volume":"9","author":"AR G\u00f3is","year":"2019","unstructured":"G\u00f3is, A. R., Santos, F. P., Pacheco, J. M., & Santos, F. C. (2019). Reward and punishment in climate change dilemmas. Scientific Reports, 9(1), 1\u20139.","journal-title":"Scientific Reports"},{"key":"9463_CR22","unstructured":"Griffiths, N. (2008). Tags and image scoring for robust cooperation. In Proceedings of AAMAS\u201908 (pp. 575\u2013582). IFAAMAS."},{"key":"9463_CR23","unstructured":"Griffiths, N., & Luck, M. (2010). Changing neighbours: Improving tag-based cooperation. In Proceedings of AAMAS\u201910 (pp. 249\u2013256). IFAAMAS."},{"issue":"3","key":"9463_CR24","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1007\/s10458-016-9338-4","volume":"31","author":"TA Han","year":"2017","unstructured":"Han, T. A., Pereira, L. M., & Lenaerts, T. (2017). Evolution of commitment and level of participation in public goods games. Autonomous Agents and Multi-Agent Systems, 31(3), 561\u2013583.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"issue":"4","key":"9463_CR25","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1162\/ARTL_a_00072","volume":"18","author":"TA Han","year":"2012","unstructured":"Han, T. A., Pereira, L. M., & Santos, F. C. (2012). Corpus-based intention recognition in cooperation dilemmas. Artificial Life, 18(4), 365\u2013383.","journal-title":"Artificial Life"},{"key":"9463_CR26","unstructured":"Han, T. A., Pereira, L. M., & Santos, F. C. (2012). The emergence of commitments and cooperation. In Proceedings of AAMAS\u201913, AAMAS \u201912 (pp. 559\u2013566). IFAAMAS, Richland, SC."},{"key":"9463_CR27","unstructured":"Han, T. A., Pereira, L. M., Santos, F. C., et\u00a0al. (2011). The role of intention recognition in the evolution of cooperative behavior. In Proceedings of IJCAI\u201911."},{"issue":"5570","key":"9463_CR28","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1126\/science.1070582","volume":"296","author":"C Hauert","year":"2002","unstructured":"Hauert, C., De Monte, S., Hofbauer, J., & Sigmund, K. (2002). Volunteering as red queen mechanism for cooperation in public goods games. Science, 296(5570), 1129\u20131132.","journal-title":"Science"},{"issue":"18","key":"9463_CR29","doi-asserted-by":"crossref","first-page":"4715","DOI":"10.1073\/pnas.1621239114","volume":"114","author":"C Hilbe","year":"2017","unstructured":"Hilbe, C., Martinez-Vaquero, L. A., Chatterjee, K., & Nowak, M. A. (2017). Memory-n strategies of direct reciprocity. Proceedings of the National Academy of Sciences, 114(18), 4715\u20134720.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"9463_CR30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-019-43102-z","volume":"9","author":"L Hindersin","year":"2019","unstructured":"Hindersin, L., Wu, B., Traulsen, A., & Garc\u00eda, J. (2019). Computation and simulation of evolutionary game dynamics in finite populations. Scientific Reports, 9(1), 1\u201321.","journal-title":"Scientific Reports"},{"key":"9463_CR31","unstructured":"Hogg, T. (1995). Social dilemmas in computational ecosystems. In Proceedings of IJCAI\u201995 (pp. 711\u2013718)."},{"issue":"1","key":"9463_CR32","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1010090405266","volume":"1","author":"NR Jennings","year":"1998","unstructured":"Jennings, N. R., Sycara, K., & Wooldridge, M. (1998). A roadmap of agent research and development. Autonomous Agents and Multi-Agent Systems, 1(1), 7\u201338.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"issue":"2","key":"9463_CR33","doi-asserted-by":"crossref","first-page":"167","DOI":"10.2307\/2009958","volume":"30","author":"R Jervis","year":"1978","unstructured":"Jervis, R. (1978). Cooperation under the security dilemma. World Politics, 30(2), 167\u2013214.","journal-title":"World Politics"},{"issue":"1","key":"9463_CR34","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1146\/annurev.soc.24.1.183","volume":"24","author":"P Kollock","year":"1998","unstructured":"Kollock, P. (1998). Social dilemmas: The anatomy of cooperation. Annual Review of Sociology, 24(1), 183\u2013214.","journal-title":"Annual Review of Sociology"},{"key":"9463_CR35","doi-asserted-by":"crossref","DOI":"10.1201\/9781315367910","volume-title":"Modeling and analysis of stochastic systems","author":"VG Kulkarni","year":"2016","unstructured":"Kulkarni, V. G. (2016). Modeling and analysis of stochastic systems. Boca Raton: Chapman and Hall\/CRC."},{"issue":"2\u20134","key":"9463_CR36","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/0921-8890(95)00053-4","volume":"16","author":"MJ Matari\u0107","year":"1995","unstructured":"Matari\u0107, M. J. (1995). Issues and approaches in the design of collective autonomous agents. Robotics and Autonomous Systems, 16(2\u20134), 321\u2013331.","journal-title":"Robotics and Autonomous Systems"},{"issue":"7","key":"9463_CR37","doi-asserted-by":"crossref","first-page":"2291","DOI":"10.1073\/pnas.0709546105","volume":"105","author":"M Milinski","year":"2008","unstructured":"Milinski, M., Sommerfeld, R. D., Krambeck, H. J., Reed, F. A., & Marotzke, J. (2008). The collective-risk social dilemma and the prevention of simulated dangerous climate change. Proceedings of the National Academy of Sciences, 105(7), 2291\u20132294.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"9463_CR38","unstructured":"Mor, Y., & Rosenschein, J. S. (1995). Time and the prisoner\u2019s dilemma. In Proceedings of ICMAS\u201995 (pp. 276\u2013282)."},{"key":"9463_CR39","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1007\/s10458-018-9390-3","volume":"32","author":"J Morales","year":"2018","unstructured":"Morales, J., Wooldridge, M., Rodr\u00edguez-Aguilar, J. A., & L\u00f3pez-S\u00e1nchez, M. (2018). Off-line synthesis of evolutionarily stable normative systems. Autonomous Agents and Multi-Agent Systems, 32, 635\u2013671.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9463_CR40","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1038\/srep01521","volume":"3","author":"JA Moreira","year":"2013","unstructured":"Moreira, J. A., Pacheco, J. M., & Santos, F. C. (2013). Evolution of collective action in adaptive social structures. Scientific Reports, 3, 1521.","journal-title":"Scientific Reports"},{"key":"9463_CR41","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctvjghw98","volume-title":"Evolutionary dynamics","author":"MA Nowak","year":"2006","unstructured":"Nowak, M. A. (2006). Evolutionary dynamics. Cambridge: Harvard University Press."},{"issue":"5485","key":"9463_CR42","doi-asserted-by":"crossref","first-page":"1773","DOI":"10.1126\/science.289.5485.1773","volume":"289","author":"MA Nowak","year":"2000","unstructured":"Nowak, M. A., Page, K. M., & Sigmund, K. (2000). Fairness versus reason in the ultimatum game. Science, 289(5485), 1773\u20131775.","journal-title":"Science"},{"issue":"4","key":"9463_CR43","doi-asserted-by":"crossref","first-page":"438","DOI":"10.3390\/g6040438","volume":"6","author":"J Olejarz","year":"2015","unstructured":"Olejarz, J., Ghang, W., & Nowak, M. A. (2015). Indirect reciprocity with optional interactions and private information. Games, 6(4), 438\u2013457.","journal-title":"Games"},{"issue":"1655","key":"9463_CR44","first-page":"315","volume":"276","author":"JM Pacheco","year":"2009","unstructured":"Pacheco, J. M., Santos, F. C., Souza, M. O., & Skyrms, B. (2009). Evolutionary dynamics of collective action in n-person stag hunt dilemmas. Proceedings of the Royal Society of London B, 276(1655), 315\u2013321.","journal-title":"Proceedings of the Royal Society of London B"},{"issue":"2","key":"9463_CR45","doi-asserted-by":"crossref","first-page":"e1004101","DOI":"10.1371\/journal.pcbi.1004101","volume":"11","author":"JM Pacheco","year":"2015","unstructured":"Pacheco, J. M., Vasconcelos, V. V., Santos, F. C., & Skyrms, B. (2015). Co-evolutionary dynamics of collective action with signaling for a quorum. PLoS Computational Biology, 11(2), e1004101.","journal-title":"PLoS Computational Biology"},{"key":"9463_CR46","doi-asserted-by":"crossref","unstructured":"Paiva, A., Santos, F. P., & Santos, F. C. (2018). Engineering pro-sociality with autonomous agents. In AAAI\u201918 (pp. 7994\u20137999).","DOI":"10.1609\/aaai.v32i1.12215"},{"key":"9463_CR47","unstructured":"Peleteiro, A., Burguillo, J. C., & Chong, S. Y. (2014). Exploring indirect reciprocity in complex networks using coalitions and rewiring. In Proceedings of AAMAS\u201914 (pp. 669\u2013676). IFAAMAS."},{"key":"9463_CR48","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.jtbi.2018.08.004","volume":"457","author":"J Pe\u00f1a","year":"2018","unstructured":"Pe\u00f1a, J., & N\u00f6ldeke, G. (2018). Group size effects in social evolution. Journal of Theoretical Biology, 457, 211\u2013220.","journal-title":"Journal of Theoretical Biology"},{"issue":"11","key":"9463_CR49","doi-asserted-by":"crossref","first-page":"e1003945","DOI":"10.1371\/journal.pcbi.1003945","volume":"10","author":"FL Pinheiro","year":"2014","unstructured":"Pinheiro, F. L., Vasconcelos, V. V., Santos, F. C., & Pacheco, J. M. (2014). Evolution of all-or-none strategies in repeated public goods dilemmas. PLoS Computational Biology, 10(11), e1003945.","journal-title":"PLoS Computational Biology"},{"key":"9463_CR50","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.jtbi.2011.03.004","volume":"299","author":"DG Rand","year":"2012","unstructured":"Rand, D. G. (2012). The promise of mechanical turk: How online labor markets can help theorists run behavioral experiments. Journal of Theoretical Biology, 299, 172\u2013179.","journal-title":"Journal of Theoretical Biology"},{"issue":"8","key":"9463_CR51","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/j.tics.2013.06.003","volume":"17","author":"DG Rand","year":"2013","unstructured":"Rand, D. G., & Nowak, M. A. (2013). Human cooperation. Trends in Cognitive Sciences, 17(8), 413\u2013425.","journal-title":"Trends in Cognitive Sciences"},{"issue":"7","key":"9463_CR52","doi-asserted-by":"crossref","first-page":"2581","DOI":"10.1073\/pnas.1214167110","volume":"110","author":"DG Rand","year":"2013","unstructured":"Rand, D. G., Tarnita, C. E., Ohtsuki, H., & Nowak, M. A. (2013). Evolution of fairness in the one-shot anonymous ultimatum game. Proceedings of the National Academy of Sciences, 110(7), 2581\u20132586.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"26","key":"9463_CR53","doi-asserted-by":"crossref","first-page":"10421","DOI":"10.1073\/pnas.1015648108","volume":"108","author":"FC Santos","year":"2011","unstructured":"Santos, F. C., & Pacheco, J. M. (2011). Risk of collective failure provides an escape from the tragedy of the commons. Proceedings of the National Academy of Sciences, 108(26), 10421\u201310425.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"10","key":"9463_CR54","doi-asserted-by":"crossref","first-page":"e140","DOI":"10.1371\/journal.pcbi.0020140","volume":"2","author":"FC Santos","year":"2006","unstructured":"Santos, F. C., Pacheco, J. M., & Lenaerts, T. (2006). Cooperation prevails when individuals adjust their social ties. PLoS Computational Biology, 2(10), e140.","journal-title":"PLoS Computational Biology"},{"key":"9463_CR55","unstructured":"Santos, F. P. (2017). Social norms of cooperation in multiagent systems. In Proceedings of AAMAS\u201917 (pp. 1859\u20131860). IFAAMAS."},{"key":"9463_CR56","unstructured":"Santos, F. P., Mascarenhas, S. F., Santos, F. C., Correia, F., Gomes, S., & Paiva, A. (2019). Outcome-based partner selection in collective risk dilemmas. In Proceedings of AAMAS\u201919 (pp. 1556\u20131564). IFAAMAS."},{"key":"9463_CR57","doi-asserted-by":"crossref","unstructured":"Santos, F. P., Pacheco, J. M., Paiva, A., & Santos, F. C. (2019). Evolution of collective fairness in hybrid populations of humans and agents. In Proceedings of AAAI\u201919. AAAI Press.","DOI":"10.1609\/aaai.v33i01.33016146"},{"key":"9463_CR58","doi-asserted-by":"crossref","first-page":"37517","DOI":"10.1038\/srep37517","volume":"6","author":"FP Santos","year":"2016","unstructured":"Santos, F. P., Pacheco, J. M., & Santos, F. C. (2016). Evolution of cooperation under indirect reciprocity and arbitrary exploration rates. Scientific Reports, 6, 37517.","journal-title":"Scientific Reports"},{"key":"9463_CR59","doi-asserted-by":"crossref","unstructured":"Santos, F. P., Pacheco, J. M., & Santos, F. C. (2018). Social norms of cooperation with costly reputation building. In Proceedings of AAAI\u201918 (pp. 4727\u20134734). AAAI Press.","DOI":"10.1609\/aaai.v32i1.11582"},{"key":"9463_CR60","doi-asserted-by":"crossref","unstructured":"Santos, F. P., Santos, F. C., Melo, F. S., Paiva, A., & Pacheco, J. M. (2016). Dynamics of fairness in groups of autonomous learning agents. In International conference on autonomous agents and multiagent systems (workshops\u2019 best papers book) (pp. 107\u2013126). Springer.","DOI":"10.1007\/978-3-319-46882-2_7"},{"issue":"7695","key":"9463_CR61","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1038\/nature25763","volume":"555","author":"FP Santos","year":"2018","unstructured":"Santos, F. P., Santos, F. C., & Pacheco, J. M. (2018). Social norm complexity and past reputations in the evolution of cooperation. Nature, 555(7695), 242.","journal-title":"Nature"},{"key":"9463_CR62","unstructured":"Sen, S., et\u00a0al. (2018). The effects of past experience on trust in repeated human-agent teamwork. In Proceedings of AAMAS\u201918 (pp. 514\u2013522). IFAAMAS."},{"key":"9463_CR63","doi-asserted-by":"crossref","unstructured":"Sequeira, P., Melo, F. S., & Paiva, A. (2011). Emotion-based intrinsic motivation for reinforcement learning agents. In International conference on affective computing and intelligent interaction (pp. 326\u2013336). Springer.","DOI":"10.1007\/978-3-642-24600-5_36"},{"issue":"7654","key":"9463_CR64","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1038\/nature22332","volume":"545","author":"H Shirado","year":"2017","unstructured":"Shirado, H., & Christakis, N. A. (2017). Locally noisy autonomous agents improve global human coordination in network experiments. Nature, 545(7654), 370\u2013374.","journal-title":"Nature"},{"key":"9463_CR65","doi-asserted-by":"crossref","DOI":"10.1515\/9781400832255","volume-title":"The calculus of selfishness","author":"K Sigmund","year":"2010","unstructured":"Sigmund, K. (2010). The calculus of selfishness. Princeton: Princeton University Press."},{"key":"9463_CR66","volume-title":"The stag hunt and the evolution of social structure","author":"B Skyrms","year":"2004","unstructured":"Skyrms, B. (2004). The stag hunt and the evolution of social structure. Cambridge: Cambridge University Press."},{"key":"9463_CR67","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780199580828.001.0001","volume-title":"Signals: Evolution, learning, and information","author":"B Skyrms","year":"2010","unstructured":"Skyrms, B. (2010). Signals: Evolution, learning, and information. Oxford: Oxford University Press."},{"issue":"5427","key":"9463_CR68","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1038\/246015a0","volume":"246","author":"JM Smith","year":"1973","unstructured":"Smith, J. M., & Price, G. R. (1973). The logic of animal conflict. Nature, 246(5427), 15.","journal-title":"Nature"},{"issue":"4","key":"9463_CR69","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1016\/j.jtbi.2009.07.010","volume":"260","author":"MO Souza","year":"2009","unstructured":"Souza, M. O., Pacheco, J. M., & Santos, F. C. (2009). Evolution of cooperation under n-person snowdrift games. Journal of Theoretical Biology, 260(4), 581\u2013588.","journal-title":"Journal of Theoretical Biology"},{"issue":"6","key":"9463_CR70","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1007\/BF00170175","volume":"29","author":"PE Stander","year":"1992","unstructured":"Stander, P. E. (1992). Cooperative hunting in lions: The role of the individual. Behavioral Ecology and Sociobiology, 29(6), 445\u2013454.","journal-title":"Behavioral Ecology and Sociobiology"},{"issue":"29","key":"9463_CR71","doi-asserted-by":"crossref","first-page":"11825","DOI":"10.1073\/pnas.1102493108","volume":"108","author":"A Tavoni","year":"2011","unstructured":"Tavoni, A., Dannenberg, A., Kallis, G., & L\u00f6schel, A. (2011). Inequality, communication, and the avoidance of disastrous climate change in a public goods game. Proceedings of the National Academy of Sciences, 108(29), 11825\u201311829.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"3","key":"9463_CR72","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1073\/pnas.0808450106","volume":"106","author":"A Traulsen","year":"2009","unstructured":"Traulsen, A., Hauert, C., De Silva, H., Nowak, M. A., & Sigmund, K. (2009). Exploration dynamics in evolutionary games. Proceedings of the National Academy of Sciences, 106(3), 709\u2013712.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"9463_CR73","doi-asserted-by":"crossref","first-page":"011909","DOI":"10.1103\/PhysRevE.74.011909","volume":"74","author":"A Traulsen","year":"2006","unstructured":"Traulsen, A., Nowak, M. A., & Pacheco, J. M. (2006). Stochastic dynamics of invasion and fixation. Physical Review E, 74(1), 011909.","journal-title":"Physical Review E"},{"issue":"1","key":"9463_CR74","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1017\/S026988890500041X","volume":"20","author":"K Tuyls","year":"2005","unstructured":"Tuyls, K., & Now\u00e9, A. (2005). Evolutionary game theory and multi-agent reinforcement learning. The Knowledge Engineering Review, 20(1), 63\u201390.","journal-title":"The Knowledge Engineering Review"},{"issue":"7","key":"9463_CR75","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1016\/j.artint.2007.01.004","volume":"171","author":"K Tuyls","year":"2007","unstructured":"Tuyls, K., & Parsons, S. (2007). What evolutionary game theory tells us about multiagent learning. Artificial Intelligence, 171(7), 406\u2013416.","journal-title":"Artificial Intelligence"},{"issue":"15","key":"9463_CR76","doi-asserted-by":"crossref","first-page":"158104","DOI":"10.1103\/PhysRevLett.108.158104","volume":"108","author":"S Van Segbroeck","year":"2012","unstructured":"Van Segbroeck, S., Pacheco, J. M., Lenaerts, T., & Santos, F. C. (2012). Emergence of fairness in repeated group interactions. Physical Review Letters, 108(15), 158104.","journal-title":"Physical Review Letters"},{"issue":"13","key":"9463_CR77","doi-asserted-by":"crossref","first-page":"2503","DOI":"10.1142\/S0218202515400163","volume":"25","author":"VV Vasconcelos","year":"2015","unstructured":"Vasconcelos, V. V., Santos, F. C., & Pacheco, J. M. (2015). Cooperation dynamics of polycentric climate governance. Mathematical Models and Methods in Applied Sciences, 25(13), 2503\u20132517.","journal-title":"Mathematical Models and Methods in Applied Sciences"},{"issue":"5","key":"9463_CR78","doi-asserted-by":"crossref","first-page":"058301","DOI":"10.1103\/PhysRevLett.118.058301","volume":"118","author":"VV Vasconcelos","year":"2017","unstructured":"Vasconcelos, V. V., Santos, F. P., Santos, F. C., & Pacheco, J. M. (2017). Stochastic dynamics through hierarchically embedded Markov chains. Physical Review Letters, 118(5), 058301.","journal-title":"Physical Review Letters"},{"key":"9463_CR79","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.physrep.2016.10.006","volume":"664","author":"Z Wang","year":"2016","unstructured":"Wang, Z., Bauch, C. T., Bhattacharyya, S., d\u2019Onofrio, A., Manfredi, P., Perc, M., et al. (2016). Statistical physics of vaccination. Physics Reports, 664, 1\u2013113.","journal-title":"Physics Reports"},{"key":"9463_CR80","volume-title":"Evolutionary game theory","author":"JW Weibull","year":"1997","unstructured":"Weibull, J. W. (1997). Evolutionary game theory. Cambridge: MIT Press."},{"key":"9463_CR81","volume-title":"Multiagent systems: A modern approach to distributed artificial intelligence","author":"G Weiss","year":"1999","unstructured":"Weiss, G. (1999). Multiagent systems: A modern approach to distributed artificial intelligence. Cambridge: MIT Press."},{"key":"9463_CR82","unstructured":"Xu, J., Garc\u00eda, J., & Handfield, T. (2019). Cooperation with bottom-up reputation dynamics. In Proceedings of AAMAS\u201919 (pp. 269\u2013276). IFAAMAS."},{"key":"9463_CR83","doi-asserted-by":"crossref","first-page":"18076","DOI":"10.1038\/srep18076","volume":"5","author":"I Zisis","year":"2015","unstructured":"Zisis, I., Di Guida, S., Han, T., Kirchsteiger, G., & Lenaerts, T. (2015). Generosity motivated by acceptance-evolutionary analysis of an anticipation game. Scientific Reports, 5, 18076.","journal-title":"Scientific Reports"}],"container-title":["Autonomous Agents and Multi-Agent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-020-09463-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10458-020-09463-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-020-09463-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,24]],"date-time":"2022-10-24T19:27:03Z","timestamp":1666639623000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10458-020-09463-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,25]]},"references-count":83,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,10]]}},"alternative-id":["9463"],"URL":"https:\/\/doi.org\/10.1007\/s10458-020-09463-w","relation":{},"ISSN":["1387-2532","1573-7454"],"issn-type":[{"type":"print","value":"1387-2532"},{"type":"electronic","value":"1573-7454"}],"subject":[],"published":{"date-parts":[[2020,5,25]]},"assertion":[{"value":"25 May 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"40"}}