{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T13:48:53Z","timestamp":1792158533422,"version":"4.4.0"},"reference-count":55,"publisher":"AIP Publishing","issue":"10","funder":[{"DOI":"10.13039\/501100010903","name":"National Key R&D Program of China","doi-asserted-by":"publisher","award":["2023YFF1204805"],"award-info":[{"award-number":["2023YFF1204805"]}],"id":[{"id":"10.13039\/501100010903","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010903","name":"Open Research Project of the State Key Laboratory of Industrial Control Technology, China","doi-asserted-by":"publisher","award":["ICT2026A23"],"award-info":[{"award-number":["ICT2026A23"]}],"id":[{"id":"10.13039\/501100010903","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010903","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62336005"],"award-info":[{"award-number":["62336005"]}],"id":[{"id":"10.13039\/501100010903","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100018625","name":"Science and Technology Innovation Plan Of Shanghai Science and Technology Commission","doi-asserted-by":"publisher","award":["22JC1401400"],"award-info":[{"award-number":["22JC1401400"]}],"id":[{"id":"10.13039\/501100018625","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007620","name":"Department of Education of Liaoning Province","doi-asserted-by":"publisher","award":["JYTMS20230377"],"award-info":[{"award-number":["JYTMS20230377"]}],"id":[{"id":"10.13039\/501100007620","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,10,1]]},"abstract":"<jats:p>Considering agents tend to interact preferentially with others adopting similar behaviors, this paper investigates the impact of similarity-based interaction mechanism on learning dynamics and evolution of strategies. We propose a novel evolution model for reactive strategies in which agents interact with similar partners within some threshold, forming a dynamically structural population. By combining exploitation and exploration, we analyze the evolution dynamics of cooperation under the influence of various payoff parameters and similarity thresholds. The results show that similarity-based interactions can efficiently protect cooperative strategies and promote their persistence. Robustness analysis further demonstrates that similarity-driven interactions sustain high cooperation across different population sizes and that moderate random exploration enhances cooperative evolution.<\/jats:p>","DOI":"10.1063\/5.0356075","type":"journal-article","created":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T13:05:21Z","timestamp":1792155921000},"update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":0,"title":["Emergence of cooperation in reactive strategy space through similarity-based interactions"],"prefix":"10.1063","volume":"36","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1568-0737","authenticated-orcid":false,"given":"Jiancheng","family":"Zhao","sequence":"first","affiliation":[{"name":"School of Information and Intelligent Science, Donghua University 1 , Shanghai 201620,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3636-7555","authenticated-orcid":false,"given":"Jing","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information and Intelligent Science, Donghua University 1 , Shanghai 201620,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2009-1053","authenticated-orcid":false,"given":"Zhihai","family":"Rong","sequence":"additional","affiliation":[{"name":"School of Information and Intelligent Science, Donghua University 1 , Shanghai 201620,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9963-3160","authenticated-orcid":false,"given":"Xiuli","family":"Du","sequence":"additional","affiliation":[{"name":"Communication and Network Laboratory, Dalian University 2 , Dalian 116622,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4943-7919","authenticated-orcid":false,"given":"Wen","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, East China University of Science and Technology 3 , Shanghai 200237,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"317","published-online":{"date-parts":[[2026,10,16]]},"reference":[{"key":"2026101609051973800_c1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.physrep.2021.10.005","article-title":"Social physics","volume":"948","year":"2022","journal-title":"Phys. Rep."},{"key":"2026101609051973800_c2","doi-asserted-by":"publisher","first-page":"2441","DOI":"10.1038\/s41562-025-02373-5","article-title":"Higher-order interactions shape collective human behaviour","volume":"9","year":"2025","journal-title":"Nat. Human Behav."},{"key":"2026101609051973800_c3","doi-asserted-by":"publisher","first-page":"010402","DOI":"10.1063\/5.0311028","article-title":"Introduction to focus issue: Intelligent game on networked systems: Optimization, evolution and control","volume":"36","year":"2026","journal-title":"Chaos"},{"key":"2026101609051973800_c4","doi-asserted-by":"publisher","first-page":"e2319948121","DOI":"10.1073\/pnas.2319948121","article-title":"Collective cooperative intelligence","volume":"122","year":"2025","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"2026101609051973800_c5","doi-asserted-by":"publisher","first-page":"e2505860122","DOI":"10.1073\/pnas.2505860122","article-title":"Collective artificial intelligence and evolutionary dynamics","volume":"122","year":"2025","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"2026101609051973800_c6","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1038\/d41586-021-01170-0","article-title":"Cooperative AI: Machines must learn to find common ground","volume":"593","year":"2021","journal-title":"Nature"},{"key":"2026101609051973800_c7","doi-asserted-by":"publisher","first-page":"1390","DOI":"10.1126\/science.7466396","article-title":"The evolution of cooperation","volume":"211","year":"1981","journal-title":"Science"},{"key":"2026101609051973800_c8","doi-asserted-by":"publisher","first-page":"1560","DOI":"10.1126\/science.1133755","article-title":"Five rules for the evolution of cooperation","volume":"314","year":"2006","journal-title":"Science"},{"key":"2026101609051973800_c9","doi-asserted-by":"publisher","first-page":"103103","DOI":"10.1063\/1.5120349","article-title":"Heterogeneous cooperative leadership structure emerging from random regular graphs","volume":"29","year":"2019","journal-title":"Chaos"},{"key":"2026101609051973800_c10","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/TNSE.2024.3481434","article-title":"Limitation of time promotes cooperation in structured collaboration systems","volume":"12","year":"2025","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"2026101609051973800_c11","doi-asserted-by":"publisher","first-page":"4562","DOI":"10.1109\/TAC.2025.3529852","article-title":"Optimally combined incentive for cooperation among interacting agents in population games","volume":"70","year":"2025","journal-title":"IEEE Trans. Autom. Control"},{"key":"2026101609051973800_c12","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1038\/s42005-026-02611-w","article-title":"Explosive transitions in coevolutionary dynamics of synchronization and cooperation","volume":"9","year":"2026","journal-title":"Commun. Phys."},{"key":"2026101609051973800_c13","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1038\/s41562-018-0320-9","article-title":"Partners and rivals in direct reciprocity","volume":"2","year":"2018","journal-title":"Nat. Human Behav."},{"key":"2026101609051973800_c14","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1177\/0022002785029004004","article-title":"The optimal level of generosity in a selfish, uncertain environment","volume":"29","year":"1985","journal-title":"J. Confl. Resolut."},{"key":"2026101609051973800_c15","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1038\/355250a0","article-title":"Tit for tat in heterogeneous populations","volume":"355","year":"1992","journal-title":"Nature"},{"key":"2026101609051973800_c16","doi-asserted-by":"publisher","first-page":"e2221080120","DOI":"10.1073\/pnas.2221080120","article-title":"Mutation enhances cooperation in direct reciprocity","volume":"120","year":"2023","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"2026101609051973800_c17","doi-asserted-by":"publisher","first-page":"2259","DOI":"10.1038\/s41467-020-16088-w","article-title":"Evolution of cooperation on temporal networks","volume":"11","year":"2020","journal-title":"Nat. Commun."},{"key":"2026101609051973800_c18","doi-asserted-by":"publisher","first-page":"20220667","DOI":"10.1098\/rspa.2022.0667","article-title":"Extending Q-learning to continuous and mixed strategy games based on spatial reciprocity","volume":"479","year":"2023","journal-title":"Proc. R. Soc. A"},{"key":"2026101609051973800_c19","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1038\/s43588-024-00621-8","article-title":"Strategy evolution on higher-order networks","volume":"4","year":"2024","journal-title":"Nat. Comput. Sci."},{"key":"2026101609051973800_c20","doi-asserted-by":"publisher","first-page":"5349","DOI":"10.1038\/s41467-024-49505-5","article-title":"Evolutionary dynamics of any multiplayer game on regular graphs","volume":"15","year":"2024","journal-title":"Nat. Commun."},{"key":"2026101609051973800_c21","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1038\/s42005-026-02536-4","article-title":"Effects of stochastic games on evolutionary dynamics in structured populations","volume":"9","year":"2026","journal-title":"Commun. Phys."},{"key":"2026101609051973800_c22","doi-asserted-by":"publisher","first-page":"1557","DOI":"10.1109\/TSIPN.2025.3636748","article-title":"Evolutionary dynamics based on reputation in networked populations with game transitions","volume":"11","year":"2025","journal-title":"IEEE Trans. Signal Inf. Process. Netw."},{"key":"2026101609051973800_c23","doi-asserted-by":"publisher","first-page":"033146","DOI":"10.1063\/5.0325835","article-title":"The impact of dynamic hyperedge activation mechanism on the evolution of cooperation on hypergraphs","volume":"36","year":"2026","journal-title":"Chaos"},{"key":"2026101609051973800_c24","doi-asserted-by":"publisher","first-page":"117586","DOI":"10.1016\/j.chaos.2025.117586","article-title":"Reputation assimilation mechanism for sustaining cooperation","volume":"202","year":"2026","journal-title":"Chaos Solitons Fractals"},{"key":"2026101609051973800_c25","doi-asserted-by":"publisher","first-page":"9929","DOI":"10.1073\/pnas.1206694109","article-title":"Direct reciprocity in structured populations","volume":"109","year":"2012","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"2026101609051973800_c26","doi-asserted-by":"publisher","first-page":"128439","DOI":"10.1016\/j.neucom.2024.128439","article-title":"Mixing prisoner\u2019s dilemma games on higher-order networks","volume":"607","year":"2024","journal-title":"Neurocomputing"},{"key":"2026101609051973800_c27","doi-asserted-by":"publisher","first-page":"8387","DOI":"10.1109\/TNNLS.2024.3439372","article-title":"Evolutionary dynamics of population games with an aspiration-based learning rule","volume":"36","year":"2025","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"2026101609051973800_c28","doi-asserted-by":"publisher","first-page":"123102","DOI":"10.1063\/5.0242023","article-title":"Effects of value-driven social learning on cooperation in the prisoner\u2019s dilemma games","volume":"34","year":"2024","journal-title":"Chaos"},{"key":"2026101609051973800_c29","doi-asserted-by":"publisher","first-page":"115541","DOI":"10.1016\/j.chaos.2024.115541","article-title":"Coevolution of extortion strategies with mixed imitation and aspiration learning dynamics in spatial prisoner\u2019s dilemma game","volume":"188","year":"2024","journal-title":"Chaos Solitons Fractals"},{"key":"2026101609051973800_c30","doi-asserted-by":"publisher","first-page":"118764","DOI":"10.1016\/j.chaos.2026.118764","article-title":"Non-monotonic effects of interlayer coupling on cooperation dynamics in higher-order networks","volume":"211","year":"2026","journal-title":"Chaos Solitons Fractals"},{"key":"2026101609051973800_c31","doi-asserted-by":"publisher","first-page":"052302","DOI":"10.1103\/PhysRevE.95.052302","article-title":"Extortion provides alternative routes to the evolution of cooperation in structured populations","volume":"95","year":"2017","journal-title":"Phys. Rev. E"},{"key":"2026101609051973800_c32","doi-asserted-by":"publisher","first-page":"8563","DOI":"10.1109\/TPAMI.2025.3579895","article-title":"Dynamic evolution of complex networks: A reinforcement learning approach applying evolutionary games to community structure","volume":"47","year":"2025","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2026101609051973800_c33","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2026.3710199","article-title":"Reinforcement learning in pursuit-evasion differential game: Safety, stability, and robustness","year":"2026","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"2026101609051973800_c34","doi-asserted-by":"publisher","first-page":"e2319933121","DOI":"10.1073\/pnas.2319933121","article-title":"Perceptual interventions ameliorate statistical discrimination in learning agents","volume":"122","year":"2025","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"2026101609051973800_c35","doi-asserted-by":"publisher","first-page":"123140","DOI":"10.1063\/5.0093996","article-title":"Incorporating social payoff into reinforcement learning promotes cooperation","volume":"32","year":"2022","journal-title":"Chaos"},{"key":"2026101609051973800_c36","doi-asserted-by":"publisher","first-page":"e2319929121","DOI":"10.1073\/pnas.2319929121","article-title":"Heterogeneity, reinforcement learning, and chaos in population games","volume":"122","year":"2025","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"2026101609051973800_c37","doi-asserted-by":"publisher","first-page":"659","DOI":"10.1613\/jair.4818","article-title":"Evolutionary dynamics of multi-agent learning: A survey","volume":"53","year":"2015","journal-title":"J. Artif. Intell. Res."},{"key":"2026101609051973800_c38","doi-asserted-by":"publisher","first-page":"2463","DOI":"10.1109\/TCSII.2022.3161655","article-title":"Analysis of Q-learning like algorithms through evolutionary game dynamics","volume":"69","year":"2022","journal-title":"IEEE Trans. Circuits Syst. II Express Briefs"},{"key":"2026101609051973800_c39","doi-asserted-by":"publisher","first-page":"033138","DOI":"10.1063\/5.0326357","article-title":"Mutation promote cooperation in repeated games on structured populations","volume":"36","year":"2026","journal-title":"Chaos"},{"key":"2026101609051973800_c40","doi-asserted-by":"publisher","first-page":"118289","DOI":"10.1016\/j.chaos.2026.118289","article-title":"Evolutionary dynamics under combined regret-based learning and random exploration","volume":"208","year":"2026","journal-title":"Chaos Solitons Fractals"},{"key":"2026101609051973800_c41","doi-asserted-by":"publisher","first-page":"116653","DOI":"10.1016\/j.chaos.2025.116653","article-title":"Q-learning update with second-order reputation promotes the evolution of trust within structured populations","volume":"199","year":"2025","journal-title":"Chaos Solitons Fractals"},{"key":"2026101609051973800_c42","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1038\/35106555","article-title":"Evolution of cooperation without reciprocity","volume":"414","year":"2001","journal-title":"Nature"},{"key":"2026101609051973800_c43","doi-asserted-by":"publisher","first-page":"046129","DOI":"10.1103\/PhysRevE.68.046129","article-title":"Minimal model for tag-based cooperation","volume":"68","year":"2003","journal-title":"Phys. Rev. E"},{"key":"2026101609051973800_c44","doi-asserted-by":"publisher","first-page":"046128","DOI":"10.1103\/PhysRevE.70.046128","article-title":"Similarity-based cooperation and spatial segregation","volume":"70","year":"2004","journal-title":"Phys. Rev. E"},{"key":"2026101609051973800_c45","doi-asserted-by":"publisher","first-page":"19318","DOI":"10.1073\/pnas.1215443110","article-title":"Similarity increases altruistic punishment in humans","volume":"110","year":"2013","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"2026101609051973800_c46","doi-asserted-by":"publisher","first-page":"e1011269","DOI":"10.1371\/journal.pcbi.1011269","article-title":"Nonlinear eco-evolutionary games with global environmental fluctuations and local environmental feedbacks","volume":"19","year":"2023","journal-title":"PLOS Comput. Biol."},{"key":"2026101609051973800_c47","doi-asserted-by":"publisher","first-page":"113874","DOI":"10.1016\/j.chaos.2023.113874","article-title":"Evolution of cooperation with tag-based expulsion in spatial public goods game","volume":"174","year":"2023","journal-title":"Chaos Solitons Fractals"},{"key":"2026101609051973800_c48","doi-asserted-by":"publisher","first-page":"665","DOI":"10.1177\/002200277501900409","article-title":"Attitude similarity, social goals, and cooperation","volume":"19","year":"1975","journal-title":"J. Confl. Resolut."},{"key":"2026101609051973800_c49","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1146\/annurev.soc.27.1.415","article-title":"Birds of a feather: Homophily in social networks","volume":"27","year":"2001","journal-title":"Ann. Rev. Sociol."},{"key":"2026101609051973800_c50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.evolhumbehav.2013.08.008","article-title":"Chimps of a feather sit together: Chimpanzee friendships are based on homophily in personality","volume":"35","year":"2014","journal-title":"Evol. Hum. Behav."},{"key":"2026101609051973800_c51","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1146\/annurev.soc.012809.102709","article-title":"Statistical models for social networks","volume":"37","year":"2011","journal-title":"Ann. Rev. Sociol."},{"key":"2026101609051973800_c52","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1109\/TPDS.2012.166","article-title":"Social similarity favors cooperation: The distributed content replication case","volume":"24","year":"2013","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"2026101609051973800_c53","doi-asserted-by":"publisher","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","DOI":"10.1609\/aaai.v34i05.6190"},{"key":"2026101609051973800_c54","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1038\/nature11459","article-title":"Popularity versus similarity in growing networks","volume":"489","year":"2012","journal-title":"Nature"},{"key":"2026101609051973800_c55","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1038\/s42254-020-00264-4","article-title":"Network geometry","volume":"3","year":"2021","journal-title":"Nat. Rev. Phys."}],"container-title":["Chaos: An Interdisciplinary Journal of Nonlinear Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/aip\/cha\/article-pdf\/doi\/10.1063\/5.0356075\/21172856\/103130_1_5.0356075.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/aip\/cha\/article-pdf\/doi\/10.1063\/5.0356075\/21172856\/103130_1_5.0356075.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T13:05:23Z","timestamp":1792155923000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/cha\/article\/36\/10\/103130\/3406686\/Emergence-of-cooperation-in-reactive-strategy"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,1]]},"references-count":55,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2026,10,1]]}},"URL":"https:\/\/doi.org\/10.1063\/5.0356075","relation":{},"ISSN":["1054-1500","1089-7682"],"issn-type":[{"value":"1054-1500","type":"print"},{"value":"1089-7682","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,10]]},"published":{"date-parts":[[2026,10,1]]},"article-number":"103130"}}