{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T14:48:54Z","timestamp":1778942934218,"version":"3.51.4"},"reference-count":36,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2017,10,27]],"date-time":"2017-10-27T00:00:00Z","timestamp":1509062400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities of China","doi-asserted-by":"crossref","award":["DUT16RC(4)17"],"award-info":[{"award-number":["DUT16RC(4)17"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["71502125, 61672358 and 61502072"],"award-info":[{"award-number":["71502125, 61672358 and 61502072"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Tianjin Research Program of Application Foundation and Advanced Technology","award":["16JCQNJC00100"],"award-info":[{"award-number":["16JCQNJC00100"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Auton. Adapt. Syst."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>\n            In multiagent systems, social norms serves as an important technique in regulating agents\u2019 behaviors to ensure effective coordination among agents without a centralized controlling mechanism. In such a distributed environment, it is important to investigate how a desirable social norm can be synthesized in a bottom-up manner among agents through repeated local interactions and learning techniques. In this article, we propose two novel learning strategies under the collective learning framework,\n            <jats:italic>collective learning EV-l<\/jats:italic>\n            and\n            <jats:italic>collective learning EV-g<\/jats:italic>\n            , to efficiently facilitate the emergence of social norms. Extensive simulations results show that both learning strategies can support the emergence of desirable social norms more efficiently and be applicable in a wider range of multiagent interaction scenarios compared with previous work. The influence of different topologies is investigated, which shows that the performance of all strategies is robust across different network topologies. The influences of a number of key factors (neighborhood size, actions space, population size, fixed agents and isolated subpopulations) on norm emergence performance are investigated as well.\n          <\/jats:p>","DOI":"10.1145\/3127498","type":"journal-article","created":{"date-parts":[[2017,10,27]],"date-time":"2017-10-27T12:48:13Z","timestamp":1509108493000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Efficient and Robust Emergence of Norms through Heuristic Collective Learning"],"prefix":"10.1145","volume":"12","author":[{"given":"Jianye","family":"Hao","sequence":"first","affiliation":[{"name":"School of Computer Software, Tianjin University, Tianjin, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Sun","sequence":"additional","affiliation":[{"name":"Singapore University of Technology and Design, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guangyong","family":"Chen","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Software, Tianjin University, Tianjin, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chao","family":"Yu","sequence":"additional","affiliation":[{"name":"Dalian University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhong","family":"Ming","sequence":"additional","affiliation":[{"name":"Shenzhen University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,10,27]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems","volume":"1","author":"\u00c5gotnes T.","unstructured":"T. \u00c5gotnes and M. Wooldridge . 2010. Optimal social laws . In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems , Volume 1 . 667--674. T. \u00c5gotnes and M. Wooldridge. 2010. Optimal social laws. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, Volume 1. 667--674."},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"A. Alexander K. Lloyd J. Pitt and M. Sergot. 2005. A protocol for resource sharing in norm-governed ad hoc networks. In Declarative Agent Languages and Technologies II. 221--238.  A. Alexander K. Lloyd J. Pitt and M. Sergot. 2005. A protocol for resource sharing in norm-governed ad hoc networks. In Declarative Agent Languages and Technologies II. 221--238.","DOI":"10.1007\/11493402_13"},{"key":"e_1_2_1_3_1","first-page":"1","article-title":"Specifying norm-governed computational societies","volume":"10","author":"Alexander A.","year":"2009","unstructured":"A. Alexander , S. Marek , and P. Jeremy . 2009 . Specifying norm-governed computational societies . ACM Trans. Comput. Logic 10 , 1 (2009), 1 . A. Alexander, S. Marek, and P. Jeremy. 2009. Specifying norm-governed computational societies. ACM Trans. Comput. Logic 10, 1 (2009), 1.","journal-title":"ACM Trans. Comput. Logic"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0378-4371(00)00018-2"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI.2015.139"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21268-0_14"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-012-9193-x"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems. 247--255","author":"Genter K.","unstructured":"K. Genter , S. Zhang , and P. Stone . 2015. Determining placements of influencing agents in a flock . In Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems. 247--255 . K. Genter, S. Zhang, and P. Stone. 2015. Determining placements of influencing agents in a flock. In Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems. 247--255."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems","volume":"2","author":"Griffiths N.","year":"2008","unstructured":"N. Griffiths . 2008 . Tags and image scoring for robust cooperation . In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems , Volume 2 . 575--582. N. Griffiths. 2008. Tags and image scoring for robust cooperation. In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, Volume 2. 575--582."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems. 1367--1368","author":"Griffiths N.","unstructured":"N. Griffiths and S. S. Anand . 2012. The impact of social placement of non-learning agents on convention emergence . In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems. 1367--1368 . N. Griffiths and S. S. Anand. 2012. The impact of social placement of non-learning agents on convention emergence. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems. 1367--1368."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems. 249--256","author":"Griffiths N.","unstructured":"N. Griffiths and M. Luck . 2010a. Changing neighbours: Improving tag-based cooperation . In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems. 249--256 . N. Griffiths and M. Luck. 2010a. Changing neighbours: Improving tag-based cooperation. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems. 249--256."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 8th European Workshop on Multi-Agent Systems.","author":"Griffiths N.","unstructured":"N. Griffiths and M. Luck . 2010b. Norm emergence in tag-based cooperation . In Proceedings of the 8th European Workshop on Multi-Agent Systems. N. Griffiths and M. Luck. 2010b. Norm emergence in tag-based cooperation. In Proceedings of the 8th European Workshop on Multi-Agent Systems."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-03473-7_12"},{"key":"e_1_2_1_14_1","volume-title":"Convention emergence and influence in dynamic topologies. In Proceedings of International Conference on Autonomous Agents and Multiagent Systems. 1785--1786","author":"James M.","unstructured":"M. James , N. Griffiths , and M. Leeke . 2015 . Convention emergence and influence in dynamic topologies. In Proceedings of International Conference on Autonomous Agents and Multiagent Systems. 1785--1786 . M. James, N. Griffiths, and M. Leeke. 2015. Convention emergence and influence in dynamic topologies. In Proceedings of International Conference on Autonomous Agents and Multiagent Systems. 1785--1786."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 18th National Conference on Artificial Intelligence. 326--331","author":"Kapetanakis S.","unstructured":"S. Kapetanakis and D. Kudenko . 2002. Reinforcement learning of coordination in cooperative multiagent systems . In Proceedings of the 18th National Conference on Artificial Intelligence. 326--331 . S. Kapetanakis and D. Kudenko. 2002. Reinforcement learning of coordination in cooperative multiagent systems. In Proceedings of the 18th National Conference on Artificial Intelligence. 326--331."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/375735.376302"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the Coordination, Organizations, Institutions and Norms in Agent Systems Workshop.","author":"Marchant J.","unstructured":"J. Marchant , N. Griffiths , and M. Leeke . 2015. Manipulating conventions in a particle-based topology . In Proceedings of the Coordination, Organizations, Institutions and Norms in Agent Systems Workshop. J. Marchant, N. Griffiths, and M. Leeke. 2015. Manipulating conventions in a particle-based topology. In Proceedings of the Coordination, Organizations, Institutions and Norms in Agent Systems Workshop."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1329125.1329429"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems. 489--496","author":"Matlock M.","unstructured":"M. Matlock and S. Sen . 2009. Effective tag mechanisms for evolving cooperation . In Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems. 489--496 . M. Matlock and S. Sen. 2009. Effective tag mechanisms for evolving cooperation. In Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems. 489--496."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-013-9240-2"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems. 483--490","author":"Morales J.","unstructured":"J. Morales , M. Lopez-Sanchez , J. A. Rodriguez-Aguilar , M. Wooldridge , and W. Vasconcelos . 2013. Automated synthesis of normative systems . In Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems. 483--490 . J. Morales, M. Lopez-Sanchez, J. A. Rodriguez-Aguilar, M. Wooldridge, and W. Vasconcelos. 2013. Automated synthesis of normative systems. In Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems. 483--490."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCAS.2006.1688199"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s100510050359"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1103\/RevModPhys.74.47"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14962-7_14"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the 16th International Joint Conference on Artificial Intelligence. 1507--1512","author":"Sen S.","unstructured":"S. Sen and S. Airiau . 2007. Emergence of norms through social learning . In Proceedings of the 16th International Joint Conference on Artificial Intelligence. 1507--1512 . S. Sen and S. Airiau. 2007. Emergence of norms through social learning. In Proceedings of the 16th International Joint Conference on Artificial Intelligence. 1507--1512."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(97)00028-3"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 20th International Joint Conference on Artificial Intelligence. 420--425","author":"Villatoro D.","unstructured":"D. Villatoro , J. Sabater-Mir , and S. Sen . 2011. Social instruments for robust convention emergence . In Proceedings of the 20th International Joint Conference on Artificial Intelligence. 420--425 . D. Villatoro, J. Sabater-Mir, and S. Sen. 2011. Social instruments for robust convention emergence. In Proceedings of the 20th International Joint Conference on Artificial Intelligence. 420--425."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/WI-IAT.2009.155"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCAS.2003.1228503"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 22th European Conference on Artificial Intelligence (ECAI\u201916)","author":"Yang T. P.","unstructured":"T. P. Yang , Z. P. Meng , J. Y. Hao , S. Sen , and C. Yu . 2016. Accelerating norm emergence through hierarchical heuristic learning . In Proceedings of the 22th European Conference on Artificial Intelligence (ECAI\u201916) . 1344--1352. T. P. Yang, Z. P. Meng, J. Y. Hao, S. Sen, and C. Yu. 2016. Accelerating norm emergence through hierarchical heuristic learning. In Proceedings of the 22th European Conference on Artificial Intelligence (ECAI\u201916). 1344--1352."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.10.2.105"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-26350-2_56"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1038\/srep27626"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2014.2306919"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 12th International Conference on Autonomous Agents and Multiagent Systems. 475--482","author":"Yu C.","unstructured":"C. Yu , M. J. Zhang , F. H. Ren , and X. D. Luo . 2013. Emergence of social norms through collective learning in networked agent societies . In Proceedings of the 12th International Conference on Autonomous Agents and Multiagent Systems. 475--482 . C. Yu, M. J. Zhang, F. H. Ren, and X. D. Luo. 2013. Emergence of social norms through collective learning in networked agent societies. In Proceedings of the 12th International Conference on Autonomous Agents and Multiagent Systems. 475--482."}],"container-title":["ACM Transactions on Autonomous and Adaptive Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3127498","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3127498","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:30:29Z","timestamp":1750217429000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3127498"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,27]]},"references-count":36,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3127498"],"URL":"https:\/\/doi.org\/10.1145\/3127498","relation":{},"ISSN":["1556-4665","1556-4703"],"issn-type":[{"value":"1556-4665","type":"print"},{"value":"1556-4703","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,27]]},"assertion":[{"value":"2015-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-10-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}