{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T04:23:23Z","timestamp":1781929403529,"version":"3.54.5"},"reference-count":56,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T00:00:00Z","timestamp":1721260800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T00:00:00Z","timestamp":1721260800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton Agent Multi-Agent Syst"],"published-print":{"date-parts":[[2024,12]]},"DOI":"10.1007\/s10458-024-09665-6","type":"journal-article","created":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T05:01:25Z","timestamp":1721278885000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Team-wise effective communication in multi-agent reinforcement learning"],"prefix":"10.1007","volume":"38","author":[{"given":"Ming","family":"Yang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kaiyan","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiming","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Renzhi","family":"Dong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yali","family":"Du","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Furui","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingliang","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leong Hou","family":"U","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,7,18]]},"reference":[{"key":"9665_CR1","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1007\/s10458-023-09621-w","volume":"37","author":"R Zivan","year":"2023","unstructured":"Zivan, R., Rachmut, B., Perry, O., et al. (2023). Effect of asynchronous execution and imperfect communication on max-sum belief propagation. Autonomous Agents and Multi-Agent Systems, 37, 40. https:\/\/doi.org\/10.1007\/s10458-023-09621-w","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"issue":"2","key":"9665_CR2","doi-asserted-by":"publisher","first-page":"2653","DOI":"10.1109\/TII.2023.3296910","volume":"20","author":"M Yang","year":"2023","unstructured":"Yang, M., Wang, Y., Yu, Y., Zhou, M., & U, L. H. (2023). MixLight: Mixed-agent cooperative reinforcement learning for traffic light control. IEEE Transactions on Industrial Informatics, 20(2), 2653\u20132661. https:\/\/doi.org\/10.1109\/TII.2023.3296910","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"9665_CR3","unstructured":"Foerster, J. N., Assael, Y. M., Freitas, N., & Whiteson, S. (2016). Learning to communicate with deep multi-agent reinforcement learning. In Proceedings of the 30th international conference on neural information processing systems (pp. 2145\u20132153)."},{"key":"9665_CR4","first-page":"2244","volume":"29","author":"S Sukhbaatar","year":"2016","unstructured":"Sukhbaatar, S., Fergus, R., et al. (2016). Learning multiagent communication with backpropagation. Advances in Neural Information Processing Systems, 29, 2244\u20132252.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9665_CR5","first-page":"7254","volume":"31","author":"J Jiang","year":"2018","unstructured":"Jiang, J., & Lu, Z. (2018). Learning attentional communication for multi-agent cooperation. Advances in Neural Information Processing Systems, 31, 7254\u20137264.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9665_CR6","unstructured":"Singh, A., Jain, T., & Sukhbaatar, S. (2018). Learning when to communicate at scale in multiagent cooperative and competitive tasks. In International conference on learning representations."},{"key":"9665_CR7","unstructured":"Das, A., Gervet, T., Romoff, J., Batra, D., Parikh, D., Rabbat, M., & Pineau, J. (2019). Tarmac: Targeted multi-agent communication. In International conference on machine learning (pp. 1538\u20131546). PMLR."},{"key":"9665_CR8","unstructured":"Du, Y., Liu, B., Moens, V., Liu, Z., Ren, Z., Wang, J., Chen, X., & Zhang, H. (2021). Learning correlated communication topology in multi-agent reinforcement learning. In Proceedings of the 20th international conference on autonomous agents and multiagent systems (pp. 456\u2013464)."},{"key":"9665_CR9","unstructured":"Niu, Y., Paleja, R., & Gombolay, M. (2021). Multi-agent graph-attention communication and teaming. In Proceedings of the 20th international conference on autonomous agents and multiagent systems (pp. 964\u2013973)."},{"key":"9665_CR10","unstructured":"Jiang, J., Dun, C., Huang, T., & Lu, Z. (2020). Graph convolutional reinforcement learning. In International conference on learning representations."},{"key":"9665_CR11","doi-asserted-by":"crossref","unstructured":"Yang, M., Dong, R., Wang, Y., Liu, F., Du, Y., Zhou, M., & Hou\u00a0U, L. (2023) TieComm: Learning a hierarchical communication topology based on tie theory. In International conference on database systems for advanced applications (pp. 604\u2013613). Springer.","DOI":"10.1007\/978-3-031-30637-2_40"},{"issue":"3","key":"9665_CR12","first-page":"271","volume":"43","author":"C Arney","year":"2009","unstructured":"Arney, C. (2009). Linked: How everything is connected to everything else and what it means for business, science, and everyday life. Mathematics and Computer Education, 43(3), 271.","journal-title":"Mathematics and Computer Education"},{"issue":"6","key":"9665_CR13","doi-asserted-by":"publisher","first-page":"1360","DOI":"10.1086\/225469","volume":"78","author":"MS Granovetter","year":"1973","unstructured":"Granovetter, M. S. (1973). The strength of weak ties. American Journal of Sociology, 78(6), 1360\u20131380.","journal-title":"American Journal of Sociology"},{"issue":"5","key":"9665_CR14","doi-asserted-by":"publisher","first-page":"1212","DOI":"10.1086\/230410","volume":"99","author":"JD Montgomery","year":"1994","unstructured":"Montgomery, J. D. (1994). Weak ties, employment, and inequality: An equilibrium analysis. American Journal of Sociology, 99(5), 1212\u20131236.","journal-title":"American Journal of Sociology"},{"key":"9665_CR15","unstructured":"Han, S., Dastani, M., & Wang, S. (2023). Model-based sparse communication in multi-agent reinforcement learning. In Proceedings of the 2023 international conference on autonomous agents and multiagent systems (pp. 439\u2013447)."},{"key":"9665_CR16","doi-asserted-by":"crossref","unstructured":"Foerster, J., Farquhar, G., Afouras, T., Nardelli, N., & Whiteson, S. (2018). Counterfactual multi-agent policy gradients. In Proceedings of the AAAI conference on artificial intelligence (Vol. 32).","DOI":"10.1609\/aaai.v32i1.11794"},{"key":"9665_CR17","first-page":"6379","volume":"30","author":"R Lowe","year":"2017","unstructured":"Lowe, R., Wu, Y., Tamar, A., Harb, J., Pieter Abbeel, O., & Mordatch, I. (2017). Multi-agent actor-critic for mixed cooperative-competitive environments. Advances in Neural Information Processing Systems, 30, 6379\u20136390.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9665_CR18","unstructured":"Du, Y., Han, L., Fang, M., Liu, J., Dai, T., & Tao, D. (2019) LIIR: Learning individual intrinsic reward in multi-agent reinforcement learning. In Advances in neural information processing systems 32."},{"key":"9665_CR19","unstructured":"Han, L., Sun, P., Du, Y., Xiong, J., Wang, Q., Sun, X., Liu, H., & Zhang, T. (2019). Grid-wise control for multi-agent reinforcement learning in video game AI. In International conference on machine learning (pp. 2576\u20132585). PMLR."},{"key":"9665_CR20","unstructured":"Sunehag, P., Lever, G., Gruslys, A., Czarnecki, W. M., Zambaldi, V., Jaderberg, M., Lanctot, M., Sonnerat, N., Leibo, J. Z., Tuyls, K., et al. (2018). Value-decomposition networks for cooperative multi-agent learning based on team reward. In Proceedings of the 17th international conference on autonomous agents and multiagent systems (pp. 2085\u20132087)."},{"key":"9665_CR21","unstructured":"Rashid, T., Samvelyan, M., Schroeder, C., Farquhar, G., Foerster, J., & Whiteson, S. (2018). QMIX: Monotonic value function factorisation for deep multi-agent reinforcement learning. In International conference on machine learning (pp. 4295\u20134304). PMLR."},{"key":"9665_CR22","unstructured":"Son, K., Kim, D., Kang, W. J., Hostallero, D. E., & Yi, Y. (2019) QTRAN: Learning to factorize with transformation for cooperative multi-agent reinforcement learning. In International conference on machine learning (pp. 5887\u20135896). PMLR."},{"key":"9665_CR23","unstructured":"Mahajan, A., Rashid, T., Samvelyan, M., & Whiteson, S. (2019) MAVEN: Multi-agent variational exploration. In Advances in neural information processing systems 32."},{"key":"9665_CR24","doi-asserted-by":"crossref","unstructured":"Freed, B., James, R., Sartoretti, G., & Choset, H. (2020). Sparse discrete communication learning for multi-agent cooperation through backpropagation. In 2020 IEEE\/RSJ international conference on intelligent robots and systems (IROS) (pp. 7993\u20137998). IEEE.","DOI":"10.1109\/IROS45743.2020.9341079"},{"key":"9665_CR25","unstructured":"Li, X., & Zhang, J. (2024). Context-aware communication for multi-agent reinforcement learning. In 23nd international conference on autonomous agents and multiagent systems (AAMAS 2024)."},{"issue":"2","key":"9665_CR26","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/s10458-023-09617-6","volume":"37","author":"Y Wang","year":"2023","unstructured":"Wang, Y., Wang, Y., & Sartoretti, G. (2023). Full communication memory networks for team-level cooperation learning. Autonomous Agents and Multi-Agent Systems, 37(2), 33.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9665_CR27","doi-asserted-by":"crossref","unstructured":"Yuan, L., Wang, J., Zhang, F., Wang, C., Zhang, Z., Yu, Y., & Zhang, C. (2022). Multi-agent incentive communication via decentralized teammate modeling. In Proceedings of the AAAI conference on artificial intelligence (Vol. 36, pp. 9466\u20139474).","DOI":"10.1609\/aaai.v36i9.21179"},{"key":"9665_CR28","first-page":"17271","volume":"33","author":"SQ Zhang","year":"2020","unstructured":"Zhang, S. Q., Zhang, Q., & Lin, J. (2020). Succinct and robust multi-agent communication with temporal message control. Advances in Neural Information Processing Systems, 33, 17271\u201317282.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9665_CR29","unstructured":"Chu, T., Chinchali, S., & Katti, S. (2019). Multi-agent reinforcement learning for networked system control. In International conference on learning representations."},{"key":"9665_CR30","unstructured":"Gupta, S., Hazra, R., & Dukkipati, A. (2020). Networked multi-agent reinforcement learning with emergent communication. In Proceedings of the international joint conference on autonomous agents and multiagent systems (AAMAS) (Vol. 2020, pp. 1858\u20131860)."},{"key":"9665_CR31","doi-asserted-by":"crossref","unstructured":"Zhang, K., Yang, Z., Liu, H., Zhang, T., & Basar, T. (2018). Fully decentralized multi-agent reinforcement learning with networked agents. In International conference on machine learning (pp. 5872\u20135881). PMLR.","DOI":"10.1109\/CDC.2018.8619581"},{"key":"9665_CR32","unstructured":"Kim, D., Moon, S., Hostallero, D., Kang, W.J., Lee, T., Son, K., & Yi, Y. (2019). Learning to schedule communication in multi-agent reinforcement learning. In ICLR 2019: international conference on representation learning."},{"key":"9665_CR33","doi-asserted-by":"crossref","unstructured":"Liu, Y., Wang, W., Hu, Y., Hao, J., Chen, X., & Gao, Y. (2020). Multi-agent game abstraction via graph attention neural network. In Proceedings of the AAAI conference on artificial intelligence (Vol. 34, pp. 7211\u20137218).","DOI":"10.1609\/aaai.v34i05.6211"},{"issue":"2","key":"9665_CR34","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1007\/s10458-022-09580-8","volume":"36","author":"J Sheng","year":"2022","unstructured":"Sheng, J., Wang, X., Jin, B., Yan, J., Li, W., Chang, T.-H., Wang, J., & Zha, H. (2022). Learning structured communication for multi-agent reinforcement learning. Autonomous Agents and Multi-Agent Systems, 36(2), 50.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9665_CR35","unstructured":"Ruan, J., Du, Y., Xiong, X., Xing, D., Li, X., Meng, L., Zhang, H., Wang, J., & Xu, B. (2022). GCS: Graph-based coordination strategy for multi-agent reinforcement learning. In International conference on autonomous agents and multi-agent systems (AAMAS)."},{"key":"9665_CR36","unstructured":"Seraj, E., Wang, Z., Paleja, R., Patel, A., & Gombolay, M. (2022). Learning efficient diverse communication for cooperative heterogeneous teaming. Technical report, Sandia National Lab. (SNL-NM), Albuquerque, NM, USA."},{"key":"9665_CR37","unstructured":"Wang, R., He, X., Yu, R., Qiu, W., An, B., & Rabinovich, Z. (2020). Learning efficient multi-agent communication: An information bottleneck approach. In International conference on machine learning (pp. 9908\u20139918). PMLR."},{"issue":"5","key":"9665_CR38","doi-asserted-by":"publisher","first-page":"3096","DOI":"10.1109\/TPAMI.2023.3337534","volume":"46","author":"S Ding","year":"2023","unstructured":"Ding, S., Du, W., Ding, L., Zhang, J., Guo, L., & An, B. (2023). Robust multi-agent communication with graph information bottleneck optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(5), 3096\u20133107.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"9665_CR39","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1007\/978-3-642-27645-3_15","volume-title":"Reinforcement learning: State-of-the-art","author":"FA Oliehoek","year":"2012","unstructured":"Oliehoek, F. A. (2012). Decentralized POMDPs. In M. Wiering & M. van Otterlo (Eds.), Reinforcement learning: State-of-the-art (pp. 471\u2013503). Berlin: Springer."},{"key":"9665_CR40","volume-title":"Game theory: Analysis of conflict","author":"R Myerson","year":"1991","unstructured":"Myerson, R. (1991). Game theory: Analysis of conflict (Vol. 3). Harvard University Press."},{"key":"9665_CR41","doi-asserted-by":"crossref","unstructured":"Voita, E., Talbot, D., Moiseev, F., Sennrich, R., & Titov, I. (2019). Analyzing multi-head self-attention: Specialized heads do the heavy lifting, the rest can be pruned. In Proceedings of the 57th annual meeting of the Association for Computational Linguistics (pp. 5797\u20135808). Association for Computational Linguistics.","DOI":"10.18653\/v1\/P19-1580"},{"issue":"1","key":"9665_CR42","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1146\/annurev.soc.27.1.415","volume":"27","author":"M McPherson","year":"2001","unstructured":"McPherson, M., Smith-Lovin, L., & Cook, J. M. (2001). Birds of a feather: Homophily in social networks. Annual Review of Sociology, 27(1), 415\u2013444.","journal-title":"Annual Review of Sociology"},{"key":"9665_CR43","unstructured":"Bianchi, F. M., Grattarola, D., & Alippi, C. (2020). Spectral clustering with graph neural networks for graph pooling. In International conference on machine learning (pp. 874\u2013883). PMLR."},{"key":"9665_CR44","unstructured":"Sutton, R.S., McAllester, D., Singh, S., & Mansour, Y. (1999). Policy gradient methods for reinforcement learning with function approximation. In Advances in neural information processing systems, 12."},{"key":"9665_CR45","unstructured":"Wei, E., Wicke, D., Freelan, D., & Luke, S. (2018). Multiagent soft Q-learning. arXiv preprint arXiv:1804.09817"},{"issue":"10","key":"9665_CR46","doi-asserted-by":"publisher","first-page":"10008","DOI":"10.1088\/1742-5468\/2008\/10\/P10008","volume":"2008","author":"VD Blondel","year":"2008","unstructured":"Blondel, V. D., Guillaume, J.-L., Lambiotte, R., & Lefebvre, E. (2008). Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment, 2008(10), 10008.","journal-title":"Journal of Statistical Mechanics: Theory and Experiment"},{"key":"9665_CR47","first-page":"13260","volume":"33","author":"G Corso","year":"2020","unstructured":"Corso, G., Cavalleri, L., Beaini, D., Li\u00f2, P., & Veli\u010dkovi\u0107, P. (2020). Principal neighbourhood aggregation for graph nets. Advances in Neural Information Processing Systems, 33, 13260\u201313271.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9665_CR48","doi-asserted-by":"crossref","unstructured":"Roy, K. K., Roy, A., Rahman, A. M., Amin, M. A., & Ali, A. A. (2021). Structure-aware hierarchical graph pooling using information bottleneck. In 2021 international joint conference on neural networks (IJCNN) (pp. 1\u20138). IEEE.","DOI":"10.1109\/IJCNN52387.2021.9533778"},{"key":"9665_CR49","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, \u0141., & Polosukhin, I. (2017). Attention is all you need. In Advances in neural information processing systems, 30."},{"issue":"1","key":"9665_CR50","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1007\/s11263-019-01217-w","volume":"128","author":"B Yang","year":"2020","unstructured":"Yang, B., Wang, S., Markham, A., & Trigoni, N. (2020). Robust attentional aggregation of deep feature sets for multi-view 3D reconstruction. International Journal of Computer Vision, 128(1), 53\u201373.","journal-title":"International Journal of Computer Vision"},{"key":"9665_CR51","unstructured":"Alemi, A. A., Fischer, I., Dillon, J.V., & Murphy, K. (2016). Deep variational information bottleneck. arXiv preprint arXiv:1612.00410"},{"key":"9665_CR52","unstructured":"Kingma, D. P., & Welling, M. (2014). Auto-encoding variational Bayes. In 2nd international conference on learning representations, ICLR 2014, Banff, AB, Canada, April 14\u201316, 2014, Conference Track Proceedings."},{"key":"9665_CR53","unstructured":"Iqbal, S., & Sha, F. (2019). Actor-attention-critic for multi-agent reinforcement learning. In International conference on machine learning (pp. 2961\u20132970). PMLR."},{"key":"9665_CR54","unstructured":"Christianos, F., Papoudakis, G., Rahman, M. A., & Albrecht, S. V. (2021). Scaling multi-agent reinforcement learning with selective parameter sharing. In International conference on machine learning (pp. 1989\u20131998). PMLR."},{"key":"9665_CR55","unstructured":"Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D., & Kavukcuoglu, K. (2016). Asynchronous methods for deep reinforcement learning. In International conference on machine learning (pp. 1928\u20131937). PMLR."},{"key":"9665_CR56","unstructured":"Lowe, R., Wu, Y. I., Tamar, A., Harb, J., Pieter\u00a0Abbeel, O., & Mordatch, I. (2017). Multi-agent actor-critic for mixed cooperative-competitive environments. In Advances in neural information processing systems, 30."}],"container-title":["Autonomous Agents and Multi-Agent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-024-09665-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10458-024-09665-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-024-09665-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,13]],"date-time":"2024-11-13T15:23:05Z","timestamp":1731511385000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10458-024-09665-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,18]]},"references-count":56,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["9665"],"URL":"https:\/\/doi.org\/10.1007\/s10458-024-09665-6","relation":{},"ISSN":["1387-2532","1573-7454"],"issn-type":[{"value":"1387-2532","type":"print"},{"value":"1573-7454","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,18]]},"assertion":[{"value":"30 June 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 July 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"36"}}