{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T10:12:54Z","timestamp":1767262374200,"version":"3.46.0"},"reference-count":127,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2025,7,21]],"date-time":"2025-07-21T00:00:00Z","timestamp":1753056000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,21]],"date-time":"2025-07-21T00:00:00Z","timestamp":1753056000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000995","name":"Australian National University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000995","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton Agent Multi-Agent Syst"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Seamless integration of Planning Under Uncertainty and Reinforcement Learning (RL) promises to bring the best of both model-driven and data-driven worlds to multi-agent decision-making, resulting in an approach with assurances on performance that scales well to more complex problems. Despite this potential, progress in developing such methods has been hindered by the lack of adequate evaluation and simulation platforms. Researchers have had to rely on creating custom environments, which reduces efficiency and makes comparing new methods difficult. In this paper, we introduce POSGGym : a library for facilitating planning and RL research in partially observable, multi-agent domains. It provides a diverse collection of discrete and continuous environments, complete with their dynamics models and a reference set of policies that can be used to evaluate generalization to novel co-players. Leveraging POSGGym, we empirically investigate existing state-of-the-art planning methods and a method that combines planning and RL in the type-based reasoning setting. Our experiments corroborate that combining planning and RL can yield superior performance compared to planning or RL alone, given the model of the environment and other agents is correct. However, our particular setup also reveals that this integrated approach could result in worse performance when the model of other agents is incorrect. Our findings indicate the benefit of integrating planning and RL in partially observable, multi-agent domains, while serving to highlight several important directions for future research. Code available at:\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/RDLLab\/posggym\" ext-link-type=\"uri\">https:\/\/github.com\/RDLLab\/posggym<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1007\/s10458-025-09716-6","type":"journal-article","created":{"date-parts":[[2025,7,21]],"date-time":"2025-07-21T05:55:15Z","timestamp":1753077315000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["POSGGym: a library for decision-theoretic planning and learning in partially observable, multi-agent environments"],"prefix":"10.1007","volume":"39","author":[{"given":"Jonathon","family":"Schwartz","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rhys","family":"Newbury","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dana","family":"Kuli\u0107","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hanna","family":"Kurniawati","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,7,21]]},"reference":[{"issue":"2","key":"9716_CR1","first-page":"37","volume":"20","author":"J Blythe","year":"1999","unstructured":"Blythe, J. (1999). Decision-theoretic planning. AI Magazine, 20(2), 37\u201337.","journal-title":"AI Magazine"},{"key":"9716_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1613\/jair.575","volume":"11","author":"C Boutilier","year":"1999","unstructured":"Boutilier, C., Dean, T., & Hanks, S. (1999). Decision-theoretic planning: Structural assumptions and computational leverage. Journal of Artificial Intelligence Research, 11, 1\u201394.","journal-title":"Journal of Artificial Intelligence Research"},{"issue":"5","key":"9716_CR3","doi-asserted-by":"publisher","first-page":"1071","DOI":"10.1287\/opre.21.5.1071","volume":"21","author":"RD Smallwood","year":"1973","unstructured":"Smallwood, R. D., & Sondik, E. J. (1973). The optimal control of partially observable Markov processes over a finite horizon. Operations Research, 21(5), 1071\u20131088.","journal-title":"Operations Research"},{"issue":"1\u20132","key":"9716_CR4","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/S0004-3702(98)00023-X","volume":"101","author":"LP Kaelbling","year":"1998","unstructured":"Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998). Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101(1\u20132), 99\u2013134.","journal-title":"Artificial Intelligence"},{"key":"9716_CR5","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1007\/s10458-007-9026-5","volume":"17","author":"S Seuken","year":"2008","unstructured":"Seuken, S., & Zilberstein, S. (2008). Formal models and algorithms for decentralized decision making under uncertainty. Autonomous Agents and Multi-Agent Systems, 17, 190\u2013250.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9716_CR6","first-page":"709","volume":"4","author":"E Hansen","year":"2004","unstructured":"Hansen, E., Bernstein, D., & Zilberstein, S. (2004). Dynamic programming for partially observable stochastic games. AAAI, 4, 709\u2013715.","journal-title":"AAAI"},{"issue":"1","key":"9716_CR7","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1146\/annurev-control-042920-092451","volume":"5","author":"H Kurniawati","year":"2022","unstructured":"Kurniawati, H. (2022). Partially Observable Markov Decision Processes and Robotics. Annual Review of Control, Robotics, and Autonomous Systems, 5(1), 253\u2013277.","journal-title":"Annual Review of Control, Robotics, and Autonomous Systems"},{"key":"9716_CR8","unstructured":"Woodward, M.P., Wood, R.J. (2012). Learning from humans as an I-POMDP. arXiv preprint\u00a0arXiv:1204.0274."},{"key":"9716_CR9","doi-asserted-by":"crossref","unstructured":"Carr, S., Jansen, N., Bharadwaj, S., Spaan, M. T., Topcu, U. (2021). Safe policies for factored partially observable stochastic games. In\u00a0Robotics: Science and Systems.","DOI":"10.15607\/RSS.2021.XVII.079"},{"key":"9716_CR10","first-page":"109","volume":"3","author":"R Seymour","year":"2009","unstructured":"Seymour, R., & Peterson, G. L. (2009). A trust-based multiagent system. International Conference on Computational Science and Engineering, 3, 109\u2013116.","journal-title":"International Conference on Computational Science and Engineering"},{"key":"9716_CR11","doi-asserted-by":"crossref","unstructured":"Ng, B., Meyers, C., Boakye, K., Nitao, J. (2010). Towards applying interactive POMDPs to real-world adversary modeling. In\u00a0Innovative Applications of Artificial Intelligence.","DOI":"10.1609\/aaai.v24i2.18818"},{"key":"9716_CR12","doi-asserted-by":"crossref","unstructured":"Bernstein, D., Givan, R., Immerman, N., Zilberstein, S. (2002). The complexity of decentralized control of markov decision processes. Mathematics of Operations Research, 27(4).","DOI":"10.1287\/moor.27.4.819.297"},{"key":"9716_CR13","doi-asserted-by":"crossref","unstructured":"LeCun, Y., Bengio, Y., Hinton, G. (2015). Deep learning. Nature, 521(7553).","DOI":"10.1038\/nature14539"},{"key":"9716_CR14","unstructured":"Kaplan, J., McCandlish, S., Henighan, T., Brown, T.B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., Amodei, D. (2020). Scaling laws for neural language models. arXiv preprint\u00a0arXiv:2001.08361."},{"key":"9716_CR15","doi-asserted-by":"crossref","unstructured":"Silver, D., Huang, A., Maddison, C., Guez, A., Sifre, L., Van Den\u00a0Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M. (2016). Mastering the game of Go with deep neural networks and tree search. Nature, 529(7587).","DOI":"10.1038\/nature16961"},{"issue":"6419","key":"9716_CR16","doi-asserted-by":"publisher","first-page":"1140","DOI":"10.1126\/science.aar6404","volume":"362","author":"D Silver","year":"2018","unstructured":"Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., & Graepel, T. (2018). A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science, 362(6419), 1140\u20131144.","journal-title":"Science"},{"key":"9716_CR17","doi-asserted-by":"crossref","unstructured":"Brown, N., Sandholm, T. (2018). Superhuman AI for heads-up no-limit poker: Libratus beats top professionals. Science, 359(6374).","DOI":"10.1126\/science.aao1733"},{"key":"9716_CR18","first-page":"17057","volume":"33","author":"N Brown","year":"2020","unstructured":"Brown, N., Bakhtin, A., Lerer, A., & Gong, Q. (2020). Combining deep reinforcement learning and search for imperfect-information games. Advances in Neural Information Processing Systems, 33, 17057\u201317069.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9716_CR19","doi-asserted-by":"crossref","unstructured":"Lerer, A., Hu, H., Foerster, J., Brown, N. (2020). Improving policies via search in cooperative partially observable games. In\u00a0Proceedings of the AAAI Conference on Artificial Intelligence, (vol. 34, pp. 7187\u20137194).","DOI":"10.1609\/aaai.v34i05.6208"},{"key":"9716_CR20","unstructured":"Berner, C., Brockman, G., Chan, B., Cheung, V., D\u0119biak, P., Dennison, C., Farhi, D., Fischer, Q., Hashme, S., Hesse, C. (2019). Dota 2 with large scale deep reinforcement learning. arXiv preprint\u00a0arXiv:1912.06680."},{"key":"9716_CR21","doi-asserted-by":"crossref","unstructured":"Vinyals, O., Babuschkin, I., Czarnecki, W., Mathieu, M., Dudzik, A., Chung, J., Choi, D., Powell, R., Ewalds, T., Georgiev, P. (2019). Grandmaster level in StarCraft II using multi-agent reinforcement learning. Nature, 575(7782).","DOI":"10.1038\/s41586-019-1724-z"},{"key":"9716_CR22","doi-asserted-by":"crossref","unstructured":"Perolat, J., De\u00a0Vylder, B., Hennes, D., Tarassov, E., Strub, F., de Boer, V., Muller, P., Connor, J., Burch, N., Anthony, T. (2022). Mastering the game of Stratego with model-free multiagent reinforcement learning. Science, 378(6623).","DOI":"10.1126\/science.add4679"},{"key":"9716_CR23","doi-asserted-by":"crossref","unstructured":"Ye, D., Liu, Z., Sun, M., Shi, B., Zhao, P., Wu, H., Yu, H., Yang, S., Wu, X., Guo, Q., et\u00a0al. (2020). Mastering complex control in moba games with deep reinforcement learning. In\u00a0Proceedings of the AAAI Conference on Artificial Intelligence, (vol. 34, pp. 6672\u20136679).","DOI":"10.1609\/aaai.v34i04.6144"},{"key":"9716_CR24","first-page":"15032","volume":"34","author":"J Terry","year":"2021","unstructured":"Terry, J., Black, B., Grammel, N., Jayakumar, M., Hari, A., Sullivan, R., Santos, L. S., Dieffendahl, C., Horsch, C., Perez-Vicente, R., et al. (2021). Pettingzoo: Gym for multi-agent reinforcement learning. Advances in Neural Information Processing Systems., 34, 15032\u201315043.","journal-title":"Advances in Neural Information Processing Systems."},{"key":"9716_CR25","unstructured":"Leibo, J. Z., Due\u00f1ez-Guzman, E. A., Vezhnevets, A., Agapiou, J. P., Sunehag, P., Koster, R., Matyas, J., Beattie, C., Mordatch, I., Graepel, T. (2021). Scalable evaluation of multi-agent reinforcement learning with melting pot. In\u00a0International Conference on Machine Learning, (pp. 6187\u20136199). PMLR."},{"key":"9716_CR26","unstructured":"Samvelyan, M., Rashid, T., De\u00a0Witt, C. S., Farquhar, G., Nardelli, N., Rudner, T. G., Hung, C.-M., Torr, P. H., Foerster, J., Whiteson, S. (2019). The starcraft multi-agent challenge. arXiv preprint\u00a0arXiv:1902.04043."},{"key":"9716_CR27","first-page":"37567","volume":"36","author":"B Ellis","year":"2023","unstructured":"Ellis, B., Cook, J., Moalla, S., Samvelyan, M., Sun, M., Mahajan, A., Foerster, J., & Whiteson, S. (2023). Smacv2: An improved benchmark for cooperative multi-agent reinforcement learning. Advances in Neural Information Processing Systems, 36, 37567\u201337593.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9716_CR28","unstructured":"Lanctot, M., Lockhart, E., Lespiau, J.-B., Zambaldi, V., Upadhyay, S., P\u00e9rolat, J., Srinivasan, S., Timbers, F., Tuyls, K., Omidshafiei, S., et\u00a0al. (2019). Openspiel: A framework for reinforcement learning in games. arXiv preprint\u00a0arXiv:1908.09453."},{"key":"9716_CR29","unstructured":"Liang, E., Liaw, R., Nishihara, R., Moritz, P., Fox, R., Goldberg, K., Gonzalez, J., Jordan, M., Stoica, I. (2018). Rllib: Abstractions for distributed reinforcement learning. In\u00a0International Conference on Machine Learning, (pp. 3053\u20133062). PMLR."},{"issue":"274","key":"9716_CR30","first-page":"1","volume":"23","author":"S Huang","year":"2022","unstructured":"Huang, S., Dossa, R. F. J., Ye, C., Braga, J., Chakraborty, D., Mehta, K., & Ara\u00c3\u0161jo, J. G. (2022). Cleanrl: High-quality single-file implementations of deep reinforcement learning algorithms. Journal of Machine Learning Research, 23(274), 1\u201318.","journal-title":"Journal of Machine Learning Research"},{"issue":"268","key":"9716_CR31","first-page":"1","volume":"22","author":"A Raffin","year":"2021","unstructured":"Raffin, A., Hill, A., Gleave, A., Kanervisto, A., Ernestus, M., & Dormann, N. (2021). Stable-baselines3: Reliable reinforcement learning implementations. Journal of Machine Learning Research, 22(268), 1\u20138.","journal-title":"Journal of Machine Learning Research"},{"key":"9716_CR32","unstructured":"Petrenko, A., Huang, Z., Kumar, T., Sukhatme, G., Koltun, V. (2020). Sample factory: Egocentric 3d control from pixels at 100000 fps with asynchronous reinforcement learning. In\u00a0International Conference on Machine Learning, (pp. 7652\u20137662). PMLR."},{"key":"9716_CR33","unstructured":"Boutilier, C. (1996). Planning, learning and coordination in multiagent decision processes. Conference on Theoretical Aspects of Rationality and Knowledge."},{"key":"9716_CR34","doi-asserted-by":"crossref","unstructured":"Shapley, L. (1953). Stochastic games. Proceedings of the National Academy of Sciences, 39(10).","DOI":"10.1073\/pnas.39.10.1953"},{"key":"9716_CR35","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.artint.2018.01.002","volume":"258","author":"SV Albrecht","year":"2018","unstructured":"Albrecht, S. V., & Stone, P. (2018). Autonomous agents modelling other agents: A comprehensive survey and open problems. Artificial Intelligence, 258, 66\u201395.","journal-title":"Artificial Intelligence"},{"key":"9716_CR36","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-28929-8","volume-title":"A Concise Introduction to Decentralized POMDPs","author":"FA Oliehoek","year":"2016","unstructured":"Oliehoek, F. A., Amato, C., et al. (2016). A Concise Introduction to Decentralized POMDPs (Vol. 1). Springer International Publishing."},{"key":"9716_CR37","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1613\/jair.1579","volume":"24","author":"PJ Gmytrasiewicz","year":"2005","unstructured":"Gmytrasiewicz, P. J., & Doshi, P. (2005). A framework for sequential planning in multi-agent settings. Journal of Artificial Intelligence Research, 24, 49\u201379.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9716_CR38","unstructured":"Bowling, M., McCracken, P. (2005). Coordination and adaptation in impromptu teams. In\u00a0AAAI, (vol. 5, pp. 53\u201358)."},{"key":"9716_CR39","doi-asserted-by":"crossref","unstructured":"Stone, P., Kaminka, G., Kraus, S., Rosenschein, J. (2010). Ad hoc autonomous agent teams: Collaboration without pre-coordination. In\u00a0Proceedings of the AAAI Conference on Artificial Intelligence, (vol. 24, pp. 1504\u20131509).","DOI":"10.1609\/aaai.v24i1.7529"},{"key":"9716_CR40","unstructured":"Albrecht, S. V., Stone, P. (2017). Reasoning about hypothetical agent behaviours and their parameters. In\u00a0Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems, (pp. 547\u2013555)."},{"key":"9716_CR41","doi-asserted-by":"crossref","unstructured":"Coulom, R. (2006). Efficient selectivity and backup operators in monte-carlo tree search. In\u00a0International Conference on Computers and Games, (pp. 72\u201383). Springer.","DOI":"10.1007\/978-3-540-75538-8_7"},{"key":"9716_CR42","unstructured":"Silver, D., Veness, J. (2010). Monte-Carlo planning in large POMDPs. Advances in Neural Information Processing Systems, 23."},{"key":"9716_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1613\/jair.1496","volume":"23","author":"N Roy","year":"2005","unstructured":"Roy, N., Gordon, G., & Thrun, S. (2005). Finding approximate POMDP solutions through belief compression. Journal of Artificial Intelligence Research, 23, 1\u201340.","journal-title":"Journal of Artificial Intelligence Research"},{"issue":"2","key":"9716_CR44","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1023\/A:1013689704352","volume":"47","author":"P Auer","year":"2002","unstructured":"Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002). Finite-time analysis of the multiarmed bandit problem. Machine Learning, 47(2), 235\u2013256.","journal-title":"Machine Learning"},{"issue":"3","key":"9716_CR45","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1007\/s10472-011-9258-6","volume":"61","author":"CD Rosin","year":"2011","unstructured":"Rosin, C. D. (2011). Multi-armed bandits with episode context. Annals of Mathematics and Artificial Intelligence., 61(3), 203\u2013230.","journal-title":"Annals of Mathematics and Artificial Intelligence."},{"key":"9716_CR46","volume-title":"Reinforcement Learning: An Introduction","author":"RS Sutton","year":"1998","unstructured":"Sutton, R. S., Barto, A. G., et al. (1998). Reinforcement Learning: An Introduction (Vol. 1). MIT press."},{"issue":"2","key":"9716_CR47","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1109\/72.279181","volume":"5","author":"Y Bengio","year":"1994","unstructured":"Bengio, Y., Simard, P., & Frasconi, P. (1994). Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 5(2), 157\u2013166.","journal-title":"IEEE Transactions on Neural Networks"},{"issue":"8","key":"9716_CR48","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735\u20131780.","journal-title":"Neural Computation"},{"key":"9716_CR49","unstructured":"Hausknecht, M., Stone, P. (2015). Deep recurrent Q-learning for partially observable MDPs. In\u00a02015 AAAI Fall Symposium Series."},{"key":"9716_CR50","unstructured":"Heinrich, J., Lanctot, M., Silver, D. (2015). Fictitious self-play in extensive-form games. In\u00a0International Conference on Machine Learning, (pp. 805\u2013813). PMLR."},{"key":"9716_CR51","doi-asserted-by":"crossref","unstructured":"Tesauro, G. (1994). TD-Gammon, a self-teaching backgammon program, achieves master-level play. Neural Computation, 6(2).","DOI":"10.1162\/neco.1994.6.2.215"},{"issue":"6456","key":"9716_CR52","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1126\/science.aay2400","volume":"365","author":"N Brown","year":"2019","unstructured":"Brown, N., & Sandholm, T. (2019). Superhuman AI for multiplayer poker. Science, 365(6456), 885\u2013890.","journal-title":"Science"},{"key":"9716_CR53","unstructured":"Lanctot, M., Zambaldi, V., Gruslys, A., Lazaridou, A., Tuyls, K., P\u00e9rolat, J., Silver, D., Graepel, T. (2017). A unified game-theoretic approach to multiagent reinforcement learning. Advances in Neural Information Processing Systems, 30."},{"key":"9716_CR54","unstructured":"Gleave, A., Dennis, M., Wild, C., Kant, N., Levine, S., Russell, S. (2019). Adversarial policies: Attacking deep reinforcement learning. In\u00a0International Conference on Learning Representations."},{"key":"9716_CR55","doi-asserted-by":"crossref","unstructured":"Jaderberg, M., Czarnecki, W., Dunning, I., Marris, L., Lever, G., Castaneda, A. G., Beattie, C., Rabinowitz, N., Morcos, A., Ruderman, A. (2019). Human-level performance in 3D multiplayer games with population-based reinforcement learning. Science, 364(6443).","DOI":"10.1126\/science.aau6249"},{"key":"9716_CR56","unstructured":"Team, O. E. L., Stooke, A., Mahajan, A., Barros, C., Deck, C., Bauer, J., Sygnowski, J., Trebacz, M., Jaderberg, M., Mathieu, M. (2021). Open-ended learning leads to generally capable agents. arXiv preprint\u00a0arXiv:2107.12808."},{"key":"9716_CR57","first-page":"8215","volume":"34","author":"B Cui","year":"2021","unstructured":"Cui, B., Hu, H., Pineda, L., & Foerster, J. (2021). K-level reasoning for zero-shot coordination in hanabi. Advances in Neural Information Processing Systems, 34, 8215\u20138228.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9716_CR58","unstructured":"He, H., Boyd-Graber, J., Kwok, K., Hal\u00a0Daum\u00e9, I. I. I. (2016). Opponent modeling in deep reinforcement learning. International Conference on Machine Learning, 1804\u20131813."},{"key":"9716_CR59","unstructured":"Bakhtin, A., Wu, D. J., Lerer, A., Gray, J., Jacob, A. P., Farina, G., Miller, A. H., Brown, N. (2022). Mastering the game of no-press diplomacy via human-regularized reinforcement learning and planning. In\u00a0International Conference on Learning Representations."},{"key":"9716_CR60","unstructured":"Rutherford, A., Ellis, B., Gallici, M., Cook, J., Lupu, A., Ingvarsson, G., Willi, T., Khan, A., Witt, C. S., Souly, A., Bandyopadhyay, S., Samvelyan, M., Jiang, M., Lange, R. T., Whiteson, S., Lacerda, B., Hawes, N., Rockt\u00e4schel, T., Lu, C., Foerster, J. N. (2023). JaxMARL: Multi-agent RL environments in JAX. In\u00a0Second Agent Learning in Open-Endedness Workshop. https:\/\/openreview.net\/forum?id=BlhQN9Jfpf"},{"key":"9716_CR61","unstructured":"Suarez, J., Du, Y., Isola, P., Mordatch, I. (2019). Neural MMO: A massively multiagent game environment for training and evaluating intelligent agents. arXiv preprint\u00a0arXiv:1903.00784."},{"key":"9716_CR62","doi-asserted-by":"crossref","unstructured":"Zheng, L., Yang, J., Cai, H., Zhou, M., Zhang, W., Wang, J., Yu, Y. (2018). Magent: A many-agent reinforcement learning platform for artificial collective intelligence. AAAI, 32.","DOI":"10.1609\/aaai.v32i1.11371"},{"key":"9716_CR63","unstructured":"Lechner, M., Yin, L., Seyde, T., Wang, T.-H., Xiao, W., Hasani, R., Rountree, J., Rus, D. (2023). Gigastep - one billion steps per second multi-agent reinforcement learning. In\u00a037th Conferences on Neural Information Processing Systems Datasets and Benchmarks Track."},{"key":"9716_CR64","doi-asserted-by":"crossref","unstructured":"Lopez, P. A., Behrisch, M., Bieker-Walz, L., Erdmann, J., Fl\u00f6tter\u00f6d, Y.-P., Hilbrich, R., L\u00fccken, L., Rummel, J., Wagner, P., Wie\u00dfner, E. (2018). Microscopic traffic simulation using sumo. International conference on intelligent transportation systems, 2575\u20132582.","DOI":"10.1109\/ITSC.2018.8569938"},{"key":"9716_CR65","doi-asserted-by":"crossref","unstructured":"Zhang, H., Feng, S., Liu, C., Ding, Y., Zhu, Y., Zhou, Z., Zhang, W., Yu, Y., Jin, H., Li, Z. (2019). Cityflow: A multi-agent reinforcement learning environment for large scale city traffic scenario. The World Wide Web Conference.","DOI":"10.1145\/3308558.3314139"},{"key":"9716_CR66","doi-asserted-by":"crossref","unstructured":"Tunyasuvunakool, S., Muldal, A., Doron, Y., Liu, S., Bohez, S., Merel, J., Erez, T., Lillicrap, T., Heess, N., Tassa, Y. (2020). Dm_control: Software and tasks for continuous control. Software Impacts, 6.","DOI":"10.1016\/j.simpa.2020.100022"},{"key":"9716_CR67","first-page":"12208","volume":"34","author":"B Peng","year":"2021","unstructured":"Peng, B., Rashid, T., Witt, C., Kamienny, P.-A., Torr, P., B\u00f6hmer, W., & Whiteson, S. (2021). Facmac: Factored multi-agent centralised policy gradients. Advances in Neural Information Processing Systems., 34, 12208\u201312221.","journal-title":"Advances in Neural Information Processing Systems."},{"key":"9716_CR68","unstructured":"Papoudakis, G., Christianos, F., Sch\u00e4fer, S. (2021). Lukas\u00a0andAlbrecht: Benchmarking multi-agent deep reinforcement learning algorithms in cooperative tasks. Advances in Neural Information Processing Systems Track on Datasets and Benchmarks."},{"key":"9716_CR69","doi-asserted-by":"crossref","unstructured":"Zha, D., Lai, K.-H., Cao, Y., Huang, S., Wei, R., Guo, J., Hu, X. (2019). RLCard: A toolkit for reinforcement learning in card games. arxiv preprint\u00a0arXiv:1910.04376.","DOI":"10.24963\/ijcai.2020\/764"},{"key":"9716_CR70","first-page":"45716","volume":"36","author":"S Koyamada","year":"2023","unstructured":"Koyamada, S., Okano, S., Nishimori, S., Murata, Y., Habara, K., Kita, H., & Ishii, S. (2023). Pgx: Hardware-accelerated parallel game simulators for reinforcement learning. Advances in Neural Information Processing Systems, 36, 45716\u201345743.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9716_CR71","volume-title":"A Course in Game Theory","author":"M Osborne","year":"1994","unstructured":"Osborne, M., & Rubinstein, A. (1994). A Course in Game Theory. MIT press."},{"key":"9716_CR72","unstructured":"Spaan, M., Oliehoek, F. (2008). The multiagent decision process toolbox: Software for decision-theoretic planning in multiagent systems. Proceedings of the AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM)."},{"key":"9716_CR73","unstructured":"Carmo\u00a0Alves, M. A., Varma, A., Elkhatib, Y., Soriano\u00a0Marcolino, L. (2022). Adleap-mas: An open-source multi-agent simulator for ad-hoc reasoning. In\u00a0Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems, (pp. 1893\u20131895)."},{"key":"9716_CR74","unstructured":"Wu, F., Zilberstein, S., Chen, X. (2011). Online planning for ad hoc autonomous agent teams. In\u00a0International Joint Conference on Artificial Intelligence."},{"key":"9716_CR75","unstructured":"Barrett, S., Stone, P., Kraus, S. (2011). Empirical evaluation of ad hoc teamwork in the pursuit domain. In\u00a0Autonomous Agents and Multiagent Systems, (pp. 567\u2013574)."},{"key":"9716_CR76","doi-asserted-by":"crossref","unstructured":"Barrett, S., Agmon, N., Hazon, N., Kraus, S., Stone, P. (2014). Communicating with unknown teammates. In\u00a0Proceedings of the International Conference on Autonomous Agents and Multi-agent Systems, (pp. 1433\u20131434).","DOI":"10.3233\/978-1-61499-419-0-45"},{"key":"9716_CR77","doi-asserted-by":"crossref","unstructured":"Yourdshahi, E. S., Pinder, T., Dhawan, G., Marcolino, L. S., Angelov, P. (2018). Towards large scale ad-hoc teamwork. In\u00a0International Conference on Agents, (pp. 44\u201349).","DOI":"10.1109\/AGENTS.2018.8460136"},{"key":"9716_CR78","unstructured":"Schwartz, J., Kurniawati, H., Hutter, M. (2023). Combining a meta-policy and Monte-Carlo planning for scalable type-based reasoning in partially observable environments. arXiv preprint\u00a0arXiv:2306.06067."},{"key":"9716_CR79","doi-asserted-by":"crossref","unstructured":"Czechowski, A., Oliehoek, F. A. (2021). Decentralized MCTS via learned teammate models. In\u00a0International Joint Conferences on Artificial Intelligence, (pp. 81\u201388).","DOI":"10.24963\/ijcai.2020\/12"},{"key":"9716_CR80","doi-asserted-by":"publisher","first-page":"821","DOI":"10.1613\/jair.1.13261","volume":"73","author":"S Choudhury","year":"2022","unstructured":"Choudhury, S., Gupta, J. K., Morales, P., & Kochenderfer, M. J. (2022). Scalable Online Planning for Multi-Agent MDPs. Journal of Artificial Intelligence Research, 73, 821\u2013846.","journal-title":"Journal of Artificial Intelligence Research"},{"issue":"2","key":"9716_CR81","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1109\/TCIAIG.2012.2200894","volume":"4","author":"PI Cowling","year":"2012","unstructured":"Cowling, P. I., Powley, E. J., & Whitehouse, D. (2012). Information set monte carlo tree search. Transactions on Computational Intelligence and AI in Games, 4(2), 120\u2013143.","journal-title":"Transactions on Computational Intelligence and AI in Games"},{"key":"9716_CR82","doi-asserted-by":"crossref","unstructured":"Amato, C., Oliehoek, F. (2015). Scalable planning and learning for multiagent POMDPs. In\u00a0Proceedings of the AAAI Conference on Artificial Intelligence, (vol. 29).","DOI":"10.1609\/aaai.v29i1.9439"},{"key":"9716_CR83","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1007\/s10458-016-9359-z","volume":"31","author":"A Panella","year":"2017","unstructured":"Panella, A., & Gmytrasiewicz, P. (2017). Interactive POMDPs with finite-state models of other agents. Autonomous Agents and Multi-Agent Systems, 31, 861\u2013904.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9716_CR84","unstructured":"Kakarlapudi, A., Anil, G., Eck, A., Doshi, P., Soh, L.-K. (2022). Decision-theoretic planning with communication in open multiagent systems. In\u00a0Uncertainty in Artificial Intelligence, (pp. 938\u2013948). PMLR."},{"key":"9716_CR85","doi-asserted-by":"crossref","unstructured":"Eck, A., Shah, M., Doshi, P., Soh, L.-K. (2020). Scalable decision-theoretic planning in open and typed multiagent systems. AAAI.","DOI":"10.1609\/aaai.v34i05.6200"},{"key":"9716_CR86","doi-asserted-by":"crossref","unstructured":"Schwartz, J., Zhou, R., Kurniawati, H. (2022). Online planning for interactive-POMDPs using nested monte carlo tree search. In\u00a0International Conference on Intelligent Robots and Systems, (pp. 8770\u20138777). IEEE.","DOI":"10.1109\/IROS47612.2022.9981713"},{"issue":"7839","key":"9716_CR87","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1038\/s41586-020-03051-4","volume":"588","author":"J Schrittwieser","year":"2020","unstructured":"Schrittwieser, J., Antonoglou, I., Hubert, T., Simonyan, K., Sifre, L., Schmitt, S., Guez, A., Lockhart, E., Hassabis, D., & Graepel, T. (2020). Mastering atari, go, chess and shogi by planning with a learned model. Nature, 588(7839), 604\u2013609.","journal-title":"Nature"},{"key":"9716_CR88","doi-asserted-by":"crossref","unstructured":"Timbers, F., Bard, N., Lockhart, E., Lanctot, M., Schmid, M., Burch, N., Schrittwieser, J., Hubert, T., Bowling, M. (2022). Approximate exploitability: Learning a best response. In\u00a0Proceedings of the International Joint Conference on Artificial Intelligence, (pp. 3487\u20133493).","DOI":"10.24963\/ijcai.2022\/484"},{"key":"9716_CR89","unstructured":"Hu, H., Lerer, A., Brown, N., Foerster, J. (2021). Learned belief search: Efficiently improving policies in partially observable settings. arxiv preprint\u00a0arXiv:2106.09086."},{"key":"9716_CR90","unstructured":"Li, Z., Lanctot, M., McKee, K. R., Marris, L., Gemp, I., Hennes, D., Muller, P., Larson, K., Bachrach, Y., Wellman, M. P. (2023). Combining tree-search, generative models, and nash bargaining concepts in game-theoretic reinforcement learning. arxiv preprint\u00a0arXiv:2302.00797."},{"key":"9716_CR91","unstructured":"Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., Zaremba, W. (2016). OpenAI Gym. arXiv preprint\u00a0arXiv:1606.01540."},{"key":"9716_CR92","unstructured":"Foundation, F. (2022). Gymnasium. GitHub."},{"key":"9716_CR93","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1613\/jair.2567","volume":"32","author":"S Ross","year":"2008","unstructured":"Ross, S., Pineau, J., Paquet, S., & Chaib-Draa, B. (2008). Online Planning Algorithms for POMDPs. Journal of Artificial Intelligence Research, 32, 663\u2013704.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9716_CR94","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1007\/s43154-020-00019-0","volume":"1","author":"A Tabrez","year":"2020","unstructured":"Tabrez, A., Luebbers, M. B., & Hayes, B. (2020). A survey of mental modeling techniques in human-robot teaming. Current Robotics Reports, 1, 259\u2013267.","journal-title":"Current Robotics Reports"},{"key":"9716_CR95","doi-asserted-by":"crossref","unstructured":"Ooi, J., Wornell, G. (1996). Decentralized control of a multiple access broadcast channel: Performance bounds. Conference on Decision and Control, 1.","DOI":"10.1109\/CDC.1996.574318"},{"key":"9716_CR96","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1613\/jair.4623","volume":"55","author":"JS Dibangoye","year":"2016","unstructured":"Dibangoye, J. S., Amato, C., Buffet, O., & Charpillet, F. (2016). Optimally solving Dec-POMDPs as continuous-state mdps. Journal of Artificial Intelligence Research, 55, 443\u2013497.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9716_CR97","unstructured":"Peralez, J., Delage, A., Buffet, O., Dibangoye, J. S.\u00a0(2024). Solving hierarchical information-sharing Dec-POMDPs: an extensive-form game approach. In Proceedings of the 41st International Conference on Machine Learning, pp. 40414\u201340438."},{"key":"9716_CR98","unstructured":"Doshi, P., Gmytrasiewicz, P.J. (2005). A particle filtering based approach to approximating interactive POMDPs. In\u00a0AAAI, (pp. 969\u2013974)."},{"key":"9716_CR99","unstructured":"Doshi, P., Perez, D. (2008). Generalized point based value iteration for interactive POMDPs. In\u00a0AAAI, (pp. 63\u201368)."},{"key":"9716_CR100","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1007\/s10458-014-9261-5","volume":"29","author":"E Sonu","year":"2015","unstructured":"Sonu, E., & Doshi, P. (2015). Scalable solutions of interactive POMDPs using generalized and bounded policy iteration. Autonomous Agents and Multi-Agent Systems, 29, 455\u2013494.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9716_CR101","doi-asserted-by":"crossref","unstructured":"Rahman, A., Cui, J., Stone, P. (2024a). Generating teammates for training robust ad hoc teamwork agents via best-response diversity. In\u00a0AAAI.","DOI":"10.1609\/aaai.v38i16.29702"},{"key":"9716_CR102","doi-asserted-by":"crossref","unstructured":"Rahman, M., Cui, J., Stone, P. (2024b). Minimum coverage sets for training robust ad hoc teamwork agents. In\u00a0AAAI, (vol. 38, pp. 17523\u201317530).","DOI":"10.1609\/aaai.v38i16.29702"},{"key":"9716_CR103","first-page":"10707","volume":"33","author":"F Christianos","year":"2020","unstructured":"Christianos, F., Sch\u00e4fer, L., & Albrecht, S. (2020). Shared experience actor-critic for multi-agent reinforcement learning. Advances in Neural Information Processing Systems, 33, 10707\u201310717.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9716_CR104","first-page":"19210","volume":"34","author":"G Papoudakis","year":"2021","unstructured":"Papoudakis, G., Christianos, F., & Albrecht, S. (2021). Agent modelling under partial observability for deep reinforcement learning. Advances in Neural Information Processing Systems, 34, 19210\u201319222.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"298","key":"9716_CR105","first-page":"1","volume":"24","author":"A Rahman","year":"2023","unstructured":"Rahman, A., Carlucho, I., H\u00f6pner, N., & Albrecht, S. V. (2023). A general learning framework for open ad hoc teamwork using graph-based policy learning. Journal of Machine Learning Research, 24(298), 1\u201374.","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"9716_CR106","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/s10458-022-09548-8","volume":"36","author":"KR McKee","year":"2022","unstructured":"McKee, K. R., Leibo, J. Z., Beattie, C., & Everett, R. (2022). Quantifying the effects of environment and population diversity in multi-agent reinforcement learning. Autonomous Agents and Multi-Agent Systems, 36(1), 21.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9716_CR107","doi-asserted-by":"crossref","unstructured":"Lerer, A., Peysakhovich, A. (2019). Learning existing social conventions via observationally augmented self-play. In\u00a0Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, (pp. 107\u2013114).","DOI":"10.1145\/3306618.3314268"},{"key":"9716_CR108","doi-asserted-by":"crossref","unstructured":"Tan, M. (1993). Multi-agent reinforcement learning: Independent vs cooperative agents. In\u00a0Proceedings of the Tenth International Conference on Machine Learning, (pp. 330\u2013337).","DOI":"10.1016\/B978-1-55860-307-3.50049-6"},{"key":"9716_CR109","first-page":"464","volume":"16","author":"J Leibo","year":"2017","unstructured":"Leibo, J., Zambaldi, V., Lanctot, M., Marecki, J., & Graepel, T. (2017). Multi-agent Reinforcement Learning in Sequential Social Dilemmas. Autonomous Agents and Multi-Agent Systems, 16, 464\u2013473.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9716_CR110","doi-asserted-by":"crossref","unstructured":"Xing, D., Liu, Q., Zheng, Q., Pan, G., Zhou, Z.: Learning with generated teammates to achieve type-free ad-hoc teamwork. In International Joint Conference on Artificial Intelligence, pp. 472\u2013478 (2021)","DOI":"10.24963\/ijcai.2021\/66"},{"key":"9716_CR111","unstructured":"O\u2019Callaghan, D., Mannion, P. (2021). Tunable behaviours in sequential social dilemmas using multi-objective reinforcement learning. In\u00a0Autonomous Agents and Multi-Agent Systems, (pp. 1610\u20131612)."},{"key":"9716_CR112","unstructured":"Seaman, I. R., van de Meent, J.-W., Wingate, D. (2018). Nested reasoning about autonomous agents using probabilistic programs. arXiv preprint\u00a0arXiv:1812.01569."},{"key":"9716_CR113","unstructured":"Blomqvist, V. (2023). Pymunk . https:\/\/pymunk.org"},{"key":"9716_CR114","doi-asserted-by":"crossref","unstructured":"Gupta, J., Egorov, M., Kochenderfer, M.\u00a0(2017). Cooperative multi-agent control using deep reinforcement learning. Autonomous Agents and Multi-Agent Systems, 66\u201383.","DOI":"10.1007\/978-3-319-71682-4_5"},{"key":"9716_CR115","doi-asserted-by":"crossref","unstructured":"De\u00a0Souza, C., Newbury, R., Cosgun, A., Castillo, P., Vidolov, B., Kuli\u0107, D. (2021). Decentralized multi-agent pursuit using deep reinforcement learning. Robotics and Automation Letters, 6(3).","DOI":"10.1109\/LRA.2021.3068952"},{"key":"9716_CR116","doi-asserted-by":"crossref","unstructured":"de Souza, C., Castillo, P., Vidolov, B. (2022). Local interaction and navigation guidance for hunters drones: A chase behavior approach with real-time tests. Robotica, 40(8).","DOI":"10.1017\/S0263574721001910"},{"key":"9716_CR117","doi-asserted-by":"crossref","unstructured":"Angelani, L. (2012). Collective predation and escape strategies. Physical Review Letters, 109(11).","DOI":"10.1103\/PhysRevLett.109.118104"},{"key":"9716_CR118","doi-asserted-by":"crossref","unstructured":"Janosov, M., Vir\u00e1gh, C., V\u00e1s\u00e1rhelyi, G., Vicsek, T. (2017) Group chasing tactics: How to catch a faster prey. New Journal of Physics.","DOI":"10.1088\/1367-2630\/aa69e7"},{"key":"9716_CR119","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/j.artint.2016.02.004","volume":"235","author":"S Albrecht","year":"2016","unstructured":"Albrecht, S., Crandall, J., & Ramamoorthy, S. (2016). Belief and truth in hypothesised behaviours. Artificial Intelligence, 235, 63\u201394.","journal-title":"Artificial Intelligence"},{"key":"9716_CR120","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O. (2017). Proximal policy optimization algorithms. arXiv preprint\u00a0arXiv:1707.06347."},{"key":"9716_CR121","unstructured":"Baker, B., Kanitscheider, I., Markov, T., Wu, Y., Powell, G., McGrew, B., Mordatch, I. (2019). Emergent tool use from multi-agent autocurricula. International Conference on Learning Representations."},{"key":"9716_CR122","first-page":"24611","volume":"35","author":"C Yu","year":"2022","unstructured":"Yu, C., Velu, A., Vinitsky, E., Gao, J., Wang, Y., Bayen, A., & Wu, Y. (2022). The surprising effectiveness of ppo in cooperative multi-agent games. Advances in Neural Information Processing Systems, 35, 24611\u201324624.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9716_CR123","first-page":"16951","volume":"34","author":"A Fickinger","year":"2021","unstructured":"Fickinger, A., Hu, H., Amos, B., Russell, S., & Brown, N. (2021). Scalable online planning via reinforcement learning fine-tuning. Advances in Neural Information Processing Systems, 34, 16951\u201316963.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9716_CR124","unstructured":"Lupu, A., Cui, B., Hu, H., Foerster, J. Trajectory diversity for zero-shot coordination. In International Conference on Machine Learning, pp. 7204\u20137213. PMLR."},{"key":"9716_CR125","doi-asserted-by":"crossref","unstructured":"Xing, D., Liu, Q., Zheng, Q., Pan, G., Zhou, Z.H.\u00a0(2021) Learning with generated teammates to achieve type-free ad-hoc teamwork. In International Joint Conference on Artificial Intelligence, pp. 472\u2013478.","DOI":"10.24963\/ijcai.2021\/66"},{"key":"9716_CR126","unstructured":"Witt, C., Gupta, T., Makoviichuk, D., Makoviychuk, V., Torr, P., Sun, M., Whiteson, S. (2020). Is independent learning all you need in the starcraft multi-agent challenge? arxiv preprint\u00a0arXiv:2011.09533."},{"key":"9716_CR127","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1609\/icaps.v28i1.13882","volume":"28","author":"Z Sunberg","year":"2018","unstructured":"Sunberg, Z., & Kochenderfer, M. (2018). Online Algorithms for POMDPs with Continuous State, Action, and Observation Spaces. International Conference on Automated Planning and Scheduling, 28, 259\u2013263.","journal-title":"International Conference on Automated Planning and Scheduling"}],"container-title":["Autonomous Agents and Multi-Agent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-025-09716-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10458-025-09716-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-025-09716-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T08:02:55Z","timestamp":1765180975000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10458-025-09716-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,21]]},"references-count":127,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["9716"],"URL":"https:\/\/doi.org\/10.1007\/s10458-025-09716-6","relation":{},"ISSN":["1387-2532","1573-7454"],"issn-type":[{"type":"print","value":"1387-2532"},{"type":"electronic","value":"1573-7454"}],"subject":[],"published":{"date-parts":[[2025,7,21]]},"assertion":[{"value":"19 June 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"35"}}