{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T05:38:09Z","timestamp":1775281089956,"version":"3.50.1"},"reference-count":78,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,8,3]],"date-time":"2021-08-03T00:00:00Z","timestamp":1627948800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,3]],"date-time":"2021-08-03T00:00:00Z","timestamp":1627948800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002661","name":"Fonds De La Recherche Scientifique - FNRS","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002661","name":"Fonds De La Recherche Scientifique - FNRS","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002661","name":"Fonds De La Recherche Scientifique - FNRS","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002910","name":"F\u00e9d\u00e9ration Wallonie-Bruxelles","doi-asserted-by":"publisher","award":["ARC"],"award-info":[{"award-number":["ARC"]}],"id":[{"id":"10.13039\/501100002910","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Swarm Intell"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Swarm intelligence studies self-organized collective behavior resulting from interactions between individuals, typically in animals and artificial agents. Some studies from cognitive science have also demonstrated self-organization mechanisms in humans, often in pairs. Further research into the topic of human swarm intelligence could provide a better understanding of new behaviors and larger human collectives. This requires studies with multiple human participants in controlled experiments in a wide variety of scenarios, where a rich scope of possible interactions can be isolated and captured. In this paper, we present HuGoS\u2014\u2018Humans Go Swarming\u2019\u2014a multi-user virtual environment implemented using the Unity game development platform, as a comprehensive tool for experimentation in human swarm intelligence. We demonstrate the functionality of HuGoS with na\u00efve participants in a browser-based implementation, in a coordination task involving collective decision-making, messaging and signaling, and stigmergy. By making HuGoS available as open-source software, we hope to facilitate further research in the field of human swarm intelligence.<\/jats:p>","DOI":"10.1007\/s11721-021-00199-1","type":"journal-article","created":{"date-parts":[[2021,8,3]],"date-time":"2021-08-03T12:03:49Z","timestamp":1627992229000},"page":"339-376","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["HuGoS: a virtual environment for studying collective human behavior from a swarm intelligence perspective"],"prefix":"10.1007","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4173-7693","authenticated-orcid":false,"given":"Nicolas","family":"Coucke","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1595-8487","authenticated-orcid":false,"given":"Mary Katherine","family":"Heinrich","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9757-5235","authenticated-orcid":false,"given":"Axel","family":"Cleeremans","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3971-0507","authenticated-orcid":false,"given":"Marco","family":"Dorigo","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,8,3]]},"reference":[{"key":"199_CR1","doi-asserted-by":"crossref","unstructured":"Almaatouq, A., Becker, J., Houghton, J.P., Paton, N., Watts, D.J., & Whiting, M. E. (2020). Empirica: a virtual lab for high-throughput macro-level experiments. arXiv preprint arXiv:200611398v1.","DOI":"10.3758\/s13428-020-01535-9"},{"issue":"4","key":"199_CR2","doi-asserted-by":"publisher","first-page":"428","DOI":"10.1162\/1054746041944803","volume":"13","author":"JN Bailenson","year":"2004","unstructured":"Bailenson, J. N., Beall, A. C., Loomis, J., Blascovich, J., & Turk, M. (2004). Transformed social interaction: Decoupling representation from behavior and form in collaborative virtual environments. Presence Teleoperators and Virtual Environments, 13(4), 428\u2013441. https:\/\/doi.org\/10.1162\/1054746041944803.","journal-title":"Presence Teleoperators and Virtual Environments"},{"key":"199_CR3","doi-asserted-by":"publisher","unstructured":"Barrington, L., Ghosh, S., Greene, M., Har-Noy, S., Berger, J. S., Gill, S. P. D., Lin, A., & Huyck, C. K. (2011). Crowdsourcing earthquake damage assessment using remote sensing imagery. Annals of Geophysics. https:\/\/doi.org\/10.4401\/ag-5324.","DOI":"10.4401\/ag-5324"},{"key":"199_CR4","doi-asserted-by":"publisher","unstructured":"Blascovich, J., Loomis, J., Beall, A., Swinth, K., Hoyt, C., & Bailenson, J. (2002). Immersive virtual environment technology as a methodological tool for social psychology. Psychological Inquiry. https:\/\/doi.org\/10.1207\/S15327965PLI1302_01.","DOI":"10.1207\/S15327965PLI1302_01"},{"key":"199_CR5","doi-asserted-by":"publisher","unstructured":"Boos, M., Pritz, J., Lange, S., & Belz, M. (2014). Leadership in moving human groups. PLoS Computational Biology,10(4), e1003541. https:\/\/doi.org\/10.1371\/journal.pcbi.1003541.","DOI":"10.1371\/journal.pcbi.1003541"},{"key":"199_CR6","doi-asserted-by":"publisher","unstructured":"Boos, M., Pritz, J., & Belz, M. (2019). The HoneyComb paradigm for research on collective human behavior. Journal of Visualized Experiments,143, e58719. https:\/\/doi.org\/10.3791\/58719.","DOI":"10.3791\/58719"},{"issue":"1","key":"199_CR7","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.comnet.2005.04.008","volume":"49","author":"M Claypool","year":"2005","unstructured":"Claypool, M. (2005). The effect of latency on user performance in real-time strategy games. Computer Networks, 49(1), 52\u201370. https:\/\/doi.org\/10.1016\/j.comnet.2005.04.008.","journal-title":"Computer Networks"},{"key":"199_CR8","doi-asserted-by":"publisher","unstructured":"Claypool, M., & Finkel, D. (2014). The effects of latency on player performance in cloud-based games. In 13th annual workshop on network and systems support for games. IEEE. https:\/\/doi.org\/10.1109\/netgames.2014.7008964.","DOI":"10.1109\/netgames.2014.7008964"},{"key":"199_CR9","doi-asserted-by":"publisher","unstructured":"Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., et al. (2010). Predicting protein structures with a multiplayer online game. Nature,466(7307), 756\u2013760. https:\/\/doi.org\/10.1038\/nature09304.","DOI":"10.1038\/nature09304"},{"key":"199_CR10","doi-asserted-by":"publisher","unstructured":"Coucke, N., Heinrich, M.K., Cleeremans, A., & Dorigo, M. (2020). Hugos: A multi-user virtual environment for studying human\u2013human swarm intelligence. In International conference on swarm intelligence (pp. 161\u2013175). Springer. https:\/\/doi.org\/10.1007\/978-3-030-60376-2_13.","DOI":"10.1007\/978-3-030-60376-2_13"},{"issue":"1","key":"199_CR11","doi-asserted-by":"publisher","first-page":"8398","DOI":"10.1038\/ncomms9398","volume":"6","author":"M Derex","year":"2015","unstructured":"Derex, M., & Boyd, R. (2015). The foundations of the human cultural niche. Nature Communications, 6(1), 8398. https:\/\/doi.org\/10.1038\/ncomms9398.","journal-title":"Nature Communications"},{"key":"199_CR12","doi-asserted-by":"publisher","unstructured":"Dorigo, M., Theraulaz, G., & Trianni, V. (2020). Reflections on the future of swarm robotics. Science Robotics, 5(49):eabe4385. https:\/\/doi.org\/10.1126\/scirobotics.abe4385.","DOI":"10.1126\/scirobotics.abe4385"},{"issue":"1","key":"199_CR13","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1080\/10463283.2018.1471948","volume":"29","author":"J Drury","year":"2018","unstructured":"Drury, J. (2018). The role of social identity processes in mass emergency behaviour: An integrative review. European Review of Social Psychology, 29(1), 38\u201381. https:\/\/doi.org\/10.1080\/10463283.2018.1471948.","journal-title":"European Review of Social Psychology"},{"issue":"1","key":"199_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11721-013-0089-4","volume":"8","author":"F Ducatelle","year":"2013","unstructured":"Ducatelle, F., Di Caro, G. A., F\u00f6rster, A., Bonani, M., Dorigo, M., Magnenat, S., et al. (2013). Cooperative navigation in robotic swarms. Swarm Intelligence, 8(1), 1\u201333. https:\/\/doi.org\/10.1007\/s11721-013-0089-4.","journal-title":"Swarm Intelligence"},{"key":"199_CR15","doi-asserted-by":"publisher","unstructured":"Eberhart, R., Palmer, D., & Kirschenbaum, M. (2015). Beyond computational intelligence: Blended intelligence. In Swarm\/Human blended intelligence workshop (SHBI). IEEE. https:\/\/doi.org\/10.1109\/shbi.2015.7321679.","DOI":"10.1109\/shbi.2015.7321679"},{"key":"199_CR16","doi-asserted-by":"publisher","unstructured":"Ellwart, T. (2011). Assessing Coordination in human groups: Concepts and methods (pp. 119\u2013135). Springer. https:\/\/doi.org\/10.1007\/978-3-642-15355-6_7.","DOI":"10.1007\/978-3-642-15355-6_7"},{"issue":"12","key":"199_CR17","doi-asserted-by":"publisher","first-page":"5334","DOI":"10.1073\/pnas.0913149107","volume":"107","author":"JH Fowler","year":"2010","unstructured":"Fowler, J. H., & Christakis, N. A. (2010). Cooperative behavior cascades in human social networks. Proceedings of the National Academy of Sciences, 107(12), 5334\u20135338. https:\/\/doi.org\/10.1073\/pnas.0913149107.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"3","key":"199_CR18","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/0378-8733(78)90021-7","volume":"1","author":"LC Freeman","year":"1978","unstructured":"Freeman, L. C. (1978). Centrality in social networks conceptual clarification. Social Networks, 1(3), 215\u2013239. https:\/\/doi.org\/10.1016\/0378-8733(78)90021-7.","journal-title":"Social Networks"},{"issue":"1","key":"199_CR19","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1146\/annurev-psych-120710-100449","volume":"63","author":"CD Frith","year":"2012","unstructured":"Frith, C. D., & Frith, U. (2012). Mechanisms of social cognition. Annual Review of Psychology, 63(1), 287\u2013313. https:\/\/doi.org\/10.1146\/annurev-psych-120710-100449.","journal-title":"Annual Review of Psychology"},{"issue":"48","key":"199_CR20","doi-asserted-by":"publisher","first-page":"E11231","DOI":"10.1073\/pnas.1716869115","volume":"115","author":"R Heck","year":"2018","unstructured":"Heck, R., Vuculescu, O., S\u00f8rensen, J. J., Zoller, J., Andreasen, M. G., Bason, M. G., et al. (2018). Remote optimization of an ultracold atoms experiment by experts and citizen scientists. Proceedings of the National Academy of Sciences, 115(48), E11231\u2013E11237.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"199_CR21","doi-asserted-by":"publisher","unstructured":"Hermans, K., Achterhof, R., Myin-Germeys, I., Kasanova, Z., Kirtley, O., & Schneider, M. (2019). Improving ecological validity in research on social cognition. In Social cognition in psychosis (pp. 249\u2013268). Elsevier. https:\/\/doi.org\/10.1016\/b978-0-12-815315-4.00010-0.","DOI":"10.1016\/b978-0-12-815315-4.00010-0"},{"key":"199_CR22","doi-asserted-by":"publisher","unstructured":"Hunt, E. R., Jones, S., & Hauert, S. (2019). Testing the limits of pheromone stigmergy in high-density robot swarms. Royal Society Open Science,6(11), 190225. https:\/\/doi.org\/10.1098\/rsos.190225.","DOI":"10.1098\/rsos.190225"},{"issue":"6443","key":"199_CR23","doi-asserted-by":"publisher","first-page":"859","DOI":"10.1126\/science.aau6249","volume":"364","author":"M Jaderberg","year":"2019","unstructured":"Jaderberg, M., Czarnecki, W. M., Dunning, I., Marris, L., Lever, G., Casta\u00f1eda, A. G., et al. (2019). Human-level performance in 3d multiplayer games with population-based reinforcement learning. Science, 364(6443), 859\u2013865. https:\/\/doi.org\/10.1126\/science.aau6249.","journal-title":"Science"},{"key":"199_CR24","doi-asserted-by":"crossref","unstructured":"Jensen, J. H. M., Gajdacz, M., Ahmed, S. Z., Czarkowski, J. H., Weidner, C., Rafner, J., S\u00f8rensen, J. J., M\u00f8lmer, K., & Sherson, J. F. (2020). Crowdsourcing human common sense for quantum control. arXiv preprint arXiv:200403296v2.","DOI":"10.1103\/PhysRevResearch.3.013057"},{"key":"199_CR25","unstructured":"Juliani, A., Berges, V. P., Vckay, E., Gao, Y., Henry, H., Mattar, M., & Lange, D. (2018). Unity: A general platform for intelligent agents. arXiv preprint arXiv:180902627."},{"issue":"4","key":"199_CR26","doi-asserted-by":"publisher","first-page":"724","DOI":"10.1287\/mnsc.1090.1129","volume":"56","author":"JH Jung","year":"2010","unstructured":"Jung, J. H., Schneider, C., & Valacich, J. (2010). Enhancing the motivational affordance of information systems: The effects of real-time performance feedback and goal setting in group collaboration environments. Management Science, 56(4), 724\u2013742. https:\/\/doi.org\/10.1287\/mnsc.1090.1129.","journal-title":"Management Science"},{"key":"199_CR27","doi-asserted-by":"publisher","unstructured":"Kirschenbaum, M., & Palmer, D. W. (2015). Perceptualization of particle swarm optimization. In Swarm\/human blended intelligence workshop (SHBI). IEEE. https:\/\/doi.org\/10.1109\/shbi.2015.7321681.","DOI":"10.1109\/shbi.2015.7321681"},{"key":"199_CR28","unstructured":"Krafft, P. M., Zheng, J., Pan, W., Della\u00a0Penna, N., Altshuler, Y., Shmueli, E., Tenenbaum, J. B., & Pentland, A. (2016). Human collective intelligence as distributed bayesian inference. arXiv preprint arXiv:160801987."},{"issue":"1","key":"199_CR29","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.tree.2009.06.016","volume":"25","author":"J Krause","year":"2010","unstructured":"Krause, J., Ruxton, G. D., & Krause, S. (2010). Swarm intelligence in animals and humans. Trends in Ecology and Evolution, 25(1), 28\u201334. https:\/\/doi.org\/10.1016\/j.tree.2009.06.016.","journal-title":"Trends in Ecology and Evolution"},{"key":"199_CR30","doi-asserted-by":"publisher","unstructured":"Labella, T. H., Dorigo, M., & Deneubourg, J. L. (2004). Self-organised task allocation in a group of robots. In Distributed autonomous robotic systems (Vol. 6, pp. 389\u2013398). Springer, Japan. https:\/\/doi.org\/10.1007\/978-4-431-35873-2_38.","DOI":"10.1007\/978-4-431-35873-2_38"},{"issue":"2\u20133","key":"199_CR31","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1007\/s11257-016-9173-y","volume":"26","author":"B Lepri","year":"2016","unstructured":"Lepri, B., Staiano, J., Shmueli, E., Pianesi, F., & Pentland, A. (2016). The role of personality in shaping social networks and mediating behavioral change. User Modeling and User-Adapted Interaction, 26(2\u20133), 143\u2013175.","journal-title":"User Modeling and User-Adapted Interaction"},{"key":"199_CR32","doi-asserted-by":"publisher","unstructured":"Lin, A. Y. M., Huynh, A., Lanckriet, G., & Barrington, L. (2014). Crowdsourcing the unknown: The satellite search for Genghis Khan. PLoS ONE,9(12), e114046. https:\/\/doi.org\/10.1371\/journal.pone.0114046.","DOI":"10.1371\/journal.pone.0114046"},{"issue":"1","key":"199_CR33","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/s00521-020-05383-8","volume":"33","author":"J Liu","year":"2020","unstructured":"Liu, J., Snodgrass, S., Khalifa, A., Risi, S., Yannakakis, G. N., & Togelius, J. (2020). Deep learning for procedural content generation. Neural Computing and Applications, 33(1), 19\u201337. https:\/\/doi.org\/10.1007\/s00521-020-05383-8.","journal-title":"Neural Computing and Applications"},{"issue":"9","key":"199_CR34","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1016\/s1473-3099(07)70212-8","volume":"7","author":"ET Lofgren","year":"2007","unstructured":"Lofgren, E. T., & Fefferman, N. H. (2007). The untapped potential of virtual game worlds to shed light on real world epidemics. The Lancet Infectious Diseases, 7(9), 625\u2013629. https:\/\/doi.org\/10.1016\/s1473-3099(07)70212-8.","journal-title":"The Lancet Infectious Diseases"},{"issue":"22","key":"199_CR35","doi-asserted-by":"publisher","first-page":"9020","DOI":"10.1073\/pnas.1008636108","volume":"108","author":"J Lorenz","year":"2011","unstructured":"Lorenz, J., Rauhut, H., Schweitzer, F., & Helbing, D. (2011). How social influence can undermine the wisdom of crowd effect. Proceedings of the National Academy of Sciences, 108(22), 9020\u20139025. https:\/\/doi.org\/10.1073\/pnas.1008636108.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"199_CR36","doi-asserted-by":"publisher","unstructured":"Mathews, N., Christensen, A. L., O\u2019Grady, R., Mondada, F., & Dorigo, M. (2017). Mergeable nervous systems for robots. Nature Communications, 8, 439. https:\/\/doi.org\/10.1038\/s41467-017-00109-2.","DOI":"10.1038\/s41467-017-00109-2"},{"key":"199_CR37","doi-asserted-by":"crossref","unstructured":"Michel, O. (2004). Cyberbotics Ltd. Webots$$^{{\\rm TM}}$$: Professional mobile robot simulation. International Journal of Advanced Robotic Systems, 1(1), 40\u201343.","DOI":"10.5772\/5618"},{"key":"199_CR38","unstructured":"Mondada, F., Bonani, M., Raemy, X., Pugh, J., Cianci, C., Klaptocz, A., Magnenat, S., Zufferey, J. C., Floreano, D., & Martinoli, A. (2009). The e-puck, a robot designed for education in engineering. In Proceedings of the 9th conference on autonomous robot systems and competitions (Vol.\u00a01, pp. 59\u201365). IPCB: Instituto Polit\u00e9cnico de Castelo Branco."},{"issue":"1668","key":"199_CR39","doi-asserted-by":"publisher","first-page":"2755","DOI":"10.1098\/rspb.2009.0405","volume":"276","author":"M Moussa\u00efd","year":"2009","unstructured":"Moussa\u00efd, M., Helbing, D., Garnier, S., Johansson, A., Combe, M., & Theraulaz, G. (2009). Experimental study of the behavioural mechanisms underlying self-organization in human crowds. Proceedings of the Royal Society B: Biological Sciences, 276(1668), 2755\u20132762. https:\/\/doi.org\/10.1098\/rspb.2009.0405.","journal-title":"Proceedings of the Royal Society B: Biological Sciences"},{"issue":"122","key":"199_CR40","doi-asserted-by":"publisher","first-page":"20160414","DOI":"10.1098\/rsif.2016.0414","volume":"13","author":"M Moussa\u00efd","year":"2016","unstructured":"Moussa\u00efd, M., Kapadia, M., Thrash, T., Sumner, R. W., Gross, M., Helbing, D., & H\u00f6lscher, C. (2016). Crowd behaviour during high-stress evacuations in an immersive virtual environment. Journal of the Royal Society Interface, 13(122), 20160414. https:\/\/doi.org\/10.1098\/rsif.2016.0414.","journal-title":"Journal of the Royal Society Interface"},{"key":"199_CR41","doi-asserted-by":"publisher","first-page":"82","DOI":"10.3389\/frobt.2018.00082","volume":"5","author":"M Moussa\u00efd","year":"2018","unstructured":"Moussa\u00efd, M., Schinazi, V. R., Kapadia, M., & Thrash, T. (2018). Virtual sensing and virtual reality: How new technologies can boost research on crowd dynamics. Frontiers in Robotics and AI, 5, 82. https:\/\/doi.org\/10.3389\/frobt.2018.00082.","journal-title":"Frontiers in Robotics and AI"},{"key":"199_CR42","doi-asserted-by":"publisher","unstructured":"Nakamura, J., & Csikszentmihalyi, M. (2014). The concept of flow. In Flow and the foundations of positive psychology (pp. 239\u2013263). Springer. https:\/\/doi.org\/10.1007\/978-94-017-9088-8_16.","DOI":"10.1007\/978-94-017-9088-8_16"},{"issue":"2","key":"199_CR43","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1038\/s41562-017-0273-4","volume":"2","author":"J Navajas","year":"2018","unstructured":"Navajas, J., Niella, T., Garbulsky, G., Bahrami, B., & Sigman, M. (2018). Aggregated knowledge from a small number of debates outperforms the wisdom of large crowds. Nature Human Behaviour, 2(2), 126\u2013132. https:\/\/doi.org\/10.1038\/s41562-017-0273-4.","journal-title":"Nature Human Behaviour"},{"key":"199_CR44","first-page":"355","volume":"19","author":"S Nebel","year":"2016","unstructured":"Nebel, S., Schneider, S., & Rey, G. D. (2016). Mining learning and crafting scientific experiments: A literature review on the use of minecraft in education and research. Educational Technology and Society, 19, 355\u2013366.","journal-title":"Educational Technology and Society"},{"issue":"4","key":"199_CR45","doi-asserted-by":"publisher","first-page":"993","DOI":"10.1007\/s11423-017-9511-8","volume":"65","author":"S Nebel","year":"2017","unstructured":"Nebel, S., Schneider, S., Beege, M., Kolda, F., Mackiewicz, V., & Rey, G. D. (2017). You cannot do this alone! Increasing task interdependence in cooperative educational videogames to encourage collaboration. Educational Technology Research and Development, 65(4), 993\u20131014. https:\/\/doi.org\/10.1007\/s11423-017-9511-8.","journal-title":"Educational Technology Research and Development"},{"issue":"1","key":"199_CR46","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1057\/s41599-020-0404-9","volume":"6","author":"J N\u00f6lle","year":"2020","unstructured":"N\u00f6lle, J., Fusaroli, R., Mills, G. J., & Tyl\u00e9n, K. (2020). Language as shaped by the environment: Linguistic construal in a collaborative spatial task. Palgrave Communications, 6(1), 27. https:\/\/doi.org\/10.1057\/s41599-020-0404-9.","journal-title":"Palgrave Communications"},{"key":"199_CR47","doi-asserted-by":"publisher","unstructured":"O\u2019Bryan, L., Beier, M., & Salas, E. (2020). How approaches to animal swarm intelligence can improve the study of collective intelligence in human teams. Journal of Intelligence, 8(1), 9. https:\/\/doi.org\/10.3390\/jintelligence8010009.","DOI":"10.3390\/jintelligence8010009"},{"key":"199_CR48","unstructured":"OpenAI, Berner, C., Brockman, G., Chan, B., Cheung, V., D\u0229biak, P., Dennison, C., Farhi, D., Fischer, Q., Hashme, S., Hesse, C., J\u00f3zefowicz, R., Gray, S., Olsson, C., Pachocki, J., Petrov, M., de\u00a0Oliveira\u00a0Pinto, H. P., Raiman, J., Salimans, T., Schlatter, J., Schneider, J., Sidor, S., Sutskever, I., Tang, J., Wolski, F., & Zhang, S. (2019). Dota 2 with large scale deep reinforcement learning. arXiv preprint arXiv:191206680v1."},{"key":"199_CR49","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.jbef.2017.12.004","volume":"17","author":"S Palan","year":"2018","unstructured":"Palan, S., & Schitter, C. (2018). Prolific.ac\u2014A subject pool for online experiments. Journal of Behavioral and Experimental Finance, 17, 22\u201327. https:\/\/doi.org\/10.1016\/j.jbef.2017.12.004.","journal-title":"Journal of Behavioral and Experimental Finance"},{"key":"199_CR50","doi-asserted-by":"crossref","unstructured":"Pinciroli, C., Trianni, V., O\u2019Grady, R., Pini, G., Brutschy, A., Brambilla, M., et al. (2012). ARGoS: a modular, parallel, multi-engine simulator for multi-robot systems. Swarm intelligence, 6(4), 271\u2013295.","DOI":"10.1007\/s11721-012-0072-5"},{"key":"199_CR51","doi-asserted-by":"publisher","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., & Ng, A. Y. (2009). ROS: An open-source robot operating system. In ICRA workshop on open source software (vol.\u00a03, p.\u00a05). https:\/\/doi.org\/10.5772\/5618.","DOI":"10.5772\/5618"},{"key":"199_CR52","doi-asserted-by":"publisher","unstructured":"Quinn, A. J., & Bederson, B. B. (2011). Human computation: A survey and taxonomy of a growing field. In Proceedings of the international conference on human factors in computing systems, association for computing machinery (pp. 1403\u20131412). https:\/\/doi.org\/10.1145\/1978942.1979148.","DOI":"10.1145\/1978942.1979148"},{"issue":"48","key":"199_CR53","doi-asserted-by":"publisher","first-page":"19193","DOI":"10.1073\/pnas.1108243108","volume":"108","author":"DG Rand","year":"2011","unstructured":"Rand, D. G., Arbesman, S., & Christakis, N. A. (2011). Dynamic social networks promote cooperation in experiments with humans. Proceedings of the National Academy of Sciences, 108(48), 19193\u201319198. https:\/\/doi.org\/10.1073\/pnas.1108243108.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"199_CR54","doi-asserted-by":"publisher","unstructured":"Rosenberg, L., Baltaxe, D., & Pescetelli, N. (2016). Crowds vs swarms, a comparison of intelligence. In 2016 swarm\/human blended intelligence workshop (SHBI) (pp. 1\u20135). IEEE. https:\/\/doi.org\/10.1109\/shbi.2016.7780278.","DOI":"10.1109\/shbi.2016.7780278"},{"key":"199_CR55","doi-asserted-by":"publisher","unstructured":"Rosenberg, L. B. (2015). Human swarms, a real-time method for collective intelligence. In Proceedings of the European conference on artificial life 2015 (pp. 658\u2013659). The MIT Press. https:\/\/doi.org\/10.7551\/978-0-262-33027-5-ch117.","DOI":"10.7551\/978-0-262-33027-5-ch117"},{"issue":"6198","key":"199_CR56","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1126\/science.1254295","volume":"345","author":"M Rubenstein","year":"2014","unstructured":"Rubenstein, M., Cornejo, A., & Nagpal, R. (2014). Programmable self-assembly in a thousand-robot swarm. Science, 345(6198), 795\u2013799. https:\/\/doi.org\/10.1126\/science.1254295.","journal-title":"Science"},{"issue":"2","key":"199_CR57","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1016\/j.cognition.2009.08.009","volume":"113","author":"TC Scott-Phillips","year":"2009","unstructured":"Scott-Phillips, T. C., Kirby, S., & Ritchie, G. R. (2009). Signalling signalhood and the emergence of communication. Cognition, 113(2), 226\u2013233. https:\/\/doi.org\/10.1016\/j.cognition.2009.08.009.","journal-title":"Cognition"},{"issue":"18","key":"199_CR58","doi-asserted-by":"publisher","first-page":"7361","DOI":"10.1073\/pnas.0702077104","volume":"104","author":"R Selten","year":"2007","unstructured":"Selten, R., & Warglien, M. (2007). The emergence of simple languages in an experimental coordination game. Proceedings of the National Academy of Sciences, 104(18), 7361\u20137366. https:\/\/doi.org\/10.1073\/pnas.0702077104.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"199_CR59","doi-asserted-by":"publisher","unstructured":"Shaker, N., Togelius, J., & Nelson, M. J. (2016). Procedural content generation in games. Springer. https:\/\/doi.org\/10.1007\/978-3-319-42716-4.","DOI":"10.1007\/978-3-319-42716-4"},{"issue":"7654","key":"199_CR60","doi-asserted-by":"publisher","first-page":"370","DOI":"10.1038\/nature22332","volume":"545","author":"H Shirado","year":"2017","unstructured":"Shirado, H., & Christakis, N. A. (2017). Locally noisy autonomous agents improve global human coordination in network experiments. Nature, 545(7654), 370\u2013374. https:\/\/doi.org\/10.1038\/nature22332.","journal-title":"Nature"},{"issue":"7598","key":"199_CR61","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1038\/nature17620","volume":"532","author":"JJWH S\u00f8rensen","year":"2016","unstructured":"S\u00f8rensen, J. J. W. H., Pedersen, M. K., Munch, M., Haikka, P., Jensen, J. H., Planke, T., et al. (2016). Exploring the quantum speed limit with computer games. Nature, 532(7598), 210\u2013213. https:\/\/doi.org\/10.1038\/nature17620.","journal-title":"Nature"},{"issue":"36","key":"199_CR62","doi-asserted-by":"publisher","first-page":"14574","DOI":"10.1073\/pnas.1303170110","volume":"110","author":"A Stolk","year":"2013","unstructured":"Stolk, A., Verhagen, L., Schoffelen, J. M., Oostenveld, R., Blokpoel, M., Hagoort, P., et al. (2013). Neural mechanisms of communicative innovation. Proceedings of the National Academy of Sciences, 110(36), 14574\u201314579. https:\/\/doi.org\/10.1073\/pnas.1303170110.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"199_CR63","doi-asserted-by":"publisher","unstructured":"Tavakoli, A., Nalbandian, H., & Ayanian, N. (2016). Crowdsourced coordination through online games. In 2016 11th ACM\/IEEE international conference on human\u2013robot interaction (HRI) (pp. 527\u2013528). https:\/\/doi.org\/10.1109\/HRI.2016.7451839.","DOI":"10.1109\/HRI.2016.7451839"},{"issue":"4","key":"199_CR64","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1162\/pres\\_a_00237","volume":"24","author":"T Thrash","year":"2015","unstructured":"Thrash, T., Kapadia, M., Moussaid, M., Wilhelm, C., Helbing, D., Sumner, R. W., & H\u00f6lscher, C. (2015). Evaluation of control interfaces for desktop virtual environments. Presence Teleoperators and Virtual Environments, 24(4), 322\u2013334. https:\/\/doi.org\/10.1162\/pres_a_00237.","journal-title":"Presence Teleoperators and Virtual Environments"},{"key":"199_CR65","doi-asserted-by":"publisher","unstructured":"Titlestad, K., Snijders, T., Durrheim, K., Quayle, M., & Postmes, T. (2019). The dynamic emergence of cooperative norms in a social dilemma. Journal of Experimental Social Psychology,84, 103799. https:\/\/doi.org\/10.1016\/j.jesp.2019.03.010.","DOI":"10.1016\/j.jesp.2019.03.010"},{"key":"199_CR66","doi-asserted-by":"publisher","unstructured":"Valentini, G., Ferrante, E., & Dorigo, M. (2017). The best-of-n problem in robot swarms: Formalization, state of the art, and novel perspectives. Frontiers in Robotics and AI,4,. https:\/\/doi.org\/10.3389\/frobt.2017.00009.","DOI":"10.3389\/frobt.2017.00009"},{"key":"199_CR67","doi-asserted-by":"publisher","unstructured":"Vasile, C., Pavel, A., & Buiu, C. (2011). Integrating human swarm interaction in a distributed robotic control system. In 2011 IEEE international conference on automation science and engineering (pp. 743\u2013748). IEEE. https:\/\/doi.org\/10.1109\/CASE.2011.6042493.","DOI":"10.1109\/CASE.2011.6042493"},{"key":"199_CR68","doi-asserted-by":"publisher","first-page":"2039","DOI":"10.3389\/fpsyg.2016.02039","volume":"07","author":"C Vesper","year":"2017","unstructured":"Vesper, C., Abramova, E., B\u00fctepage, J., Ciardo, F., Crossey, B., Effenberg, A., et al. (2017). Joint action: Mental representations, shared information and general mechanisms for coordinating with others. Frontiers in Psychology, 07, 2039. https:\/\/doi.org\/10.3389\/fpsyg.2016.02039.","journal-title":"Frontiers in Psychology"},{"key":"199_CR69","doi-asserted-by":"publisher","unstructured":"Walker, P., Amraii, S. A., Chakraborty, N., Lewis, M., & Sycara, K. (2014). Human control of robot swarms with dynamic leaders. In 2014 IEEE\/RSJ international conference on intelligent robots and systems (pp. 1108\u20131113). IEEE. https:\/\/doi.org\/10.1109\/IROS.2014.6942696.","DOI":"10.1109\/IROS.2014.6942696"},{"key":"199_CR70","unstructured":"Wang, H., & Sun, C. T. (2012). Game reward systems: Gaming experiences and social meanings. In Proceedings of DiGRA 2011 conference: Think design play, DiGRA (vol.\u00a06)."},{"key":"199_CR71","doi-asserted-by":"publisher","unstructured":"Weibel, R. P., Gr\u00fcbel, J., Zhao, H., Thrash, T., Meloni, D., H\u00f6lscher, C., & Schinazi, V. R. (2018). Virtual reality experiments with physiological measures. Journal of Visualized Experiments,138, e58318. https:\/\/doi.org\/10.3791\/58318.","DOI":"10.3791\/58318"},{"issue":"6172","key":"199_CR72","doi-asserted-by":"publisher","first-page":"754","DOI":"10.1126\/science.1245842","volume":"343","author":"J Werfel","year":"2014","unstructured":"Werfel, J., Petersen, K., & Nagpal, R. (2014). Designing collective behavior in a termite-inspired robot construction team. Science, 343(6172), 754\u2013758. https:\/\/doi.org\/10.1126\/science.1245842.","journal-title":"Science"},{"issue":"3","key":"199_CR73","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1002\/j.1533-8665.2012.00022.x","volume":"25","author":"JP Williams","year":"2012","unstructured":"Williams, J. P., & Kirschner, D. (2012). Coordinated action in the massively multiplayer online game world of warcraft. Symbolic Interaction, 25(3), 340\u2013367. https:\/\/doi.org\/10.1002\/j.1533-8665.2012.00022.x.","journal-title":"Symbolic Interaction"},{"key":"199_CR74","doi-asserted-by":"publisher","unstructured":"Yannakakis, G. N., & Togelius, J. (2018). Modeling players. In Artificial Intelligence and Games (pp. 203\u2013255). Springer. https:\/\/doi.org\/10.1007\/978-3-319-63519-4_5.","DOI":"10.1007\/978-3-319-63519-4_5"},{"key":"199_CR75","unstructured":"Zhang, Y., Wang, S., O\u011fuz, S., Heinrich, M., Wang, X., Garone, E., & Dorigo, M. (2021). Self-reconfigurable hierarchical frameworks for bearing-based formation control of robot swarms. Technical Report TR\/IRIDIA\/2021-004, IRIDIA, Universit\u00e9 Libre de Bruxelles, Brussels, Belgium."},{"key":"199_CR76","doi-asserted-by":"publisher","unstructured":"Zhao, H., Thrash, T., Wehrli, S., H\u00f6lscher, C., Kapadia, M., Gr\u00fcbel, J., Weibel, R. P., & Schinazi, V. R. (2018). A networked desktop virtual reality setup for decision science and navigation experiments with multiple participants. Journal of Visualized Experiments. https:\/\/doi.org\/10.3791\/58155.","DOI":"10.3791\/58155"},{"key":"199_CR77","doi-asserted-by":"publisher","unstructured":"Zhao, H., Thrash, T., Grossrieder, A., Kapadia, M., Moussa\u00efd, M., H\u00f6lscher, C., & Schinazi, V. R. (2020). The interaction between map complexity and crowd movement on navigation decisions in virtual reality. Royal Society Open Science,7(3), 191523. https:\/\/doi.org\/10.1098\/rsos.191523.","DOI":"10.1098\/rsos.191523"},{"key":"199_CR78","doi-asserted-by":"publisher","unstructured":"Zhu, W., Allwright, M., Heinrich, M. K., O\u011fuz, S., Christensen, A. L., & Dorigo, M. (2020). Formation control of UAVs and mobile robots using self-organized communication topologies. In Swarm Intelligence\u2014Proceedings of ANTS 2020\u2014Twelfth International Conference (vol. 12421, pp. 306\u2013314). Springer, Berlin, Lecture Notes in Computer Science. https:\/\/doi.org\/10.1007\/978-3-030-60376-2_25.","DOI":"10.1007\/978-3-030-60376-2_25"}],"container-title":["Swarm Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11721-021-00199-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11721-021-00199-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11721-021-00199-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,29]],"date-time":"2021-11-29T06:10:57Z","timestamp":1638166257000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11721-021-00199-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,3]]},"references-count":78,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["199"],"URL":"https:\/\/doi.org\/10.1007\/s11721-021-00199-1","relation":{},"ISSN":["1935-3812","1935-3820"],"issn-type":[{"value":"1935-3812","type":"print"},{"value":"1935-3820","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,3]]},"assertion":[{"value":"22 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All participants indicated their consent to participate in the study by accepting a written statement.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All participants indicated their consent for their anonymized data to be made available to the scientific community, by accepting a written statement.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"These pilot studies were approved by the ethical committee of the Universit\u00e9 libre de Bruxelles (permission 126\/2020).","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}}]}}