{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T10:33:56Z","timestamp":1776076436620,"version":"3.50.1"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"5","funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation programme","award":["955569"],"award-info":[{"award-number":["955569"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2025,10,31]]},"abstract":"<jats:p>Voluntary Geographic Information initiatives are transforming the disaster response landscape. Our research provides insights into how the concept of collective intelligence is accomplished in humanitarian mapping initiatives. The main source originates from the data obtained in 746 mapping projects organised by the Humanitarian OpenStreetMap Team between December 2021 and November 2023, where 38,893 contributors completed 312,289 mapping tasks. These data include detailed attributes of the contributors and the states the tasks go through. The methodology adopts a quantitative approach, including descriptive and inferential statistics, and standard process mining techniques. Our results indicate that, in general terms, in humanitarian mapping, a group of contributors from outside the area of interest perform straightforward mapping tasks with limited collaboration among them. The \u2018wisdom\u2019 of advanced contributors is the cornerstone that sustains the system. The discussion section elaborates on (1) how these findings suggest that humanitarian mapping projects effectively meet their short-term mapping objectives but fall short if more sustainable mapping objectives are sought and (2) possible strategies for better harnessing the collective intelligence of these efforts.<\/jats:p>","DOI":"10.1145\/3733600","type":"journal-article","created":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T12:31:28Z","timestamp":1746189088000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Collective Intelligence in Humanitarian Voluntary Geographic Information: The Case of the HOT Tasking\u00a0Manager"],"prefix":"10.1145","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8000-628X","authenticated-orcid":false,"given":"Dagoberto Jos\u00e9","family":"Herrera-Murillo","sequence":"first","affiliation":[{"name":"Aragon Institute of Engineering Research (I3A), Universidad de Zaragoza, Zaragoza, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6477-0683","authenticated-orcid":false,"given":"H\u00e9ctor","family":"Ochoa-Ortiz","sequence":"additional","affiliation":[{"name":"Computer Science Division, School of Science and Technology, Universit\u00e0 degli Studi di Camerino, Camerino, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2260-2777","authenticated-orcid":false,"given":"Umair","family":"Ahmed","sequence":"additional","affiliation":[{"name":"Computer Science Division, School of Science and Technology, Universit\u00e0 degli Studi di Camerino, Camerino, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6491-7430","authenticated-orcid":false,"given":"Francisco J.","family":"Lopez-Pellicer","sequence":"additional","affiliation":[{"name":"Aragon Institute of Engineering Research (I3A), Universidad de Zaragoza, Zaragoza, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5374-2364","authenticated-orcid":false,"given":"Barbara","family":"Re","sequence":"additional","affiliation":[{"name":"Computer Science Division, School of Science and Technology, Universit\u00e0 degli Studi di Camerino, Camerino, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2840-7561","authenticated-orcid":false,"given":"Andrea","family":"Polini","sequence":"additional","affiliation":[{"name":"Computer Science Division, School of Science and Technology, Universit\u00e0 degli Studi di Camerino, Camerino, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1279-0367","authenticated-orcid":false,"given":"Javier","family":"Nogueras-Iso","sequence":"additional","affiliation":[{"name":"Aragon Institute of Engineering Research (I3A), Universidad de Zaragoza, Zaragoza, Spain"}]}],"member":"320","published-online":{"date-parts":[[2025,10,14]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"crossref","first-page":"5468","DOI":"10.1109\/HICSS.2016.675","volume-title":"Proceedings of the 2016 49th Hawaii International Conference on System Sciences (HICSS)","author":"Anderson Jennings","year":"2016","unstructured":"Jennings Anderson, Robert Soden, Kenneth M. Anderson, Marina Kogan, and Leysia Palen. 2016. EPIC-OSM: A software framework for OpenStreetMap data analytics. In Proceedings of the 2016 49th Hawaii International Conference on System Sciences (HICSS), 5468\u20135477. DOI: 10.1109\/HICSS.2016.675"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1080\/13658816.2018.1458312"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1037\/amp0000305"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1609.09748"},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9693.001.0001","volume-title":"Crowdsourcing","author":"Brabham Daren C.","year":"2013","unstructured":"Daren C. Brabham. 2013. Crowdsourcing. The MIT Press."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1177\/0002764212469364"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","unstructured":"Youjin Choe Martin Tomko and Mohsen Kalantari. 2023. Assessing mapper conflict in OpenStreetMap using the Delphi survey method. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI \u201923). ACM New York NY Article 546 17 pages. DOI: 10.1145\/3544548.3580758","DOI":"10.1145\/3544548.3580758"},{"key":"e_1_3_2_9_2","author":"Chrisman Nicholas","year":"1991","unstructured":"Nicholas Chrisman. 1991. The Error Component in Spatial Data, Vol. 1.","journal-title":"The Error Component in Spatial Data"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819939"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","unstructured":"Jean-Christophe Dubois Laetitia Gros Mouloud Kharoune Yolande Le Gall Arnaud Martin Zoltan Miklos and Hosna Ouni. 2019. In Advances in Knowledge Discovery and Management. Studies in Computational Intelligence. Bruno Pinaud Fabrice Guillet Fabien Gandon and Christine Largeron (Eds.) Springer International Publishing Cham 139\u2013157. DOI: 10.1007\/978-3-030-18129-1_7","DOI":"10.1007\/978-3-030-18129-1_7"},{"key":"e_1_3_2_12_2","volume-title":"Proceedings of the International Conference on Information Systems for Crisis Response and Management","author":"Eckle Melanie","year":"2015","unstructured":"Melanie Eckle and Jo\u00e3o Porto de Albuquerque. 2015. Quality assessment of remote mapping in OpenStreetMap for disaster management purposes. In Proceedings of the International Conference on Information Systems for Crisis Response and Management. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:4506679"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702259"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1080\/0022250X.1999.9990219"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10708-007-9111-y"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.spasta.2012.03.002"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.3390\/ijgi11040230"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0114(99)00016-0"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1068\/b35097"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.2375"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718962"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-82404-z"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-43126-5_1"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.5194\/agile-giss-5-5-2024"},{"issue":"6","key":"e_1_3_2_25_2","first-page":"176","article-title":"The rise of crowdsourcing","volume":"14","author":"Jeff Howe","year":"2006","unstructured":"Jeff Howe. 2006. The rise of crowdsourcing. Wired Magazine 14, 6 (2006), 176\u2013183.","journal-title":"Wired Magazine"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.34133\/remotesensing.0105"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.techsoc.2020.101496"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858123"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858122"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858371"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1177\/26339137221104785"},{"key":"e_1_3_2_32_2","volume-title":"Superminds: The Surprising Power of People and Computers Thinking Together","author":"Malone Thomas W.","year":"2018","unstructured":"Thomas W. Malone. 2018. Superminds: The Surprising Power of People and Computers Thinking Together (1st ed.). Little, Brown and Company, New York.","edition":"1"},{"key":"e_1_3_2_33_2","volume-title":"Handbook of Collective Intelligence","author":"Malone Thomas W.","year":"2022","unstructured":"Thomas W. Malone and Michael S. Bernstein. 2022. Handbook of Collective Intelligence. MIT Press."},{"key":"e_1_3_2_34_2","first-page":"21","article-title":"The collective intelligence genome","volume":"51","author":"Malone Thomas W.","year":"2010","unstructured":"Thomas W. Malone, Robert Laubacher, and Chrysanthos Dellarocas. 2010. The collective intelligence genome. Sloan Management Review 51, 3 (2010), 21\u201331. Retrieved from http:\/\/www.lhstech.com\/chair\/Articles\/malone.pdf","journal-title":"Sloan Management Review"},{"key":"e_1_3_2_35_2","article-title":"Task dependency and the organization of the crowd","author":"McDonald David W.","year":"2011","unstructured":"David W. McDonald. 2011. Task dependency and the organization of the crowd. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI \u201911).","journal-title":"Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI \u201911)"},{"key":"e_1_3_2_36_2","first-page":"282","volume-title":"Proceedings of the AGILE\u20192012 International Conference on Geographic Information Science","author":"Mooney Peter","year":"2012","unstructured":"Peter Mooney and Padraig Corcoran. 2012. How social is OpenStreetMap? In Proceedings of the AGILE\u20192012 International Conference on Geographic Information Science, 282\u2013287."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1111\/tgis.12051"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781315789293-2"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1038\/srep01783"},{"key":"e_1_3_2_40_2","unstructured":"Pascal Neis Peter Singler and Alexander Zipf. 2010. Collaborative mapping and emergency routing for disaster logistics\u2014Case studies from the Haiti earthquake and the UN portal for Afrika. In Geospatial Crossroads @ GI_Forum \u201910: Proceedings of the Geoinformatics Forum Salzburg. Adrijana Car Gerald Griesebner and Josef Strobl (Eds.) Wichmann Verlag Austria Salzburg 1\u20136."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.3390\/ijgi1020146"},{"key":"e_1_3_2_42_2","unstructured":"OpenStreetMap Wiki. 2025. Stats\u2014OpenStreetMap Wiki. Retrieved from https:\/\/wiki.openstreetmap.org\/wiki\/Stats"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2005737118"},{"key":"e_1_3_2_44_2","unstructured":"Lucia Saganeiti Federico Amato Beniamino Murgante and Gabriele Nol\u00e8. 2017. VGI and crisis mapping in an emergency situation. Comparison of four case studies: Haiti Kibera Kathmandu Centre Italy. GEOmedia 21 3 (Aug. 2017) 30\u201333. Retrieved from https:\/\/mediageo.it\/ojs\/index.php\/GEOmedia\/article\/view\/1445"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00752449"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702170"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06498-7_19"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1080\/15230406.2013.874200"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.738345"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","unstructured":"Shweta Suran Vishwajeet Pattanaik and Dirk Draheim. 2020. Frameworks for collective intelligence: A Systematic Literature Review 53 1 (2020) 36 pages. DOI: 10.1145\/3368986","DOI":"10.1145\/3368986"},{"key":"e_1_3_2_51_2","unstructured":"James Surowiecki. 2004. The Wisdom of Crowds: Why the Many Are Smarter Than the Few and How Collective Wisdom Shapes Business Economies Societies and Nations. Abacus 295 pages."},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173722"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","unstructured":"Vinit Tipnis Eunae Yoo Gloria Urrea and Fei Gao. 2024. AI-powered philanthropy: Effects on volunteer productivity. Social Science Research Network 3 (2024) 1\u201324. DOI: 10.2139\/ssrn.4701631","DOI":"10.2139\/ssrn.4701631"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2014.04.005"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1111\/poms.13879"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3665326"},{"key":"e_1_3_2_57_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-662-49851-4","volume-title":"Process Mining: Data Science in Action","author":"Van der Aalst Wil","year":"2016","unstructured":"Wil Van der Aalst. 2016. Process Mining: Data Science in Action. Springer, NL."},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1080\/15230406.2022.2156389"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1193147"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.3390\/ijgi5020021"},{"key":"e_1_3_2_61_2","first-page":"34","volume-title":"Proceedings of the ACM on Human-Computer Interaction 8, CSCW1, Article","volume":"113","author":"Yin Yaxuan","year":"2024","unstructured":"Yaxuan Yin, Longjie Guo, and Jacob Thebault Spieker. 2024. Productivity or equity? Tradeoffs in volunteer microtasking in humanitarian OpenStreetMap. Proceedings of the ACM on Human-Computer Interaction 8, CSCW1, Article 113 (Apr. 2024), 34 pages. DOI: 10.1145\/3637390"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641963"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.3390\/su132413991"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3733600","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,15]],"date-time":"2025-10-15T06:50:51Z","timestamp":1760511051000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3733600"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,14]]},"references-count":62,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,10,31]]}},"alternative-id":["10.1145\/3733600"],"URL":"https:\/\/doi.org\/10.1145\/3733600","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,14]]},"assertion":[{"value":"2024-07-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-11","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}