{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T08:22:47Z","timestamp":1774513367912,"version":"3.50.1"},"reference-count":82,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004828","name":"Grand Challenges Canada","doi-asserted-by":"publisher","award":["R-HGC-POC-2007-34904"],"award-info":[{"award-number":["R-HGC-POC-2007-34904"]}],"id":[{"id":"10.13039\/501100004828","id-type":"DOI","asserted-by":"publisher"}]},{"name":"City of The Hague Humanitarian Action Challenge","award":["18.238"],"award-info":[{"award-number":["18.238"]}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Big Data &amp; Society"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:p> There is increasing criticism on the use of big data and algorithms in public governance. Studies revealed that algorithms may reinforce existing biases and defy scrutiny by public officials using them and citizens subject to algorithmic decisions and services. In response, scholars have called for more algorithmic transparency and regulation. These are useful, but ex post solutions in which the development of algorithms remains a rather autonomous process. This paper argues that co-design of algorithms with relevant stakeholders from government and society is another means to achieve responsible and accountable algorithms that is largely overlooked in the literature. We present a case study of the development of an algorithmic tool to estimate the populations of refugee camps to manage the delivery of emergency supplies. This case study demonstrates how in different stages of development of the tool\u2014data selection and pre-processing, training of the algorithm and post-processing and adoption\u2014inclusion of knowledge from the field led to changes to the algorithm. Co-design supported responsibility of the algorithm in the selection of big data sources and in preventing reinforcement of biases. It contributed to accountability of the algorithm by making the estimations transparent and explicable to its users. They were able to use the tool for fitting purposes and used their discretion in the interpretation of the results. It is yet unclear whether this eventually led to better servicing of refugee camps. <\/jats:p>","DOI":"10.1177\/20539517221087855","type":"journal-article","created":{"date-parts":[[2022,4,6]],"date-time":"2022-04-06T05:55:23Z","timestamp":1649224523000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":22,"title":["Co-designing algorithms for governance: Ensuring responsible and accountable algorithmic management of  refugee camp supplies"],"prefix":"10.1177","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6460-4223","authenticated-orcid":false,"given":"Rianne","family":"Dekker","sequence":"first","affiliation":[{"name":"Utrecht University School of Governance, Utrecht, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5016-7891","authenticated-orcid":false,"given":"Paul","family":"Koot","sequence":"additional","affiliation":[{"name":"Notilyze B.V, Rotterdam, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7472-7032","authenticated-orcid":false,"given":"S. Ilker","family":"Birbil","sequence":"additional","affiliation":[{"name":"Faculty of Economics and Business, University of Amsterdam, Amsterdam, The Netherlands"}]},{"given":"Mark","family":"van Embden Andres","sequence":"additional","affiliation":[{"name":"Elva Foundation, The Hague, The Netherlands"}]}],"member":"179","published-online":{"date-parts":[[2022,4,5]]},"reference":[{"key":"bibr1-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720949566"},{"key":"bibr2-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1111\/padm.12534"},{"key":"bibr3-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781316105337.002"},{"key":"bibr4-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1177\/2053951717718854"},{"key":"bibr5-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1093\/migration\/mnaa003"},{"key":"bibr6-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1080\/014311600210786"},{"key":"bibr7-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8500.12310"},{"key":"bibr8-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2012.678878"},{"key":"bibr9-20539517221087855","doi-asserted-by":"publisher","DOI":"10.4324\/9781315756400-13"},{"key":"bibr10-20539517221087855","doi-asserted-by":"publisher","DOI":"10.3233\/IDA-2000-43-413"},{"key":"bibr11-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1332\/030557319X15613696433190"},{"key":"bibr12-20539517221087855","doi-asserted-by":"publisher","DOI":"10.3233\/IP-200223"},{"key":"bibr13-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715622512"},{"key":"bibr14-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1111\/puar.13293"},{"key":"bibr15-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2017.11.002"},{"key":"bibr16-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1007\/s10109-018-0278-1"},{"key":"bibr17-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1177\/2053951717726554"},{"key":"bibr18-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1177\/2056305118764439"},{"key":"bibr19-20539517221087855","first-page":"135638902199784","author":"Dekker R","year":"2021","journal-title":"Evaluation"},{"key":"bibr20-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1177\/0095399714555751"},{"key":"bibr21-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1038\/543032a"},{"key":"bibr22-20539517221087855","volume-title":"Automating Inequality. How High-Tech Tools Profile, Police, and Punish the Poor","author":"Eubanks V","year":"2018"},{"key":"bibr23-20539517221087855","doi-asserted-by":"publisher","DOI":"10.18574\/nyu\/9781479854608.001.0001"},{"key":"bibr24-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511973000"},{"key":"bibr25-20539517221087855","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7585.001.0001"},{"key":"bibr26-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1080\/0143116021000035021"},{"key":"bibr27-20539517221087855","first-page":"1","author":"Giest S","year":"2020","journal-title":"Information Polity"},{"key":"bibr28-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000089"},{"key":"bibr29-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-6210.2007.00778.x"},{"key":"bibr30-20539517221087855","author":"Gritsenko D","year":"2020","journal-title":"Regulation & Governance"},{"key":"bibr31-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1080\/01431161.2016.1266059"},{"key":"bibr32-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1111\/puar.12136"},{"key":"bibr33-20539517221087855","volume-title":"Forensic Rhetorics and Satellite Surveillance: The Visualization of War Crimes and Human Rights Violations","author":"Hasian M","year":"2016"},{"key":"bibr34-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1332\/030557319X15579230420126"},{"key":"bibr35-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1332\/030557303765371726"},{"key":"bibr36-20539517221087855","unstructured":"IOM & European Commission (2018) Big Data for Migration Alliance (BD4M). Harnessing the potential of new data sources and innovative methodologies for migration. Available at: https:\/\/data4migration.org\/ (accessed 2 November 2020)."},{"key":"bibr37-20539517221087855","volume-title":"Groupthink: Psychological Studies of Policy Decisions and Fiascoes","author":"Janis IL","year":"1982"},{"key":"bibr38-20539517221087855","volume-title":"Little Bites of Big Data for Public Policy","author":"Kettl D","year":"2018"},{"key":"bibr39-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2016.1154087"},{"key":"bibr40-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1007\/s10796-016-9686-2"},{"issue":"3","key":"bibr41-20539517221087855","first-page":"633","volume":"165","author":"Kroll JA","year":"2017","journal-title":"University of Pennsylvania Law Review"},{"key":"bibr42-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1186\/s41018-020-00069-1"},{"key":"bibr43-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-017-0279-x"},{"key":"bibr44-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1332\/030557319X15579230420081"},{"key":"bibr45-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2020.1739731"},{"key":"bibr46-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0230264"},{"key":"bibr47-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1007\/s11077-018-9315-7"},{"key":"bibr48-20539517221087855","doi-asserted-by":"publisher","DOI":"10.4324\/9780429261404-5"},{"key":"bibr49-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1080\/01900692.2019.1575664"},{"key":"bibr50-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1111\/puar.12625"},{"key":"bibr51-20539517221087855","unstructured":"Milakovich ME (2012) Anticipatory government: Integrating big data for smaller government. Internet, politics, policy 2012: Big data, big challenges."},{"key":"bibr52-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1177\/2053951716679679"},{"key":"bibr53-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1177\/2053951716662054"},{"key":"bibr54-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1126\/science.aax2342"},{"key":"bibr55-20539517221087855","unstructured":"OCHA (2020) The Humanitarian Data Exchange. United Nations Office for the Coordination of Humanitarian Affairs. Available at: https:\/\/data.humdata.org\/ (accessed 22 December 2020)."},{"key":"bibr56-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1111\/puar.12260"},{"key":"bibr57-20539517221087855","doi-asserted-by":"publisher","DOI":"10.4159\/harvard.9780674736061"},{"key":"bibr58-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1111\/1540-6210.00247"},{"issue":"2","key":"bibr59-20539517221087855","first-page":"185","volume":"14","author":"Raymond NA","year":"2013","journal-title":"Georgetown Journal of International Affairs"},{"key":"bibr60-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"bibr61-20539517221087855","doi-asserted-by":"crossref","unstructured":"Rudin C, Chen C, Chen Z, Huang H, Semenova L, Zhong C (2021) Interpretable machine learning: Fundamental principles and 10 grand challenges. ArXiv preprint arXiv:2103.11251.","DOI":"10.1214\/21-SS133"},{"key":"bibr62-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2017.06.003"},{"key":"bibr63-20539517221087855","doi-asserted-by":"publisher","DOI":"10.3233\/IP-160012"},{"key":"bibr64-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-12554-7"},{"key":"bibr65-20539517221087855","volume-title":"Participatory Design: Principles and Practices","author":"Schuler D","year":"1993"},{"key":"bibr66-20539517221087855","unstructured":"Statistics Netherlands (2018) Available at: https:\/\/www.cbs.nl\/en-gb\/corporate\/2018\/09\/mapping-migrant-flows-with-satellites (Accessed 19 August 2019)."},{"key":"bibr67-20539517221087855","volume-title":"Action Research: A Handbook for Practitioners","author":"Stringer E","year":"1996"},{"key":"bibr68-20539517221087855","unstructured":"UNHCR (2018) Global trends. Forced displacement in 2017. Available at: https:\/\/www.unhcr.org\/5b27be547.pdf (Accessed 13 August 2019)."},{"key":"bibr69-20539517221087855","unstructured":"UNHCR (2020) Nigeria emergency. Available at: https:\/\/www.unhcr.org\/nigeria-emergency.html (Accessed 20 October 2020)."},{"key":"bibr70-20539517221087855","unstructured":"UNITAR (2020) United Nations satellite analysis and applied research programme. Available at: https:\/\/unitar.org\/maps (Accessed 2 November 2020)."},{"key":"bibr71-20539517221087855","first-page":"138826272110312","author":"Van Bekkum M","year":"2021","journal-title":"European Journal of Social Security"},{"key":"bibr72-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2018.10.011"},{"key":"bibr73-20539517221087855","unstructured":"Van Etten A (2018) You only look twice: Rapid multi-scale object detection in satellite imagery. arXiv preprint arXiv: 1805.09512."},{"key":"bibr74-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1016\/j.jag.2014.11.013"},{"issue":"2","key":"bibr75-20539517221087855","volume":"15","author":"Westley F","year":"2010","journal-title":"Innovation Journal"},{"key":"bibr76-20539517221087855","first-page":"1","volume":"2","author":"Whitman M","year":"2018","journal-title":"Proceedings of the 15th Participatory Design Conference"},{"key":"bibr77-20539517221087855","doi-asserted-by":"publisher","DOI":"10.3390\/rs6042912"},{"key":"bibr78-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1126\/science.aaf6545"},{"key":"bibr79-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1177\/0952076714529139"},{"key":"bibr80-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2016.1186713"},{"key":"bibr81-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198838494.003.0001"},{"key":"bibr82-20539517221087855","doi-asserted-by":"publisher","DOI":"10.1145\/3274463"}],"container-title":["Big Data &amp; Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20539517221087855","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/20539517221087855","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20539517221087855","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,1]],"date-time":"2025-03-01T17:52:38Z","timestamp":1740851558000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/20539517221087855"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1]]},"references-count":82,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["10.1177\/20539517221087855"],"URL":"https:\/\/doi.org\/10.1177\/20539517221087855","relation":{},"ISSN":["2053-9517","2053-9517"],"issn-type":[{"value":"2053-9517","type":"print"},{"value":"2053-9517","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1]]},"article-number":"20539517221087855"}}