{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T23:48:56Z","timestamp":1776124136644,"version":"3.50.1"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T00:00:00Z","timestamp":1541030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2018,11]]},"abstract":"<jats:p>Most commonly used approaches to developing automated or artificially intelligent algorithmic systems are Big Data-driven and machine learning-based. However, these approaches can fail, for two notable reasons: (1) they may lack critical engagement with users and other stakeholders; (2) they rely largely on historical human judgments, which do not capture and incorporate human insights into how the world can be improved in the future. We propose and describe a novel method for the design of such algorithms, which we call Value Sensitive Algorithm Design. Value Sensitive Algorithm Design incorporates stakeholders' tacit knowledge and explicit feedback in the early stages of algorithm creation. This increases the chance to avoid biases in design choices or to compromise key stakeholder values. Generally, we believe that algorithms should be designed to balance multiple stakeholders' needs, motivations, and interests, and to help achieve important collective goals. We also describe a specific project \"Designing Intelligent Socialization Algorithms for WikiProjects in Wikipedia\" to illustrate our method. We intend this paper to contribute to the rich ongoing conversation concerning the use of algorithms in supporting critical decision-making in society.<\/jats:p>","DOI":"10.1145\/3274463","type":"journal-article","created":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T17:21:27Z","timestamp":1541092887000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":150,"title":["Value-Sensitive Algorithm Design"],"prefix":"10.1145","volume":"2","author":[{"given":"Haiyi","family":"Zhu","sequence":"first","affiliation":[{"name":"University of Minnesota, Minneapolis, MN, USA"}]},{"given":"Bowen","family":"Yu","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, MN, USA"}]},{"given":"Aaron","family":"Halfaker","sequence":"additional","affiliation":[{"name":"Wikimedia Foundation, San Francisco, CA, USA"}]},{"given":"Loren","family":"Terveen","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, MN, USA"}]}],"member":"320","published-online":{"date-parts":[[2018,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"key":"e_1_2_1_2_1","first-page":"168","article-title":"Make algorithms accountable","volume":"1","author":"Angwin Julia","year":"2016","unstructured":"Julia Angwin. 2016. Make algorithms accountable. The New York Times , Vol. 1 (2016), 168.","journal-title":"The New York Times"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208560"},{"key":"e_1_2_1_4_1","volume-title":"Wicked problems in design thinking. Design issues","author":"Buchanan Richard","year":"1992","unstructured":"Richard Buchanan. 1992. Wicked problems in design thinking. Design issues , Vol. 8, 2 (1992), 5--21."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715622512"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2013.114"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-010-0190-x"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753447"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718940"},{"key":"e_1_2_1_10_1","volume-title":"Conference on Fairness, Accountability and Transparency. 134--148","author":"Chouldechova Alexandra","year":"2018","unstructured":"Alexandra Chouldechova, Diana Benavides-Prado, Oleksandr Fialko, and Rhema Vaithianathan. 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In Conference on Fairness, Accountability and Transparency. 134--148."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098095"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1216295.1216309"},{"key":"e_1_2_1_13_1","volume-title":"Rule extraction: Where do we go from here","author":"Craven Mark","year":"1999","unstructured":"Mark Craven and Jude Shavlik. 1999. Rule extraction: Where do we go from here. University of Wisconsin Machine Learning Research Group working Paper , Vol. 99 (1999)."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1515\/popets-2015-0007"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2016.2643"},{"key":"e_1_2_1_17_1","volume-title":"Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608","author":"Doshi-Velez Finale","year":"2017","unstructured":"Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 (2017)."},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Benjamin G Edelman and Michael Luca. 2014. Digital discrimination: The case of airbnb. com. (2014).","DOI":"10.2139\/ssrn.2377353"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783311"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145270"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.2753\/MIS0742-1222260103"},{"key":"e_1_2_1_22_1","unstructured":"Wikimedia Foundation. {n. d.}. Definition of research terms in Wikimedia Foundation. ({n. d.}). http:\/\/upload.wikimedia.org\/wikipedia\/commons\/0\/09\/Definitions_of_Research_Terms.pdf"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1561\/1100000015"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491055.2491061"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.72"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-014-0393-7"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764212469365"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557313"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038558.2038585"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038558.2038575"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2141512.2141550"},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Marit Hinnosaar Toomas Hinnosaar Michael E Kummer and Olga Slivko. 2017. Wikipedia Matters. (2017).","DOI":"10.2139\/ssrn.3046400"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_2_1_34_1","unstructured":"Andrew McAfee Natalie Saltiel Iyad Rahwan Karthik Dinakar. 2016. Society in the Loop Artificial Intelligence. (2016). https:\/\/joi.ito.com\/weblog\/2016\/06\/23\/society-in-the-.html"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858123"},{"key":"e_1_2_1_36_1","volume-title":"Control and Communication, 2009. IC4 2009. 2nd International Conference on. IEEE, 1--6.","author":"Kamiran Faisal","year":"2009","unstructured":"Faisal Kamiran and Toon Calders. 2009. Classifying without discriminating. In Computer, Control and Communication, 2009. IC4 2009. 2nd International Conference on. IEEE, 1--6."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2010.50"},{"key":"e_1_2_1_38_1","volume-title":"Quantifying explainable discrimination and removing illegal discrimination in automated decision making. Knowledge and information systems","author":"Kamiran Faisal","year":"2013","unstructured":"Faisal Kamiran, Indr\u0117 \u017dliobait\u0117, and Toon Calders. 2013. Quantifying explainable discrimination and removing illegal discrimination in automated decision making. Knowledge and information systems , Vol. 35, 3 (2013), 613--644."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33486-3_3"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518930"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518928"},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1093\/qje\/qjx032","article-title":"Human decisions and machine predictions","volume":"133","author":"Kleinberg Jon","year":"2017","unstructured":"Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. 2017. Human decisions and machine predictions. The Quarterly Journal of Economics , Vol. 133, 1 (2017), 237--293.","journal-title":"The Quarterly Journal of Economics"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518927"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038558.2038560"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","unstructured":"Min Kyung Lee and Su Baykal. 2017. Algorithmic Mediation in Group Decisions: Fairness Perceptions of Algorithmically Mediated vs. Discussion-Based Social Division.. In CSCW. 1035--1048. 10.1145\/2998181.2998230","DOI":"10.1145\/2998181.2998230"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1120212.1120281"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10506-014-9156-4"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1316624.1316668"},{"key":"e_1_2_1_49_1","volume-title":"Explanation in artificial intelligence: insights from the social sciences. arXiv preprint arXiv:1706.07269","author":"Miller Tim","year":"2017","unstructured":"Tim Miller. 2017. Explanation in artificial intelligence: insights from the social sciences. arXiv preprint arXiv:1706.07269 (2017)."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441871"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/153571.255960"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038558.2038586"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.5555\/3002861"},{"key":"e_1_2_1_54_1","unstructured":"Andrew Orlowski. 2014. Jimbo tells Wikipedians: You CAN'T vote to disable 'key software features'. (2014). http:\/\/www.theregister.co.uk\/2014\/09\/03\/wales_aura_wears_off_as_jimbo_tells_wikipedians_use_what_your_told\/"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","unstructured":"Roy D Pea. 1986. User centered system design: New perspectives on human-computer interaction. (1986).","DOI":"10.5555\/576915"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/1793274.1793338"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-017-9430-8"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.5555\/2481655.2481665"},{"key":"e_1_2_1_59_1","volume-title":"Applying common identity and bond theory to design of online communities","author":"Ren Yuqing","year":"2007","unstructured":"Yuqing Ren, Robert Kraut, and Sara Kiesler. 2007. Applying common identity and bond theory to design of online communities. Organization studies , Vol. 28, 3 (2007), 377--408."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/192844.192905"},{"key":"e_1_2_1_61_1","volume-title":"Model-agnostic interpretability of machine learning. arXiv preprint arXiv:1606.05386","author":"Ribeiro Marco Tulio","year":"2016","unstructured":"Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. Model-agnostic interpretability of machine learning. arXiv preprint arXiv:1606.05386 (2016)."},{"key":"e_1_2_1_62_1","volume-title":"Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry","author":"Sandvig Christian","year":"2014","unstructured":"Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry (2014), 1--23."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372071"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2013.31"},{"key":"e_1_2_1_65_1","volume-title":"The idea of justice","author":"Sen Amartya Kumar","unstructured":"Amartya Kumar Sen. 2009. The idea of justice .Harvard University Press."},{"key":"e_1_2_1_66_1","first-page":"50","article-title":"The decline of Wikipedia","volume":"116","author":"Simonite Tom","year":"2013","unstructured":"Tom Simonite. 2013. The decline of Wikipedia. Technology Review , Vol. 116, 6 (2013), 50--56.","journal-title":"Technology Review"},{"key":"e_1_2_1_67_1","volume-title":"AAAI workshop on Wikipedia and artificial intelligence: An Evolving Synergy . 43--48","author":"Smets Koen","year":"2008","unstructured":"Koen Smets, Bart Goethals, and Brigitte Verdonk. 2008. Automatic vandalism detection in Wikipedia: Towards a machine learning approach. In AAAI workshop on Wikipedia and artificial intelligence: An Evolving Synergy . 43--48."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/1641309.1641322"},{"key":"e_1_2_1_69_1","unstructured":"Petr Svab. 2015. Wikipedia's Crisis of Identity. (2015). https:\/\/www.theepochtimes.com\/wikipedias-crisis-of-identity_1288751.html"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","unstructured":"Sebastian Thrun. 1995. Learning to play the game of chess. In Advances in neural information processing systems . 1069--1076.","DOI":"10.5555\/2998687.2998820"},{"key":"e_1_2_1_71_1","volume-title":"How Should We Think About Audience Power in the Digital Age? The International Encyclopedia of Media Studies","author":"Turow Joseph","year":"2013","unstructured":"Joseph Turow. 2013. How Should We Think About Audience Power in the Digital Age? The International Encyclopedia of Media Studies (2013)."},{"key":"e_1_2_1_72_1","first-page":"60","article-title":"Websites vary prices, deals based on users' information","volume":"10","author":"Valentino-Devries Jennifer","year":"2012","unstructured":"Jennifer Valentino-Devries, Jeremy Singer-Vine, and Ashkan Soltani. 2012. Websites vary prices, deals based on users' information. Wall Street Journal , Vol. 10 (2012), 60--68.","journal-title":"Wall Street Journal"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174014"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675241"},{"key":"e_1_2_1_75_1","doi-asserted-by":"crossref","unstructured":"Morten Warncke-Wang Vivek Ranjan Loren G Terveen and Brent J Hecht. 2015. Misalignment Between Supply and Demand of Quality Content in Peer Production Communities.. In ICWSM. 493--502.","DOI":"10.1609\/icwsm.v9i1.14631"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/2462932.2462959"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998227"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145344"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240704"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-017-0506-1"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274463","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3274463","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T23:05:17Z","timestamp":1775257517000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274463"}},"subtitle":["Method, Case Study, and Lessons"],"short-title":[],"issued":{"date-parts":[[2018,11]]},"references-count":80,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2018,11]]}},"alternative-id":["10.1145\/3274463"],"URL":"https:\/\/doi.org\/10.1145\/3274463","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11]]},"assertion":[{"value":"2018-11-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}