{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T01:56:40Z","timestamp":1776391000658,"version":"3.51.2"},"reference-count":106,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T00:00:00Z","timestamp":1656633600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Big Data &amp; Society"],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:p> Algorithmic decision-making increasingly shapes people's daily lives. Given that such autonomous systems can cause severe harm to individuals and social groups, fairness concerns have arisen. A human-centric approach demanded by scholars and policymakers requires considering people's fairness perceptions when designing and implementing algorithmic decision-making. We provide a comprehensive, systematic literature review synthesizing the existing empirical insights on perceptions of algorithmic fairness from 58 empirical studies spanning multiple domains and scientific disciplines. Through thorough coding, we systemize the current empirical literature along four dimensions: (1) algorithmic predictors, (2) human predictors, (3) comparative effects (human decision-making vs. algorithmic decision-making), and (4) consequences of algorithmic decision-making. While we identify much heterogeneity around the theoretical concepts and empirical measurements of algorithmic fairness, the insights come almost exclusively from Western-democratic contexts. By advocating for more interdisciplinary research adopting a society-in-the-loop framework, we hope our work will contribute to fairer and more responsible algorithmic decision-making. <\/jats:p>","DOI":"10.1177\/20539517221115189","type":"journal-article","created":{"date-parts":[[2022,10,11]],"date-time":"2022-10-11T06:59:52Z","timestamp":1665471592000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":183,"title":["Fairness perceptions of algorithmic decision-making: A systematic review  of the empirical literature"],"prefix":"10.1177","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7899-6029","authenticated-orcid":false,"given":"Christopher","family":"Starke","sequence":"first","affiliation":[{"name":"Amsterdam School of Communication Research, University of Amsterdam, Amsterdam, the Netherlands"}]},{"given":"Janine","family":"Baleis","sequence":"additional","affiliation":[{"name":"Department of Social Sciences, Heinrich Heine University D\u00fcsseldorf, D\u00fcsseldorf, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3145-5206","authenticated-orcid":false,"given":"Birte","family":"Keller","sequence":"additional","affiliation":[{"name":"Department of Social Sciences, Heinrich Heine University D\u00fcsseldorf, D\u00fcsseldorf, Germany"}]},{"given":"Frank","family":"Marcinkowski","sequence":"additional","affiliation":[{"name":"Department of Social Sciences, Heinrich Heine University D\u00fcsseldorf, D\u00fcsseldorf, Germany"}]}],"member":"179","published-online":{"date-parts":[[2022,10,10]]},"reference":[{"key":"bibr1-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1111\/ijsa.12306"},{"key":"bibr2-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3450614.3463291"},{"key":"bibr3-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3465456.3467620"},{"key":"bibr4-20539517221115189","unstructured":"AlgorithmWatch (2019) Automating Society: Taking Stock of Automated Decision-Making in the EU. Berlin. Available at: https:\/\/algorithmwatch.org\/wp-content\/uploads\/2019\/01\/Automating_Society_Report_2019.pdf (accessed 18 July 2022)."},{"key":"bibr5-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-019-00931-w"},{"key":"bibr6-20539517221115189","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3550887"},{"key":"bibr7-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s10796-021-10223-8"},{"key":"bibr8-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1126\/science.aao4408"},{"key":"bibr9-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372859"},{"key":"bibr10-20539517221115189","doi-asserted-by":"publisher","DOI":"10.15779\/Z38BG31"},{"key":"bibr11-20539517221115189","first-page":"149","volume":"81","author":"Binns R","journal-title":"Proceedings of Machine Learning Research"},{"key":"bibr12-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2018.2701147"},{"key":"bibr13-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1111\/rego.12358"},{"key":"bibr14-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173951"},{"key":"bibr15-20539517221115189","volume-title":"Systematic Approaches to a Successful Literature Review","author":"Booth A","year":"2016"},{"key":"bibr16-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445308"},{"key":"bibr17-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0047"},{"key":"bibr18-20539517221115189","first-page":"187","volume-title":"The Oxford Handbook of Justice in the Workplace","author":"Colquitt JA","year":"2015"},{"key":"bibr19-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s11211-021-00382-z"},{"key":"bibr20-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-4560.1975.tb01000.x"},{"key":"bibr21-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"bibr22-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302310"},{"key":"bibr23-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"bibr24-20539517221115189","volume-title":"Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor","author":"Eubanks V","year":"2018"},{"key":"bibr25-20539517221115189","unstructured":"European Commission (2019) Ethics guidelines for trustworthy AI. Available at: https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai (accessed 18 July 2022)."},{"key":"bibr26-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-019-0177-4"},{"key":"bibr27-20539517221115189","unstructured":"Gajane P, Pechenizkiy M (2017) On Formalizing Fairness in Prediction with Machine Learning. Available at: http:\/\/arxiv.org\/abs\/1710.03184 (accessed 18 July 2022)."},{"key":"bibr28-20539517221115189","doi-asserted-by":"publisher","DOI":"10.5465\/annals.2018.0057"},{"key":"bibr29-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1177\/014920639001600208"},{"key":"bibr30-20539517221115189","first-page":"79","volume-title":"Justice in the Workplace: Approaching Fairness in Human Resource Management","author":"Greenberg J","year":"1993"},{"key":"bibr31-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186138"},{"key":"bibr32-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11296"},{"key":"bibr33-20539517221115189","unstructured":"Grgi\u0107-Hla\u010da N, Weller A, Redmiles EM (2020) Dimensions of Diversity in Human Perceptions of Algorithmic Fairness. Available at: https:\/\/arxiv.org\/abs\/2005.00808v1."},{"key":"bibr34-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462568"},{"key":"bibr35-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372831"},{"key":"bibr36-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.clsr.2020.105456"},{"key":"bibr37-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X0999152X"},{"key":"bibr38-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1002\/9780470712184.ch7"},{"key":"bibr39-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445424"},{"key":"bibr40-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287600"},{"key":"bibr41-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0088-2"},{"key":"bibr42-20539517221115189","doi-asserted-by":"publisher","DOI":"10.5465\/AMBPP.2019.210"},{"key":"bibr43-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445931"},{"key":"bibr44-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3430665.3456311"},{"key":"bibr45-20539517221115189","unstructured":"Kelley PG, Yang Y, Heldreth C, et al. (2021) \u201cHappy and assured that life will be easy 10 years from now.\u201d: Perceptions of artificial intelligence in 8 countries. In: Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, pp. 1\u201312. Virtual Event, USA. Available at: https:\/\/arxiv.org\/abs\/2001.00081."},{"key":"bibr46-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-020-00734-w"},{"key":"bibr47-20539517221115189","first-page":"1","author":"Kieslich K","year":"2022","journal-title":"Big Data & Society"},{"key":"bibr48-20539517221115189","doi-asserted-by":"publisher","DOI":"10.4230\/LIPIcs.ITCS.2017.43"},{"key":"bibr49-20539517221115189","unstructured":"K\u00f6bis N, Starke C, Rahwan I (2021) Artificial Intelligence as an Anti-Corruption Tool (AI-ACT)\u2014Potentials and Pitfalls for top-down and bottom-up approaches. Available at: http:\/\/arxiv.org\/abs\/2102.11567."},{"key":"bibr50-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s40685-020-00134-w"},{"key":"bibr51-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3091478.3098864"},{"key":"bibr52-20539517221115189","unstructured":"Kusner M, Loftus J, Russell C, et al. (2017) Counterfactual Fairness. In: Proceedings of the International Conference on Neural Information Processing Systems, pp. 4066\u20134076. Red Hook, USA."},{"key":"bibr53-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1177\/2053951718756684"},{"key":"bibr54-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998230"},{"key":"bibr55-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445570"},{"key":"bibr56-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025884"},{"key":"bibr57-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3359284"},{"key":"bibr58-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3359283"},{"key":"bibr59-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1002\/9780470712184.ch6"},{"key":"bibr60-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-017-0279-x"},{"key":"bibr61-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4613-3087-5_2"},{"key":"bibr62-20539517221115189","doi-asserted-by":"publisher","DOI":"10.14361\/9783839448649-014"},{"key":"bibr63-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372867"},{"key":"bibr64-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1093\/jopart\/muaa019"},{"key":"bibr65-20539517221115189","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-151-4-200908180-00135"},{"key":"bibr66-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2020.101536"},{"key":"bibr67-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2020.101491"},{"key":"bibr68-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2020.03.008"},{"key":"bibr69-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1111\/ijsa.12320"},{"key":"bibr70-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3375784"},{"key":"bibr71-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3465416.348329.1"},{"key":"bibr72-20539517221115189","unstructured":"OECD (2019) Recommendation of the Council on OECD Legal Instruments Artificial Intelligence. Paris. Available at: https:\/\/www.oecd.ai\/ai-principles (accessed 18 July 2022)."},{"key":"bibr73-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3091478.3091512"},{"key":"bibr74-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1002\/9780470754887"},{"key":"bibr75-20539517221115189","unstructured":"Pierson E (2017) Demographics and discussion influence views on algorithmic fairness. Available at: http:\/\/arxiv.org\/abs\/1712.09124."},{"key":"bibr76-20539517221115189","unstructured":"Plane AC, Redmiles EM, Mazurek ML, et al. (2017) Exploring user perceptions of discrimination in online targeted advertising. In: Proceedings of the USENIX Security Symposium, pp. 935\u2013951. Vancouver, Canada."},{"key":"bibr77-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-017-9430-8"},{"key":"bibr78-20539517221115189","unstructured":"Richardson R, Schultz JM, Southerland VM (2019) Litigating Algorithms 2019 US Report: New Challenges to Government Use of Algorithmic Decision Systems. New York. Available at: https:\/\/ainowinstitute.org\/litigatingalgorithms-2019-us.html (accessed 18 July 2022)."},{"key":"bibr79-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3375627.3375819"},{"key":"bibr80-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445896"},{"key":"bibr81-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2020.103238"},{"key":"bibr82-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.106837"},{"key":"bibr83-20539517221115189","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2103.04757"},{"key":"bibr84-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1080\/08838151.2020.1843357"},{"key":"bibr85-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2020.102551"},{"key":"bibr86-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2019.04.019"},{"key":"bibr87-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2019.102061"},{"key":"bibr88-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-022-09623-4"},{"key":"bibr89-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0084-6"},{"key":"bibr90-20539517221115189","unstructured":"Smith J, Sonboli N, Fiesler C, et al. (2020) Exploring User Opinions of Fairness in Recommender Systems. In: CHI\u201920 Workshop on Human-Centered Approaches to Fair and Responsible AI, pp. 1\u20134. Honolulu, USA."},{"key":"bibr91-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330664"},{"key":"bibr92-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-017-0506-1"},{"key":"bibr93-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2019.04.012"},{"key":"bibr94-20539517221115189","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2021.748765"},{"key":"bibr95-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3359130"},{"key":"bibr96-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445365"},{"key":"bibr97-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1177\/2053951717743530"},{"key":"bibr98-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3194770.3194776"},{"key":"bibr99-20539517221115189","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3170136"},{"key":"bibr100-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376813"},{"key":"bibr101-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-019-00355-w"},{"key":"bibr102-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1016\/j.tele.2021.101695"},{"key":"bibr103-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174230"},{"key":"bibr104-20539517221115189","unstructured":"Zafar MB, Valera I, Rodriguez MG, et al. (2017) From parity to preference-based notions of fairness in classification. In: Proceedings of the International Conference on Neural Information Processing Systems, pp. 1\u201311. Long Beach, USA."},{"key":"bibr105-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1109\/BESC53957.2021.9635182"},{"key":"bibr106-20539517221115189","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-017-0506-1"}],"container-title":["Big Data &amp; Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20539517221115189","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/20539517221115189","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20539517221115189","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,2]],"date-time":"2025-03-02T02:06:01Z","timestamp":1740881161000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/20539517221115189"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7]]},"references-count":106,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["10.1177\/20539517221115189"],"URL":"https:\/\/doi.org\/10.1177\/20539517221115189","relation":{},"ISSN":["2053-9517","2053-9517"],"issn-type":[{"value":"2053-9517","type":"print"},{"value":"2053-9517","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7]]},"article-number":"20539517221115189"}}