{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:50:26Z","timestamp":1776084626714,"version":"3.50.1"},"reference-count":25,"publisher":"Association for Computing Machinery (ACM)","issue":"8","license":[{"start":{"date-parts":[[2021,7,26]],"date-time":"2021-07-26T00:00:00Z","timestamp":1627257600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Commun. ACM"],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:p>A survey for practitioners.<\/jats:p>","DOI":"10.1145\/3464903","type":"journal-article","created":{"date-parts":[[2021,7,26]],"date-time":"2021-07-26T16:09:42Z","timestamp":1627315782000},"page":"44-49","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":92,"title":["Biases in AI systems"],"prefix":"10.1145","volume":"64","author":[{"given":"Ramya","family":"Srinivasan","sequence":"first","affiliation":[{"name":"Fujitsu Research of America"}]},{"given":"Ajay","family":"Chander","sequence":"additional","affiliation":[]}],"member":"320","published-online":{"date-parts":[[2021,7,26]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359301"},{"key":"e_1_2_1_2_1","volume-title":"What does the concept of presentation-feedback bias refer to in the context of machine learning? Quora","author":"Amatriain X.","year":"2015","unstructured":"Amatriain , X. What does the concept of presentation-feedback bias refer to in the context of machine learning? Quora , 2015 ; https:\/\/www.quora.com\/What-does-the-concept-of-presentation-feedback-bias-refer-to-in-the-context-of-machine-learning. Amatriain, X. What does the concept of presentation-feedback bias refer to in the context of machine learning? Quora, 2015; https:\/\/www.quora.com\/What-does-the-concept-of-presentation-feedback-bias-refer-to-in-the-context-of-machine-learning."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2009.05.009"},{"key":"e_1_2_1_4_1","volume-title":"Fairness and machine learning: limitations and opportunities","author":"Barocas S.","year":"2019","unstructured":"Barocas , S. , Hardt , M. , Narayanan , A. Fairness and machine learning: limitations and opportunities , 2019 ; https:\/\/fairmlbook.org. Barocas, S., Hardt, M., Narayanan, A. Fairness and machine learning: limitations and opportunities, 2019; https:\/\/fairmlbook.org."},{"key":"e_1_2_1_5_1","volume-title":"et al. AI Fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias","author":"Bellamy R.K.E.","year":"2018","unstructured":"Bellamy , R.K.E. et al. AI Fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias . 2018 , arXiv; https:\/\/arxiv.org\/abs\/1810.01943. Bellamy, R.K.E. et al. AI Fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias. 2018, arXiv; https:\/\/arxiv.org\/abs\/1810.01943."},{"key":"e_1_2_1_6_1","first-page":"1","volume":"81","author":"Buolamwini J.","year":"2018","unstructured":"Buolamwini , J. , Gebru , T. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Proceedings of Machine Learning Research 81 ( 2018 ), 1 -- 15 ; http:\/\/proceedings.mlr.press\/v81\/buolamwini18a\/buolamwini18a.pdf. Buolamwini, J., Gebru, T. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Proceedings of Machine Learning Research 81 (2018), 1--15; http:\/\/proceedings.mlr.press\/v81\/buolamwini18a\/buolamwini18a.pdf.","journal-title":"Proceedings of Machine Learning Research"},{"key":"e_1_2_1_7_1","volume-title":"Excavating AI: The politics of images in machine learning training sets","author":"Crawford K.","year":"2019","unstructured":"Crawford , K. , Paglen , T. Excavating AI: The politics of images in machine learning training sets . The AI Now Institute, New York University , 2019 ; https:\/\/www.excavating.ai. Crawford, K., Paglen, T. Excavating AI: The politics of images in machine learning training sets. The AI Now Institute, New York University, 2019; https:\/\/www.excavating.ai."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.aao5580"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-soc-071913-043455"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/230538.230561"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the Intern. Conf. Machine Learning, Fairness Accountability and Transparency Workshop","author":"Gajane P.","unstructured":"Gajane , P. , Pechenizkiy , M. On formalizing fairness in prediction with machine learning . In Proceedings of the Intern. Conf. Machine Learning, Fairness Accountability and Transparency Workshop , 2018; https:\/\/www.fatml.org\/media\/documents\/formalizing_fairness_in_prediction_with_ml.pdf. Gajane, P., Pechenizkiy, M. On formalizing fairness in prediction with machine learning. In Proceedings of the Intern. Conf. Machine Learning, Fairness Accountability and Transparency Workshop, 2018; https:\/\/www.fatml.org\/media\/documents\/formalizing_fairness_in_prediction_with_ml.pdf."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 5th Workshop on Fairness, Accountability, and Transparency in Machine Learning","author":"Gebru T.","unstructured":"Gebru , T. , Morgenstern , J. , Vecchione , B. , Vaughan , J. W. , Wallach , H. , Daum\u00e9 III, H. , Crawford , K. Datasheets for datasets . In Proceedings of the 5th Workshop on Fairness, Accountability, and Transparency in Machine Learning , 2018; https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/01\/1803.09010.pdf. Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daum\u00e9 III, H., Crawford, K. Datasheets for datasets. In Proceedings of the 5th Workshop on Fairness, Accountability, and Transparency in Machine Learning, 2018; https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/01\/1803.09010.pdf."},{"key":"e_1_2_1_13_1","volume-title":"This is how AI bias really happens---and why it's so hard to fix. MIT Technology Review","author":"Hao K.","year":"2019","unstructured":"Hao , K. This is how AI bias really happens---and why it's so hard to fix. MIT Technology Review ; https:\/\/www.technologyreview.com\/ 2019 \/02\/04\/137602\/this-is-how-ai-bias-really-happensand-why-its-so-hard-to-fix\/. Hao, K. This is how AI bias really happens---and why it's so hard to fix. MIT Technology Review; https:\/\/www.technologyreview.com\/2019\/02\/04\/137602\/this-is-how-ai-bias-really-happensand-why-its-so-hard-to-fix\/."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_2_1_15_1","volume-title":"Evaluation by moments: past and future","author":"Kahneman D.","year":"2000","unstructured":"Kahneman , D. Evaluation by moments: past and future . Choices, Values and Frames. D. Kahneman and A. Tversky, Eds. Cambridge University Press , New York , 2000 . Kahneman, D. Evaluation by moments: past and future. Choices, Values and Frames. D. Kahneman and A. Tversky, Eds. Cambridge University Press, New York, 2000."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 2019 Conf. Uncertainty in Artificial Intelligence; http:\/\/auai.org\/uai2019\/proceedings\/papers\/213","author":"Kilbertus N.","unstructured":"Kilbertus , N. , Ball , P.J. , Kusner , M.J. , Weller , A. , Silva , R. The sensitivity of counterfactual fairness to unmeasured confounding . In Proceedings of the 2019 Conf. Uncertainty in Artificial Intelligence; http:\/\/auai.org\/uai2019\/proceedings\/papers\/213 .pdf. Kilbertus, N., Ball, P.J., Kusner, M.J., Weller, A., Silva, R. The sensitivity of counterfactual fairness to unmeasured confounding. In Proceedings of the 2019 Conf. Uncertainty in Artificial Intelligence; http:\/\/auai.org\/uai2019\/proceedings\/papers\/213.pdf."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.296.6623.657"},{"key":"e_1_2_1_18_1","volume-title":"A survey on bias and fairness in machine learning","author":"Mehrabi N.","year":"2019","unstructured":"Mehrabi , N. , Morstatter , F. , Saxena , N. , Lerman , K. , Galstyan , A. A survey on bias and fairness in machine learning . 2019 , arXiv; https:\/\/arxiv.org\/abs\/1908.09635. Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., Galstyan, A. A survey on bias and fairness in machine learning. 2019, arXiv; https:\/\/arxiv.org\/abs\/1908.09635."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 2019 AAAI\/ACM Conf. AI, Ethics, and Society; arXiv; https:\/\/arxiv.org\/abs\/1810","author":"Mitchell M.","unstructured":"Mitchell , M. et al. Model cards for model reporting . In Proceedings of the 2019 AAAI\/ACM Conf. AI, Ethics, and Society; arXiv; https:\/\/arxiv.org\/abs\/1810 .03993. Mitchell, M. et al. Model cards for model reporting. In Proceedings of the 2019 AAAI\/ACM Conf. AI, Ethics, and Society; arXiv; https:\/\/arxiv.org\/abs\/1810.03993."},{"key":"e_1_2_1_20_1","volume-title":"The Book of Why: The New Science of Cause and Effect","author":"Pearl J.","year":"2018","unstructured":"Pearl , J. , Mackenzie , D. The Book of Why: The New Science of Cause and Effect . Basic Books , 2018 . Pearl, J., Mackenzie, D. The Book of Why: The New Science of Cause and Effect. Basic Books, 2018."},{"key":"e_1_2_1_21_1","volume-title":"The Psychology of Judgment and Decision Making","author":"Plous S.","year":"1993","unstructured":"Plous , S. The Psychology of Judgment and Decision Making . McGraw-Hill , 1993 . Plous, S. The Psychology of Judgment and Decision Making. McGraw-Hill, 1993."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314244"},{"key":"e_1_2_1_23_1","unstructured":"Small Z. 600 000 images removed from AI database after art project exposes racist bias. Hyperallergic 2019; https:\/\/hyperallergic.com\/518822\/600000-imagesremoved-from-ai-database-after-art-project-exposesracist-bias\/.  Small Z. 600 000 images removed from AI database after art project exposes racist bias. Hyperallergic 2019; https:\/\/hyperallergic.com\/518822\/600000-imagesremoved-from-ai-database-after-art-project-exposesracist-bias\/."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the 2019 Intern. Conf. Machine Learning Workshop on Human in the Loop Learning; https:\/\/arxiv.org\/abs\/1906","author":"Srinivasan R.","unstructured":"Srinivasan , R. , Chander , A. Crowdsourcing in the absence of ground truth---a case study . In Proceedings of the 2019 Intern. Conf. Machine Learning Workshop on Human in the Loop Learning; https:\/\/arxiv.org\/abs\/1906 .07254. Srinivasan, R., Chander, A. Crowdsourcing in the absence of ground truth---a case study. In Proceedings of the 2019 Intern. Conf. Machine Learning Workshop on Human in the Loop Learning; https:\/\/arxiv.org\/abs\/1906.07254."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 2011 IEEE Con. Computer Vision and Pattern Recognition, 1521--1528; https:\/\/ieeexplore.ieee.org\/document\/5995347","author":"Torralba A.","unstructured":"Torralba , A. , Efros , A.A. Unbiased look at dataset bias . In Proceedings of the 2011 IEEE Con. Computer Vision and Pattern Recognition, 1521--1528; https:\/\/ieeexplore.ieee.org\/document\/5995347 . Torralba, A., Efros, A.A. Unbiased look at dataset bias. In Proceedings of the 2011 IEEE Con. Computer Vision and Pattern Recognition, 1521--1528; https:\/\/ieeexplore.ieee.org\/document\/5995347."}],"container-title":["Communications of the ACM"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3464903","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3464903","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:11Z","timestamp":1750191431000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3464903"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,26]]},"references-count":25,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2021,8]]}},"alternative-id":["10.1145\/3464903"],"URL":"https:\/\/doi.org\/10.1145\/3464903","relation":{},"ISSN":["0001-0782","1557-7317"],"issn-type":[{"value":"0001-0782","type":"print"},{"value":"1557-7317","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,26]]},"assertion":[{"value":"2021-07-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}