{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T06:39:24Z","timestamp":1782801564785,"version":"3.54.5"},"reference-count":74,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"Google Award for Inclusion Research"},{"DOI":"10.13039\/501100000155","name":"Social Sciences and Humanities Research Council of Canada","doi-asserted-by":"publisher","award":["Postdoctoral Fellowship 756- 2019-0289"],"award-info":[{"award-number":["Postdoctoral Fellowship 756- 2019-0289"]}],"id":[{"id":"10.13039\/501100000155","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Big Data &amp; Society"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:p>There has been a surge of recent interest in sociocultural diversity in machine learning research. Currently, however, there is a gap between discussions of measures and benefits of diversity in machine learning, on the one hand, and the broader research on the underlying concepts of diversity and the precise mechanisms of its functional benefits, on the other. This gap is problematic because diversity is not a monolithic concept. Rather, different concepts of diversity are based on distinct rationales that should inform how we measure diversity in a given context. Similarly, the lack of specificity about the precise mechanisms underpinning diversity\u2019s potential benefits can result in uninformative generalities, invalid experimental designs, and illicit interpretations of findings. In this work, we draw on research in philosophy, psychology, and social and organizational sciences to make three contributions: First, we introduce a taxonomy of different diversity concepts from philosophy of science, and explicate the distinct epistemic and political rationales underlying these concepts. Second, we provide an overview of mechanisms by which diversity can benefit group performance. Third, we situate these taxonomies of concepts and mechanisms in the lifecycle of sociotechnical machine learning systems and make a case for their usefulness in fair and accountable machine learning. We do so by illustrating how they clarify the discourse around diversity in the context of machine learning systems, promote the formulation of more precise research questions about diversity\u2019s impact, and provide conceptual tools to further advance research and practice.<\/jats:p>","DOI":"10.1177\/20539517221082027","type":"journal-article","created":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T02:09:06Z","timestamp":1648606146000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":31,"title":["Diversity in sociotechnical machine learning systems"],"prefix":"10.1177","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4447-318X","authenticated-orcid":false,"given":"Sina","family":"Fazelpour","sequence":"first","affiliation":[{"name":"Northeastern University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2297-3308","authenticated-orcid":false,"given":"Maria","family":"De-Arteaga","sequence":"additional","affiliation":[{"name":"University of Texas at Austin, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2022,3,29]]},"reference":[{"key":"bibr1-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720949566"},{"key":"bibr2-20539517221082027","unstructured":"Albright A (2019) If you give a judge a risk score: evidence from kentucky bail decisions.\n                      Harvard John M. Olin Fellow\u2019s Discussion Paper\n                      85."},{"key":"bibr3-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1177\/135581960501000112"},{"key":"bibr4-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00056"},{"key":"bibr5-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1098\/rsos.170193"},{"key":"bibr6-20539517221082027","doi-asserted-by":"crossref","unstructured":"Barbosa NM, Chen M (2019) Rehumanized crowdsourcing: a labeling framework addressing bias and ethics in machine learning. In:\n                      Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems\n                      . pp. 1\u201312.","DOI":"10.1145\/3290605.3300773"},{"key":"bibr7-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1179\/030801811X13013181961473"},{"key":"bibr8-20539517221082027","volume-title":"Inequality and Heterogeneity: A Primitive Theory of Social Structure","author":"Blau PM","year":"1977"},{"key":"bibr9-20539517221082027","unstructured":"Buolamwini J, Gebru T (2018) Gender shades: Intersectional accuracy disparities in commercial gender classification. In:\n                      Conference on fairness, accountability and transparency\n                      . PMLR, pp. 77\u201391."},{"key":"bibr10-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0079147"},{"issue":"2","key":"bibr11-20539517221082027","first-page":"167","volume":"33","author":"Cantor J","year":"1996","journal-title":"Inquiry"},{"key":"bibr12-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1002\/acp.3720"},{"key":"bibr13-20539517221082027","doi-asserted-by":"publisher","DOI":"10.17265\/2159-5313\/2016.09.003"},{"key":"bibr14-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0047"},{"key":"bibr15-20539517221082027","doi-asserted-by":"publisher","DOI":"10.4324\/9780203900055"},{"key":"bibr16-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1145\/3391403.3399545"},{"key":"bibr17-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462521"},{"key":"bibr18-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00449"},{"issue":"7","key":"bibr19-20539517221082027","first-page":"14","volume":"94","author":"Dobbin F","year":"2016","journal-title":"Harvard Business Review"},{"key":"bibr20-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0054"},{"key":"bibr21-20539517221082027","doi-asserted-by":"crossref","unstructured":"Duan X, Ho CJ, Yin M (2020) Does exposure to diverse perspectives mitigate biases in crowdwork? an explorative study. In:\n                      Proceedings of the AAAI Conference on Human Computation and Crowdsourcing\n                      , volume 8. pp. 155\u2013158.","DOI":"10.1609\/hcomp.v8i1.7474"},{"key":"bibr22-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1111\/phc3.12760"},{"key":"bibr23-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1017\/can.2021.24"},{"key":"bibr24-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1017\/psa.2021.25"},{"key":"bibr25-20539517221082027","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7585.001.0001"},{"key":"bibr26-20539517221082027","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/237"},{"key":"bibr27-20539517221082027","unstructured":"Grasswick H (2018) Feminist social epistemology. In: Zalta EN (ed.)\n                      The Stanford Encyclopedia of Philosophy\n                      , fall 2018 edition. Metaphysics Research Lab, Stanford University."},{"key":"bibr28-20539517221082027","volume-title":"The Feminist Standpoint Theory Reader: Intellectual and Political Controversies","author":"Harding SG","year":"2004"},{"key":"bibr29-20539517221082027","doi-asserted-by":"publisher","DOI":"10.5465\/amr.2007.26586096"},{"key":"bibr30-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.92.5.1189"},{"key":"bibr31-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0403723101"},{"key":"bibr32-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1111\/j.1527-2001.2010.01138.x"},{"key":"bibr33-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-2466.1978.tb01600.x"},{"key":"bibr34-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0088-2"},{"key":"bibr35-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1145\/3213586.3226206"},{"key":"bibr36-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462516"},{"key":"bibr37-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM199605163342006"},{"key":"bibr38-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1407301111"},{"key":"bibr39-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372861"},{"key":"bibr40-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1515\/9780691209753"},{"key":"bibr41-20539517221082027","unstructured":"Madras D, Pitassi T, Zemel R (2018) Predict responsibly: improving fairness and accuracy by learning to defer. In:\n                      Proceedings of the 32nd International Conference on Neural Information Processing Systems\n                      . pp. 6150\u20136160."},{"key":"bibr42-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376257"},{"key":"bibr43-20539517221082027","unstructured":"Martin Jr D, Prabhakaran V, Kuhlberg J, et al. (2020) Extending the machine learning abstraction boundary: A complex systems approach to incorporate societal context.\n                      arXiv preprint arXiv:2006.09663\n                      ."},{"key":"bibr44-20539517221082027","doi-asserted-by":"publisher","DOI":"10.2307\/258667"},{"key":"bibr45-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1145\/3375627.3375832"},{"key":"bibr46-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-statistics-042720-125902"},{"key":"bibr47-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1111\/phc3.12000"},{"key":"bibr48-20539517221082027","doi-asserted-by":"publisher","DOI":"10.4324\/9781315545882"},{"key":"bibr49-20539517221082027","first-page":"807","volume":"16","author":"Muldoon R","year":"2018","journal-title":"Geo. JL & Pub. Pol\u2019y"},{"key":"bibr50-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1126\/science.aax2342"},{"key":"bibr51-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1515\/9781400835140"},{"key":"bibr52-20539517221082027","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvc77c0h"},{"key":"bibr53-20539517221082027","doi-asserted-by":"crossref","unstructured":"Peng A, Nushi B, K\u0131c\u0131man E, et al. (2019) What you see is what you get? the impact of representation criteria on human bias in hiring. In:\n                      Proceedings of the AAAI Conference on Human Computation and Crowdsourcing\n                      , volume 7. pp. 125\u2013134.","DOI":"10.1609\/hcomp.v7i1.5281"},{"issue":"3","key":"bibr54-20539517221082027","volume":"50","author":"Pennsylvania Commission on Sentencing","year":"2020","journal-title":"Pennsylvania Bulletin"},{"key":"bibr55-20539517221082027","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvc77c0h.12"},{"key":"bibr56-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1177\/0146167208328062"},{"key":"bibr57-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2005.12.001"},{"key":"bibr58-20539517221082027","doi-asserted-by":"publisher","DOI":"10.5465\/amj.2013.0319"},{"key":"bibr59-20539517221082027","author":"Ray V","year":"2019","journal-title":"Harvard Business Review"},{"key":"bibr60-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-orgpsych-012218-015243"},{"issue":"4","key":"bibr61-20539517221082027","first-page":"1213","volume":"22","author":"Rodriguez-Diaz CA","year":"2018","journal-title":"Computaci\u00f3n y Sistemas"},{"key":"bibr62-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1111\/j.1541-0072.2008.00276.x"},{"key":"bibr63-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675285"},{"key":"bibr64-20539517221082027","unstructured":"Shankar S, Halpern Y, Breck E, et al. (2017) No classification without representation: Assessing geodiversity issues in open data sets for the developing world.\n                      arXiv preprint arXiv:1711.08536\n                      ."},{"key":"bibr65-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1038\/163688a0"},{"key":"bibr66-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220088"},{"key":"bibr67-20539517221082027","volume-title":"Social Empiricism","author":"Solomon M","year":"2007"},{"key":"bibr68-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1007\/s11229-019-02108-w"},{"key":"bibr69-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1007\/s13194-018-0209-5"},{"key":"bibr70-20539517221082027","unstructured":"Tan S, Adebayo J, Inkpen K, et al. (2018) Investigating human+ machine complementarity for recidivism predictions.\n                      arXiv preprint arXiv:1808.09123\n                      ."},{"key":"bibr71-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8309.1989.tb00855.x"},{"key":"bibr72-20539517221082027","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2012.06.003"},{"key":"bibr73-20539517221082027","author":"West SM","year":"2019","journal-title":"AI Now Institute"},{"key":"bibr74-20539517221082027","doi-asserted-by":"publisher","DOI":"10.11606\/51678-31662017000100002"}],"container-title":["Big Data &amp; Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20539517221082027","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/20539517221082027","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20539517221082027","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T12:58:30Z","timestamp":1777381110000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/20539517221082027"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1]]},"references-count":74,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["10.1177\/20539517221082027"],"URL":"https:\/\/doi.org\/10.1177\/20539517221082027","relation":{},"ISSN":["2053-9517","2053-9517"],"issn-type":[{"value":"2053-9517","type":"print"},{"value":"2053-9517","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1]]},"article-number":"20539517221082027"}}