{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T01:59:02Z","timestamp":1767664742887,"version":"3.41.2"},"reference-count":94,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T00:00:00Z","timestamp":1672531200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"name":"Research for this project was supported by the Center for Information, Technology, & Public Life, made possible by the John S. and James L. Knight Foundation"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Big Data &amp; Society"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:p> While research has explored the extent of gender bias and the barriers to women's inclusion on English-language Wikipedia, very little research has focused on the problem of racial bias within the encyclopedia. Despite advocacy groups' efforts to incrementally improve representation on Wikipedia, much is unknown regarding how biographies are assessed after creation. Applying a combination of web-scraping, deep learning, natural language processing, and qualitative analysis to pages of academics nominated for deletion on Wikipedia, we demonstrate how Wikipedia's notability guidelines are unequally applied across race and gender. We find that online presence predicts whether a Wikipedia page is kept or deleted for white male academics but that this metric is idiosyncratically applied for female and BIPOC academics. Further, women's pages, regardless of race, were more likely to be deemed \u201ctoo soon\u201d for Wikipedia. A deeper analysis of the deletion archives reveals that when the tag is used on a woman's biography it is done so outside of the community guidelines, referring to one's career stage rather than media\/online coverage. We argue that awareness of hidden biases on Wikipedia is critical to the objective and equitable application of the notability criteria across race and gender both on the encyclopedia and beyond. <\/jats:p>","DOI":"10.1177\/20539517231165490","type":"journal-article","created":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T04:28:01Z","timestamp":1680150481000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":12,"title":["\u201cToo Soon\u201d to count? How gender and race cloud notability considerations on Wikipedia"],"prefix":"10.1177","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6015-8668","authenticated-orcid":false,"given":"Mackenzie Emily","family":"Lemieux","sequence":"first","affiliation":[{"name":"Washington University School of Medicine in Saint Louis, St Louis, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7667-1132","authenticated-orcid":false,"given":"Rebecca","family":"Zhang","sequence":"additional","affiliation":[{"name":"Weill Cornell Medical College, New York, USA"}]},{"given":"Francesca","family":"Tripodi","sequence":"additional","affiliation":[{"name":"School of Information and Library Science, University of North Carolina System at Chapel Hill, Chapel Hill, USA"}]}],"member":"179","published-online":{"date-parts":[[2023,3,29]]},"reference":[{"key":"bibr1-20539517231165490","unstructured":"Aaltonen A, Seiler S (2014) Quantifying spillovers in open source content production: Evidence from Wikipedia. CEP Discussion Papers dp1275, Centre for Economic Performance, LSE."},{"key":"bibr2-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1177\/2378023118823946"},{"key":"bibr3-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-422X(00)00005-X"},{"key":"bibr4-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1145\/1557019.1557032"},{"key":"bibr5-20539517231165490","unstructured":"American Association of University Professors (2022) The Annual Report on the Economic Status of the Profession, 2021\u201322. Available at: https:\/\/www.aaup.org\/report\/annual-report-economic-status-profession-2021-22 (accessed 22 October 2022)."},{"key":"bibr6-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1007\/s11199-015-0573-y"},{"key":"bibr7-20539517231165490","unstructured":"Berger M (2020) Women are systematically excluded from global coronavirus coverage, experts say. The Washington Post. Available at: https:\/\/www.washingtonpost.com\/world\/2020\/10\/08\/women-experts-excluded-global-coronavirus-coverage\/ (accessed 5 November 2021)."},{"journal-title":"bioRxiv","year":"2020","author":"Berterolo M","key":"bibr8-20539517231165490"},{"issue":"4","key":"bibr9-20539517231165490","first-page":"991","volume":"94","author":"Bertrand M","year":"2004","journal-title":"National Bureau of Economic Research"},{"key":"bibr10-20539517231165490","unstructured":"Bever L (2019) Katie Bouman helped the world see a black hole. Fans want \u2018a rightful seat in history\u2019 for her. The Washington Post. Available at: https:\/\/www.washingtonpost.com\/science\/2019\/04\/11\/katie-bouman-helped-world-see-black-hole-fans-want-rightful-seat-history-her\/ (accessed 12 December 2021)."},{"key":"bibr11-20539517231165490","unstructured":"Boyer M (2019) Katie Bouman's actual contributions to the historic Black Hole Image. Telegraph India. Available at: https:\/\/www.telegraphindia.com\/opinion\/katie-bouman-s-actual-contributions-to-the-historic-black-hole-image\/cid\/1688787 (accessed 12 December 2021)."},{"key":"bibr12-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1145\/1099203.1099205"},{"key":"bibr13-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21577"},{"volume-title":"Black Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment","year":"1990","author":"Collins PH","key":"bibr14-20539517231165490"},{"key":"bibr15-20539517231165490","first-page":"8","volume":"1","author":"Crenshaw K","year":"1989","journal-title":"University of Chicago Legal Forum"},{"volume-title":"Dusk of Dawn: An Essay Toward an Autobiography of a Race Concept","year":"1940","author":"DuBois WEB","key":"bibr16-20539517231165490"},{"key":"bibr17-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1177\/0196859913505618"},{"key":"bibr18-20539517231165490","unstructured":"Elfrink T (2019) Trolls hijacked a scientist's image to attack Katie Bouman. they picked the wrong astrophysicist. The Washington Post. Available at: https:\/\/www.washingtonpost.com\/nation\/2019\/04\/12\/trolls-hijacked-scientists-image-attack-katie-bouman-they-picked-wrong-astrophysicist\/ (accessed 12 December 2021)."},{"key":"bibr19-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1086\/683380"},{"key":"bibr20-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1080\/01419870.2020.1851383"},{"key":"bibr21-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1177\/0306312717692172"},{"key":"bibr22-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1080\/14791420.2017.1386321"},{"volume-title":"Diversity in STEM: What it is and Why it Matters","year":"2014","author":"Gibbs K","key":"bibr23-20539517231165490"},{"key":"bibr24-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2020.05.045"},{"key":"bibr25-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1086\/225469"},{"key":"bibr26-20539517231165490","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v7i4.942"},{"key":"bibr27-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2014.957711"},{"key":"bibr28-20539517231165490","doi-asserted-by":"publisher","DOI":"10.2307\/1341787"},{"key":"bibr30-20539517231165490","unstructured":"Harrison S (2019) How the sexism of the past reinforces Wikipedia's gender gap. Slate Magazine. Available at: https:\/\/slate.com\/technology\/2019\/03\/wikipedia-women-history-notability-gender-gap.html (accessed 12 December 2021)."},{"key":"bibr31-20539517231165490","unstructured":"Hengel E (2017) Publishing while Female. Are women held to higher standards? Evidence from peer review. Cambridge Working Papers in Economics. Available at: https:\/\/doi.org\/10.17863\/CAM.17548 (accessed 11 October 2022)."},{"volume-title":"Why so few? Women in science, technology, engineering, and mathematics","year":"2010","author":"Hill C","key":"bibr32-20539517231165490"},{"key":"bibr33-20539517231165490","unstructured":"Humaniki: Wikimedia Diversity Dashboard tool (n.d.) Humaniki | Wikimedia Diversity Dashboard Tool. Available at: https:\/\/whgi.wmflabs.org\/ (accessed 12 December 2021)."},{"key":"bibr34-20539517231165490","volume-title":"Common knowledge?: An ethnography of Wikipedia","author":"Jemielniak D","year":"2014","edition":"1"},{"volume-title":"How to make artificial intelligence more democratic","year":"2021","author":"Khurana R","key":"bibr35-20539517231165490"},{"key":"bibr36-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1093\/qje\/qjac024"},{"key":"bibr37-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818779080"},{"volume-title":"The dark saga of Katie Bouman","year":"2019","author":"Koren M","key":"bibr38-20539517231165490"},{"key":"bibr39-20539517231165490","unstructured":"Kramer K (2019) Female scientists\u2019 pages keep disappearing from Wikipedia \u2013 what's going on? Chemistry World. Available at: https:\/\/www.chemistryworld.com\/news\/female-scientists-pages-keep-disappearing-from-wikipedia-whats-going-on\/3010664.article (accessed 12 December 2021)."},{"key":"bibr40-20539517231165490","doi-asserted-by":"crossref","unstructured":"Lam SK, Uduwage A, Dong Z, et al. (2011) WP: Clubhouse: an exploration of Wikipedia\u2019s gender imbalance. Proceedings of the 7th International Symposium on Wikis and Open Collaboration, Mountain View, CA, 3\u20135 October. 1\u201310.","DOI":"10.1145\/2038558.2038560"},{"key":"bibr41-20539517231165490","unstructured":"Lou M, Ahmed S (2019) That image of a black hole you saw everywhere? thank this grad student for making it possible. Cable News Network. Available at: https:\/\/www.cnn.com\/2019\/04\/10\/us\/katie-bouman-mit-black-hole-algorithm-sci-trnd\/index.html (accessed 12 December 2021)."},{"key":"bibr42-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1163\/15691330-12341471"},{"key":"bibr43-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1002\/asi.22671"},{"key":"bibr44-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21304"},{"key":"bibr45-20539517231165490","volume":"9","author":"MacAulay M","year":"2016","journal-title":"ADA: A Journal of Gender New Media and Technology"},{"key":"bibr46-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1037\/1076-8971.7.1.98"},{"key":"bibr47-20539517231165490","unstructured":"Maguire D (2019) Trolls target the scientist who became the face of the Black Hole Photo. ABC News. Available at: https:\/\/www.abc.net.au\/news\/2019-04-15\/black-hole-photo-katie-bouman-trolls\/11006820 (accessed 12 December 2021)."},{"key":"bibr48-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1145\/3415171"},{"volume-title":"Doing race: 21 essays for the 21st Century","year":"2010","author":"Markus HR","key":"bibr49-20539517231165490"},{"key":"bibr50-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1080\/01972243.2011.534368"},{"key":"bibr51-20539517231165490","unstructured":"McDonough M (2021) Women are writing themselves back into history on Wikipedia. LX. Available at: https:\/\/www.lx.com\/social-justice\/women-are-writing-themselves-back-into-history-on-wikipedia\/34029\/ (accessed 12 December 2021)."},{"key":"bibr52-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702514"},{"key":"bibr53-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300702"},{"key":"bibr54-20539517231165490","unstructured":"Mervosh S (2019) How Katie Bouman accidentally became the face of the Black Hole Project. The New York Times. Available at: https:\/\/www.nytimes.com\/2019\/04\/11\/science\/katie-bouman-black-hole.html (accessed 12 December 2021)."},{"volume-title":"Racial Formation in the United States","year":"1994","author":"Omi M","key":"bibr55-20539517231165490"},{"key":"bibr56-20539517231165490","unstructured":"Page S (2022) She\u2019s made 1,750 Wikipedia bios for female scientists who haven\u2019t gotten their due.The Washington Post. Available from: https:\/\/www.washingtonpost.com\/lifestyle\/2022\/10\/17\/jess-wade-scientist-wikiepdia-women\/ (accessed 21 October 2022)."},{"key":"bibr57-20539517231165490","unstructured":"Paling E (2015) Wikipedia\u2019s hostility to women. The Atlantic. Available at: https:\/\/www.theatlantic.com\/technology\/archive\/2015\/10\/how-wikipedia-is-hostile-to-women\/411619\/ (accessed 11 November 2022)."},{"key":"bibr58-20539517231165490","volume":"7","author":"Peake B","year":"2015","journal-title":"ADA: A Journal of Gender, New Media, & Technology"},{"key":"bibr59-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1108\/SGPE-D-17-00041"},{"volume-title":"Media-Ready Feminism and Everyday Sexism","year":"2021","author":"Press AL","key":"bibr60-20539517231165490"},{"key":"bibr61-20539517231165490","unstructured":"Primer. Available at: https:\/\/primer.ai (accessed 6 June 2021)."},{"key":"bibr62-20539517231165490","unstructured":"Rainone C (2020) The Humanity of Blackness\u2019 Missing from history classes: How to transform Black history education in schools. NBC Philadelphia. Available from: https:\/\/www.nbcphiladelphia.com\/news\/national-international\/how-to-transform-black-history-education-in-schools\/2450465\/ (accessed 6 June 2021)."},{"key":"bibr63-20539517231165490","first-page":"21","volume":"5","author":"Reagle J","year":"2011","journal-title":"International Journal Of Communication"},{"volume-title":"Fatal Invention: How Science, Politics, and Big Business Re-Recreate Race in the Twenty-First Century","year":"2011","author":"Roberts D","key":"bibr64-20539517231165490"},{"key":"bibr65-20539517231165490","unstructured":"Robitzski D (2017) To keep AI from \u2018eating a table,\u2019 scientists make it read Wikipedia. LiveScience, Purch. Available from: https:\/\/www.livescience.com\/60520-artificial-intelligence-reads-wikipedia-to-learn-english.html (accessed 12 December 2021)."},{"key":"bibr66-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1080\/01419870.2016.1140793"},{"key":"bibr67-20539517231165490","unstructured":"Sadeque S (2019) Wikipedia doesn't think this black female scientist is notable enough for a page. The Daily Dot. Available from: https:\/\/www.dailydot.com\/irl\/wikipedia-clarice-phelps\/ (accessed 12 December 2021)."},{"key":"bibr68-20539517231165490","unstructured":"Salam M (2019) Most Wikipedia profiles are of men. this scientist is changing that. The New York Times. Available at: https:\/\/www.nytimes.com\/2019\/07\/19\/science\/jess-wade-wikipedia-science-women.html (accessed 12 December 2021)."},{"key":"bibr69-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1140\/epjds20"},{"journal-title":"arXiv","year":"2019","author":"Schellekens MH","key":"bibr70-20539517231165490"},{"key":"bibr71-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1145\/2462932.2462955"},{"key":"bibr72-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1017\/S1049096521001220"},{"key":"bibr73-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1093\/joc\/jqx003"},{"key":"bibr74-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1080\/01419870.2019.1700296"},{"key":"bibr75-20539517231165490","unstructured":"Smith JF (2015) Howard University fills in Wikipedia's gaps in black history. The New York Times. Available at: https:\/\/www.nytimes.com\/2015\/02\/20\/us\/at-howard-a-historically-black-university-filling-in-wikipedias-gaps-in-color.html (accessed 12 December 2021)."},{"issue":"2","key":"bibr76-20539517231165490","first-page":"43","volume":"24","author":"Smith V","year":"1994","journal-title":"The Johns Hopkins University Press"},{"journal-title":"arXiv","year":"2018","author":"Sood G","key":"bibr77-20539517231165490"},{"volume-title":"National Center for Education Statistics (NCES) Home Page, a Part of the U.S","year":"2018","author":"The NCES Fast Facts Tool provides quick answers to many education questions","key":"bibr78-20539517231165490"},{"volume-title":"Why do so few women edit wikipedia? Harvard Business Review","year":"2016","author":"Torres N","key":"bibr79-20539517231165490"},{"key":"bibr80-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1177\/14614448211023772"},{"key":"bibr81-20539517231165490","unstructured":"Vincent J (2018) AI spots 40,000 prominent scientists overlooked by Wikipedia. The Verge Available at: https:\/\/www.theverge.com\/2018\/8\/8\/17663544\/ai-scientists-wikipedia-primer (accessed 12 December 2021)."},{"journal-title":"arXiv","year":"2017","author":"Vitulli MA","key":"bibr82-20539517231165490"},{"key":"bibr83-20539517231165490","doi-asserted-by":"crossref","DOI":"10.1038\/d41586-018-05947-8","volume-title":"Why We\u2019re Editing Women Scientists onto Wikipedia","author":"Wade J","year":"2018"},{"key":"bibr84-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1140\/epjds\/s13688-016-0066-4"},{"key":"bibr85-20539517231165490","volume":"10","author":"White A","year":"2018","journal-title":"Science Museum Journal Group"},{"key":"bibr86-20539517231165490","unstructured":"Wikimedia Foundation (2018) Gender equity report 2018\/Barrier to equity. Available at: https:\/\/meta.wikimedia.org\/wiki\/Gender_equity_report_2018\/Barriers_to_equity (accessed 10 December 2022)."},{"key":"bibr87-20539517231165490","unstructured":"Wikipedia:Articles for Deletion. Available at: https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Articles_for_deletion (accessed 15 January 2022)."},{"key":"bibr89-20539517231165490","unstructured":"Wikipedia:Notability. Available at: https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Notability (accessed 12 December 2021)."},{"key":"bibr90-20539517231165490","unstructured":"Wikipedia:Notability (academics). Available at: https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Notability_(academics) (accessed 12 December 2021)."},{"key":"bibr91-20539517231165490","unstructured":"Wikipedia:Search Engine Test. Available at: https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Search_engine_test (accessed 12 December 2021)."},{"key":"bibr92-20539517231165490","unstructured":"Wikipedia:SNOW. Available at: https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Snowball_clause"},{"key":"bibr93-20539517231165490","unstructured":"Wikipedia:Too soon. Available at: https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Too_soon (accessed 12 December 2021)."},{"key":"bibr94-20539517231165490","unstructured":"Wikipedia:Wikiproject women in red. Available at: https:\/\/en.wikipedia.org\/wiki\/Wikipedia:WikiProject_Women_in_Red (accessed 12 December 2021)."},{"key":"bibr95-20539517231165490","doi-asserted-by":"publisher","DOI":"10.1111\/j.1527-2001.1995.tb01356.x"},{"volume-title":"Thicker than Blood: How Racial Statistics Lie","year":"2001","author":"Zuberi T","key":"bibr96-20539517231165490"}],"container-title":["Big Data &amp; Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20539517231165490","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/20539517231165490","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20539517231165490","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,1]],"date-time":"2025-03-01T01:36:10Z","timestamp":1740792970000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/20539517231165490"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1]]},"references-count":94,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1]]}},"alternative-id":["10.1177\/20539517231165490"],"URL":"https:\/\/doi.org\/10.1177\/20539517231165490","relation":{},"ISSN":["2053-9517","2053-9517"],"issn-type":[{"type":"print","value":"2053-9517"},{"type":"electronic","value":"2053-9517"}],"subject":[],"published":{"date-parts":[[2023,1]]},"article-number":"20539517231165490"}}