{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:59:35Z","timestamp":1776110375778,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":45,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,2,7]],"date-time":"2020-02-07T00:00:00Z","timestamp":1581033600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,2,7]]},"DOI":"10.1145\/3375627.3375820","type":"proceedings-article","created":{"date-parts":[[2020,2,4]],"date-time":"2020-02-04T20:10:22Z","timestamp":1580847022000},"page":"145-151","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":224,"title":["Saving Face"],"prefix":"10.1145","author":[{"given":"Inioluwa Deborah","family":"Raji","sequence":"first","affiliation":[{"name":"University of Toronto, Toronto, ON, Canada"}]},{"given":"Timnit","family":"Gebru","sequence":"additional","affiliation":[{"name":"Google Research, San Francisco, CA, USA"}]},{"given":"Margaret","family":"Mitchell","sequence":"additional","affiliation":[{"name":"Google Research, San Francisco, CA, USA"}]},{"given":"Joy","family":"Buolamwini","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA, USA"}]},{"given":"Joonseok","family":"Lee","sequence":"additional","affiliation":[{"name":"Google Research, San Francisco, CA, USA"}]},{"given":"Remi","family":"Denton","sequence":"additional","affiliation":[{"name":"Google Research, San Francisco, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,2,7]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Retrieved","year":"2019","unstructured":"Amazon. 2019. Amazon Rekognition FAQs. Retrieved Oct 31, 2019 from https:\/\/aws.amazon.com\/rekognition\/faqs\/"},{"key":"e_1_3_2_1_2_1","volume-title":"Race after technology: Abolitionist tools for the new jim code","author":"Benjamin Ruha","unstructured":"Ruha Benjamin. 2019. Race after technology: Abolitionist tools for the new jim code. John Wiley & Sons."},{"key":"e_1_3_2_1_3_1","volume-title":"Proc. of the Conference on Fairness, Accountability, and Transparency (FAT). 10","author":"Benthall Sebastian","unstructured":"Sebastian Benthall and Bruce D. Haynes. 2019. Racial Categories in Machine Learning. In Proc. of the Conference on Fairness, Accountability, and Transparency (FAT). 10."},{"key":"e_1_3_2_1_4_1","unstructured":"Sen. Roy Blunt. 2019. S.847 - Commercial Facial Recognition Privacy Act of 2019. https:\/\/www.congress.gov\/bill\/116th-congress\/senate-bill\/847\/text"},{"key":"e_1_3_2_1_5_1","unstructured":"Joy Buolamwini. 2018. When the Robot Doesn't See Dark Skin."},{"key":"e_1_3_2_1_6_1","volume-title":"Proc. of the Conference on Fairness, Accountability, and Transparency (FAT).","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proc. of the Conference on Fairness, Accountability, and Transparency (FAT)."},{"key":"e_1_3_2_1_7_1","unstructured":"Matt Cagle and Nicole Ozer. 2018. Amazon Teams Up With Government to Deploy Dangerous New Facial Recognition Technology. (2018)."},{"key":"e_1_3_2_1_8_1","volume-title":"Retrieved","year":"2019","unstructured":"Clarifai. 2019. Custom Face Recognition. Retrieved Oct 31, 2019 from https: \/\/www.clarifai.com\/custom-face-recognition"},{"key":"e_1_3_2_1_9_1","unstructured":"Rep. Yvette D. Clarke. 2019. H.R.2231 - Algorithmic Accountability Act of 2019. https:\/\/www.congress.gov\/bill\/116th-congress\/house-bill\/2231"},{"key":"e_1_3_2_1_10_1","unstructured":"Rep. Yvette D. Clarke. 2019. H.R.4008 - No Biometric Barriers to Housing Act of 2019. https:\/\/www.congress.gov\/bill\/116th-congress\/house-bill\/4008\/text?r= 11&s=1"},{"key":"e_1_3_2_1_11_1","unstructured":"Lord Clement-Jones. 2019. Automated Facial Recognition Technology (Moratorium and Review) Bill [HL] 2019--20. https:\/\/services.parliament.uk\/bills\/2019- 20\/automatedfacialrecognitiontechnologymoratoriumandreview.html"},{"key":"e_1_3_2_1_12_1","volume-title":"Demarginalizing the intersection of race and sex: A black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics","author":"Crenshaw Kimberle","year":"1989","unstructured":"Kimberle Crenshaw. 1989. Demarginalizing the intersection of race and sex: A black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics. The University of Chicago Legal Forum (1989), 139."},{"key":"e_1_3_2_1_13_1","unstructured":"Kimberle Crenshaw. 2017. Kimberle Crenshaw on Intersectionality More than Two Decades Later."},{"key":"e_1_3_2_1_14_1","first-page":"38","article-title":"Procedural fairness in the peer and quality review programs","volume":"15","author":"Ehlen Craig R","year":"1996","unstructured":"Craig R Ehlen and Robert B Welker. 1996. Procedural fairness in the peer and quality review programs. Auditing 15, 1 (1996), 38.","journal-title":"Auditing"},{"key":"e_1_3_2_1_15_1","volume-title":"Computer Security: A Management Audit Approach. Amacom New York.","author":"Enger Norman L","year":"1980","unstructured":"Norman L Enger and Paul William Howerton. 1980. Computer Security: A Management Audit Approach. Amacom New York."},{"key":"e_1_3_2_1_16_1","volume-title":"Retrieved","year":"2019","unstructured":"Face++. 2019. Face Attributes. Retrieved Oct 31, 2019 from https:\/\/www. faceplusplus.com\/attributes\/"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.kjss.2016.10.003"},{"key":"e_1_3_2_1_18_1","unstructured":"Sheera Frenkel. 2018. Microsoft Employees Question CEO Over Company's Contract With ICE. (2018)."},{"key":"e_1_3_2_1_19_1","volume-title":"Oxford Handbook on AI Ethics Book","author":"Gebru Timnit","year":"1908","unstructured":"Timnit Gebru. 2019. Oxford Handbook on AI Ethics Book Chapter on Race and Gender. arXiv preprint arXiv:1908.06165 (2019)."},{"key":"e_1_3_2_1_20_1","volume-title":"Hal Daume\u00e9 III, and Kate Crawford","author":"Gebru Timnit","year":"2018","unstructured":"Timnit Gebru, Jamie Morgenstern, Briana Vecchione, JenniferWortman Vaughan, HannaWallach, Hal Daume\u00e9 III, and Kate Crawford. 2018. Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018)."},{"key":"e_1_3_2_1_21_1","volume-title":"Ms-celeb-1m: Challenge of recognizing one million celebrities in the real world. Electronic imaging","author":"Guo Yandong","year":"2016","unstructured":"Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, and Jianfeng Gao. 2016. Ms-celeb-1m: Challenge of recognizing one million celebrities in the real world. Electronic imaging 2016, 11 (2016), 1--6."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173582"},{"key":"e_1_3_2_1_23_1","volume-title":"Retrieved","author":"Hawkins Amy","year":"2018","unstructured":"Amy Hawkins. 2018. Beijing's Big Brother Tech Needs African Faces. Retrieved October 31, 2019 from https:\/\/foreignpolicy.com\/2018\/07\/24\/beijings-big-brothertech- needs-african-faces\/"},{"key":"e_1_3_2_1_24_1","volume-title":"Alexandra Olteanu, and Kush R Varshney.","author":"Hind Michael","year":"2018","unstructured":"Michael Hind, Sameep Mehta, Aleksandra Mojsilovic, Ravi Nair, Karthikeyan Natesan Ramamurthy, Alexandra Olteanu, and Kush R Varshney. 2018. Increasing Trust in AI Services through Supplier's Declarations of Conformity. arXiv preprint arXiv:1808.07261 (2018)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2019.1573912"},{"key":"e_1_3_2_1_26_1","volume-title":"Retrieved","author":"IBM.","year":"2019","unstructured":"IBM. 2019. Release notes. Retrieved Oct 31, 2019 from https:\/\/cloud.ibm.com\/ docs\/services\/visual-recognition?topic=visual-recognition-release-notes"},{"key":"e_1_3_2_1_27_1","volume-title":"Retrieved","year":"2019","unstructured":"Kairos. 2019. Kairos Face Recognition Pricing Guide. Retrieved Oct 31, 2019 from https:\/\/www.kairos.com\/pricing"},{"key":"e_1_3_2_1_28_1","volume-title":"Proc. of the International Conference on Machine Learning (ICML).","author":"Kearns Michael","year":"2018","unstructured":"Michael Kearns, Seth Neel, Aaron Roth, and Zhiwei Steven Wu. 2018. Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In Proc. of the International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274357"},{"key":"e_1_3_2_1_30_1","volume-title":"Clarifai plans to push further into government work.","author":"Melendez Steven","year":"2018","unstructured":"Steven Melendez. 2018. Despite a surge of tech activism, Clarifai plans to push further into government work. (2018)."},{"key":"e_1_3_2_1_31_1","volume-title":"Retrieved","author":"Melendez Steven","year":"2018","unstructured":"Steven Melendez. 2018. Uber driver troubles raise concerns about transgender face recognition. Retrieved October 31, 2019 from https:\/\/www.fastcompany.com\/90216258\/uber-face-recognition-tool-haslocked- out-some-transgender-drivers"},{"key":"e_1_3_2_1_32_1","volume-title":"Smith","author":"Merler Michele","year":"2019","unstructured":"Michele Merler, Nalini Ratha, Rogerio S. Feris, and John R. Smith. 2019. Diversity in Faces. arXiv preprints, Article arXiv:1901.10436 (Jan. 2019), arXiv:1901.10436 pages."},{"key":"e_1_3_2_1_33_1","volume-title":"Retrieved","year":"2019","unstructured":"Microsoft. 2019. What is the Azure Face API? Retrieved Oct 31, 2019 from https:\/\/docs.microsoft.com\/en-us\/azure\/cognitive-services\/face\/overview"},{"key":"e_1_3_2_1_34_1","volume-title":"Inioluwa Deborah Raji, and Timnit Gebru","author":"Mitchell Margaret","year":"2018","unstructured":"Margaret Mitchell, SimoneWu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2018. Model Cards for Model Reporting. CoRR abs\/1810.03993 (2018). arXiv:1810.03993 http:\/\/arxiv.org\/abs\/1810.03993"},{"key":"e_1_3_2_1_35_1","volume-title":"Retrieved","author":"Mozur Paul","year":"2019","unstructured":"Paul Mozur. 2019. One Month, 500,000 Face Scans: How China Is Using A.I. to Profile a Minority. Retrieved October 31, 2019 from https:\/\/www.nytimes.com\/2019\/04\/14\/technology\/china-surveillance-artificialintelligence- racial-profiling.html"},{"key":"e_1_3_2_1_36_1","article-title":"Procedural justice and tax compliance","volume":"38","author":"Murphy Kristina","year":"2003","unstructured":"Kristina Murphy. 2003. Procedural justice and tax compliance. Australian Journal of Social Issues (Australian Council of Social Service) 38, 3 (2003).","journal-title":"Australian Journal of Social Issues (Australian Council of Social Service)"},{"key":"e_1_3_2_1_37_1","volume-title":"Deep Learning for Face Recognition: Pride or Prejudiced? arXiv preprint arXiv:1904.01219","author":"Nagpal Shruti","year":"2019","unstructured":"Shruti Nagpal, Maneet Singh, Richa Singh, Mayank Vatsa, and Nalini Ratha. 2019. Deep Learning for Face Recognition: Pride or Prejudiced? arXiv preprint arXiv:1904.01219 (2019)."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Mei Ngan Mei Ngan and Patrick Grother. 2015. Face recognition vendor test (FRVT) performance of automated gender classification algorithms. Government Technical Report. US Department of Commerce National Institute of Standards and Technology.","DOI":"10.6028\/NIST.IR.8052"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314244"},{"key":"e_1_3_2_1_40_1","volume-title":"International Journal of Computer Vision (IJCV) (7","author":"Rothe Rasmus","year":"2016","unstructured":"Rasmus Rothe, Radu Timofte, and Luc Van Gool. 2016. Deep expectation of real and apparent age from a single image without facial landmarks. International Journal of Computer Vision (IJCV) (7 2016)."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.4103\/0378-6323.45238"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Morgan Klaus Scheuerman Jacob M Paul and Jedr Brubaker. 2019. How Computers See Gender: An Evaluation of Gender Classification in Commercial Facial Analysis and Image Labeling Services. (2019).","DOI":"10.1145\/3359246"},{"key":"e_1_3_2_1_43_1","volume-title":"Retrieved","author":"Snow Jacob","year":"2018","unstructured":"Jacob Snow. 2018. Amazon's Face Recognition Falsely Matched 28 Members of Congress With Mugshots. Retrieved August 24, 2017 from https:\/\/www.aclu.org\/blog\/privacy-technology\/surveillance-technologies\/ amazons-face-recognition-falsely-matched-28"},{"key":"e_1_3_2_1_44_1","volume-title":"Retrieved","author":"Solon Olivia","year":"2019","unstructured":"Olivia Solon. 2019. Facial recognition's 'dirty little secret': Millions of online photos scraped without consent. Retrieved October 31, 2019 from https:\/\/www.nbcnews.com\/tech\/internet\/facial-recognition-s-dirty-littlesecret- millions-online-photos-scraped-n981921"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2019.00280"}],"event":{"name":"AIES '20: AAAI\/ACM Conference on AI, Ethics, and Society","location":"New York NY USA","acronym":"AIES '20","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence"]},"container-title":["Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375627.3375820","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3375627.3375820","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,18]],"date-time":"2025-08-18T17:35:44Z","timestamp":1755538544000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375627.3375820"}},"subtitle":["Investigating the Ethical Concerns of Facial Recognition Auditing"],"short-title":[],"issued":{"date-parts":[[2020,2,7]]},"references-count":45,"alternative-id":["10.1145\/3375627.3375820","10.1145\/3375627"],"URL":"https:\/\/doi.org\/10.1145\/3375627.3375820","relation":{},"subject":[],"published":{"date-parts":[[2020,2,7]]},"assertion":[{"value":"2020-02-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}