{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T14:16:31Z","timestamp":1766067391403,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,7,21]],"date-time":"2021-07-21T00:00:00Z","timestamp":1626825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,7,21]]},"DOI":"10.1145\/3461702.3462554","type":"proceedings-article","created":{"date-parts":[[2021,7,31]],"date-time":"2021-07-31T01:21:38Z","timestamp":1627694498000},"page":"926-935","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Fairness in the Eyes of the Data: Certifying Machine-Learning Models"],"prefix":"10.1145","author":[{"given":"Shahar","family":"Segal","sequence":"first","affiliation":[{"name":"Tel-Aviv University, Tel-Aviv, Israel"}]},{"given":"Yossi","family":"Adi","sequence":"additional","affiliation":[{"name":"The Hebrew University of Jerusalem, Jerusalem, Israel"}]},{"given":"Benny","family":"Pinkas","sequence":"additional","affiliation":[{"name":"Bar-Ilan University, Ramat Gan, Israel"}]},{"given":"Carsten","family":"Baum","sequence":"additional","affiliation":[{"name":"Aarhus University, Aarhus, Denmark"}]},{"given":"Chaya","family":"Ganesh","sequence":"additional","affiliation":[{"name":"IISc Bangalore, Bangalore, Denmark"}]},{"given":"Joseph","family":"Keshet","sequence":"additional","affiliation":[{"name":"Bar-Ilan University, Ramat Gan, Israel"}]}],"member":"320","published-online":{"date-parts":[[2021,7,30]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"Victor Arribas Abril Pieter Maene Nele Mertens and Nigel Smart. [n.d.]. 'Bristol Fashion' MPC Circuits. https:\/\/homes.esat.kuleuven.be\/ nsmart\/MPC\/. Last accessed on 11\/16\/2019.  Victor Arribas Abril Pieter Maene Nele Mertens and Nigel Smart. [n.d.]. 'Bristol Fashion' MPC Circuits. https:\/\/homes.esat.kuleuven.be\/ nsmart\/MPC\/. Last accessed on 11\/16\/2019."},{"key":"e_1_3_2_2_2_1","volume-title":"Machine Bias: there's software used across the country to predict future criminals. And it's biased against blacks. ProPublica","author":"Angwin Julia","year":"2016","unstructured":"Julia Angwin , Jeff Larson , Surya Mattu , and Lauren Kirchner . 2016. Machine Bias: there's software used across the country to predict future criminals. And it's biased against blacks. ProPublica 2016 . Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias: there's software used across the country to predict future criminals. And it's biased against blacks. ProPublica 2016."},{"key":"e_1_3_2_2_3_1","volume-title":"Invariant risk minimization. arXiv preprint arXiv:1907.02893","author":"Arjovsky Martin","year":"2019","unstructured":"Martin Arjovsky , L\u00e9on Bottou , Ishaan Gulrajani , and David Lopez-Paz . 2019. Invariant risk minimization. arXiv preprint arXiv:1907.02893 ( 2019 ). Martin Arjovsky, L\u00e9on Bottou, Ishaan Gulrajani, and David Lopez-Paz. 2019. Invariant risk minimization. arXiv preprint arXiv:1907.02893 (2019)."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3319535.3354245"},{"key":"e_1_3_2_2_6_1","volume-title":"Conference on fairness, accountability and transparency. 77--91","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru . 2018 . Gender shades: Intersectional accuracy disparities in commercial gender classification . In Conference on fairness, accountability and transparency. 77--91 . Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. 77--91."},{"key":"e_1_3_2_2_7_1","volume-title":"Science","volume":"356","author":"Caliskan Aylin","year":"2017","unstructured":"Aylin Caliskan , Joanna J Bryson , and Arvind Narayanan . 2017 . Semantics derived automatically from language corpora contain human-like biases . Science , Vol. 356 , 6334 (2017), 183--186. Aylin Caliskan, Joanna J Bryson, and Arvind Narayanan. 2017. Semantics derived automatically from language corpora contain human-like biases. Science, Vol. 356, 6334 (2017), 183--186."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098095"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2019.00078"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_3_2_2_11_1","unstructured":"FacebookResearch. 2019. CrypTen. https:\/\/github.com\/facebookresearch\/CrypTen.  FacebookResearch. 2019. CrypTen. https:\/\/github.com\/facebookresearch\/CrypTen."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783311"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/230538.230561"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.6028\/NIST.IR.4930"},{"key":"e_1_3_2_2_15_1","volume-title":"Secure multiparty computations in floating-point arithmetic. arXiv preprint arXiv:2001.03192","author":"Guo Chuan","year":"2020","unstructured":"Chuan Guo , Awni Hannun , Brian Knott , Laurens van der Maaten , Mark Tygert , and Ruiyu Zhu . 2020. Secure multiparty computations in floating-point arithmetic. arXiv preprint arXiv:2001.03192 ( 2020 ). Chuan Guo, Awni Hannun, Brian Knott, Laurens van der Maaten, Mark Tygert, and Ruiyu Zhu. 2020. Secure multiparty computations in floating-point arithmetic. arXiv preprint arXiv:2001.03192 (2020)."},{"key":"e_1_3_2_2_16_1","volume-title":"International Conference on Machine Learning. 1944--1953","author":"H\u00e9bert-Johnson \u00darsula","year":"2018","unstructured":"\u00darsula H\u00e9bert-Johnson , Michael Kim , Omer Reingold , and Guy Rothblum . 2018 . Multicalibration: Calibration for the (computationally-identifiable) masses . In International Conference on Machine Learning. 1944--1953 . \u00darsula H\u00e9bert-Johnson, Michael Kim, Omer Reingold, and Guy Rothblum. 2018. Multicalibration: Calibration for the (computationally-identifiable) masses. In International Conference on Machine Learning. 1944--1953."},{"key":"e_1_3_2_2_18_1","volume-title":"27th USENIX Security Symposium (USENIX Security 18)","author":"Juvekar Chiraag","year":"2018","unstructured":"Chiraag Juvekar , Vinod Vaikuntanathan , and Anantha Chandrakasan . 2018 . GAZELLE: A low latency framework for secure neural network inference . In 27th USENIX Security Symposium (USENIX Security 18) . 1651--1669. Chiraag Juvekar, Vinod Vaikuntanathan, and Anantha Chandrakasan. 2018. GAZELLE: A low latency framework for secure neural network inference. In 27th USENIX Security Symposium (USENIX Security 18). 1651--1669."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702520"},{"key":"e_1_3_2_2_20_1","volume-title":"Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In International Conference on Machine Learning. 2569--2577","author":"Kearns Michael","year":"2018","unstructured":"Michael Kearns , Seth Neel , Aaron Roth , and Zhiwei Steven Wu . 2018 . Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In International Conference on Machine Learning. 2569--2577 . Michael Kearns, Seth Neel, Aaron Roth, and Zhiwei Steven Wu. 2018. Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In International Conference on Machine Learning. 2569--2577."},{"key":"e_1_3_2_2_21_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\"a ssan","author":"Kilbertus Niki","year":"2018","unstructured":"Niki Kilbertus , Adri\u00e0 Gasc\u00f3 n, Matt J. Kusner , Michael Veale , Krishna P. Gummadi , and Adrian Weller . 2018 . Blind Justice: Fairness with Encrypted Sensitive Attributes . In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\"a ssan , Stockholm, Sweden, July 10--15 , 2018 (Proceedings of Machine Learning Research, Vol. 80), Jennifer G. Dy and Andreas Krause (Eds.). PMLR, 2635--2644. Niki Kilbertus, Adri\u00e0 Gasc\u00f3 n, Matt J. Kusner, Michael Veale, Krishna P. Gummadi, and Adrian Weller. 2018. Blind Justice: Fairness with Encrypted Sensitive Attributes. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\"a ssan, Stockholm, Sweden, July 10--15, 2018 (Proceedings of Machine Learning Research, Vol. 80), Jennifer G. Dy and Andreas Krause (Eds.). PMLR, 2635--2644."},{"key":"e_1_3_2_2_22_1","volume-title":"arXiv preprint arXiv:1904.01793","author":"Kim Michael P","year":"2019","unstructured":"Michael P Kim , Aleksandra Korolova , Guy N Rothblum , and Gal Yona . 2019. Preference-Informed Fairness . arXiv preprint arXiv:1904.01793 ( 2019 ). Michael P Kim, Aleksandra Korolova, Guy N Rothblum, and Gal Yona. 2019. Preference-Informed Fairness. arXiv preprint arXiv:1904.01793 (2019)."},{"key":"e_1_3_2_2_23_1","volume-title":"Inherent Trade-Offs in the Fair Determination of Risk Scores. In 8th Innovations in Theoretical Computer Science Conference (ITCS","author":"Kleinberg Jon","year":"2017","unstructured":"Jon Kleinberg , Sendhil Mullainathan , and Manish Raghavan . 2017 . Inherent Trade-Offs in the Fair Determination of Risk Scores. In 8th Innovations in Theoretical Computer Science Conference (ITCS 2017). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik. Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2017. Inherent Trade-Offs in the Fair Determination of Risk Scores. In 8th Innovations in Theoretical Computer Science Conference (ITCS 2017). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/3001460.3001502"},{"key":"e_1_3_2_2_25_1","volume-title":"Cryptflow: Secure tensorflow inference. arXiv preprint arXiv:1909.07814","author":"Kumar Nishant","year":"2019","unstructured":"Nishant Kumar , Mayank Rathee , Nishanth Chandran , Divya Gupta , Aseem Rastogi , and Rahul Sharma . 2019 . Cryptflow: Secure tensorflow inference. arXiv preprint arXiv:1909.07814 (2019). Nishant Kumar, Mayank Rathee, Nishanth Chandran, Divya Gupta, Aseem Rastogi, and Rahul Sharma. 2019. Cryptflow: Secure tensorflow inference. arXiv preprint arXiv:1909.07814 (2019)."},{"key":"e_1_3_2_2_26_1","volume-title":"Enhancing the reliability of out-of-distribution image detection in neural networks. arXiv preprint arXiv:1706.02690","author":"Liang Shiyu","year":"2017","unstructured":"Shiyu Liang , Yixuan Li , and Rayadurgam Srikant . 2017. Enhancing the reliability of out-of-distribution image detection in neural networks. arXiv preprint arXiv:1706.02690 ( 2017 ). Shiyu Liang, Yixuan Li, and Rayadurgam Srikant. 2017. Enhancing the reliability of out-of-distribution image detection in neural networks. arXiv preprint arXiv:1706.02690 (2017)."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.425"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.12"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196494.3196522"},{"key":"e_1_3_2_2_30_1","volume-title":"Probably approximately metric-fair learning. arXiv preprint arXiv:1803.03242","author":"Rothblum Guy N","year":"2018","unstructured":"Guy N Rothblum and Gal Yona . 2018. Probably approximately metric-fair learning. arXiv preprint arXiv:1803.03242 ( 2018 ). Guy N Rothblum and Gal Yona. 2018. Probably approximately metric-fair learning. arXiv preprint arXiv:1803.03242 (2018)."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"crossref","unstructured":"Rachael Tatman and Conner Kasten. 2017. Effects of Talker Dialect Gender & Race on Accuracy of Bing Speech and YouTube Automatic Captions.. In INTERSPEECH. 934--938.  Rachael Tatman and Conner Kasten. 2017. Effects of Talker Dialect Gender & Race on Accuracy of Bing Speech and YouTube Automatic Captions.. In INTERSPEECH. 934--938.","DOI":"10.21437\/Interspeech.2017-1746"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1968.1972"},{"key":"e_1_3_2_2_33_1","volume-title":"The Trade-Offs of Private Prediction. arXiv preprint arXiv:2007.05089","author":"van der Maaten Laurens","year":"2020","unstructured":"Laurens van der Maaten and Awni Hannun . 2020. The Trade-Offs of Private Prediction. arXiv preprint arXiv:2007.05089 ( 2020 ). Laurens van der Maaten and Awni Hannun. 2020. The Trade-Offs of Private Prediction. arXiv preprint arXiv:2007.05089 (2020)."},{"volume-title":"Estimation of dependences based on empirical data","author":"Vapnik Vladimir","key":"e_1_3_2_2_34_1","unstructured":"Vladimir Vapnik . 2006. Estimation of dependences based on empirical data . Springer Science & Business Media . Vladimir Vapnik. 2006. Estimation of dependences based on empirical data .Springer Science & Business Media."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3194770.3194776"},{"key":"e_1_3_2_2_36_1","volume-title":"The Atlantic","volume":"2","author":"Waddell Kaveh","year":"2016","unstructured":"Kaveh Waddell . 2016 . How algorithms can bring down minorities' credit scores . The Atlantic , Vol. 2 (2016). Kaveh Waddell. 2016. How algorithms can bring down minorities' credit scores. The Atlantic, Vol. 2 (2016)."},{"key":"e_1_3_2_2_37_1","volume-title":"International Conference on Machine Learning. 325--333","author":"Zemel Rich","year":"2013","unstructured":"Rich Zemel , Yu Wu , Kevin Swersky , Toni Pitassi , and Cynthia Dwork . 2013 . Learning fair representations . In International Conference on Machine Learning. 325--333 . Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. 2013. Learning fair representations. In International Conference on Machine Learning. 325--333."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.463"},{"key":"e_1_3_2_2_39_1","volume-title":"Random erasing data augmentation. arXiv preprint arXiv:1708.04896","author":"Zhong Zhun","year":"2017","unstructured":"Zhun Zhong , Liang Zheng , Guoliang Kang , Shaozi Li , and Yi Yang . 2017. Random erasing data augmentation. arXiv preprint arXiv:1708.04896 ( 2017 ). Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, and Yi Yang. 2017. Random erasing data augmentation. arXiv preprint arXiv:1708.04896 (2017)."}],"event":{"name":"AIES '21: AAAI\/ACM Conference on AI, Ethics, and Society","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"],"location":"Virtual Event USA","acronym":"AIES '21"},"container-title":["Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461702.3462554","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461702.3462554","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:49:06Z","timestamp":1750193346000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461702.3462554"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,21]]},"references-count":37,"alternative-id":["10.1145\/3461702.3462554","10.1145\/3461702"],"URL":"https:\/\/doi.org\/10.1145\/3461702.3462554","relation":{},"subject":[],"published":{"date-parts":[[2021,7,21]]},"assertion":[{"value":"2021-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}