{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T15:07:24Z","timestamp":1785251244117,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,11,9]],"date-time":"2020-11-09T00:00:00Z","timestamp":1604880000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,11,9]]},"DOI":"10.1145\/3411501.3419419","type":"proceedings-article","created":{"date-parts":[[2020,11,4]],"date-time":"2020-11-04T03:22:57Z","timestamp":1604460177000},"page":"15-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":58,"title":["Neither Private Nor Fair"],"prefix":"10.1145","author":[{"given":"Tom","family":"Farrand","sequence":"first","affiliation":[{"name":"Seldon & OpenMined, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fatemehsadat","family":"Mireshghallah","sequence":"additional","affiliation":[{"name":"University of California San Diego & OpenMined, San Diego, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sahib","family":"Singh","sequence":"additional","affiliation":[{"name":"Ford R&A & OpenMined, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Trask","sequence":"additional","affiliation":[{"name":"University of Oxford & OpenMined, Oxford, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,11,9]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2976749.2978318"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3226070"},{"key":"e_1_3_2_1_3_1","volume-title":"International Workshop on Formal Aspects in Security and Trust. Springer, 39--54","author":"Alvim M\u00e1rio S","year":"2011","unstructured":"M\u00e1rio S Alvim , Miguel E Andr\u00e9s , Konstantinos Chatzikokolakis , Pierpaolo Degano , and Catuscia Palamidessi . 2011 . Differential privacy: on the trade-off between utility and information leakage . In International Workshop on Formal Aspects in Security and Trust. Springer, 39--54 . M\u00e1rio S Alvim, Miguel E Andr\u00e9s, Konstantinos Chatzikokolakis, Pierpaolo Degano, and Catuscia Palamidessi. 2011. Differential privacy: on the trade-off between utility and information leakage. In International Workshop on Formal Aspects in Security and Trust. Springer, 39--54."},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning -","volume":"70","author":"Arpit Devansh","unstructured":"Devansh Arpit , Stanis\u0142aw Jastrzundefinedbski , Nicolas Ballas , David Krueger , Emmanuel Bengio , Maxinder S. Kanwal , Tegan Maharaj , Asja Fischer , Aaron Courville , Yoshua Bengio , and et al. 2017. A Closer Look at Memorization in Deep Networks . In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (Sydney, NSW, Australia) (ICML'17). JMLR.org, 233--242. Devansh Arpit, Stanis\u0142aw Jastrzundefinedbski, Nicolas Ballas, David Krueger, Emmanuel Bengio, Maxinder S. Kanwal, Tegan Maharaj, Asja Fischer, Aaron Courville, Yoshua Bengio, and et al. 2017. A Closer Look at Memorization in Deep Networks. In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (Sydney, NSW, Australia) (ICML'17). JMLR.org, 233--242."},{"key":"e_1_3_2_1_5_1","unstructured":"Eugene Bagdasaryan Omid Poursaeed and Vitaly Shmatikov. 2019. Differential privacy has disparate impact on model accuracy. In Advances in Neural Information Processing Systems. 15479--15488.  Eugene Bagdasaryan Omid Poursaeed and Vitaly Shmatikov. 2019. Differential privacy has disparate impact on model accuracy. In Advances in Neural Information Processing Systems. 15479--15488."},{"key":"e_1_3_2_1_6_1","volume-title":"Demographic dialectal variation in social media: A case study of African-American English. arXiv preprint arXiv:1608.08868","author":"Blodgett Su Lin","year":"2016","unstructured":"Su Lin Blodgett , Lisa Green , and Brendan O'Connor . 2016. Demographic dialectal variation in social media: A case study of African-American English. arXiv preprint arXiv:1608.08868 ( 2016 ). Su Lin Blodgett, Lisa Green, and Brendan O'Connor. 2016. Demographic dialectal variation in social media: A case study of African-American English. arXiv preprint arXiv:1608.08868 (2016)."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1131"},{"key":"e_1_3_2_1_8_1","volume":"201","author":"Bu Zhiqi","unstructured":"Zhiqi Bu , Jinshuo Dong , Qi Long , and Weijie J Su. 201 9. Deep learning with Gaussian differential privacy. arXiv preprint arXiv:1911.11607 (2019). Zhiqi Bu, Jinshuo Dong, Qi Long, and Weijie J Su. 2019. Deep learning with Gaussian differential privacy. arXiv preprint arXiv:1911.11607 (2019).","journal-title":"Weijie J Su."},{"key":"e_1_3_2_1_9_1","volume-title":"\u00da lfar Erlingsson, and Dawn Song","author":"Carlini Nicholas","year":"2018","unstructured":"Nicholas Carlini , Chang Liu , Jernej Kos , \u00da lfar Erlingsson, and Dawn Song . 2018 . The Secret Sharer: Measuring Unintended Neural Network Memorization & Extracting Secrets. CoRR , Vol. abs\/ 1802 .08232 (2018). arxiv: 1802.08232 http:\/\/arxiv.org\/abs\/1802.08232 Nicholas Carlini, Chang Liu, Jernej Kos, \u00da lfar Erlingsson, and Dawn Song. 2018. The Secret Sharer: Measuring Unintended Neural Network Memorization & Extracting Secrets. CoRR, Vol. abs\/1802.08232 (2018). arxiv: 1802.08232 http:\/\/arxiv.org\/abs\/1802.08232"},{"key":"e_1_3_2_1_10_1","volume-title":"Sarwate","author":"Chaudhuri Kamalika","year":"2009","unstructured":"Kamalika Chaudhuri , Claire Monteleoni , and Anand D . Sarwate . 2009 . Differentially Private Empirical Risk Minimization . arXiv preprint arXiv:0912.0071 (2009). arxiv: 0912.0071 [cs.LG] Kamalika Chaudhuri, Claire Monteleoni, and Anand D. Sarwate. 2009. Differentially Private Empirical Risk Minimization. arXiv preprint arXiv:0912.0071 (2009). arxiv: 0912.0071 [cs.LG]"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/11761679_29"},{"key":"e_1_3_2_1_12_1","volume-title":"Theory of cryptography conference","author":"Dwork Cynthia","unstructured":"Cynthia Dwork , Frank McSherry , Kobbi Nissim , and Adam Smith . 2006 b. Calibrating noise to sensitivity in private data analysis . In Theory of cryptography conference . Springer , 265--284. Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam Smith. 2006 b. Calibrating noise to sensitivity in private data analysis. In Theory of cryptography conference. Springer, 265--284."},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the 23rd USENIX Conference on Security Symposium","author":"Fredrikson Matthew","year":"2014","unstructured":"Matthew Fredrikson , Eric Lantz , Somesh Jha , Simon Lin , David Page , and Thomas Ristenpart . 2014 . Privacy in Pharmacogenetics: An End-to-End Case Study of Personalized Warfarin Dosing . In Proceedings of the 23rd USENIX Conference on Security Symposium ( San Diego, CA) (SEC'14). USENIX Association, USA, 17--32. Matthew Fredrikson, Eric Lantz, Somesh Jha, Simon Lin, David Page, and Thomas Ristenpart. 2014. Privacy in Pharmacogenetics: An End-to-End Case Study of Personalized Warfarin Dosing. In Proceedings of the 23rd USENIX Conference on Security Symposium (San Diego, CA) (SEC'14). USENIX Association, USA, 17--32."},{"key":"e_1_3_2_1_14_1","unstructured":"Moritz Hardt Eric Price and Nati Srebro. 2016. Equality of opportunity in supervised learning. In Advances in neural information processing systems. 3315--3323.  Moritz Hardt Eric Price and Nati Srebro. 2016. Equality of opportunity in supervised learning. In Advances in neural information processing systems. 3315--3323."},{"key":"e_1_3_2_1_15_1","volume-title":"Deep Residual Learning for Image Recognition. CoRR","author":"He Kaiming","year":"2015","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun . 2015. Deep Residual Learning for Image Recognition. CoRR , Vol. abs\/ 1512 .03385 ( 2015 ). arxiv: 1512.03385 http:\/\/arxiv.org\/abs\/1512.03385 Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep Residual Learning for Image Recognition. CoRR, Vol. abs\/1512.03385 (2015). arxiv: 1512.03385 http:\/\/arxiv.org\/abs\/1512.03385"},{"key":"e_1_3_2_1_16_1","volume-title":"Differentially private fair learning. arXiv preprint arXiv:1812.02696","author":"Jagielski Matthew","year":"2018","unstructured":"Matthew Jagielski , Michael Kearns , Jieming Mao , Alina Oprea , Aaron Roth , Saeed Sharifi-Malvajerdi , and Jonathan Ullman . 2018. Differentially private fair learning. arXiv preprint arXiv:1812.02696 ( 2018 ). Matthew Jagielski, Michael Kearns, Jieming Mao, Alina Oprea, Aaron Roth, Saeed Sharifi-Malvajerdi, and Jonathan Ullman. 2018. Differentially private fair learning. arXiv preprint arXiv:1812.02696 (2018)."},{"key":"e_1_3_2_1_17_1","volume-title":"Censored and Fair Universal Representations using Generative Adversarial Models. arXiv","author":"Kairouz Peter","year":"2019","unstructured":"Peter Kairouz , Jiachun Liao , Chong Huang , and Lalitha Sankar . 2019. Censored and Fair Universal Representations using Generative Adversarial Models. arXiv ( 2019 ), arXiv--1910. Peter Kairouz, Jiachun Liao, Chong Huang, and Lalitha Sankar. 2019. Censored and Fair Universal Representations using Generative Adversarial Models. arXiv (2019), arXiv--1910."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287592"},{"key":"e_1_3_2_1_19_1","volume-title":"Fair decision making using privacy-protected data. arXiv preprint arXiv:1905.12744","author":"Kuppam Satya","year":"2019","unstructured":"Satya Kuppam , Ryan McKenna , David Pujol , Michael Hay , Ashwin Machanavajjhala , and Gerome Miklau . 2019. Fair decision making using privacy-protected data. arXiv preprint arXiv:1905.12744 ( 2019 ). Satya Kuppam, Ryan McKenna, David Pujol, Michael Hay, Ashwin Machanavajjhala, and Gerome Miklau. 2019. Fair decision making using privacy-protected data. arXiv preprint arXiv:1905.12744 (2019)."},{"key":"e_1_3_2_1_20_1","unstructured":"Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135.  Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.425"},{"key":"e_1_3_2_1_22_1","volume-title":"et almbox","author":"McMahan H Brendan","year":"2016","unstructured":"H Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , et almbox . 2016 . Communication-efficient learning of deep networks from decentralized data. arXiv preprint arXiv:1602.05629 (2016). H Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, et almbox. 2016. Communication-efficient learning of deep networks from decentralized data. arXiv preprint arXiv:1602.05629 (2016)."},{"key":"e_1_3_2_1_23_1","volume-title":"A survey on bias and fairness in machine learning. arXiv preprint arXiv:1908.09635","author":"Mehrabi Ninareh","year":"2019","unstructured":"Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , and Aram Galstyan . 2019. A survey on bias and fairness in machine learning. arXiv preprint arXiv:1908.09635 ( 2019 ). Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2019. A survey on bias and fairness in machine learning. arXiv preprint arXiv:1908.09635 (2019)."},{"key":"e_1_3_2_1_24_1","volume-title":"Diversity in faces. arXiv preprint arXiv:1901.10436","author":"Merler Michele","year":"2019","unstructured":"Michele Merler , Nalini Ratha , Rogerio S Feris , and John R Smith . 2019. Diversity in faces. arXiv preprint arXiv:1901.10436 ( 2019 ). Michele Merler, Nalini Ratha, Rogerio S Feris, and John R Smith. 2019. Diversity in faces. arXiv preprint arXiv:1901.10436 (2019)."},{"key":"e_1_3_2_1_25_1","volume-title":"ArXiv","author":"Mireshghallah Fatemehsadat","unstructured":"Fatemehsadat Mireshghallah , Mohammadkazem Taram , Praneeth Vepakomma , Abhishek Singh , Ramesh Raskar , and Hadi Esmaeilzadeh . 2020. Privacy in Deep Learning: A Survey . In ArXiv , Vol. abs\/ 2004 .12254. Fatemehsadat Mireshghallah, Mohammadkazem Taram, Praneeth Vepakomma, Abhishek Singh, Ramesh Raskar, and Hadi Esmaeilzadeh. 2020. Privacy in Deep Learning: A Survey. In ArXiv, Vol. abs\/2004.12254."},{"key":"e_1_3_2_1_26_1","volume-title":"Renyi Differential Privacy. CoRR","author":"Mironov Ilya","year":"2017","unstructured":"Ilya Mironov . 2017. Renyi Differential Privacy. CoRR , Vol. abs\/ 1702 .07476 ( 2017 ). arxiv: 1702.07476 http:\/\/arxiv.org\/abs\/1702.07476 Ilya Mironov. 2017. Renyi Differential Privacy. CoRR, Vol. abs\/1702.07476 (2017). arxiv: 1702.07476 http:\/\/arxiv.org\/abs\/1702.07476"},{"key":"e_1_3_2_1_27_1","volume-title":"PyTorch: An Imperative Style","author":"Paszke Adam","unstructured":"Adam Paszke , Sam Gross , Francisco Massa , Adam Lerer , James Bradbury , Gregory Chanan , Trevor Killeen , Zeming Lin , Natalia Gimelshein , Luca Antiga , Alban Desmaison , Andreas Kopf , Edward Yang , Zachary DeVito , Martin Raison , Alykhan Tejani , Sasank Chilamkurthy , Benoit Steiner , Lu Fang , Junjie Bai , and Soumith Chintala . 2019. PyTorch: An Imperative Style , High-Performance Deep Learning Library . In Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.). Curran Associates, Inc., 8024--8035. https:\/\/github.com\/pytorch\/ Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.). Curran Associates, Inc., 8024--8035. https:\/\/github.com\/pytorch\/"},{"key":"e_1_3_2_1_28_1","volume-title":"Membership Inference Attacks Against Machine Learning Models. In IEEE Symposium on Security and Privacy (S&P).","author":"Shokri R.","unstructured":"R. Shokri , M. Stronati , C. Song , and V. Shmatikov . 2017 . Membership Inference Attacks Against Machine Learning Models. In IEEE Symposium on Security and Privacy (S&P). R. Shokri, M. Stronati, C. Song, and V. Shmatikov. 2017. Membership Inference Attacks Against Machine Learning Models. In IEEE Symposium on Security and Privacy (S&P)."},{"key":"e_1_3_2_1_29_1","volume-title":"Benchmarking Differentially Private Residual Networks for Medical Imagery. arXiv preprint arXiv:2005.13099","author":"Singh Sahib","year":"2020","unstructured":"Sahib Singh , Harshvardhan Sikka , Sasikanth Kotti , and Andrew Trask . 2020. Benchmarking Differentially Private Residual Networks for Medical Imagery. arXiv preprint arXiv:2005.13099 ( 2020 ). Sahib Singh, Harshvardhan Sikka, Sasikanth Kotti, and Andrew Trask. 2020. Benchmarking Differentially Private Residual Networks for Medical Imagery. arXiv preprint arXiv:2005.13099 (2020)."},{"key":"e_1_3_2_1_30_1","volume-title":"Thompson and Charlie Warzel","author":"Stuart","year":"2019","unstructured":"Stuart A. Thompson and Charlie Warzel . 2019 . The Privacy Project: Twelve Million Phones, One Dataset, Zero Privacy . online accessed February 2020 https:\/\/www.nytimes.com\/interactive\/2019\/12\/19\/opinion\/location-tracking-cell-phone.html. Stuart A. Thompson and Charlie Warzel. 2019. The Privacy Project: Twelve Million Phones, One Dataset, Zero Privacy. online accessed February 2020 https:\/\/www.nytimes.com\/interactive\/2019\/12\/19\/opinion\/location-tracking-cell-phone.html."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287566"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00914"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.463"}],"event":{"name":"CCS '20: 2020 ACM SIGSAC Conference on Computer and Communications Security","location":"Virtual Event USA","acronym":"CCS '20","sponsor":["SIGSAC ACM Special Interest Group on Security, Audit, and Control"]},"container-title":["Proceedings of the 2020 Workshop on Privacy-Preserving Machine Learning in Practice"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411501.3419419","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411501.3419419","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:41Z","timestamp":1750195901000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411501.3419419"}},"subtitle":["Impact of Data Imbalance on Utility and Fairness in Differential Privacy"],"short-title":[],"issued":{"date-parts":[[2020,11,9]]},"references-count":33,"alternative-id":["10.1145\/3411501.3419419","10.1145\/3411501"],"URL":"https:\/\/doi.org\/10.1145\/3411501.3419419","relation":{},"subject":[],"published":{"date-parts":[[2020,11,9]]},"assertion":[{"value":"2020-11-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}