{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T17:59:28Z","timestamp":1773511168219,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":77,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,11,15]],"date-time":"2023-11-15T00:00:00Z","timestamp":1700006400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,11,15]]},"DOI":"10.1145\/3600100.3625373","type":"proceedings-article","created":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T12:17:16Z","timestamp":1699013836000},"page":"322-327","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Towards Benchmarking Privacy Risk for Differential Privacy: A Survey"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-2225-4295","authenticated-orcid":false,"given":"Dmitry","family":"Prokhorenkov","sequence":"first","affiliation":[{"name":"Technical University of Munich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6424-8633","authenticated-orcid":false,"given":"Yang","family":"Cao","sequence":"additional","affiliation":[{"name":"Hokkaido University, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,11,15]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"1","article-title":"What a hybrid legal-technical analysis teaches us about privacy regulation: The case of singling out. BUJ Sci","author":"Altman Micah","year":"2021","unstructured":"Micah Altman, Aloni Cohen, Kobbi Nissim, and Alexandra Wood. 2021. What a hybrid legal-technical analysis teaches us about privacy regulation: The case of singling out. BUJ Sci. & Tech. L. 27 (2021), 1.","journal-title":"& Tech."},{"key":"e_1_3_2_1_2_1","volume-title":"International Conference on Machine Learning. PMLR, 263\u2013271","author":"Amin Kareem","year":"2019","unstructured":"Kareem Amin, Alex Kulesza, Andres Munoz, and Sergei Vassilvtiskii. 2019. Bounding user contributions: A bias-variance trade-off in differential privacy. In International Conference on Machine Learning. PMLR, 263\u2013271."},{"key":"e_1_3_2_1_3_1","volume-title":"Differential privacy has disparate impact on model accuracy. Advances in neural information processing systems 32","author":"Bagdasaryan Eugene","year":"2019","unstructured":"Eugene Bagdasaryan, Omid Poursaeed, and Vitaly Shmatikov. 2019. Differential privacy has disparate impact on model accuracy. Advances in neural information processing systems 32 (2019)."},{"key":"e_1_3_2_1_4_1","unstructured":"George Balston Marion Oswald Alexander Harris and Ardi Janjeva. 2022. Implications of Emerging Privacy Enhancing Technologies for UK Surveillance Policy. (2022)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23556-6_1"},{"key":"e_1_3_2_1_6_1","volume-title":"4th Annual IoT Security Foundation Conference, Vol.\u00a04. 1\u20138.","author":"Bastos Daniel","year":"2018","unstructured":"Daniel Bastos, Fabio Giubilo, Mark Shackleton, and Fadi El-Moussa. 2018. GDPR privacy implications for the Internet of Things. In 4th Annual IoT Security Foundation Conference, Vol.\u00a04. 1\u20138."},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings of the Conference on Very Large Databases.","author":"Bernau Daniel","year":"2021","unstructured":"Daniel Bernau, G\u00fcnther Eibl, Philip\u00a0W Grassal, Hannah Keller, and Florian Kerschbaum. 2021. Quantifying Identifiability to Choose and Audit \u01eb in Differentially Private Deep Learning. In Proceedings of the Conference on Very Large Databases."},{"key":"e_1_3_2_1_8_1","volume-title":"Assessing differentially private deep learning with membership inference. arXiv preprint arXiv:1912.11328","author":"Bernau Daniel","year":"2019","unstructured":"Daniel Bernau, Philip-William Grassal, Jonas Robl, and Florian Kerschbaum. 2019. Assessing differentially private deep learning with membership inference. arXiv preprint arXiv:1912.11328 (2019)."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-81242-3_2"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-10684-2_1"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2019.11.041"},{"key":"e_1_3_2_1_12_1","volume-title":"30th { USENIX} Security Symposium ({ USENIX} Security 21).","author":"Cao Xiaoyu","unstructured":"Xiaoyu Cao, Jinyuan Jia, and Neil\u00a0Zhenqiang Gong. 2021. Data poisoning attacks to local differential privacy protocols. In 30th { USENIX} Security Symposium ({ USENIX} Security 21)."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.2018.1700447"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1561\/9781601982773"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/PRDC.2017.59"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-013-0344-8"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.14778\/3402707.3402744"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP40001.2021.00001"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1914598117"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.2478\/popets-2021-0005"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00766-010-0115-7"},{"key":"e_1_3_2_1_22_1","volume-title":"The algorithmic foundations of differential privacy. Foundations and Trends\u00ae in Theoretical Computer Science 9, 3\u20134","author":"Dwork Cynthia","year":"2014","unstructured":"Cynthia Dwork, Aaron Roth, 2014. The algorithmic foundations of differential privacy. Foundations and Trends\u00ae in Theoretical Computer Science 9, 3\u20134 (2014), 211\u2013407."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3151670"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2019.00031"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2810103.2813677"},{"key":"e_1_3_2_1_26_1","volume-title":"23rd { USENIX} Security Symposium ({ USENIX} Security 14). 17\u201332.","author":"Fredrikson Matthew","unstructured":"Matthew Fredrikson, Eric Lantz, Somesh Jha, Simon Lin, David Page, and Thomas Ristenpart. 2014. Privacy in pharmacogenetics: An end-to-end case study of personalized warfarin dosing. In 23rd { USENIX} Security Symposium ({ USENIX} Security 14). 17\u201332."},{"key":"e_1_3_2_1_27_1","volume-title":"Pool Inference Attacks on Local Differential Privacy: Quantifying the Privacy Guarantees of Apple\u2019s Count Mean Sketch in Practice. In 31st USENIX Security Symposium (USENIX Security 22)","author":"Gadotti Andrea","year":"2022","unstructured":"Andrea Gadotti, Florimond Houssiau, Meenatchi Sundaram Muthu\u00a0Selva Annamalai, and Yves-Alexandre de Montjoye. 2022. Pool Inference Attacks on Local Differential Privacy: Quantifying the Privacy Guarantees of Apple\u2019s Count Mean Sketch in Practice. In 31st USENIX Security Symposium (USENIX Security 22). 501\u2013518."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3243734.3243834"},{"key":"e_1_3_2_1_29_1","volume-title":"Do I get the privacy I need? Benchmarking utility in differential privacy libraries. arXiv preprint arXiv:2109.10789","author":"Garrido Gonzalo\u00a0Munilla","year":"2021","unstructured":"Gonzalo\u00a0Munilla Garrido, Joseph Near, Aitsam Muhammad, Warren He, Roman Matzutt, and Florian Matthes. 2021. Do I get the privacy I need? Benchmarking utility in differential privacy libraries. arXiv preprint arXiv:2109.10789 (2021)."},{"key":"e_1_3_2_1_30_1","volume-title":"An Alphabet of Leakage Measures. In 2022 IEEE Information Theory Workshop (ITW). IEEE, 458\u2013463","author":"Gilani Atefeh","year":"2022","unstructured":"Atefeh Gilani, Gowtham\u00a0R Kurri, Oliver Kosut, and Lalitha Sankar. 2022. An Alphabet of Leakage Measures. In 2022 IEEE Information Theory Workshop (ITW). IEEE, 458\u2013463."},{"key":"e_1_3_2_1_31_1","volume-title":"A Unified Framework for Quantifying Privacy Risk in Synthetic Data. arXiv preprint arXiv:2211.10459","author":"Giomi Matteo","year":"2022","unstructured":"Matteo Giomi, Franziska Boenisch, Christoph Wehmeyer, and Borb\u00e1la Tasn\u00e1di. 2022. A Unified Framework for Quantifying Privacy Risk in Synthetic Data. arXiv preprint arXiv:2211.10459 (2022)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41576-021-00428-7"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACOMP.2019.00022"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2588581"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3339252.3340516"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM51629.2021.00129"},{"key":"e_1_3_2_1_37_1","volume-title":"USENIX Security Symposium.","author":"Jayaraman Bargav","year":"2019","unstructured":"Bargav Jayaraman and David Evans. 2019. Evaluating differentially private machine learning in practice. In USENIX Security Symposium."},{"key":"e_1_3_2_1_38_1","first-page":"108","article-title":"Applications of differential privacy in social network analysis: A survey","volume":"35","author":"Jiang Honglu","year":"2021","unstructured":"Honglu Jiang, Jian Pei, Dongxiao Yu, Jiguo Yu, Bei Gong, and Xiuzhen Cheng. 2021. Applications of differential privacy in social network analysis: A survey. IEEE Transactions on Knowledge and Data Engineering 35, 1 (2021), 108\u2013127.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_1_39_1","volume-title":"Frequency-based Randomization for Guaranteeing Differential Privacy in Spatial Trajectories. In 2022 IEEE 38th International Conference on Data Engineering (ICDE). IEEE, 1727\u20131739","author":"Jin Fengmei","year":"2022","unstructured":"Fengmei Jin, Wen Hua, Boyu Ruan, and Xiaofang Zhou. 2022. Frequency-based Randomization for Guaranteeing Differential Privacy in Spatial Trajectories. In 2022 IEEE 38th International Conference on Data Engineering (ICDE). IEEE, 1727\u20131739."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3187009.3177733"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807085.1807106"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989345"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213556.2213571"},{"key":"e_1_3_2_1_44_1","first-page":"1","article-title":"Procedures for performing systematic reviews. Keele, UK","volume":"33","author":"Kitchenham Barbara","year":"2004","unstructured":"Barbara Kitchenham. 2004. Procedures for performing systematic reviews. Keele, UK, Keele University 33, 2004 (2004), 1\u201326.","journal-title":"Keele University"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00049"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/DCOSS.2019.00064"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-33752-0_5"},{"key":"e_1_3_2_1_48_1","volume-title":"Privacy in Practice: Private COVID-19 Detection in X-Ray Images. arXiv preprint arXiv:2211.11434","author":"Lange Lucas","year":"2022","unstructured":"Lucas Lange, Maja Schneider, and Erhard Rahm. 2022. Privacy in Practice: Private COVID-19 Detection in X-Ray Images. arXiv preprint arXiv:2211.11434 (2022)."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508859.2516686"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.2478\/popets-2019-0045"},{"key":"e_1_3_2_1_51_1","volume-title":"Disclosure Risk From Homogeneity Attack in Differentially Privately Sanitized Frequency Distribution","author":"Liu Fang","year":"2022","unstructured":"Fang Liu and Xingyuan Zhao. 2022. Disclosure Risk From Homogeneity Attack in Differentially Privately Sanitized Frequency Distribution. IEEE Transactions on Dependable and Secure Computing (2022)."},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989284.1989290"},{"key":"e_1_3_2_1_53_1","volume-title":"Privacy in deep learning: A survey. arXiv preprint arXiv:2004.12254","author":"Mireshghallah Fatemehsadat","year":"2020","unstructured":"Fatemehsadat Mireshghallah, Mohammadkazem Taram, Praneeth Vepakomma, Abhishek Singh, Ramesh Raskar, and Hadi Esmaeilzadeh. 2020. Privacy in deep learning: A survey. arXiv preprint arXiv:2004.12254 (2020)."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.2478\/popets-2022-0058"},{"key":"e_1_3_2_1_55_1","first-page":"687","article-title":"Bridging the gap between computer science and legal approaches to privacy","volume":"31","author":"Nissim Kobbi","year":"2017","unstructured":"Kobbi Nissim, Aaron Bembenek, Alexandra Wood, Mark Bun, Marco Gaboardi, Urs Gasser, David\u00a0R O\u2019Brien, Thomas Steinke, and Salil Vadhan. 2017. Bridging the gap between computer science and legal approaches to privacy. Harv. JL & Tech. 31 (2017), 687.","journal-title":"Harv. JL & Tech."},{"key":"e_1_3_2_1_56_1","volume-title":"Is privacy privacy?Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 376, 2128","author":"Nissim Kobbi","year":"2018","unstructured":"Kobbi Nissim and Alexandra Wood. 2018. Is privacy privacy?Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 376, 2128 (2018), 20170358."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.32604\/cmc.2023.031491"},{"key":"e_1_3_2_1_58_1","volume-title":"How to dp-fy ml: A practical guide to machine learning with differential privacy. arXiv preprint arXiv:2303.00654","author":"Ponomareva Natalia","year":"2023","unstructured":"Natalia Ponomareva, Hussein Hazimeh, Alex Kurakin, Zheng Xu, Carson Denison, H\u00a0Brendan McMahan, Sergei Vassilvitskii, Steve Chien, and Abhradeep Thakurta. 2023. How to dp-fy ml: A practical guide to machine learning with differential privacy. arXiv preprint arXiv:2303.00654 (2023)."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.56553\/popets-2023-0043"},{"key":"e_1_3_2_1_60_1","volume-title":"Anonymization Level and Compliance for Differential Privacy: A Systematic Literature Review. 2022 International Wireless Communications and Mobile Computing (IWCMC)","author":"Prokhorenkov Dmitry","year":"2022","unstructured":"Dmitry Prokhorenkov. 2022. Anonymization Level and Compliance for Differential Privacy: A Systematic Literature Review. 2022 International Wireless Communications and Mobile Computing (IWCMC) (2022), 1119\u20131124."},{"key":"e_1_3_2_1_61_1","volume-title":"Toward Compliance Implications and Security Objectives: A Qualitative Study. In 2023 IEEE 39th International Conference on Data Engineering Workshops (ICDEW). IEEE, 138\u2013145","author":"Prokhorenkov Dmitry","year":"2023","unstructured":"Dmitry Prokhorenkov. 2023. Toward Compliance Implications and Security Objectives: A Qualitative Study. In 2023 IEEE 39th International Conference on Data Engineering Workshops (ICDEW). IEEE, 138\u2013145."},{"key":"e_1_3_2_1_62_1","volume-title":"Privacy technologies and policy. Edited by S. Schiffner et al 11498","author":"Schiffner Stefan","year":"2019","unstructured":"Stefan Schiffner, Jetzabel Serna, Demosthenes Ikonomou, and Kai Rannenberg. 2019. Privacy technologies and policy. Edited by S. Schiffner et al 11498 (2019)."},{"key":"e_1_3_2_1_63_1","volume-title":"International Conference on Computer Ethics, Vol.\u00a01.","author":"Seeman Jeremy","year":"2023","unstructured":"Jeremy Seeman. 2023. Framing Effects in the Operationalization of Differential Privacy Systems as Code-Driven Law. In International Conference on Computer Ethics, Vol.\u00a01."},{"key":"e_1_3_2_1_64_1","volume-title":"Privacy enhancing technologies: A review","author":"Shen Yun","year":"2011","unstructured":"Yun Shen and Siani Pearson. 2011. Privacy enhancing technologies: A review. Hewlet Packard Development Company. Disponible en https:\/\/bit. ly\/3cfpAKz (2011)."},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.41"},{"key":"e_1_3_2_1_66_1","volume-title":"A taxonomy of privacy","author":"Solove J","unstructured":"Daniel\u00a0J Solove. 2006. A taxonomy of privacy. University of Pennsylvania law review (2006), 477\u2013564."},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3134077"},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE51399.2021.00020"},{"key":"e_1_3_2_1_69_1","unstructured":"Florian Tram\u00e8r Fan Zhang Ari Juels Michael\u00a0K Reiter and Thomas Ristenpart. 2016. Stealing Machine Learning Models via Prediction APIs.. In USENIX security symposium Vol.\u00a016. 601\u2013618."},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPS-ISA48467.2019.00019"},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2018.00038"},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0169"},{"key":"e_1_3_2_1_73_1","volume-title":"Fast-adapting and privacy-preserving federated recommender system. The VLDB Journal","author":"Wang Qinyong","year":"2021","unstructured":"Qinyong Wang, Hongzhi Yin, Tong Chen, Junliang Yu, Alexander Zhou, and Xiangliang Zhang. 2021. Fast-adapting and privacy-preserving federated recommender system. The VLDB Journal (2021), 1\u201320."},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2016.2584610"},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2987435"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSS.2023.3243089"},{"key":"e_1_3_2_1_77_1","volume-title":"Privacy risk in machine learning: Analyzing the connection to overfitting. In 2018 IEEE 31st computer security foundations symposium (CSF)","author":"Yeom Samuel","unstructured":"Samuel Yeom, Irene Giacomelli, Matt Fredrikson, and Somesh Jha. 2018. Privacy risk in machine learning: Analyzing the connection to overfitting. In 2018 IEEE 31st computer security foundations symposium (CSF). IEEE, 268\u2013282."}],"event":{"name":"BuildSys '23: The 10th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation","location":"Istanbul Turkey","acronym":"BuildSys '23"},"container-title":["Proceedings of the 10th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3600100.3625373","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3600100.3625373","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T21:29:41Z","timestamp":1755898181000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3600100.3625373"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,15]]},"references-count":77,"alternative-id":["10.1145\/3600100.3625373","10.1145\/3600100"],"URL":"https:\/\/doi.org\/10.1145\/3600100.3625373","relation":{},"subject":[],"published":{"date-parts":[[2023,11,15]]},"assertion":[{"value":"2023-11-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}