{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T17:38:43Z","timestamp":1784137123146,"version":"3.55.0"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,10,6]],"date-time":"2023-10-06T00:00:00Z","timestamp":1696550400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2024,3,31]]},"abstract":"<jats:p>This tutorial studies relations between differential privacy and various information-theoretic measures by using several selective articles. In particular, we present how these connections can provide new interpretations for the privacy guarantee in systems that deploy differential privacy in an information-theoretic framework. Accordingly, the tutorial delivers an extensive summary on the existing literature that makes use of information-theoretic measures and tools such as mutual information, min-entropy, Kullback-Leibler divergence, and rate-distortion function for quantification and characterization of differential privacy in various settings.<\/jats:p>","DOI":"10.1145\/3604904","type":"journal-article","created":{"date-parts":[[2023,6,17]],"date-time":"2023-06-17T08:41:02Z","timestamp":1686991262000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Information-Theoretic Approaches to Differential Privacy"],"prefix":"10.1145","volume":"56","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5313-1168","authenticated-orcid":false,"given":"Ay\u015fe","family":"\u00dcnsal","sequence":"first","affiliation":[{"name":"Digital Security Department, EURECOM, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0269-9495","authenticated-orcid":false,"given":"Melek","family":"\u00d6nen","sequence":"additional","affiliation":[{"name":"Digital Security Department, EURECOM, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,10,6]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313276.3316378"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29420-4_3"},{"key":"e_1_3_1_4_2","unstructured":"M\u00e1rio S. Alvim Konstantinos Chatzikokolakis Pierpaolo Degano and Catuscia Palamidessi. 2010. Differential privacy versus quantitative information flow.  arXiv:1012.4250. https:\/\/arxiv.org\/abs\/1012.4250"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcss.2003.11.006"},{"key":"e_1_3_1_6_2","first-page":"67","volume-title":"42nd ACM Symposium on Theory of Computing","author":"Barak B.","year":"2010","unstructured":"B. Barak, M. Braverman, X. Chen, and A. Rao. 2010. How to compress interactive communication. In 42nd ACM Symposium on Theory of Computing. ACM, New York, NY, 67\u201376."},{"key":"e_1_3_1_7_2","first-page":"191","volume-title":"Computer Security Foundations Symposium","author":"Barthe G.","year":"2011","unstructured":"G. Barthe and B. K\u00f6pf. 2011. Information-theoretic bounds for differentially private mechanisms. In Computer Security Foundations Symposium. IEEE, New York, NY, 191\u2013204."},{"key":"e_1_3_1_8_2","first-page":"294","volume-title":"Advances in Cryptology-CRYPTO","author":"Bellare M.","year":"2012","unstructured":"M. Bellare, S. Tessaro, and A. Vardy. 2012. Semantic security for the wiretap channel. Advances in Cryptology-CRYPTO. Springer, Berlin, 294\u2013311."},{"key":"e_1_3_1_9_2","doi-asserted-by":"crossref","unstructured":"A. Chawla. 2021. Pegasus Spyware\u2014\u2018A Privacy Killer\u2019. (July2021). SSRN.","DOI":"10.2139\/ssrn.3890657"},{"key":"e_1_3_1_10_2","first-page":"43","volume-title":"CCS 2016","author":"Cuff P.","year":"2016","unstructured":"P. Cuff and L. Yu. 2016. Differential privacy as a mutual information constraint. In CCS 2016. Association for Computing Machinery, New York, NY, 43\u201354."},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-28914-9_18"},{"key":"e_1_3_1_12_2","volume-title":"International Conference on Learning Representations (ICLR\u201920)","author":"Du M.","year":"2020","unstructured":"M. Du, R. Jia, and D. Song. 2020. Robust anomaly detection and backdoor attack detection via differential privacy. In International Conference on Learning Representations (ICLR\u201920)."},{"key":"e_1_3_1_13_2","first-page":"1401","volume-title":"50th Annual Allerton Conference","author":"Calmon F. du Pin","year":"2012","unstructured":"F. du Pin Calmon and N. Fawaz. 2012. Privacy against statistical inference. In 50th Annual Allerton Conference. IEEE, New York, NY, 1401\u20131408."},{"key":"e_1_3_1_14_2","first-page":"1","volume-title":"Automata, Languages and Programming","author":"Dwork C.","year":"2006","unstructured":"C. Dwork. 2006. Differential privacy. Automata, Languages and Programming. Springer, Berlin, 1\u201312."},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-79228-4_1"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/11681878_14"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1561\/0400000042"},{"key":"e_1_3_1_18_2","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/FOCS.2010.12","volume-title":"51st Annual Symposium on Foundations of Computer Science (FOCS\u201910)","author":"Dwork C.","year":"2010","unstructured":"C. Dwork, G. N. Rothblum, and S. Vadhan. 2010. Boosting and differential privacy. In 51st Annual Symposium on Foundations of Computer Science (FOCS\u201910). IEEE Computer Society, NW Washington, DC, 51\u201360."},{"key":"e_1_3_1_19_2","doi-asserted-by":"crossref","first-page":"135","DOI":"10.29012\/jpc.v1i2.570","article-title":"Differential privacy for statistics: What we know and what we want to learn","volume":"1","author":"Dwork C.","year":"2010","unstructured":"C. Dwork and A. Smith. 2010. Differential privacy for statistics: What we know and what we want to learn. Journal of Privacy and Confidentiality 1, 2 (2010), 135\u2013154.","journal-title":"Journal of Privacy and Confidentiality"},{"key":"e_1_3_1_20_2","first-page":"1","article-title":"A systematic review of re-identification attacks on health data","volume":"6","author":"Emam K. E.","year":"2011","unstructured":"K. E. Emam, E. Jonker, L. Arbuckle, and B. Malin. 2011. A systematic review of re-identification attacks on health data. Plos One PMC 6, 12 (2011), 1\u201312.","journal-title":"Plos One PMC"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2660267.2660348"},{"key":"e_1_3_1_22_2","first-page":"211","volume-title":"22nd ACM Symposium on Principles of Database Systems","author":"Evfimievski A.","year":"2003","unstructured":"A. Evfimievski, J. Gehrke, and R. Srikant. 2003. Limiting privacy breaches in privacy preserving data mining. In 22nd ACM Symposium on Principles of Database Systems. ACM, New York, NY, 211\u2013222."},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2022\/766"},{"key":"e_1_3_1_24_2","first-page":"2371","volume-title":"IEEE International Symposium on Information Theory","author":"Geng Q.","year":"2014","unstructured":"Q. Geng and P. Viswanath. 2014. The optimal mechanism in differential privacy. In IEEE International Symposium on Information Theory. IEEE, New York, NY, 2371\u20132375."},{"key":"e_1_3_1_25_2","unstructured":"C. Hirche C. Rouz\u00e9 and D. S. Fran\u00e7a. 2023. Quantum differential privacy: An information theory perspective. arXiv:2202.10717. Retrieved from https:\/\/arxiv.org\/abs\/2202.10717."},{"key":"e_1_3_1_26_2","first-page":"4037","volume-title":"32nd International Conference on Machine Learning","author":"Kairouz P.","year":"2015","unstructured":"P. Kairouz, S. Oh, and P. Viswanath. 2015. The composition theorem for differential privacy. In 32nd International Conference on Machine Learning. JMLR, Inc. and Microtome Publishing, 4037\u20134049."},{"key":"e_1_3_1_27_2","first-page":"1054","volume-title":"IEEE Symposium on Security and Privacy","author":"Lecuyer M.","year":"2019","unstructured":"M. Lecuyer, V. Atlidakis, R. Geambasu, D. Hsu, and S. Jana. 2019. Certified robustness to adversarial examples with differential privacy. In IEEE Symposium on Security and Privacy. 1054\u20131067."},{"key":"e_1_3_1_28_2","first-page":"1","volume-title":"2019 IEEE International Workshop on Information Forensics and Security (WIFS\u201919)","author":"Lin P. H.","year":"2019","unstructured":"P. H. Lin, C. Kuhn, T. Strufe, and E. A. Jorswieck. 2019. Physical layer privacy in broadcast channels. In 2019 IEEE International Workshop on Information Forensics and Security (WIFS\u201919). IEEE, 1\u20136."},{"key":"e_1_3_1_29_2","first-page":"454","volume-title":"AMIA 2002 Annual Symposium Proceedings","author":"Lin Z.","year":"2002","unstructured":"Z. Lin, M. Hewett, and R. B. Altman. 2002. Using binning to maintain confidentiality of medical data. In AMIA 2002 Annual Symposium Proceedings. 454\u2013458."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2008.4497436"},{"key":"e_1_3_1_31_2","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/FOCS.2010.14","volume-title":"51st Annual Symposium on Foundations of Computer Science (FOCS\u201910)","author":"McGregor A.","year":"2010","unstructured":"A. McGregor, I. Mironov, T. Pitassi, O. Reingold, K. Talwar, and S. Vadhan. 2010. The limits of two-party differential privacy. In 51st Annual Symposium on Foundations of Computer Science (FOCS\u201910). IEEE Computer Society, NW Washington, DC, 81\u201390."},{"key":"e_1_3_1_32_2","first-page":"206","volume-title":"International Workshop on Privacy and Anonymity in the Information Society PAIS","author":"Mir D. J.","year":"2012","unstructured":"D. J. Mir. 2012. Differentially-private learning and information theory. In International Workshop on Privacy and Anonymity in the Information Society PAIS. ACM, New York, NY, 206\u2013210."},{"key":"e_1_3_1_33_2","first-page":"374","volume-title":"International Symposium of Foundations on Practice of Security","author":"Mir D. J.","year":"2012","unstructured":"D. J. Mir. 2012. Information theoretic foundations of differential privacy. In International Symposium of Foundations on Practice of Security. Springer, Berlin, 374\u2013381."},{"key":"e_1_3_1_34_2","first-page":"111","volume-title":"IEEE Symposium on Security and Privacy","author":"Narayanan A.","year":"2008","unstructured":"A. Narayanan and V. Shmatikov. 2008. Robust de-anonymization of large sparse datasets. In IEEE Symposium on Security and Privacy. IEEE, New York, NY, 111\u2013125."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2019.2959976"},{"key":"e_1_3_1_36_2","volume-title":"Communication Complexity and Information Complexity","author":"Pankratov D.","year":"2015","unstructured":"D. Pankratov. 2015. Communication Complexity and Information Complexity. Ph.D. Dissertation. The University of Chicago."},{"key":"e_1_3_1_37_2","first-page":"1","article-title":"Locally differentially private randomized response for discrete distribution learning","volume":"22","author":"Pastore A.","year":"2021","unstructured":"A. Pastore and M. Gastpar. 2021. Locally differentially private randomized response for discrete distribution learning. Journal on Machine Learning Research 22 (July2021), 1\u201356.","journal-title":"Journal on Machine Learning Research"},{"key":"e_1_3_1_38_2","volume-title":"Proceedings of the 37th International Conference on Machine Learning (ICML\u201920)","author":"Phan NhatHai","year":"2020","unstructured":"NhatHai Phan, My T. Thai, Han Hu, Ruoming Jin, Tong Sun, and Dejing Dou. 2020. Scalable differential privacy with certified robustness in adversarial learning. In Proceedings of the 37th International Conference on Machine Learning (ICML\u201920). JMLR.org, Article 712, 12 pages."},{"key":"e_1_3_1_39_2","volume-title":"Workshop on Machine Learning for CyberSecurity at ECMLPKDD 2019","author":"Pinot Rafael","year":"2019","unstructured":"Rafael Pinot, Florian Yger, Cedric Gouy-Pailler, and Jamal Atif. 2019. A unified view on differential privacy and robustness to adversarial examples. In Workshop on Machine Learning for CyberSecurity at ECMLPKDD 2019. https:\/\/hal.science\/hal-02892170."},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/AFRCON.2017.8095692"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1142\/S0218488502001648"},{"key":"e_1_3_1_42_2","first-page":"1","volume-title":"IEEE Information Theory Workshop 2021","author":"\u00dcnsal A.","year":"2021","unstructured":"A. \u00dcnsal and M. \u00d6nen. 2021. A statistical threshold for adversarial classification in Laplace mechanisms. In IEEE Information Theory Workshop 2021. IEEE, New York, NY, 1\u20136."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.3390\/jcp2040042"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2016.2584610"},{"key":"e_1_3_1_45_2","unstructured":"G. Wu X. Xia and Y. He. 2021. Achieving Dalenius\u2019 Goal of Data Privacy with Practical Assumptions. (May2021). https:\/\/arxiv.org\/abs\/1703.07474v5."},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/2030613.2030630"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/CSF.2017.23"},{"key":"e_1_3_1_48_2","first-page":"2718","volume-title":"IEEE International Symposium on Information Theory (ISIT\u201909)","author":"Zhou S.","year":"2009","unstructured":"S. Zhou, K. Ligett, and L. Wasserman. 2009. Differential privacy with compression. In IEEE International Symposium on Information Theory (ISIT\u201909). IEEE, New York, NY, 2718\u20132722."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604904","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3604904","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:05Z","timestamp":1750178765000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604904"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,6]]},"references-count":47,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,3,31]]}},"alternative-id":["10.1145\/3604904"],"URL":"https:\/\/doi.org\/10.1145\/3604904","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,6]]},"assertion":[{"value":"2022-04-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-02","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}