{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T18:09:33Z","timestamp":1783620573606,"version":"3.55.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,3,7]],"date-time":"2023-03-07T00:00:00Z","timestamp":1678147200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,7]],"date-time":"2023-03-07T00:00:00Z","timestamp":1678147200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Data are often correlated in real-world datasets. Existing data privacy algorithms did not consider data correlation an inherent property of datasets. This data correlation caused privacy leakages that most researchers left unnoticed. Such privacy leakages are often caused by homogeneity, background knowledge, and linkage attacks, and the probability of such attacks increases with the magnitude of correlation among data. This problem further got magnified by the large size of real-world datasets, and we refer to these large datasets as \u2019Big Data.\u2019 Several researchers proposed algorithms using machine learning models, correlation analysis, and data privacy algorithms to prevent privacy leakages due to correlation in large-sized data. The current proposed work first analyses the correlation among data. We studied the Mutual Information Correlation analysis technique and the distance correlation analysis technique for data correlation analysis. We found out distance correlation analysis technique to be more accurate for high-dimensional data. It then divides the data into blocks using the correlation computed earlier and applies the differential privacy algorithm to ensure the data privacy expectations. The results are derived based upon multiple parameters such as data utility, mean average error, variation with data size, and privacy budget values. The results showed that the proposed methodology provides better data utility when compared to the works of other researchers. Also, the data privacy commitments offered by the proposed method are comparable to the other results. Thus, the proposed methodology gives a better data utility while maintaining the required data privacy commitments.<\/jats:p>","DOI":"10.1186\/s40537-023-00705-8","type":"journal-article","created":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T00:21:26Z","timestamp":1680740486000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Enhancing correlated big data privacy using differential privacy and machine learning"],"prefix":"10.1186","volume":"10","author":[{"given":"Sreemoyee","family":"Biswas","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anuja","family":"Fole","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nilay","family":"Khare","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pragati","family":"Agrawal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,3,7]]},"reference":[{"issue":"39","key":"705_CR1","first-page":"1","volume":"01","author":"JY Liang","year":"2016","unstructured":"Liang JY, Feng CJ, Song P. A survey on correlation analysis of big data. J Soft. 2016;01(39):1\u201318.","journal-title":"J Soft"},{"issue":"334","key":"705_CR2","doi-asserted-by":"publisher","first-page":"1518","DOI":"10.1126\/science.1205438","volume":"12","author":"D Reshef","year":"2011","unstructured":"Reshef D, Reshef Y, Finucane H, Grossman S, McVean G, Turnbaugh P, et al. Detecting novel associations in large data sets. Science (New York, NY). 2011;12(334):1518\u201324.","journal-title":"Science (New York, NY)"},{"key":"705_CR3","first-page":"9","volume":"11","author":"HB Abdalla","year":"2022","unstructured":"Abdalla HB. A brief survey on big data: technologies, terminologies and data-intensive applications. J Big Data. 2022;11:9.","journal-title":"J Big Data"},{"key":"705_CR4","first-page":"1","volume":"12","author":"S Biswas","year":"2021","unstructured":"Biswas S, Khare N, Agrawal P, Jain P. Machine learning concepts for correlated Big Data privacy. J Big Data. 2021;12:1.","journal-title":"J Big Data."},{"key":"705_CR5","first-page":"82","volume":"05","author":"D Lv","year":"2019","unstructured":"Lv D, Zhu S. Achieving correlated differential privacy of big data publication. Comput Secur. 2019;05:82.","journal-title":"Comput Secur"},{"issue":"1","key":"705_CR6","doi-asserted-by":"publisher","first-page":"3-es","DOI":"10.1145\/1217299.1217302","volume":"1","author":"A Machanavajjhala","year":"2007","unstructured":"Machanavajjhala A, Kifer D, Gehrke J, Venkitasubramaniam M. L-diversity: privacy beyond k-anonymity. ACM Trans Knowl Discov Data. 2007;1(1):3-es.","journal-title":"ACM Trans Knowl Discov Data"},{"key":"705_CR7","doi-asserted-by":"crossref","unstructured":"Li N, Li T, Venkatasubramanian S. t-closeness: privacy beyond k-anonymity and l-diversity. In: 2007 IEEE 23rd international conference on data engineering; 2007. p. 106\u201315.","DOI":"10.1109\/ICDE.2007.367856"},{"key":"705_CR8","doi-asserted-by":"crossref","unstructured":"Dwork C. Differential privacy. In: 33rd international colloquium on automata, languages and programming, part II (ICALP 2006). vol. 4052 of lecture notes in computer science. New York: Springer; 2006. p. 1\u201312. Available from: https:\/\/www.microsoft.com\/en-us\/research\/publication\/differential-privacy\/.","DOI":"10.1007\/11787006_1"},{"key":"705_CR9","first-page":"1","volume":"1","author":"X Yang","year":"2017","unstructured":"Yang X, Wang T, Ren X, Yu W. Survey on improving data utility in differentially private sequential data publishing. IEEE Trans Big Data. 2017;1:1.","journal-title":"IEEE Trans Big Data"},{"key":"705_CR10","first-page":"3","volume":"11","author":"P Jain","year":"2016","unstructured":"Jain P, Gyanchandani M, Khare N. Big data privacy: a technological perspective and review. J Big Data. 2016;11:3.","journal-title":"J Big Data"},{"key":"705_CR11","first-page":"5","volume":"04","author":"P Jain","year":"2018","unstructured":"Jain P, Gyanchandani M, Khare N. Differential privacy: its technological prescriptive using big data. J Big Data. 2018;04:5.","journal-title":"J Big Data"},{"issue":"2","key":"705_CR12","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1109\/TIFS.2014.2368363","volume":"10","author":"T Zhu","year":"2015","unstructured":"Zhu T, Xiong P, Li G, Zhou W. Correlated differential privacy: hiding information in non-IID data set. IEEE Trans Inf Forensics Secur. 2015;10(2):229\u201342.","journal-title":"IEEE Trans Inf Forensics Secur"},{"key":"705_CR13","doi-asserted-by":"crossref","unstructured":"Kifer D, Machanavajjhala A. No free lunch in data privacy. In: Proceedings of the 2011 ACM SIGMOD international conference on management of data. SIGMOD\u201911. New York, NY, USA: Association for Computing Machinery; 2011. p. 193\u2013204. Available from: https:\/\/doi.org\/10.1145\/1989323.1989345.","DOI":"10.1145\/1989323.1989345"},{"key":"705_CR14","unstructured":"Wu G, Xia X, He Y. Extending differential privacy for treating dependent records via information theory; 2017, 03."},{"key":"705_CR15","doi-asserted-by":"crossref","unstructured":"Zhao J, Zhang J, Poor HV. Dependent differential privacy for correlated data; 2017. p. 1\u20137.","DOI":"10.1109\/GLOCOMW.2017.8269219"},{"issue":"9","key":"705_CR16","doi-asserted-by":"publisher","first-page":"2342","DOI":"10.1109\/TIFS.2019.2895970","volume":"14","author":"Y Li","year":"2019","unstructured":"Li Y, Ren X, Yang S, Yang X. Impact of prior knowledge and data correlation on privacy leakage: a unified analysis. IEEE Trans Inf Forensics Secur. 2019;14(9):2342\u201357.","journal-title":"IEEE Trans Inf Forensics Secur"},{"key":"705_CR17","doi-asserted-by":"crossref","unstructured":"Kumar S, Chong I. Correlation analysis to identify the effective data in machine learning: prediction of depressive disorder and emotion states. Int J Environ Res Public Health. 2018;15(12):1. Available from: https:\/\/www.mdpi.com\/1660-4601\/15\/12\/2907.","DOI":"10.3390\/ijerph15122907"},{"key":"705_CR18","first-page":"1","volume":"1","author":"X Yang","year":"2017","unstructured":"Yang X, Wang Teng RXYW. Survey on improving data utility in differentially private sequential data publishing. IEEE Trans Big Data. 2017;1:1.","journal-title":"IEEE Trans Big Data"},{"key":"705_CR19","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1007\/978-3-642-19571-6_26","volume-title":"Theory of cryptography","author":"J Gehrke","year":"2011","unstructured":"Gehrke J, Lui E, Pass R. Towards privacy for social networks: a zero-knowledge based definition of privacy. In: Ishai Y, editor. Theory of cryptography. Berlin: Springer; 2011. p. 432\u201349."},{"key":"705_CR20","first-page":"9","volume":"01","author":"CRMFe Belcastro","year":"2022","unstructured":"Belcastro CRMFe. Programming big data analysis: principles and solutions. J Big Data. 2022;01:9.","journal-title":"J Big Data"},{"key":"705_CR21","first-page":"39","volume":"01","author":"D Kifer","year":"2014","unstructured":"Kifer D, Machanavajjhala A. Pufferfish: a framework for mathematical privacy definitions. ACM Trans Datab Syst (TODS). 2014;01:39.","journal-title":"ACM Trans Datab Syst (TODS)"},{"key":"705_CR22","doi-asserted-by":"crossref","unstructured":"Yang B, Sato I, Nakagawa H. Bayesian differential privacy on correlated data; 2015.","DOI":"10.1145\/2723372.2747643"},{"key":"705_CR23","unstructured":"Wang Y, Song S, Chaudhuri K. Privacy-preserving analysis of correlated data; 2016. arXiv:1603.03977."},{"issue":"PP","key":"705_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TBDATA.2017.2777862","volume":"12","author":"J Chen","year":"2017","unstructured":"Chen J, Ma H, Zhao D, Liu L. Correlated differential privacy protection for mobile crowdsensing. IEEE Trans Big Data. 2017;12(PP):1.","journal-title":"IEEE Trans Big Data"},{"issue":"24","key":"705_CR25","first-page":"1","volume":"08","author":"L Cao","year":"2012","unstructured":"Cao L, Ou Y, Yu P. Coupled behavior analysis with applications. IEEE Trans Knowl Data Eng. 2012;08(24):1.","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"57","key":"705_CR26","first-page":"1358","volume":"08","author":"L Cao","year":"2013","unstructured":"Cao L. Non-IIDness learning in behavioral and social data. Comput J. 2013;08(57):1358\u201370.","journal-title":"Comput J"},{"issue":"23","key":"705_CR27","doi-asserted-by":"publisher","first-page":"653","DOI":"10.1007\/s00778-013-0344-8","volume":"08","author":"R Chen","year":"2014","unstructured":"Chen R, Fung B, Yu P, Desai B. Correlated network data publication via differential privacy. VLDB J. 2014;08(23):653\u201376.","journal-title":"VLDB J"},{"issue":"3","key":"705_CR28","doi-asserted-by":"publisher","first-page":"1650","DOI":"10.1007\/s12083-021-01078-6","volume":"14","author":"D Hemkumar","year":"2021","unstructured":"Hemkumar D, Ravichandra S, Somayajulu DVLN. Impact of data correlation on privacy budget allocation in continuous publication of location statistics. Peer-to-Peer Netw Appl. 2021;14(3):1650\u201365.","journal-title":"Peer-to-Peer Netw Appl"},{"issue":"04","key":"705_CR29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TBDATA.2017.2717439","volume":"7","author":"J Chen","year":"2021","unstructured":"Chen J, Ma H, Zhao D, Liu L. Correlated differential privacy protection for mobile crowdsensing. IEEE Trans Big Data. 2021;7(04):1.","journal-title":"IEEE Trans Big Data."},{"key":"705_CR30","first-page":"9","volume":"02","author":"CSDDEAF Cerruto","year":"2022","unstructured":"Cerruto CSDDEAF. Social network data analysis to highlight privacy threats in sharing data. J Big Data. 2022;02:9.","journal-title":"J Big Data"},{"key":"705_CR31","doi-asserted-by":"crossref","unstructured":"Song Y, Cao L, Wu X, Wei G, Ye W, Ding W. Coupled behavior analysis for capturing coupling relationships in group-based market manipulations. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining; 2012.","DOI":"10.1145\/2339530.2339683"},{"key":"705_CR32","doi-asserted-by":"crossref","unstructured":"Dwork C, Roth A. The algorithmic foundations of differential privacy. Found Trends Theor Comput Sci. 2014;9(3\u20134):211\u2013407. Available from: https:\/\/doi.org\/10.1561\/0400000042.","DOI":"10.1561\/0400000042"},{"key":"705_CR33","doi-asserted-by":"crossref","unstructured":"Sz\u00e9kely GJ, Rizzo ML, Bakirov NK. Measuring and testing dependence by correlation of distances. Ann Stat. 2007;35(6):2769\u201394. Available from: http:\/\/www.jstor.org\/stable\/25464608.","DOI":"10.1214\/009053607000000505"},{"key":"705_CR34","first-page":"6","volume":"03","author":"P Jain","year":"2019","unstructured":"Jain P, Gyanchandani M, Khare N. Enhanced secured map reduce layer for big data privacy and security. J Big Data. 2019;03:6.","journal-title":"J Big Data"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00705-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-023-00705-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00705-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T00:22:15Z","timestamp":1680740535000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-023-00705-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,7]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["705"],"URL":"https:\/\/doi.org\/10.1186\/s40537-023-00705-8","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,7]]},"assertion":[{"value":"23 March 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 February 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"All authors have given consent for publication of the matter.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"30"}}