{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T06:41:59Z","timestamp":1776840119891,"version":"3.51.2"},"reference-count":30,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T00:00:00Z","timestamp":1722297600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Fundamental Research Funds for the Central Universities","award":["23CX03012A"],"award-info":[{"award-number":["23CX03012A"]}]},{"name":"Fundamental Research Funds for the Central Universities","award":["2021YFA1000102"],"award-info":[{"award-number":["2021YFA1000102"]}]},{"name":"National Key Research and Development Program of China","award":["23CX03012A"],"award-info":[{"award-number":["23CX03012A"]}]},{"name":"National Key Research and Development Program of China","award":["2021YFA1000102"],"award-info":[{"award-number":["2021YFA1000102"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Axioms"],"abstract":"<jats:p>Transfer learning, as a machine learning approach enhancing model generalization across different domains, has extensive applications in various fields. However, the risk of privacy leakage remains a crucial consideration during the transfer learning process. Differential privacy, with its rigorous mathematical foundation, has been proven to offer consistent and robust privacy protection. This study delves into the logistic regression transfer learning problem supported by differential privacy. In cases where transferable sources are known, we propose a two-step transfer learning algorithm. For scenarios with unknown transferable sources, a non-algorithmic, cross-validation-based transferable source detection method is introduced, to mitigate adverse effects from non-informative sources. The effectiveness of the proposed algorithm is validated through simulations and experiments with real-world data.<\/jats:p>","DOI":"10.3390\/axioms13080517","type":"journal-article","created":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T15:25:23Z","timestamp":1722353123000},"page":"517","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Transfer Learning for Logistic Regression with Differential Privacy"],"prefix":"10.3390","volume":"13","author":[{"given":"Yiming","family":"Hou","sequence":"first","affiliation":[{"name":"College of Science, China University of Petroleum, Qingdao 266580, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yunquan","family":"Song","sequence":"additional","affiliation":[{"name":"College of Science, China University of Petroleum, Qingdao 266580, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Gyorfi, L., Ottucsak, G., and Walk, H. (2012). Machine Learning for Financial Engineering, World Scientific.","DOI":"10.1142\/9781848168145"},{"key":"ref_2","unstructured":"Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L.D., Monfort, M., Muller, U., and Zhang, J. (2016). End to end learning for self-driving cars. arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1038\/s41551-022-00898-y","article-title":"Shifting machine learning for healthcare from development to deployment and from models to data","volume":"6","author":"Zhang","year":"2022","journal-title":"Nat. Biomed. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4773","DOI":"10.1080\/00207543.2021.1956675","article-title":"Machine learning in manufacturing and industry 4.0 applications","volume":"59","author":"Rai","year":"2021","journal-title":"Int. J. Prod. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1142\/S0218488502001648","article-title":"k-anonymity: A model for protecting privacy","volume":"10","author":"Sweeney","year":"2002","journal-title":"Int. J. Uncertain. Fuzziness -Knowl.-Based Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1561\/0400000042","article-title":"The algorithmic foundations of differential privacy","volume":"9","author":"Dwork","year":"2014","journal-title":"Found. Trends Theor. Comput. Sci."},{"key":"ref_7","first-page":"1069","article-title":"Differentially private empirical risk minimization","volume":"12","author":"Chaudhuri","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_8","first-page":"8079839","article-title":"Differentially private m-estimators","volume":"24","author":"Lei","year":"2011","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, J., Zhang, Z., Xiao, X., Yang, Y., and Winslett, M. (2012). Functional mechanism: Regression analysis under differential privacy. arXiv.","DOI":"10.14778\/2350229.2350253"},{"key":"ref_10","unstructured":"Kifer, D., Smith, A., and Thakurta, A. (2012, January 25\u201327). Private convex empirical risk minimization and high-dimensional regression. Proceedings of the Conference on Learning Theory, JMLR Workshop and Conference Proceedings, Edinburgh, Scotland."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Smith, A. (2011, January 6\u20138). Privacy-preserving statistical estimation with optimal convergence rates. Proceedings of the Forty-Third Annual ACM Symposium on Theory of Computing, San Jose, CA, USA.","DOI":"10.1145\/1993636.1993743"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1080\/10618600.2018.1538881","article-title":"Differentially private significance tests for regression coefficients","volume":"28","author":"Barrientos","year":"2019","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2825","DOI":"10.1214\/21-AOS2058","article-title":"The cost of privacy: Optimal rates of convergence for parameter estimation with differential privacy","volume":"49","author":"Cai","year":"2021","journal-title":"Ann. Stat."},{"key":"ref_14","first-page":"278736","article-title":"Privacy-preserving logistic regression","volume":"21","author":"Chaudhuri","year":"2008","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Khanna, A., Lu, F., Raff, E., and Testa, B. (2023, January 30). Differentially Private Logistic Regression with Sparse Solutions. Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security, Copenhagen, Denmark.","DOI":"10.1145\/3605764.3623910"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xu, D., Yuan, S., and Wu, X. Achieving differential privacy and fairness in logistic regression. Proceedings of the Companion Proceedings of the 2019 World Wide Web Conference, San Francisco, CA, USA, 13\u201317 May 2019.","DOI":"10.1145\/3308560.3317584"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"102769","DOI":"10.1016\/j.jnca.2020.102769","article-title":"Privacy preserving based logistic regression on big data","volume":"171","author":"Fan","year":"2020","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ji, Z., Jiang, X., Wang, S., Xiong, L., and Ohno-Machado, L. (2014). Differentially private distributed logistic regression using private and public data. BMC Med Genom., 7.","DOI":"10.1186\/1755-8794-7-S1-S14"},{"key":"ref_19","first-page":"147613","article-title":"Discriminability-based transfer between neural networks","volume":"5","author":"Pratt","year":"1992","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_20","first-page":"1016169","article-title":"Is learning the n-th thing any easier than learning the first?","volume":"8","author":"Thrun","year":"1995","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_21","unstructured":"Bianchi, A., Vendra, M.R., Protopapas, P., and Brambilla, M. (2019). Improving image classification robustness through selective cnn-filters fine-tuning. arXiv."},{"key":"ref_22","unstructured":"Zhu, Z., Li, Y., Li, R., and Gu, X. (2018, January 17\u201319). Distant Domain Adaptation for Text Classification. Proceedings of the Knowledge Science, Engineering and Management: 11th International Conference, KSEM 2018, Changchun, China. Proceedings, Part I 11."},{"key":"ref_23","unstructured":"Fawaz, H.I., Forestier, G., Weber, J., Idoumghar, L., and Muller, P.A. (2018). Transfer learning for time series classification. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1111\/rssb.12479","article-title":"Transfer learning for high-dimensional linear regression: Prediction, estimation and minimax optimality","volume":"84","author":"Li","year":"2022","journal-title":"J. R. Stat. Soc. Ser. B Stat. Methodol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2964","DOI":"10.1287\/mnsc.2020.3729","article-title":"Predicting with proxies: Transfer learning in high dimension","volume":"67","author":"Bastani","year":"2021","journal-title":"Manag. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2684","DOI":"10.1080\/01621459.2022.2071278","article-title":"Transfer learning under high-dimensional generalized linear models","volume":"118","author":"Tian","year":"2022","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_27","unstructured":"Yang, F., Zhang, H.R., Wu, S., Su, W.J., and R\u00e9, C. (2020). Analysis of information transfer from heterogeneous sources via precise high-dimensional asymptotics. arXiv."},{"key":"ref_28","unstructured":"Zhou, D., Liu, M., Li, M., and Cai, T. (2022). Doubly robust augmented model accuracy transfer inference with high dimensional features. arXiv."},{"key":"ref_29","unstructured":"Lin, H., and Reimherr, M. (2022). On transfer learning in functional linear regression. arXiv."},{"key":"ref_30","first-page":"14266","article-title":"Transfer Learning via ell_1 Regularization","volume":"33","author":"Takada","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Axioms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-1680\/13\/8\/517\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:26:31Z","timestamp":1760109991000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-1680\/13\/8\/517"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,30]]},"references-count":30,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["axioms13080517"],"URL":"https:\/\/doi.org\/10.3390\/axioms13080517","relation":{},"ISSN":["2075-1680"],"issn-type":[{"value":"2075-1680","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,30]]}}}