{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T12:03:18Z","timestamp":1773316998184,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,8,4]],"date-time":"2022-08-04T00:00:00Z","timestamp":1659571200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Federated learning (FL) is a privacy-preserving distributed learning approach that allows multiple parties to jointly build machine learning models without disclosing sensitive data. Although FL has solved the problem of collaboration without compromising privacy, it has a significant communication overhead due to the repetitive updating of models during training. Several studies have proposed communication-efficient FL approaches to address this issue, but adequate solutions are still lacking in cases where parties must deal with different data features, also referred to as vertical federated learning (VFL). In this paper, we propose a communication-efficient approach for VFL that compresses the local data of clients, and then aggregates the compressed data from all clients to build an ML model. Since local data are shared in compressed form, the privacy of these data is preserved. Experiments on publicly available benchmark datasets using our proposed method show that the final model obtained by aggregation of compressed data from clients outperforms the performance of the local models of the clients.<\/jats:p>","DOI":"10.3390\/a15080273","type":"journal-article","created":{"date-parts":[[2022,8,4]],"date-time":"2022-08-04T21:52:48Z","timestamp":1659649968000},"page":"273","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["Communication-Efficient Vertical Federated Learning"],"prefix":"10.3390","volume":"15","author":[{"given":"Afsana","family":"Khan","sequence":"first","affiliation":[{"name":"Department of Advanced Computing Sciences, Maastricht University, 6229 EN Maastricht, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7186-7344","authenticated-orcid":false,"given":"Marijn","family":"ten Thij","sequence":"additional","affiliation":[{"name":"Department of Advanced Computing Sciences, Maastricht University, 6229 EN Maastricht, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1989-0301","authenticated-orcid":false,"given":"Anna","family":"Wilbik","sequence":"additional","affiliation":[{"name":"Department of Advanced Computing Sciences, Maastricht University, 6229 EN Maastricht, The Netherlands"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ahmad, M.A., Eckert, C., and Teredesai, A. (September, January 29). Interpretable machine learning in healthcare. Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics, Washington, DC, USA.","DOI":"10.1145\/3233547.3233667"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Liakos, K.G., Busato, P., Moshou, D., Pearson, S., and Bochtis, D. (2018). Machine learning in agriculture: A review. Sensors, 18.","DOI":"10.3390\/s18082674"},{"key":"ref_3","first-page":"1","article-title":"Large scale distributed deep networks","volume":"25","author":"Dean","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_4","first-page":"1","article-title":"Federated learning","volume":"13","author":"Yang","year":"2019","journal-title":"Synth. Lect. Artif. Intell. Mach. Learn."},{"key":"ref_5","unstructured":"Sun, J., Yang, X., Yao, Y., Zhang, A., Gao, W., Xie, J., and Wang, C. (2021). Vertical Federated Learning without Revealing Intersection Membership. arXiv."},{"key":"ref_6","unstructured":"Gasc\u00f3n, A., Schoppmann, P., Balle, B., Raykova, M., Doerner, J., Zahur, S., and Evans, D. (2016). Secure Linear Regression on Vertically Partitioned Datasets. IACR Cryptol. ePrint Arch., 2016."},{"key":"ref_7","unstructured":"Hardy, S., Henecka, W., Ivey-Law, H., Nock, R., Patrini, G., Smith, G., and Thorne, B. (2017). Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hou, J., Su, M., Fu, A., and Yu, Y. (2021). Verifiable Privacy-preserving Scheme based on Vertical Federated Random Forest. IEEE Internet Things J.","DOI":"10.1109\/JIOT.2021.3090951"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3400","DOI":"10.1109\/TNNLS.2019.2944481","article-title":"Robust and communication-efficient federated learning from non-iid data","volume":"31","author":"Sattler","year":"2019","journal-title":"IEEE Trans. Neural Networks Learn. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chen, M., Shlezinger, N., Poor, H.V., Eldar, Y.C., and Cui, S. (2021). Communication-efficient federated learning. Proc. Natl. Acad. Sci. USA, 118.","DOI":"10.1073\/pnas.2024789118"},{"key":"ref_11","unstructured":"Guha, N., Talwalkar, A., and Smith, V. (2019). One-shot federated learning. arXiv."},{"key":"ref_12","unstructured":"Bui, T.D., Nguyen, C.V., Swaroop, S., and Turner, R.E. (2018). Partitioned variational inference: A unified framework encompassing federated and continual learning. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Li, Q., He, B., and Song, D. (2020). Practical one-shot federated learning for cross-silo setting. arXiv.","DOI":"10.24963\/ijcai.2021\/205"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kasturi, A., Ellore, A.R., and Hota, C. (2020, January 16\u201318). Fusion learning: A one shot federated learning. Proceedings of the International Conference on Computational Science, Krakow, Poland.","DOI":"10.1007\/978-3-030-50420-5_31"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Seide, F., Fu, H., Droppo, J., Li, G., and Yu, D. (2014, January 14\u201318). 1-bit stochastic gradient descent and its application to data-parallel distributed training of speech dnns. Proceedings of the 15th Annual Conference of the International Speech Communication Association, Singapore.","DOI":"10.21437\/Interspeech.2014-274"},{"key":"ref_16","first-page":"1","article-title":"QSGD: Communication-efficient SGD via gradient quantization and encoding","volume":"30","author":"Alistarh","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_17","unstructured":"Bernstein, J., Wang, Y.X., Azizzadenesheli, K., and Anandkumar, A. (2018, January 10\u201315). signSGD: Compressed optimisation for non-convex problems. Proceedings of the International Conference on Machine Learning. PMLR, Stockholm, Sweden."},{"key":"ref_18","unstructured":"Amiri, M.M., Gunduz, D., Kulkarni, S.R., and Poor, H.V. (2020). Federated learning with quantized global model updates. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/IOTM.001.2100173","article-title":"FL-SEC: Privacy-Preserving Decentralized Federated Learning Using SignSGD for the Internet of Artificially Intelligent Things","volume":"5","author":"Qu","year":"2022","journal-title":"IEEE Internet Things Mag."},{"key":"ref_20","first-page":"1","article-title":"Gradient sparsification for communication-efficient distributed optimization","volume":"31","author":"Wangni","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Strom, N. (2015, January 6\u201310). Scalable distributed DNN training using commodity GPU cloud computing. Proceedings of the 16th Annual Conference of the International Speech Communication Association, Dresden, Germany.","DOI":"10.21437\/Interspeech.2015-354"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fikri Aji, A., and Heafield, K. (2017). Sparse Communication for Distributed Gradient Descent. arXiv.","DOI":"10.18653\/v1\/D17-1045"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Han, P., Wang, S., and Leung, K.K. (2020, January 8\u201310). Adaptive gradient sparsification for efficient federated learning: An online learning approach. Proceedings of the 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS), Singapore.","DOI":"10.1109\/ICDCS47774.2020.00026"},{"key":"ref_24","unstructured":"Liu, Y., Kang, Y., Li, L., Zhang, X., Cheng, Y., Chen, T., Hong, M., and Yang, Q. (2019). A communication efficient vertical federated learning framework. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Gu, B., Deng, C., Gu, S., Bo, L., Pei, J., and Huang, H. (2021, January 14\u201318). AsySQN: Faster Vertical Federated Learning Algorithms with Better Computation Resource Utilization. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, Singapore.","DOI":"10.1145\/3447548.3467169"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, M., Chen, Y., Wang, Y., and Pan, Y. (2020, January 13\u201315). Efficient asynchronous vertical federated learning via gradient prediction and double-end sparse compression. Proceedings of the 2020 16th International Conference on Control, Automation, Robotics and Vision (ICARCV), Shenzhen, China.","DOI":"10.1109\/ICARCV50220.2020.9305383"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1002\/wics.101","article-title":"Principal component analysis","volume":"2","author":"Abdi","year":"2010","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2426","DOI":"10.2514\/3.5008","article-title":"Rates of change of eigenvalues and eigenvectors","volume":"6","author":"Fox","year":"1968","journal-title":"AIAA J."},{"key":"ref_29","unstructured":"Dua, D., and Graff, C. (2017). Adult, UCI Machine Learning Repository."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1016\/0002-9149(89)90524-9","article-title":"International application of a new probability algorithm for the diagnosis of coronary artery disease","volume":"64","author":"Detrano","year":"1989","journal-title":"Am. J. Cardiol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1016\/j.dss.2009.05.016","article-title":"Modeling wine preferences by data mining from physicochemical properties","volume":"47","author":"Cortez","year":"2009","journal-title":"Decis. Support Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"188","DOI":"10.18201\/ijisae.2019355381","article-title":"Classification of rice varieties using artificial intelligence methods","volume":"7","author":"Cinar","year":"2019","journal-title":"Int. J. Intell. Syst. Appl. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1109\/72.661126","article-title":"On relative convergence properties of principal component analysis algorithms","volume":"9","author":"Chatterjee","year":"1998","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_34","unstructured":"Nguyen, T.V., Wong, R.K., and Hegde, C. (2019, January 16\u201318). On the dynamics of gradient descent for autoencoders. Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics, PMLR, Okinawa, Japan."},{"key":"ref_35","unstructured":"Kleinbaum, D.G., Dietz, K., Gail, M., Klein, M., and Klein, M. (2002). Logistic Regression, Springer."},{"key":"ref_36","first-page":"1","article-title":"Knowledge-based support vector machine classifiers","volume":"15","author":"Fung","year":"2002","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/8\/273\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:04:04Z","timestamp":1760141044000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/8\/273"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,4]]},"references-count":36,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["a15080273"],"URL":"https:\/\/doi.org\/10.3390\/a15080273","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,4]]}}}