{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,16]],"date-time":"2025-07-16T13:47:56Z","timestamp":1752673676791,"version":"3.37.3"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,17]],"date-time":"2023-08-17T00:00:00Z","timestamp":1692230400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,17]],"date-time":"2023-08-17T00:00:00Z","timestamp":1692230400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61876123"],"award-info":[{"award-number":["61876123"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100013317","name":"Shanxi Provincial Key Research and Development Project","doi-asserted-by":"publisher","award":["202102020101002"],"award-info":[{"award-number":["202102020101002"]}],"id":[{"id":"10.13039\/501100013317","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004480","name":"Natural Science Foundation of Shanxi Province","doi-asserted-by":"publisher","award":["202203021211194"],"award-info":[{"award-number":["202203021211194"]}],"id":[{"id":"10.13039\/501100004480","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2024,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Federated learning has been shown to be efficient for training a global model without needing to collect all data from multiple entities to the centralized server. However, the model performance, communication traffic, and data privacy and security are still the focus of federated learning after it has been developed. In this paper, a composition\u2013decomposition based federated learning, denoted as CD-FL, is proposed. In the CD-FL approach, the global model, composed of <jats:italic>K<\/jats:italic> sub-models with the same framework, will be decomposed and broadcast to all clients. Each client will randomly choose a sub-model, update its parameters using its own dataset, and upload this sub-model to the server. All sub-models, including the sub-models before and after updating, will be clustered into <jats:italic>K<\/jats:italic> clusters to form the global model of the next round. Experimental results on Fashion-MNIST, CIFAR-10, EMNIST, and Tiny-IMAGENET datasets show the efficiency of the model performance and communication traffic of the proposed method.<\/jats:p>","DOI":"10.1007\/s40747-023-01198-x","type":"journal-article","created":{"date-parts":[[2023,8,17]],"date-time":"2023-08-17T10:02:11Z","timestamp":1692266531000},"page":"1027-1042","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A composition\u2013decomposition based federated learning"],"prefix":"10.1007","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8011-8222","authenticated-orcid":false,"given":"Chaoli","family":"Sun","sequence":"first","affiliation":[]},{"given":"Xiaojun","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Junwei","family":"Ma","sequence":"additional","affiliation":[]},{"given":"Gang","family":"Xie","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,8,17]]},"reference":[{"key":"1198_CR1","doi-asserted-by":"crossref","unstructured":"Wang C, Cheng M, Hu X, Huang J (2021) Easyasr: a distributed machine learning platform for end-to-end automatic speech recognition. In: Proceedings of the AAAI Conference on Artificial Intelligence 35:16111\u201316113","DOI":"10.1609\/aaai.v35i18.18028"},{"issue":"3","key":"1198_CR2","doi-asserted-by":"publisher","first-page":"362","DOI":"10.1002\/rob.21918","volume":"37","author":"S Grigorescu","year":"2020","unstructured":"Grigorescu S, Trasnea B, Cocias T, Macesanu G (2020) A survey of deep learning techniques for autonomous driving. J Field Robot 37(3):362\u2013386","journal-title":"J Field Robot"},{"issue":"32","key":"1198_CR3","doi-asserted-by":"publisher","first-page":"6569","DOI":"10.2174\/0929867328666201218122633","volume":"28","author":"V Visco","year":"2021","unstructured":"Visco V, Ferruzzi GJ, Nicastro F, Virtuoso N, Carrizzo A, Galasso G, Vecchione C, Ciccarelli M (2021) Artificial intelligence as a business partner in cardiovascular precision medicine: an emerging approach for disease detection and treatment optimization. Curr Med Chem 28(32):6569\u20136590","journal-title":"Curr Med Chem"},{"key":"1198_CR4","doi-asserted-by":"crossref","unstructured":"Shokri R, Shmatikov V (2015) Privacy-preserving deep learning. In: Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security, pp. 1310\u20131321","DOI":"10.1145\/2810103.2813687"},{"key":"1198_CR5","unstructured":"Kone\u010dn\u00fd J, McMahan B, Yu F, Richt\u00e1rik P, Suresh A, Bacon D (2016) Federated learning: strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492"},{"key":"1198_CR6","unstructured":"McMahan B, Moore E, Ramage D, Hampson S, Aguera y\u00a0AB (2017) Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, pp 1273\u20131282"},{"issue":"5","key":"1198_CR7","doi-asserted-by":"publisher","first-page":"3501","DOI":"10.1109\/TII.2021.3119038","volume":"18","author":"M Alazab","year":"2021","unstructured":"Alazab M, Swarna Priya RM, Parimala M, Maddikunta PKR, Gadekallu TR, Pham Q-V (2021) Federated learning for cybersecurity: concepts, challenges, and future directions. IEEE Trans Ind Inform 18(5):3501\u20133509","journal-title":"IEEE Trans Ind Inform"},{"issue":"6","key":"1198_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3460427","volume":"54","author":"X Yin","year":"2021","unstructured":"Yin X, Zhu Y, Jiankun H (2021) A comprehensive survey of privacy-preserving federated learning: a taxonomy, review, and future directions. ACM Comput Surv (CSUR) 54(6):1\u201336","journal-title":"ACM Comput Surv (CSUR)"},{"key":"1198_CR9","doi-asserted-by":"crossref","unstructured":"Bouacida N, Hou J, Zang H, Liu X (2020) Adaptive federated dropout: improving communication efficiency and generalization for federated learning. arXiv preprint arXiv:2011.04050","DOI":"10.1109\/INFOCOMWKSHPS51825.2021.9484526"},{"issue":"10","key":"1198_CR10","doi-asserted-by":"publisher","first-page":"4229","DOI":"10.1109\/TNNLS.2019.2953131","volume":"31","author":"Y Chen","year":"2019","unstructured":"Chen Y, Sun X, Jin Y (2019) Communication-efficient federated deep learning with layerwise asynchronous model update and temporally weighted aggregation. IEEE Trans Neural Netw Learn Syst 31(10):4229\u20134238","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"1198_CR11","unstructured":"Rothchild D, Panda A, Ullah E, Ivkin N, Stoica I, Braverman V, Gonzalez J, Arora R (2020) FetchSGD: communication-efficient federated learning with sketching. In: Proceedings of the 37th International Conference on Machine Learning, pp 8253\u20138265"},{"key":"1198_CR12","unstructured":"Wang H, Yurochkin M, Sun Y, Papailiopoulos D, Khazaeni Y (2020) Federated learning with matched averaging. arXiv preprint arXiv:2002.06440"},{"key":"1198_CR13","unstructured":"Haddadpour F, Mahdavi M (2019) On the convergence of local descent methods in federated learning. arXiv preprint arXiv:1910.14425"},{"key":"1198_CR14","unstructured":"Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V (2020) Federated optimization in heterogeneous networks. In: Proceedings of Machine Learning and Systems, vol 2, pp 429\u2013450"},{"key":"1198_CR15","unstructured":"Mohri M, Sivek G, Suresh AT (2019) Agnostic federated learning. In: Proceedings of International Conference on Machine Learning, pp 4615\u20134625"},{"key":"1198_CR16","unstructured":"Zhao Y, Li M, Lai L, Suda N, Civin D, Chandra V (2018) Federated learning with non-iid data. arXiv preprint arXiv:1806.00582"},{"key":"1198_CR17","unstructured":"Alp\u00a0Emre AD, Zhao Y, Navarro RM, Mattina M, Whatmough PN, Saligrama V (2021) Federated learning based on dynamic regularization. arXiv preprint arXiv:2111.04263"},{"key":"1198_CR18","unstructured":"Li X, Huang K, Yang W, Wang S, Zhang Z (2019) On the convergence of fedavg on non-iid data. arXiv preprint arXiv:1907.02189"},{"issue":"5","key":"1198_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0041-5553(64)90137-5","volume":"4","author":"BT Polyak","year":"1964","unstructured":"Polyak BT (1964) Some methods of speeding up the convergence of iteration methods. Ussr Comput Math Math Phys 4(5):1\u201317","journal-title":"Ussr Comput Math Math Phys"},{"key":"1198_CR20","unstructured":"Kingma DP, Adam JB (2014) A method for stochastic optimization. arXiv preprint arXiv:1412.6980"},{"issue":"8","key":"1198_CR21","doi-asserted-by":"publisher","first-page":"1754","DOI":"10.1109\/TPDS.2020.2975189","volume":"31","author":"Wei Liu","year":"2020","unstructured":"Liu Wei, Chen Li, Chen Yunfei, Zhang Wenyi (2020) Accelerating federated learning via momentum gradient descent. IEEE Trans Parallel Distrib Syst 31(8):1754\u20131766","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"1198_CR22","unstructured":"Reddi S, Charles Z, Zaheer M, Garrett Z, Rush K, Kone\u010dn\u1ef3 J, Kumar S, McMahan HB (2020) Adaptive federated optimization. arXiv preprint arXiv:2003.00295"},{"issue":"1","key":"1198_CR23","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1109\/JSAC.2020.3036952","volume":"39","author":"HT Nguyen","year":"2020","unstructured":"Nguyen HT, Sehwag V, Hosseinalipour S, Brinton CG, Chiang M, Poor HV (2020) Fast-convergent federated learning. IEEE J Select Areas Commun 39(1):201\u2013218","journal-title":"IEEE J Select Areas Commun"},{"key":"1198_CR24","doi-asserted-by":"crossref","unstructured":"Briggs C, Fan Z, Andras P (2020) Federated learning with hierarchical clustering of local updates to improve training on non-iid data. In: Proceedings of 2020 International Joint Conference on Neural Networks (IJCNN), pp 1\u20139","DOI":"10.1109\/IJCNN48605.2020.9207469"},{"key":"1198_CR25","unstructured":"Chen H, Chao W (2021) On bridging generic and personalized federated learning for image classification. arXiv preprint arXiv:2107.00778"},{"key":"1198_CR26","doi-asserted-by":"crossref","unstructured":"Huang Y, Chu L, Zhou Z, Wang L, Liu J, Pei J, Zhang Y (2021) Personalized cross-silo federated learning on non-iid data. In: Proceedings of the AAAI Conference on Artificial Intelligence 35:7865\u20137873","DOI":"10.1609\/aaai.v35i9.16960"},{"key":"1198_CR27","doi-asserted-by":"crossref","unstructured":"Li L, Li M, Qin F, Zeng W (2021) Evolutionary-based federated ensemble learning on face recognition. In: 2021 IEEE 4th Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), vol\u00a04, pp 815\u2013819","DOI":"10.1109\/IMCEC51613.2021.9482149"},{"key":"1198_CR28","doi-asserted-by":"crossref","unstructured":"Thonglek K, Takahashi K, Ichikawa K, Iida H, Nakasan C (2020) Federated learning of neural network models with heterogeneous structures. In: 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA), pp 735\u2013740","DOI":"10.1109\/ICMLA51294.2020.00120"},{"key":"1198_CR29","first-page":"1","volume":"19","author":"V Stephanie","year":"2022","unstructured":"Stephanie V, Khalil I, Atiquzzaman M, Yi X (2022) Trustworthy privacy-preserving hierarchical ensemble and federated learning in healthcare 4.0 with blockchain. IEEE Trans Ind Inform 19:1\u201310","journal-title":"IEEE Trans Ind Inform"},{"issue":"3","key":"1198_CR30","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1109\/MSP.2020.2975749","volume":"37","author":"T Li","year":"2020","unstructured":"Li T, Sahu AK, Talwalkar A, Smith V (2020) Federated learning: challenges, methods, and future directions. IEEE Signal Process Mag 37(3):50\u201360","journal-title":"IEEE Signal Process Mag"},{"issue":"99","key":"1198_CR31","first-page":"1","volume":"31","author":"F Sattler","year":"2019","unstructured":"Sattler F, Wiedemann S, M\u00fcller K-R, Samek W (2019) Robust and communication-efficient federated learning from non-iid data. IEEE Trans Neural Netw Learn Syst 31(99):1\u201314","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"1198_CR32","unstructured":"Reisizadeh A, Mokhtari A, Hassani H, Jadbabaie A, Pedarsani R (2020) Fedpaq: a communication-efficient federated learning method with periodic averaging and quantization. In: Proceedings of International Conference on Artificial Intelligence and Statistics, pp 2021\u20132031"},{"issue":"12","key":"1198_CR33","doi-asserted-by":"publisher","first-page":"3836","DOI":"10.1109\/JSAC.2021.3118415","volume":"39","author":"Y Yang","year":"2021","unstructured":"Yang Y, Zhang Z, Yang Q (2021) Communication-efficient federated learning with binary neural networks. IEEE J Select Areas Commun 39(12):3836\u20133850","journal-title":"IEEE J Select Areas Commun"},{"key":"1198_CR34","unstructured":"Po-Chen LF, Brinton CG, Michelusi N (2020) Federated learning with communication delay in edge networks. In: GLOBECOM 2020-2020 IEEE Global Communications Conference, pp 1\u20136"},{"key":"1198_CR35","doi-asserted-by":"crossref","unstructured":"Shi W, Sun Y, Zhou S, Niu Z (2021) Device scheduling and resource allocation for federated learning under delay and energy constraints. In: 2021 IEEE 22nd International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), pp 596\u2013600","DOI":"10.1109\/SPAWC51858.2021.9593178"},{"key":"1198_CR36","doi-asserted-by":"crossref","unstructured":"Truex S, Baracaldo N, Anwar A, Steinke T, Ludwig H, Zhang R, Zhou Y (2019) A hybrid approach to privacy-preserving federated learning. In: Proceedings of the 12th ACM workshop on artificial intelligence and security, pp 1\u201311","DOI":"10.1145\/3338501.3357370"},{"key":"1198_CR37","doi-asserted-by":"crossref","unstructured":"Xu R, Baracaldo N,\u00a0Zhou Y, Anwar A, Ludwig H (2019) Hybridalpha: an efficient approach for privacy-preserving federated learning. In: Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security, pp 13\u201323","DOI":"10.1145\/3338501.3357371"},{"key":"1198_CR38","doi-asserted-by":"crossref","unstructured":"Xiong Z, Cai Z, Takabi D, Li W (2021) Privacy threat and defense for federated learning with non-iid data in aiot. IEEE Trans Ind Inform 18(2):1310\u20131321","DOI":"10.1109\/TII.2021.3073925"},{"key":"1198_CR39","unstructured":"Zhang C, Li S, Xia J, Wang W, Yan F, Liu Y (2020) BatchCrypt: efficient homomorphic encryption for cross-silo federated learning. In: 2020 USENIX annual technical conference (USENIX ATC 20), pp 493\u2013506"},{"key":"1198_CR40","doi-asserted-by":"crossref","unstructured":"Ma J, Naas S-A, Sigg S, Lyu X (2022) Privacy-preserving federated learning based on multi-key homomorphic encryption. Int J Intell Syst 37(9):5880\u20135901","DOI":"10.1002\/int.22818"},{"key":"1198_CR41","unstructured":"Xiao H, Rasul K, Vollgraf R (2017) Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747"},{"key":"1198_CR42","unstructured":"Krizhevsky A, Hinton G et\u00a0al (2009) Learning multiple layers of features from tiny images. Computer Science Department, University of Toronto, Tech. Rep, 1:1\u201358"},{"key":"1198_CR43","doi-asserted-by":"crossref","unstructured":"Cohen G, Afshar S, Tapson J, Van\u00a0Schaik A (2017) Emnist: extending mnist to handwritten letters. In: 2017 international joint conference on neural networks (IJCNN), pp 2921\u20132926","DOI":"10.1109\/IJCNN.2017.7966217"},{"key":"1198_CR44","unstructured":"Yao L, Miller J (2015) Tiny imagenet classification with convolutional neural networks. CS 231N, 2(5):8\u20139"},{"key":"1198_CR45","unstructured":"Hsu T-MH, Qi H, Brown M (2019) Measuring the effects of non-identical data distribution for federated visual classification. arXiv preprint arXiv:1909.06335"},{"key":"1198_CR46","doi-asserted-by":"crossref","unstructured":"Li Q, He B, Song D (2021) Model-contrastive federated learning. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 10713\u201310722","DOI":"10.1109\/CVPR46437.2021.01057"},{"key":"1198_CR47","doi-asserted-by":"crossref","unstructured":"Zhao M, Li J (2018) Tuning the hyper-parameters of cma-es with tree-structured parzen estimators. In: 2018 Tenth International Conference on Advanced Computational Intelligence (ICACI), pp 613\u2013618","DOI":"10.1109\/ICACI.2018.8377530"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01198-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01198-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01198-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,10]],"date-time":"2024-02-10T22:29:03Z","timestamp":1707604143000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01198-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,17]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,2]]}},"alternative-id":["1198"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01198-x","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"type":"print","value":"2199-4536"},{"type":"electronic","value":"2198-6053"}],"subject":[],"published":{"date-parts":[[2023,8,17]]},"assertion":[{"value":"2 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 May 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"On behalf of all authors, the corresponding author states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}