{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T14:13:01Z","timestamp":1774966381210,"version":"3.50.1"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2023,6,6]],"date-time":"2023-06-06T00:00:00Z","timestamp":1686009600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,6,6]],"date-time":"2023-06-06T00:00:00Z","timestamp":1686009600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Traditional federated learning algorithms suffer from considerable performance reduction with non-identically and independently distributed datasets. This paper proposes a federated learning algorithm based on parallel-ensemble learning, which improves performance for image classification on these datasets. The training process of this algorithm includes basic federation learning and meta federation learning. First, several basic models are trained through cross-validation of federated learning, and then the meta-model is trained using the prediction results of the validation sets. In the training process, the training of different basic models is parallel. In prediction, meta-model is used to aggregate the output of the basic models to get the final prediction results. Our algorithm can achieve higher accuracy than traditional federated learning when using non-independent identically distributed datasets for image classification. Our algorithm aggregates different models through federated learning based on parallel-ensemble method, and improves the image classification performance of federated learning on non-independent identically distributed datasets.<\/jats:p>","DOI":"10.1007\/s40747-023-01110-7","type":"journal-article","created":{"date-parts":[[2023,6,6]],"date-time":"2023-06-06T02:50:34Z","timestamp":1686019834000},"page":"6891-6903","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A federated learning algorithm using parallel-ensemble method on non-IID datasets"],"prefix":"10.1007","volume":"9","author":[{"given":"Haoran","family":"Yu","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2349-2549","authenticated-orcid":false,"given":"Chang","family":"Wu","sequence":"additional","affiliation":[]},{"given":"Haixin","family":"Yu","sequence":"additional","affiliation":[]},{"given":"Xuelin","family":"Wei","sequence":"additional","affiliation":[]},{"given":"Siyan","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Ying","family":"Zhang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,6,6]]},"reference":[{"key":"1110_CR1","unstructured":"Kone\u010dn\u1ef3 J, McMahan HB, Yu FX, Richt\u00e1rik P, Suresh AT, Bacon D (2016) Federated learning: strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492"},{"key":"1110_CR2","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1109\/OJCS.2020.2993259","volume":"1","author":"Q Wu","year":"2020","unstructured":"Wu Q, He K, Chen X (2020) Personalized federated learning for intelligent IoT applications: a cloud-edge based framework. IEEE Open J Comput Soc 1:35\u201344","journal-title":"IEEE Open J Comput Soc"},{"key":"1110_CR3","doi-asserted-by":"crossref","unstructured":"Li Q, Diao Y, Chen Q, He B (2021) Federated learning on non-iid data silos: an experimental study. arXiv preprint arXiv:2102.02079","DOI":"10.1109\/ICDE53745.2022.00077"},{"key":"1110_CR4","unstructured":"Zhao Y, Li M, Lai L, Suda N, Civin D, Chandra V (2018) Federated learning with non-iid data. arXiv preprint arXiv:1806.00582"},{"key":"1110_CR5","doi-asserted-by":"crossref","unstructured":"Zhuang Z, Tao H, Chen Y, Stojanovic V, Paszke W (2022) An optimal iterative learning control approach for linear systems with nonuniform trial lengths under input constraints. IEEE Trans Syst Man Cybern Syst","DOI":"10.1109\/TSMC.2022.3225381"},{"key":"1110_CR6","doi-asserted-by":"crossref","unstructured":"Djordjevic V, Stojanovic V, Tao H, Song X, He S, Gao W (2022) Data-driven control of hydraulic servo actuator based on adaptive dynamic programming. Discrete Contin Dyn Syst Ser S 15(7)","DOI":"10.3934\/dcdss.2021145"},{"issue":"18","key":"1110_CR7","doi-asserted-by":"publisher","first-page":"10139","DOI":"10.1002\/rnc.6354","volume":"32","author":"C Zhou","year":"2022","unstructured":"Zhou C, Tao H, Chen Y, Stojanovic V, Paszke W (2022) Robust point-to-point iterative learning control for constrained systems: a minimum energy approach. Int J Robust Nonlinear Control 32(18):10139\u201310161","journal-title":"Int J Robust Nonlinear Control"},{"issue":"2","key":"1110_CR8","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","volume":"5","author":"DH Wolpert","year":"1992","unstructured":"Wolpert DH (1992) Stacked generalization. Neural Netw 5(2):241\u2013259","journal-title":"Neural Netw"},{"key":"1110_CR9","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"1110_CR10","unstructured":"Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556"},{"key":"1110_CR11","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700\u20134708","DOI":"10.1109\/CVPR.2017.243"},{"issue":"6","key":"1110_CR12","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","volume":"29","author":"L Deng","year":"2012","unstructured":"Deng L (2012) The mnist database of handwritten digit images for machine learning research [best of the web]. IEEE Signal Process Mag 29(6):141\u2013142","journal-title":"IEEE Signal Process Mag"},{"key":"1110_CR13","unstructured":"Krizhevsky A, Hinton G (2009) Learning multiple layers of features from tiny images. Handb Syst Autoimmune Dis 1(4)"},{"key":"1110_CR14","unstructured":"McMahan B, Moore E, Ramage D, Hampson S, y Arcas BA (2017) Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics. PMLR, pp 1273\u20131282"},{"key":"1110_CR15","first-page":"429","volume":"2","author":"T Li","year":"2020","unstructured":"Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V (2020) Federated optimization in heterogeneous networks. Proc Mach Learn Syst 2:429\u2013450","journal-title":"Proc Mach Learn Syst"},{"key":"1110_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.107338","volume":"229","author":"Z Xiao","year":"2021","unstructured":"Xiao Z, Xu X, Xing H, Song F, Wang X, Zhao B (2021) A federated learning system with enhanced feature extraction for human activity recognition. Knowl Based Syst 229:107338","journal-title":"Knowl Based Syst"},{"key":"1110_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106679","volume":"213","author":"W Zhang","year":"2021","unstructured":"Zhang W, Li X, Ma H, Luo Z, Li X (2021) Federated learning for machinery fault diagnosis with dynamic validation and self-supervision. Knowl Based Syst 213:106679","journal-title":"Knowl Based Syst"},{"key":"1110_CR18","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1007\/s40747-020-00247-z","volume":"7","author":"H Zhu","year":"2021","unstructured":"Zhu H, Zhang H, Jin Y (2021) From federated learning to federated neural architecture search: a survey. Complex Intell Syst 7:639\u2013657","journal-title":"Complex Intell Syst"},{"key":"1110_CR19","doi-asserted-by":"crossref","unstructured":"Gao L, Fu H, Li L, Chen Y, Xu M, Xu C-Z (2022) Feddc: federated learning with non-iid data via local drift decoupling and correction. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 10112\u201310121","DOI":"10.1109\/CVPR52688.2022.00987"},{"key":"1110_CR20","doi-asserted-by":"crossref","unstructured":"Zhang X, Hong M, Dhople S, Yin W, Liu Y (2020) Fedpd: a federated learning framework with optimal rates and adaptivity to non-iid data. arXiv preprint arXiv:2005.11418","DOI":"10.1109\/TSP.2021.3115952"},{"key":"1110_CR21","unstructured":"Li X, Jiang M, Zhang X, Kamp M, Dou Q (2021) Fedbn: federated learning on non-iid features via local batch normalization. arXiv preprint arXiv:2102.07623"},{"key":"1110_CR22","doi-asserted-by":"crossref","unstructured":"Kulkarni V, Kulkarni M, Pant A (2020) Survey of personalization techniques for federated learning. In: 2020 fourth world conference on smart trends in systems, security and sustainability (WorldS4). IEEE, pp 794\u2013797","DOI":"10.1109\/WorldS450073.2020.9210355"},{"key":"1110_CR23","doi-asserted-by":"crossref","unstructured":"Ma X, Zhang J, Guo S, Xu W (2022) Layer-wised model aggregation for personalized federated learning. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 10092\u201310101","DOI":"10.1109\/CVPR52688.2022.00985"},{"key":"1110_CR24","unstructured":"Shin M, Hwang C, Kim J, Park J, Bennis M, Kim S-L (2020) Xor mixup: privacy-preserving data augmentation for one-shot federated learning. arXiv preprint arXiv:2006.05148"},{"issue":"1","key":"1110_CR25","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1006\/jcss.1997.1504","volume":"55","author":"Y Freund","year":"1997","unstructured":"Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119\u2013139","journal-title":"J Comput Syst Sci"},{"issue":"1","key":"1110_CR26","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Random forests. Mach Learn 45(1):5\u201332","journal-title":"Mach Learn"},{"key":"1110_CR27","doi-asserted-by":"crossref","unstructured":"Lin S, Yang G, Zhang J (2020) A collaborative learning framework via federated meta-learning. In: 2020 IEEE 40th international conference on distributed computing systems (ICDCS). IEEE, pp 289\u2013299","DOI":"10.1109\/ICDCS47774.2020.00032"},{"key":"1110_CR28","unstructured":"Hamer J, Mohri M, Suresh AT (2020) Fedboost: a communication-efficient algorithm for federated learning. In: International conference on machine learning. PMLR, pp 3973\u20133983"},{"key":"1110_CR29","unstructured":"Liu Y, Liu Y, Liu Z, Liang Y, Meng C, Zhang J, Zheng Y (2020) Federated forest. IEEE Trans Big Data"},{"key":"1110_CR30","first-page":"4642","volume":"34","author":"Q Li","year":"2020","unstructured":"Li Q, Wen Z, He B (2020) Practical federated gradient boosting decision trees. Proc AAAI Conf Artif Intell 34:4642\u20134649","journal-title":"Proc AAAI Conf Artif Intell"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01110-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01110-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01110-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,27]],"date-time":"2023-10-27T19:22:10Z","timestamp":1698434530000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01110-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,6]]},"references-count":30,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["1110"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01110-7","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,6]]},"assertion":[{"value":"6 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 May 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 June 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}