{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T09:16:44Z","timestamp":1770283004215,"version":"3.49.0"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,11,24]],"date-time":"2023-11-24T00:00:00Z","timestamp":1700784000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,24]],"date-time":"2023-11-24T00:00:00Z","timestamp":1700784000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62171287"],"award-info":[{"award-number":["62171287"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shenzhen Science and Technology Program","award":["JCYJ20220818100004008"],"award-info":[{"award-number":["JCYJ20220818100004008"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Federated learning (FL) represents a promising distributed machine learning paradigm for resolving data isolation due to data privacy concerns. Nevertheless, most vanilla FL algorithms, which depend on a server, encounter the problem of reliability and a high communication burden in real cases. Decentralized federated learning (DFL) that does not follow the star topology faces the challenges of weight divergence and inferior communication efficiency. In this paper, a novel DFL framework called federated incremental subgradient-proximal (FedISP) is proposed that utilizes the incremental method to perform model updates to alleviate weight divergence. In our setup, multiple clients are distributed in a ring topology and communicate in a cyclic manner, which significantly mitigates the communication load. A convergence guarantee is given under the convex condition to demonstrate the impact of the learning rate on our algorithms, which further improves the performance of FedISP. Extensive experiments on benchmark datasets validate the effectiveness of the proposed approach in both independent and identically distributed (IID) and non-IID settings while illustrating the advantages of the FedISP algorithm in achieving model consensus and saving communication costs.<\/jats:p>","DOI":"10.1007\/s40747-023-01272-4","type":"journal-article","created":{"date-parts":[[2023,11,24]],"date-time":"2023-11-24T09:02:46Z","timestamp":1700816566000},"page":"2499-2514","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Fedisp: an incremental subgradient-proximal-based ring-type architecture for decentralized federated learning"],"prefix":"10.1007","volume":"10","author":[{"given":"Jianjun","family":"Huang","sequence":"first","affiliation":[]},{"given":"Zihao","family":"Rui","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1996-7898","authenticated-orcid":false,"given":"Li","family":"Kang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,11,24]]},"reference":[{"issue":"3","key":"1272_CR1","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1007\/s42979-021-00592-x","volume":"2","author":"H Sarker Iqbal","year":"2021","unstructured":"Sarker Iqbal H (2021) Machine learning: algorithms, real-world applications and research directions. SN Comput Sci 2(3):160","journal-title":"SN Comput Sci"},{"key":"1272_CR2","doi-asserted-by":"crossref","unstructured":"Voigt P, Von\u00a0dem Bussche A (2017) The eu general data protection regulation (gdpr). A Practical Guide, 1st Ed., Cham: Springer International Publishing, 10(3152676):10\u20135555","DOI":"10.1007\/978-3-319-57959-7_1"},{"key":"1272_CR3","unstructured":"McMahan B, Moore E, Ramage D, Hampson S, Arcas Blaise\u00a0A (2017) Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics, pp 1273\u20131282"},{"issue":"1\u20132","key":"1272_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2200000083","volume":"14","author":"P Kairouz","year":"2021","unstructured":"Kairouz P, McMahan HB, Avent B, Bellet A, Bennis M, Bhagoji AN, Bonawitz K, Charles Z, Cormode G, Cummings R (2021) Advances and open problems in federated learning. Found Trends Mach Learn 14(1\u20132):1\u2013210","journal-title":"Found Trends Mach Learn"},{"issue":"3","key":"1272_CR5","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1109\/MSP.2020.2975749","volume":"37","author":"L Tian","year":"2020","unstructured":"Tian L, Kumar SA, Ameet T, Virginia S (2020) Federated learning: challenges, methods, and future directions. IEEE Signal Process Mag 37(3):50\u201360","journal-title":"IEEE Signal Process Mag"},{"issue":"2","key":"1272_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3298981","volume":"10","author":"Q Yang","year":"2019","unstructured":"Yang Q, Liu Y, Chen T, Tong Y (2019) Federated machine learning: concept and applications. ACM Trans Intell Syst Technol (TIST) 10(2):1\u201319","journal-title":"ACM Trans Intell Syst Technol (TIST)"},{"issue":"5","key":"1272_CR7","doi-asserted-by":"publisher","first-page":"953","DOI":"10.1109\/JPROC.2018.2817461","volume":"106","author":"N Angelia","year":"2018","unstructured":"Angelia N, Alex O, Rabbat Michael G (2018) Network topology and communication-computation tradeoffs in decentralized optimization. Proc IEEE 106(5):953\u2013976","journal-title":"Proc IEEE"},{"issue":"8","key":"1272_CR8","doi-asserted-by":"publisher","first-page":"1738","DOI":"10.1109\/JPROC.2019.2918951","volume":"107","author":"X Zhi Zhou","year":"2019","unstructured":"Zhi Zhou X, Chen EL, Zeng L, Luo K, Zhang J (2019) Edge intelligence: paving the last mile of artificial intelligence with edge computing. Proc IEEE 107(8):1738\u20131762","journal-title":"Proc IEEE"},{"issue":"6","key":"1272_CR9","doi-asserted-by":"publisher","first-page":"2508","DOI":"10.1109\/TIT.2006.874516","volume":"52","author":"S Boyd","year":"2006","unstructured":"Boyd S, Ghosh A, Prabhakar B, Shah D (2006) Randomized gossip algorithms. IEEE Trans Inf Theory 52(6):2508\u20132530","journal-title":"IEEE Trans Inf Theory"},{"key":"1272_CR10","unstructured":"Roy AG, Siddiqui S, P\u00f6lsterl S, Navab N, Wachinger C (2019) Braintorrent: a peer-to-peer environment for decentralized federated learning. arXiv preprint arXiv:1905.06731"},{"key":"1272_CR11","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1109\/TSIPN.2022.3151242","volume":"8","author":"W Liu","year":"2022","unstructured":"Liu W, Chen L, Zhang W (2022) Decentralized federated learning: Balancing communication and computing costs. IEEE Transactions on Signal and Information Processing over Networks 8:131\u2013143","journal-title":"IEEE Transactions on Signal and Information Processing over Networks"},{"key":"1272_CR12","doi-asserted-by":"crossref","unstructured":"Heged\u0171s Istv\u00e1n, Danner G\u00e1bor, Jelasity M\u00e1rk (2019) Gossip learning as a decentralized alternative to federated learning. In Distributed Applications and Interoperable Systems: 19th IFIP WG 6.1 International Conference, DAIS 2019, Held as Part of the 14th International Federated Conference on Distributed Computing Techniques, DisCoTec 2019, Kongens Lyngby, Denmark, June 17-21, 2019, Proceedings 19, pages 74\u201390. Springer","DOI":"10.1007\/978-3-030-22496-7_5"},{"key":"1272_CR13","unstructured":"Jiang Zhanhong, Balu Aditya, Hegde Chinmay, Sarkar Soumik (2017) Collaborative deep learning in fixed topology networks. Advances in Neural Information Processing Systems, 30"},{"key":"1272_CR14","unstructured":"Hu Chenghao, Jiang Jingyan, Wang Zhi (2019) Decentralized federated learning: A segmented gossip approach. arXiv preprint arXiv:1908.07782"},{"key":"1272_CR15","unstructured":"Karimireddy Sai\u00a0Praneeth, Kale Satyen, Mohri Mehryar, Reddi Sashank, Stich Sebastian, SureshAnanda\u00a0Theertha (2020) Scaffold: Stochastic controlled averaging for federated learning. In International Conference on Machine Learning, pages 5132\u20135143. PMLR"},{"key":"1272_CR16","unstructured":"Zhao Yue, Li Meng, Lai Liangzhen, Suda Naveen, Civin Damon, Chandra Vikas (2018) Federated learning with non-iid data. arXiv preprint arXiv:1806.00582"},{"issue":"4","key":"1272_CR17","doi-asserted-by":"publisher","first-page":"1574","DOI":"10.1137\/070704277","volume":"19","author":"A Nemirovski","year":"2009","unstructured":"Nemirovski A, Juditsky A, Lan G, Shapiro A (2009) Robust stochastic approximation approach to stochastic programming. SIAM J Optim 19(4):1574\u20131609","journal-title":"SIAM J Optim"},{"key":"1272_CR18","unstructured":"Zhu Zhuangdi, Hong Junyuan, Zhou Jiayu (2021) Data-free knowledge distillation for heterogeneous federated learning. In International Conference on Machine Learning, pages 12878\u201312889. PMLR"},{"key":"1272_CR19","doi-asserted-by":"crossref","unstructured":"Li Qinbin, He Bingsheng, Song Dawn (2021) Model-contrastive federated learning. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pages 10713\u201310722","DOI":"10.1109\/CVPR46437.2021.01057"},{"key":"1272_CR20","doi-asserted-by":"crossref","unstructured":"Qinbin Li, Yiqun Diao, Quan Chen, Bingsheng He (2022) Federated learning on non-iid data silos: An experimental study. In 2022 IEEE 38th International Conference on Data Engineering (ICDE), pages 965\u2013978. IEEE","DOI":"10.1109\/ICDE53745.2022.00077"},{"key":"1272_CR21","unstructured":"Chen Yiqiang, Lu Wang, Qin Xin, Wang Jindong, Xie Xing (2022) Metafed: Federated learning among federations with cyclic knowledge distillation for personalized healthcare. arXiv preprint arXiv:2206.08516"},{"issue":"1\u201338","key":"1272_CR22","first-page":"3","volume":"2010","author":"P Bertsekas Dimitri","year":"2011","unstructured":"Bertsekas Dimitri P (2011) Incremental gradient, subgradient, and proximal methods for convex optimization: A survey. Optimization for Machine Learning 2010(1\u201338):3","journal-title":"Optimization for Machine Learning"},{"key":"1272_CR23","unstructured":"Lalitha Anusha, Shekhar Shubhanshu, Javidi Tara, Koushanfar Farinaz (2018) Fully decentralized federated learning. In Third workshop on bayesian deep learning (NeurIPS), volume\u00a02"},{"key":"1272_CR24","unstructured":"Lalitha Anusha, Kilinc Osman\u00a0Cihan, Javidi Tara, Koushanfar Farinaz (2019) Peer-to-peer federated learning on graphs. arXiv preprint arXiv:1901.11173"},{"key":"1272_CR25","unstructured":"Kim Hyesung, Park Jihong, Bennis Mehdi, Kim Seong-Lyun (2018) On-device federated learning via blockchain and its latency analysis. arXiv preprint arXiv:1808.03949"},{"issue":"1","key":"1272_CR26","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1109\/MNET.011.2000263","volume":"35","author":"Y Li","year":"2020","unstructured":"Li Y, Chen C, Liu N, Huang H, Zheng Z, Yan Q (2020) A blockchain-based decentralized federated learning framework with committee consensus. IEEE Network 35(1):234\u2013241","journal-title":"IEEE Network"},{"issue":"10","key":"1272_CR27","doi-asserted-by":"publisher","first-page":"1548","DOI":"10.3390\/electronics11101548","volume":"11","author":"Z Wang","year":"2022","unstructured":"Wang Z, Yifan H, Yan S, Wang Z, Hou R, Chao W (2022) Efficient ring-topology decentralized federated learning with deep generative models for medical data in ehealthcare systems. Electronics 11(10):1548","journal-title":"Electronics"},{"issue":"12","key":"1272_CR28","doi-asserted-by":"publisher","first-page":"3851","DOI":"10.1109\/JSAC.2021.3118344","volume":"39","author":"LF Po-Chen","year":"2021","unstructured":"Po-Chen LF, Seyyedali H, Shams AS, Brinton Christopher G, Nicolo M (2021) Semi-decentralized federated learning with cooperative d2d local model aggregations. IEEE J Sel Areas Commun 39(12):3851\u20133869","journal-title":"IEEE J Sel Areas Commun"},{"key":"1272_CR29","doi-asserted-by":"crossref","unstructured":"Hosseinalipour Seyyedali, Azam Sheikh\u00a0Shams, Brinton Christopher\u00a0G, Michelusi Nicolo, Aggarwal Vaneet, Love David\u00a0J, Dai Huaiyu (2022) Multi-stage hybrid federated learning over large-scale d2d-enabled fog networks. IEEE\/ACM Transactions on Networking, 30(4):1569\u20131584","DOI":"10.1109\/TNET.2022.3143495"},{"key":"1272_CR30","doi-asserted-by":"crossref","unstructured":"Abad Mehdi Salehi\u00a0Heydar, Ozfatura Emre, Gunduz Deniz, Ercetin Ozgur (2020) Hierarchical federated learning across heterogeneous cellular networks. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 8866\u20138870. IEEE","DOI":"10.1109\/ICASSP40776.2020.9054634"},{"issue":"2","key":"1272_CR31","first-page":"1136","volume":"9","author":"L Chengxi","year":"2021","unstructured":"Chengxi L, Gang L, Varshney Pramod K (2021) Decentralized federated learning via mutual knowledge transfer. IEEE Internet Things J 9(2):1136\u20131147","journal-title":"IEEE Internet Things J"},{"key":"1272_CR32","first-page":"429","volume":"2","author":"L Tian","year":"2020","unstructured":"Tian L, Kumar SA, Manzil Z, Maziar S, Ameet T, Virginia S (2020) Federated optimization in heterogeneous networks. Proceedings of Machine learning and systems 2:429\u2013450","journal-title":"Proceedings of Machine learning and systems"},{"issue":"6","key":"1272_CR33","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","volume":"29","author":"L Deng","year":"2012","unstructured":"Deng L (2012) The mnist database of handwritten digit images for machine learning research [best of the web]. IEEE Signal Process Mag 29(6):141\u2013142","journal-title":"IEEE Signal Process Mag"},{"key":"1272_CR34","unstructured":"Alex Krizhevsky, Geoffrey Hinton, et\u00a0al. Learning multiple layers of features from tiny images. 2009"},{"key":"1272_CR35","unstructured":"Xiao Han, Rasul Kashif, Vollgraf Roland (2017) Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747"},{"key":"1272_CR36","doi-asserted-by":"crossref","unstructured":"Cohen Gregory, Afshar Saeed, Tapson Jonathan, Van\u00a0Schaik Andre (2017) Emnist: Extending mnist to handwritten letters. In 2017 international joint conference on neural networks (IJCNN), pages 2921\u20132926. IEEE","DOI":"10.1109\/IJCNN.2017.7966217"},{"key":"1272_CR37","doi-asserted-by":"publisher","first-page":"7865","DOI":"10.1609\/aaai.v35i9.16960","volume":"35","author":"Y Huang","year":"2021","unstructured":"Huang Y, Chu L, Zhou Z, Wang L, Liu J, Pei J, Zhang Y (2021) Personalized cross-silo federated learning on non-iid data. In Proceedings of the AAAI Conference on Artificial Intelligence 35:7865\u20137873","journal-title":"In Proceedings of the AAAI Conference on Artificial Intelligence"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01272-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01272-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01272-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,3]],"date-time":"2024-11-03T06:48:53Z","timestamp":1730616533000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01272-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,24]]},"references-count":37,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["1272"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01272-4","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,24]]},"assertion":[{"value":"29 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 November 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}