{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T05:14:34Z","timestamp":1755839674059,"version":"3.37.3"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T00:00:00Z","timestamp":1709078400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T00:00:00Z","timestamp":1709078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Data Sci. Eng."],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Federated learning (FL) is a promising approach for learning a model from data distributed on massive clients without exposing data privacy. It works effectively in the ideal federation where clients share homogeneous data distribution and learning behavior. However, FL may fail to function appropriately when the federation is not ideal, amid an unhealthy state called <jats:italic>Negative Federated Learning<\/jats:italic> (NFL), in which most clients gain no benefit from participating in FL. Many studies have tried to address NFL. However, their solutions either (1) predetermine to prevent NFL in the entire learning life-cycle or (2) tackle NFL in the aftermath of numerous learning rounds. Thus, they either (1) indiscriminately incur extra costs even if FL can perform well without such costs or (2) waste numerous learning rounds. Additionally, none of the previous work takes into account the clients who may be unwilling\/unable to follow the proposed NFL solutions when using those solutions to upgrade an FL system in use. This paper introduces FL-GUARD, a holistic framework that can be employed on <jats:italic>any<\/jats:italic> FL system for tackling NFL in a run-time paradigm. That is, to dynamically <jats:italic>detect<\/jats:italic> NFL at the early stage (tens of rounds) of learning and then to activate <jats:italic>recovery<\/jats:italic> measures when necessary. Specifically, we devise a cost-effective NFL detection mechanism, which relies on an estimation of performance gain on clients. Only when NFL is detected, we activate the NFL recovery process, in which each client learns in parallel an adapted model when training the global model. Extensive experiment results confirm the effectiveness of FL-GUARD in detecting NFL and recovering from NFL to a healthy learning state. We also show that FL-GUARD is compatible with previous NFL solutions and robust against clients unwilling\/unable to take any recovery measures.<\/jats:p>","DOI":"10.1007\/s41019-024-00243-0","type":"journal-article","created":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T08:02:17Z","timestamp":1709107337000},"page":"204-219","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["FL-GUARD: A Holistic Framework for Run-Time Detection and Recovery of Negative Federated Learning"],"prefix":"10.1007","volume":"9","author":[{"given":"Hong","family":"Lin","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8062-8356","authenticated-orcid":false,"given":"Lidan","family":"Shou","sequence":"additional","affiliation":[]},{"given":"Ke","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Gang","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Sai","family":"Wu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,2,28]]},"reference":[{"unstructured":"McMahan HB, Moore E, Ramage D, Hampson, S, y Arcas BA (2017) Communication-efficient learning of deep networks from decentralized data. In: Proceedings of the 20th international conference on artificial intelligence and statistics. AISTATS, Ft. Lauderdale, FL, USA","key":"243_CR1"},{"unstructured":"Hard A, Rao K, Mathews R, Beaufays F, Augenstein S, Eichner H, Kiddon C, Ramage D (2018) Federated learning for mobile keyboard prediction. arXiv:1811.03604, https:\/\/api.semanticscholar.org\/CorpusID:53207681","key":"243_CR2"},{"doi-asserted-by":"crossref","unstructured":"Chen Y, Qin X, Wang J, Yu C, Gao W (2020) Fedhealth: a federated transfer learning framework for wearable healthcare. IEEE Intell Syst 1\u20131","key":"243_CR3","DOI":"10.1109\/MIS.2020.2988604"},{"doi-asserted-by":"crossref","unstructured":"Duarte MF, Hen Hu Y (2004) Vehicle classification in distributed sensor networks. J Parallel Distrib Comput 64(7), 826\u2013838. Computing and Communication in Distributed Sensor Networks","key":"243_CR4","DOI":"10.1016\/j.jpdc.2004.03.020"},{"unstructured":"Anguita D, Ghio A, Oneto L, Parra X, Reyes-Ortiz JL (2013) A public domain dataset for human activity recognition using smartphones. In: Proceedings of the 21th international European symposium on artificial neural networks, computational intelligence and machine learning. ESANN, Bruges, pp 437\u2013442","key":"243_CR5"},{"doi-asserted-by":"crossref","unstructured":"Rahman SA, Merck C, Yuxiao Huang Kleinberg S (2015) Unintrusive eating recognition using google glass. In: Proceeding of the 9th international conference on pervasive computing technologies for healthcare. PervasiveHealth, Istanbul Turkey, pp 108\u2013111","key":"243_CR6","DOI":"10.4108\/icst.pervasivehealth.2015.259044"},{"unstructured":"Caldas S, Wu P, Li T, Konecn\u00fd J, McMahan HB, Smith V, Talwalkar A (2018) LEAF: a benchmark for federated settings. arXiv:1812.01097","key":"243_CR7"},{"unstructured":"Reddit: Reddit comments (2019)","key":"243_CR8"},{"unstructured":"Smith V, Chiang C-K, Sanjabi M, Talwalkar AS (2017) Federated multi-task learning. In: Advances in neural information processing systems, vol 30, pp 4424\u20134434","key":"243_CR9"},{"unstructured":"Yu T, Bagdasaryan E, Shmatikov V (2020) Salvaging federated learning by local adaptation. arXiv:2002.04758, https:\/\/api.semanticscholar.org\/CorpusID:211082601","key":"243_CR10"},{"unstructured":"Kairouz P, McMahan HB, Avent B, Bellet A, Bennis M, Bhagoji AN, Bonawitz K, Charles ZB, Cormode G, Cummings R, D\u2019Oliveira RGL, El Rouayheb SY, Evans D, Gardner J, Garrett Z, Gasc\u00f3n\nA,\nGhazi B, Gibbons PB, Gruteser M, Harchaoui Z, He C, He L, Huo Z, Hutchinson B, Hsu J, Jaggi M, Javidi T, Joshi G, Khodak M, Konecn\u00fd J, Korolova A, Koushanfar F,\nKoyejo O, Lepoint T, Liu Y, Mittal P, Mohri M, Nock R, \u00d6zg\u00fcr A, Pagh R, Raykova M, Qi H, Ramage D, Raskar R, Xiaodong Song D, Song W, Stich SU, Sun Z, Suresh AT, Tram\u00e8r F, Vepakomma P, Wang J, Xiong L, Xu\nZ, Yang Q, Yu FX, Yu H, Zhao S (2019) Advances and open problems in federated learning. Found Trends Mach Learn 14:1\u2013210. https:\/\/api.semanticscholar.org\/CorpusID:209202606","key":"243_CR11"},{"unstructured":"Wang K, Mathews R, Kiddon C, Eichner H, Beaufays F, Ramage D (2019) Federated evaluation of on-device personalization. arXiv:1910.10252, https:\/\/api.semanticscholar.org\/CorpusID:204837855","key":"243_CR12"},{"doi-asserted-by":"crossref","unstructured":"Liu Y, Ma S, Aafer Y, Lee W-C, Zhai J, Wang W, Zhang X (2018) Trojaning attack on neural networks. In: Proceedings of the network and distributed system security symposium, NDSS 2018. NDSS, San Diego, California","key":"243_CR13","DOI":"10.14722\/ndss.2018.23291"},{"unstructured":"Bhagoji AN, Chakraborty S, Mittal P, Calo S (2019) Analyzing federated learning through an adversarial lens. In: Proceedings of the 36th international conference on machine learning. Proceedings of machine learning research, vol 97, pp 634\u2013643. PMLR, Long Beach, California, USA","key":"243_CR14"},{"unstructured":"Bagdasaryan E, Veit A, Hua Y, Estrin D, Shmatikov V (2020) How to backdoor federated learning. In: Proceedings of the twenty third international conference on artificial intelligence and statistics. Proceedings of machine learning research, vol 108, pp 2938\u20132948. PMLR, Online","key":"243_CR15"},{"unstructured":"McMahan HB, Ramage D, Talwar K, Zhang L (2018) Learning differentially private recurrent language models. In: Conference track proceedings of 6th international conference on learning representations. ICLR, Vancouver, BC, Canada","key":"243_CR16"},{"unstructured":"Li D, Wang J (2019) FedMD: Heterogenous federated learning via model distillation. arXiv:1910.03581, https:\/\/api.semanticscholar.org\/CorpusID:203951869","key":"243_CR17"},{"unstructured":"Jiang Y, Kone\u010dn\u00fd J, Rush K, Kannan S (2020) Improving federated learning personalization via model agnostic meta learning. In: International conference on learning representations. ICLR, Addis Ababa, Ethiopia","key":"243_CR18"},{"unstructured":"Mansour Y, Mohri M, Ro JY, Suresh AT (2020) Three approaches for personalization with applications to federated learning. arXiv:2002.10619, https:\/\/api.semanticscholar.org\/CorpusID:211296702","key":"243_CR19"},{"unstructured":"Hanzely F, Richt\u00e1rik P (2020) Federated learning of a mixture of global and local models. arXiv:2002.05516, https:\/\/api.semanticscholar.org\/CorpusID:211096943","key":"243_CR20"},{"unstructured":"Deng Y, Kamani MM, Mahdavi M (2020) Adaptive personalized federated learning. arXiv:2003.13461, https:\/\/api.semanticscholar.org\/CorpusID:214713948","key":"243_CR21"},{"unstructured":"Karimireddy SP, Kale S, Mohri M, Reddi SJ, Stich SU, Suresh AT (2020) Scaffold: stochastic controlled averaging for federated learning. In: Proceedings of the 37th international conference on machine learning (ICML)","key":"243_CR22"},{"unstructured":"Wang J, Liu Q, Liang H, Joshi G, Poor H (2020) Tackling the objective inconsistency problem in heterogeneous federated optimization. arXiv:2007.07481, https:\/\/api.semanticscholar.org\/CorpusID:220525591","key":"243_CR23"},{"unstructured":"Mitra A, Jaafar RH, Pappas GJ, Hassani H (2021) Achieving linear convergence in federated learning under objective and systems heterogeneity. arXiv:2102.07053, https:\/\/api.semanticscholar.org\/CorpusID:231924804","key":"243_CR24"},{"unstructured":"Collins L, Hassani H, Mokhtari A, Shakkottai S (2021) Exploiting shared representations for personalized federated learning. In: Proceedings of the 38th international conference on machine learning (ICML)","key":"243_CR25"},{"doi-asserted-by":"crossref","unstructured":"Zhang Y, Wei S, Wang Y, Xu Y, Li Y, Shang X (2022) A personalized federated learning framework using side information for heterogeneous data classification. In: 2022 IEEE international conference on big data (big data), pp 3455\u20133461","key":"243_CR26","DOI":"10.1109\/BigData55660.2022.10020809"},{"doi-asserted-by":"crossref","unstructured":"Zheng K, Liu X, Zhu G, Wu X, Niu J (2022) Channelfed: Enabling personalized federated learning via localized channel attention. In: GLOBECOM 2022\u20142022 IEEE global communications conference, pp 2987\u20132992","key":"243_CR27","DOI":"10.1109\/GLOBECOM48099.2022.10000892"},{"unstructured":"Li T, Hu S, Beirami A, Smith V (2021) Ditto: Fair and robust federated learning through personalization. In: Proceedings of the 38th international conference on machine learning (ICML)","key":"243_CR28"},{"unstructured":"Zhao Y, Li M, Lai L, Suda N, Civin D, Chandra V (2018) Federated learning with non-IID data. arXiv:1806.00582, https:\/\/api.semanticscholar.org\/CorpusID:46936175","key":"243_CR29"},{"doi-asserted-by":"crossref","unstructured":"Briggs CA, Fan Z, Andr\u00e1s P (2020) Federated learning with hierarchical clustering of local updates to improve training on non-IID data. In: 2020 international joint conference on neural networks (IJCNN), pp 1\u20139. https:\/\/api.semanticscholar.org\/CorpusID:216144447","key":"243_CR30","DOI":"10.1109\/IJCNN48605.2020.9207469"},{"unstructured":"Yin D, Chen Y, Kannan R, Bartlett P (2018) Byzantine-robust distributed learning: Towards optimal statistical rates. In: Proceedings of the 35th international conference on machine learning. Proceedings of machine learning research, vol 80, pp 5650\u20135659. PMLR, Stockholmsm\u00e4ssan, Stockholm Sweden","key":"243_CR31"},{"doi-asserted-by":"crossref","unstructured":"Gao L, Fu H, Li L, Chen Y, Xu M, Xu C (2022) FedDC: Federated learning with non-IID data via local drift decoupling and correction. In: 2022 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 10102\u201310111","key":"243_CR32","DOI":"10.1109\/CVPR52688.2022.00987"},{"doi-asserted-by":"publisher","unstructured":"Sattler F, M\u00fcller K-R, Samek W (2020) Clustered federated learning: Model-agnostic distributed multi-task optimization under privacy constraints. IEEE Trans Neural Netw Learn Syst. https:\/\/doi.org\/10.1109\/TNNLS.2020.3015958","key":"243_CR33","DOI":"10.1109\/TNNLS.2020.3015958"},{"unstructured":"Dai R, Shen L, He F, Tian X, Tao D (2022) DisPFL: Towards communication-efficient personalized federated learning via decentralized sparse training. In: International conference on machine learning","key":"243_CR34"},{"doi-asserted-by":"crossref","unstructured":"Pearson G, Verma D, Mel G (2019) Value of information: Quantification and application to coalition machine learning. In: Calo S, Bertino E, Verma D (eds) Policy-based autonomic data governance, vol 11550, pp 21\u201341","key":"243_CR35","DOI":"10.1007\/978-3-030-17277-0_2"},{"unstructured":"Krizhevsky A (2009) Learning multiple layers of features from tiny images. Technical report","key":"243_CR36"},{"unstructured":"Wang H, Yurochkin M, Sun Y, Papailiopoulos D, Khazaeni Y (2020) Federated learning with matched averaging. In: International conference on learning representations. ICLR, Addis Ababa, Ethiopia","key":"243_CR37"},{"unstructured":"Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V (2020) Federated optimization in heterogeneous networks. In: Dhillon I, Papailiopoulos D, Sze V (eds) Proceedings of machine learning and systems, vol 2, pp 429\u2013450","key":"243_CR38"},{"doi-asserted-by":"crossref","unstructured":"Li X-C, Zhan D-C (2021) Fedrs: Federated learning with restricted softmax for label distribution non-IID data. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining","key":"243_CR39","DOI":"10.1145\/3447548.3467254"},{"unstructured":"Fang M, Cao X, Jia J, Gong NZ (2019) Local model poisoning attacks to byzantine-robust federated learning. In: USENIX security symposium. https:\/\/api.semanticscholar.org\/CorpusID:208310035","key":"243_CR40"},{"unstructured":"Fu S, Xie C, Li B, Chen Q (2019) Attack-resistant federated learning with residual-based reweighting. arXiv:1912.11464, https:\/\/api.semanticscholar.org\/CorpusID:209460895","key":"243_CR41"},{"unstructured":"Baruch M, Baruch G, Goldberg Y (2019) A little is enough: circumventing defenses for distributed learning. In: NeurIPS","key":"243_CR42"},{"unstructured":"Blanchard P, Mhamdi EME, Guerraoui R, Stainer J (2017) Machine learning with adversaries: Byzantine tolerant gradient descent. In: NIPS","key":"243_CR43"},{"unstructured":"Fallah A, Mokhtari A, Ozdaglar AE (2020) Personalized federated learning with theoretical guarantees: a model-agnostic meta-learning approach. In: Neural information processing systems. https:\/\/api.semanticscholar.org\/CorpusID:227276412","key":"243_CR44"}],"container-title":["Data Science and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41019-024-00243-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41019-024-00243-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41019-024-00243-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,11]],"date-time":"2024-06-11T17:19:34Z","timestamp":1718126374000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41019-024-00243-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,28]]},"references-count":44,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["243"],"URL":"https:\/\/doi.org\/10.1007\/s41019-024-00243-0","relation":{},"ISSN":["2364-1185","2364-1541"],"issn-type":[{"type":"print","value":"2364-1185"},{"type":"electronic","value":"2364-1541"}],"subject":[],"published":{"date-parts":[[2024,2,28]]},"assertion":[{"value":"12 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 October 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 January 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 February 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}