{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T08:42:18Z","timestamp":1769071338002,"version":"3.49.0"},"reference-count":29,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,19]],"date-time":"2023-01-19T00:00:00Z","timestamp":1674086400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education","doi-asserted-by":"publisher","award":["2020R1I1A3068305"],"award-info":[{"award-number":["2020R1I1A3068305"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Due to the distributed data collection and learning in federated learnings, many clients conduct local training with non-independent and identically distributed (non-IID) datasets. Accordingly, the training from these datasets results in severe performance degradation. We propose an efficient algorithm for enhancing the performance of federated learning by overcoming the negative effects of non-IID datasets. First, the intra-client class imbalance is reduced by rendering the class distribution of clients close to Uniform distribution. Second, the clients to participate in federated learning are selected to make their integrated class distribution close to Uniform distribution for the purpose of mitigating the inter-client class imbalance, which represents the class distribution difference among clients. In addition, the amount of local training data for the selected clients is finely adjusted. Finally, in order to increase the efficiency of federated learning, the batch size and the learning rate of local training for the selected clients are dynamically controlled reflecting the effective size of the local dataset for each client. In the performance evaluation on CIFAR-10 and MNIST datasets, the proposed algorithm achieves 20% higher accuracy than existing federated learning algorithms. Moreover, in achieving this huge accuracy improvement, the proposed algorithm uses less computation and communication resources compared to existing algorithms in terms of the amount of data used and the number of clients joined in the training.<\/jats:p>","DOI":"10.3390\/s23031152","type":"journal-article","created":{"date-parts":[[2023,1,19]],"date-time":"2023-01-19T05:50:20Z","timestamp":1674107420000},"page":"1152","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Performance Enhancement in Federated Learning by Reducing Class Imbalance of Non-IID Data"],"prefix":"10.3390","volume":"23","author":[{"given":"Mihye","family":"Seol","sequence":"first","affiliation":[{"name":"School of Information and Communication Engineering, Chungbuk National University, Chungju 28644, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6326-2559","authenticated-orcid":false,"given":"Taejoon","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Chungbuk National University, Chungju 28644, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,19]]},"reference":[{"key":"ref_1","unstructured":"Cisco (2020). Cisco Annual Internet Report (2018\u20132023), Cisco. White Paper."},{"key":"ref_2","unstructured":"McMahan, B., and Ramage, D. (2021, June 12). Research Scientists. Federated Learning: Collaborative Machine Learning without Centralized Training Data. Available online: https:\/\/ai.googleblog.com\/2017\/04\/federated-learning-collaborative.html."},{"key":"ref_3","unstructured":"McMahan, B., Moore, E., Ramage, D., Hampson, S., and Arcas, B.A. (2017, January 20\u201322). Communication-efficient learning of deep networks from decentralized data. Proceedings of the Artificial Intelligence and Statistics (AISTATS 2017), Fort Lauderdale, FL, USA."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Nishio, T., and Yonetani, R. (2019, January 20\u201324). Client selection for federated learning with heterogeneous resources in mobile edge. Proceedings of the 2019 IEEE International Conference on Communications (ICC 2019), Shanghai, China.","DOI":"10.1109\/ICC.2019.8761315"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.1109\/JSAC.2019.2904348","article-title":"Adaptive Federated Learning in Resource Constrained Edge Computing Systems","volume":"37","author":"Wang","year":"2019","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, Z., Xu, H., Liu, J., Huang, H., Qiao, C., and Zhao, Y. (2021, January 10\u201313). Resource-Efficient Federated Learning with Hierarchical Aggregation in Edge Computing. Proceedings of the IEEE INFOCOM 2021\u2014IEEE Conference on Computer Communications, Vancouver, BC, Canada.","DOI":"10.1109\/INFOCOM42981.2021.9488756"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3400","DOI":"10.1109\/TNNLS.2019.2944481","article-title":"Robust and Communication-Efficient Federated Learning from Non-i.i.d. Data","volume":"31","author":"Sattler","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhao, Y., and Gong, X. (2021, January 10\u201313). Quality-Aware Distributed Computation and User Selection for Cost-Effective Federated Learning. Proceedings of the IEEE INFOCOM 2021\u2014IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Vancouver, BC, Canada.","DOI":"10.1109\/INFOCOMWKSHPS51825.2021.9484642"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1109\/TMC.2021.3075291","article-title":"Adaptive Batch Size for Federated Learning in Resource-Constrained Edge Computing","volume":"22","author":"Ma","year":"2021","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"11038","DOI":"10.1109\/TWC.2022.3189320","article-title":"To Talk or to Work: Dynamic Batch Sizes Assisted Time Efficient Federated Learning over Future Mobile Edge Devices","volume":"21","author":"Shi","year":"2022","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, Q., Diao, Y., Chen, Q., and He, B. (2022, January 9\u201312). Federated Learning on Non-Iid Data Silos: An Experimental Study. Proceedings of the 2022 IEEE 38th International Conference on Data Engineering (ICDE), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICDE53745.2022.00077"},{"key":"ref_12","unstructured":"Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., and Chandra, V. (2018). Federated Learning with Non-IID Data. arXiv."},{"key":"ref_13","unstructured":"Krizhevsky, A., and Hinton, G. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto. Technical Report."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","article-title":"The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]","volume":"29","author":"Li","year":"2012","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_15","unstructured":"Li, T., Sahu, A.K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V. (2018). Federated Optimization in Heterogeneous Networks. arXiv."},{"key":"ref_16","unstructured":"Shoham, N., Avidor, T., Keren, A., Israel, N., Benditkis, D., Mor-Yosef, L., and Zeitak, I. (2019). Overcoming forgetting in federated learning on non-iid data. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Rizk, E., Vlaski, S., and Sayed, A.H. (2021, January 6\u201311). Optimal Importance Sampling for Federated Learning. Proceedings of the ICASSP 2021\u20142021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.","DOI":"10.1109\/ICASSP39728.2021.9413655"},{"key":"ref_18","unstructured":"Kopparapu, K., and Lin, E. (2020). Fedfmc: Sequential efficient federated learning on non-iid data. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Briggs, C., Fan, Z., and Andras, P. (2020, January 19\u201324). Federated Learning with Hierarchical Clustering of Local Updates to Improve Training on Non-IID Data. Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK.","DOI":"10.1109\/IJCNN48605.2020.9207469"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Duan, M., Liu, D., Chen, X., Tan, Y., Ren, J., Qiao, L., and Liang, L. (2019, January 17\u201320). Astraea: Self-Balancing Federated Learning for Improving Classification Accuracy of Mobile Deep Learning Applications. Proceedings of the 2019 IEEE 37th International Conference on Computer Design (ICCD), Abu Dhabi, United Arab Emirates.","DOI":"10.1109\/ICCD46524.2019.00038"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1023\/A:1013689704352","article-title":"Finite-time analysis of the multiarmed bandit problem","volume":"47","author":"Auer","year":"2002","journal-title":"Mach. Learn."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"24462","DOI":"10.1109\/ACCESS.2021.3056919","article-title":"Client Selection for Federated Learning With Non-IID Data in Mobile Edge Computing","volume":"9","author":"Zhang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yang, M., Wang, X., Zhu, H., Wang, H., and Qian, H. (2021, January 23\u201327). Federated Learning with Class Imbalance Reduction. Proceedings of the 2021 29th European Signal Processing Conference (EUSIPCO), Dublin, Ireland.","DOI":"10.23919\/EUSIPCO54536.2021.9616052"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1109\/MCOM.001.2001016","article-title":"Federated Learning at the Network Edge: When Not All Nodes Are Created Equal","volume":"59","author":"Malandrino","year":"2021","journal-title":"IEEE Commun. Mag."},{"key":"ref_25","first-page":"7611","article-title":"Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization","volume":"33","author":"Wang","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst. (NeurIPS)"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1655","DOI":"10.1109\/TC.2021.3099723","article-title":"Adaptive Federated Learning on Non-IID Data with Resource Constraint","volume":"71","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Comput."},{"key":"ref_27","unstructured":"Hsu, T.M.H., Qi, H., and Brown, M. (2019). Measuring the effects of non-identical data distribution for federated visual classification. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On Information and Sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_29","unstructured":"Goyal, P., Doll\u00e1r, P., Girshick, R.B., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., and He, K. (2018, April 30). Accurate, Large Minibatch SGD: Training ImageNet in 1 h, CoRRabs\/1706.02677. Available online: https:\/\/dblp.org\/db\/journals\/corr\/corr1706.html#GoyalDGNWKTJH17."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1152\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:10:30Z","timestamp":1760119830000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1152"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,19]]},"references-count":29,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23031152"],"URL":"https:\/\/doi.org\/10.3390\/s23031152","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,19]]}}}