{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T11:59:07Z","timestamp":1774699147895,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,2,8]],"date-time":"2025-02-08T00:00:00Z","timestamp":1738972800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Science Foundation Project of Heilongjiang Province of China","award":["LH2022F003"],"award-info":[{"award-number":["LH2022F003"]}]},{"name":"Natural Science Foundation Project of Heilongjiang Province of China","award":["2022ZX01A35"],"award-info":[{"award-number":["2022ZX01A35"]}]},{"name":"Key Research and Development Program of Heilongjiang Province of China","award":["LH2022F003"],"award-info":[{"award-number":["LH2022F003"]}]},{"name":"Key Research and Development Program of Heilongjiang Province of China","award":["2022ZX01A35"],"award-info":[{"award-number":["2022ZX01A35"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Federated learning has attracted widespread attention due to its strong capabilities of privacy protection, making it a powerful supporting technology for addressing data silos in the future. However, federated learning still lags significantly behind traditional centralized learning in terms of learning efficiency and system security. In this paper, we first construct a hierarchical federated learning architecture integrated with blockchain based on the cooperation of the cloud, edge, and terminal, which has the ability to enhance the security of federated learning while reducing the introduction costs of blockchain. Under this architecture, we propose a semi-asynchronous aggregation scheme at the edge layer and introduce a hierarchical aggregation scheme that combines it with synchronous aggregation at the cloud end to improve system efficiency. Furthermore, we present a multi-objective node selection scheme that considers various influencing factors such as security and efficiency. We formulate the node selection problem as a Markov Decision Process (MDP) and propose a solution based on deep reinforcement learning to address it more efficiently. The experimental results show that the proposed scheme can effectively improve system efficiency and enhance system security. In addition, the proposed DQN-based node selection algorithm can efficiently realize the selection of the optimal policy.<\/jats:p>","DOI":"10.3390\/fi17020075","type":"journal-article","created":{"date-parts":[[2025,2,12]],"date-time":"2025-02-12T10:25:57Z","timestamp":1739355957000},"page":"75","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Participant Selection for Efficient and Trusted Federated Learning in Blockchain-Assisted Hierarchical Federated Learning Architectures"],"prefix":"10.3390","volume":"17","author":[{"given":"Peng","family":"Liu","sequence":"first","affiliation":[{"name":"College of Computer and Control Engineering, Northeast Forestry University, Hexing Road 26, Harbin 150040, China"}]},{"given":"Lili","family":"Jia","sequence":"additional","affiliation":[{"name":"College of Computer and Control Engineering, Northeast Forestry University, Hexing Road 26, Harbin 150040, China"}]},{"given":"Yang","family":"Xiao","sequence":"additional","affiliation":[{"name":"College of Computer and Control Engineering, Northeast Forestry University, Hexing Road 26, Harbin 150040, China"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3039","DOI":"10.1109\/COMST.2019.2926625","article-title":"Artificial neural networks-based machine learning for wireless networks: A tutorial","volume":"21","author":"Chen","year":"2019","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1109\/JIOT.2021.3079104","article-title":"Reputation-based federated learning for secure wireless networks","volume":"9","author":"Song","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.future.2023.02.001","article-title":"Feddcs: A distributed client selection framework for cross device federated learning","volume":"144","author":"Panigrahi","year":"2023","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"21467","DOI":"10.1109\/JIOT.2023.3298196","article-title":"A blockchain-based federated learning scheme for data sharing in industrial internet of things","volume":"10","author":"Xu","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"111399","DOI":"10.1016\/j.knosys.2024.111399","article-title":"Fedaga: A federated learning framework for enhanced inter-client relationship learning","volume":"286","author":"Ge","year":"2024","journal-title":"Knowl.-Based Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, C., Zeng, X., Zhang, M., and Cao, Z. (2022). Pyramidfl: A Fine-Grained Client Selection Framework for Efficient Federated Learning, Association for Computing Machinery.","DOI":"10.1145\/3495243.3517017"},{"key":"ref_7","unstructured":"Zhang, S.Q., Lin, J., and Zhang, Q. (March, January 22). A multi-agent reinforcement learning approach for efficient client selection in federated learning. Proceedings of the AAAI Conference on Artificial Intelligence, Online."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sun, H., Tian, H., Ni, W., and Zheng, J. (2024, January 14\u201319). On the convergence of hierarchical federated learning with gradient quantization and imperfect transmission. Proceedings of the ICASSP 2024\u20142024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Republic of Korea.","DOI":"10.1109\/ICASSP48485.2024.10446709"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Romandini, N., Mazzocca, C., and Montanari, R. (2023, January 1\u20133). Federated learning meets blockchain: A power consumption case study. Proceedings of the 2023 31st Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), Naples, Italy.","DOI":"10.1109\/PDP59025.2023.00040"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Xu, C., Qu, Y., Eklund, P.W., Xiang, Y., and Gao, L. (2021, January 5\u20138). Bafl: An efficient blockchain-based asynchronous federated learning framework. Proceedings of the 2021 IEEE Symposium on Computers and Communications (ISCC), Athens, Greece.","DOI":"10.1109\/ISCC53001.2021.9631405"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"10462","DOI":"10.1109\/JIOT.2023.3238658","article-title":"Do not trust the clouds easily: The insecurity of content security policy based on object storage","volume":"10","author":"Lv","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"8229","DOI":"10.1109\/JIOT.2022.3150363","article-title":"Recent advances on federated learning for cybersecurity and cybersecurity for federated learning for internet of things","volume":"9","author":"Ghimire","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, L., Zhang, J., Song, S.H., and Letaief, K.B. (2020, January 7\u201311). Client-edge-cloud hierarchical federated learning. Proceedings of the ICC 2020\u20142020 IEEE International Conference on Communications (ICC), Dublin, Ireland.","DOI":"10.1109\/ICC40277.2020.9148862"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TNSE.2021.3053588","article-title":"Optimal user-edge assignment in hierarchical federated learning based on statistical properties and network topology constraints","volume":"9","author":"Mhaisen","year":"2022","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"7377","DOI":"10.1109\/TITS.2022.3150756","article-title":"Asynchronous federated deep reinforcement learning-based urllc-aware computation offloading in space-assisted vehicular networks","volume":"24","author":"Pan","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chen, Y., Ning, Y., Slawski, M., and Rangwala, H. (2020, January 10\u201313). Asynchronous online federated learning for edge devices with non-iid data. Proceedings of the 2020 IEEE International Conference on Big Data (Big Data), Atlanta, GA, USA.","DOI":"10.1109\/BigData50022.2020.9378161"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chai, Z., Chen, Y., Anwar, A., Zhao, L., Cheng, Y., and Rangwala, H. (2021, January 14\u201319). Fedat: A high-performance and communication-efficient federated learning system with asynchronous tiers. Proceedings of the SC21: International Conference for High Performance Computing, Networking, Storage and Analysis, St. Louis, MO, USA.","DOI":"10.1145\/3458817.3476211"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4229","DOI":"10.1109\/TNNLS.2019.2953131","article-title":"Communication-efficient federated deep learning with layerwise asynchronous model update and temporally weighted aggregation","volume":"31","author":"Chen","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"6961","DOI":"10.1109\/TWC.2022.3153495","article-title":"Asynchronous federated learning over wireless communication networks","volume":"21","author":"Wang","year":"2022","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"11100","DOI":"10.1109\/JIOT.2021.3053055","article-title":"Federated sensing: Edge-cloud elastic collaborative learning for intelligent sensing","volume":"8","author":"Gao","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_21","unstructured":"Shayan, M., Fung, C., Yoon, C.J.M., and Beschastnikh, I. (2019). Biscotti: A ledger for private and secure peer-to-peer machine learning. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, L., Zhao, D., Tao, L., Wang, K., Qiao, S., Zeng, X., and Tan, C.W. (2024). A credible and fair federated learning framework based on blockchain. IEEE Trans. Artif. Intell., 1\u201315.","DOI":"10.1109\/TAI.2024.3355362"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, L., Wang, W., and Li, B. (2019, January 7\u201310). Cmfl: Mitigating communication overhead for federated learning. Proceedings of the 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), Dallas, TX, USA.","DOI":"10.1109\/ICDCS.2019.00099"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, H., Kaplan, Z., Niu, D., and Li, B. (2020, January 6\u20139). Optimizing federated learning on non-iid data with reinforcement learning. Proceedings of the IEEE INFOCOM 2020\u2014IEEE Conference on Computer Communications, Toronto, ON, Canada.","DOI":"10.1109\/INFOCOM41043.2020.9155494"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Nishio, T., and Yonetani, R. (June, January 28). Client selection for federated learning with heterogeneous resources in mobile edge. Proceedings of the ICC 2019\u20142019 IEEE International Conference on Communications (ICC), Rome, Italy.","DOI":"10.1109\/ICC.2019.8761315"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Jin, Y., Jiao, L., Qian, Z., Zhang, S., and Lu, S. (2021, January 10\u201313). Learning for learning: Predictive online control of federated learning with edge provisioning. Proceedings of the IEEE INFOCOM 2021\u2014IEEE Conference on Computer Communications, Vancouver, BC, Canada.","DOI":"10.1109\/INFOCOM42981.2021.9488733"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/s10791-024-09478-x","article-title":"Enhancing federated learning with dynamic weight adjustment based on particle swarm optimization","volume":"27","author":"Ouyang","year":"2024","journal-title":"Discov. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhao, R., Yang, X., Zhi, P., Zhou, R., Zhou, Q., and Jin, Q. (2025). Adaptive Weighting via Federated Evaluation Mechanism for Domain Adaptation with Edge Devices. Acm Trans. Sens. Netw.","DOI":"10.1145\/3669903"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Huang, X., Wu, Y., Chen, Z., Chen, Q., and Zhang, J. (2022, January 1\u20133). Blockchain-enabled edge computing framework for hierarchic cluster-based federated learning. Proceedings of the 2022 14th International Conference on Wireless Communications and Signal Processing (WCSP), Nanjing, China.","DOI":"10.1109\/WCSP55476.2022.10039121"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chen, C., Liu, J., Tan, H., Li, X., Wang, K.I.-K., Li, P., Sakurai, K., and Dou, D. (2024). Trustworthy federated learning: Privacy, security, and beyond. Knowl. Inf. Syst., 1\u201336.","DOI":"10.1007\/s10115-024-02285-2"},{"key":"ref_31","unstructured":"Xu, R., Pokhrel, S., Lan, Q., and Li, G. (September, January 29). Fair-bfl: Flexible and incentive redesign for blockchain-based federated learning. Proceedings of the 51st International Conference on Parallel Processing, Bordeaux, France."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1109\/TPDS.2020.3044223","article-title":"Biscotti: A blockchain system for private and secure federated learning","volume":"32","author":"Shayan","year":"2021","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_33","unstructured":"Fung, C., Yoon, C.J.M., and Beschastnikh, I. (2020). Mitigating sybils in federated learning poisoning. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Majeed, U., and Hong, C.S. (2019, January 18\u201320). Flchain: Federated learning via mec-enabled blockchain network. Proceedings of the 2019 20th Asia-Pacific Network Operations and Management Symposium (APNOMS), Matsue, Japan.","DOI":"10.23919\/APNOMS.2019.8892848"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"6092","DOI":"10.1109\/TII.2020.2974555","article-title":"A trustworthy privacy preserving framework for machine learning in industrial iot systems","volume":"16","author":"Arachchige","year":"2020","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"15776","DOI":"10.1109\/JIOT.2021.3081578","article-title":"Cross-cluster federated learning and blockchain for internet of medical things","volume":"8","author":"Jin","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"12075","DOI":"10.1109\/TVT.2023.3265366","article-title":"Blockchain-based decentralized and lightweight anonymous authentication for federated learning","volume":"72","author":"Fan","year":"2023","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"4920","DOI":"10.1109\/OJCOMS.2024.3438264","article-title":"Trustworthy federated learning: A comprehensive review, architecture, key challenges, and future research prospects","volume":"5","author":"Tariq","year":"2024","journal-title":"IEEE Open J. Commun. Soc."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Xu, T., Liu, Y., Ma, Z., Huang, Y., and Liu, P. (2023). A DQN-Based Multi-Objective Participant Selection for Efficient Federated Learning. Future Internet, 15.","DOI":"10.20944\/preprints202304.0734.v1"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/2\/75\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:29:22Z","timestamp":1760027362000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/2\/75"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,8]]},"references-count":39,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["fi17020075"],"URL":"https:\/\/doi.org\/10.3390\/fi17020075","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,8]]}}}