{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T16:45:45Z","timestamp":1784738745828,"version":"3.55.0"},"reference-count":43,"publisher":"Institution of Engineering and Technology (IET)","issue":"1","license":[{"start":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T00:00:00Z","timestamp":1731024000000},"content-version":"vor","delay-in-days":312,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62376100"],"award-info":[{"award-number":["62376100"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003453","name":"Natural Science Foundation of Guangdong Province","doi-asserted-by":"publisher","award":["2022A1515010114"],"award-info":[{"award-number":["2022A1515010114"]}],"id":[{"id":"10.13039\/501100003453","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["ietresearch.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["IET Biometrics"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:p>Recently, multimodal authentication methods based on deep learning have been widely explored in biometrics. Nevertheless, the contradiction between the data privacy protection and the requirement of sufficient data when model optimizing has become increasingly prominent. To this end, we proposes a multimodal biometric federated learning framework (FedMB) to realize the multiparty joint training of identity authentication models with different modal data while protecting the users\u2019 data privacy. Specifically, a personalized multimodal biometric recognition model fully trained by each participant is first obtained to improve the authentication performance, using modal point clustering with class\u2010first federated learning methods on the service side with the modal. Then a complementary multimodal biometric recognition strategy is implemented to build a complementary modal model. Finally, the fusion participant local model, with the modal model and complementary modal model, is trained by all participants again to obtain a more personalized modal model. The experimental results have demonstrated that the proposed FedMB can either protect the data privacy or utilize the data from all participants to train the personalized biometric recognition model to improve identity authentication performance.<\/jats:p>","DOI":"10.1049\/2024\/5873909","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T04:20:22Z","timestamp":1731039622000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Multimodal Biometric Recognition Method Based on Federated Learning"],"prefix":"10.1049","volume":"2024","author":[{"given":"Guang","family":"Chen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dacan","family":"Luo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fengzhao","family":"Lian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feng","family":"Tian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xu","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9023-7252","authenticated-orcid":false,"given":"Wenxiong","family":"Kang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"265","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"key":"e_1_2_10_1_2","first-page":"1","volume-title":"Federal Study\u2019","author":"Qiang Y.","year":"2020"},{"key":"e_1_2_10_2_2","unstructured":"BaiF. WuJ. ShenP. LiS. andZhouS. Federated Face Recognition 2021."},{"key":"e_1_2_10_3_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIM.2021.3109978","article-title":"Joint Attention Network for Finger Vein Authentication","volume":"70","author":"Huang J.","year":"2021","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"e_1_2_10_4_2","doi-asserted-by":"crossref","unstructured":"MinaeeS. AbdolrashidiyA. andWangY. An Experimental Study of Deep Convolutional Features For Iris Recognition\u2019 2016 IEEE Signal Processing in Medicine and Biology Symposium (SPMB) IEEE 2017 IEEE.","DOI":"10.1109\/SPMB.2016.7846859"},{"key":"e_1_2_10_5_2","first-page":"82","article-title":"Multi-Modal Human Face Anti-Deception Based on the Self-Attention Network","volume":"6","author":"Kong C.","year":"2021","journal-title":"Modern Computer"},{"key":"e_1_2_10_6_2","unstructured":"WangYao Research and Application of Face Recognition Based on Multi-Modal Fusion\u2019 2021 Sichuan University master\u2019s thesis."},{"key":"e_1_2_10_7_2","unstructured":"HardikU. AlirezaS.-M. MichaelG. andAliE. Two-Level Attention-Based Fusion Learning for RGB-D Face Recognition 2020."},{"key":"e_1_2_10_8_2","first-page":"1070","article-title":"Deep Learning-Based Iris Face Multi-Feature Fusion Recognition","volume":"4","author":"Xiao K.","year":"2020","journal-title":"Computer Engineering and Design"},{"key":"e_1_2_10_9_2","unstructured":"MengK. Research and System Design of Face-Ear Multi-Modal Identity Authentication Based on Deep Learning\u2019 2020 Xihua University master\u2019s thesis."},{"key":"e_1_2_10_10_2","unstructured":"LiuY. Research on Face-Speech Multi-Modal Identity Identification Based on Deep Feature Fusion\u2019 2019 Huaqiao University master\u2019s thesis."},{"key":"e_1_2_10_11_2","first-page":"54","article-title":"Design of the Synchronous Acquisition System of Finger Multi-Modal Feature Image Posture","volume":"1","author":"Yang J.","year":"2020","journal-title":"Journal of the Civil Aviation University of China"},{"key":"e_1_2_10_12_2","unstructured":"LuG. Research on Multi-Modal Finger Identification Techniques 2020 Hangzhou Dianzi University master\u2019s thesis."},{"key":"e_1_2_10_13_2","unstructured":"LuY. Study on the Finger Shape Fusion Recognition Algorithm of the Finger Vein With Anti-Rotation Ability\u2019 2020 South China University of Technology master\u2019s thesis."},{"key":"e_1_2_10_14_2","unstructured":"ZhouC. Research on Multi-Modal Biometric Identification Based on Fusion Algorithm and Deep Learning\u2019 2020 Southern Medical University Master thesis."},{"key":"e_1_2_10_15_2","first-page":"158","article-title":"Multi-Modal Fusion of Face Fingerprint Based on Generalized Canonical Correlation Analysis Fusion and Robust Probability Collaborative Representation","volume":"2","author":"Zhang J.","year":"2018","journal-title":"Journal of the University of Shanghai for Science and Technology"},{"key":"e_1_2_10_16_2","unstructured":"ZhangS. Research on Multiple Biometric Identification Systems Based on SOPC\u2019 2021 Inner Mongolia University master\u2019s thesis."},{"key":"e_1_2_10_17_2","article-title":"Communication-Efficient Learning of Deep Networks From Decentralized Data","author":"Brendan M. M.","year":"2017","journal-title":"Artificial Intelligence and Statistics"},{"key":"e_1_2_10_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/OJCS.2020.2993259"},{"key":"e_1_2_10_19_2","unstructured":"TanA. Z. YuH. CuiL. andYangQ Towards Personalized Federated Learning 2021."},{"key":"e_1_2_10_20_2","unstructured":"YishayM. MehryarM. JaeR. andTheerthaS. A. Three Approaches for Personalization with Applications to Federated Learning 2020."},{"key":"e_1_2_10_21_2","first-page":"62","article-title":"Federated Learning Node Selection Method Based on DRL","volume":"6","author":"He W.","year":"2021","journal-title":"Journal of Communications"},{"key":"e_1_2_10_22_2","first-page":"2515","article-title":"Edge-Based Federated Learning Model Cleaning and Device Clustering Methods","volume":"12","author":"Liu Y.","year":"2021","journal-title":"Journal of Computer Science"},{"key":"e_1_2_10_23_2","first-page":"2968","article-title":"Device Selection Algorithm Based on Federated Learning of Category-Imbalanced Data","volume":"10","author":"Wang X.","year":"2021","journal-title":"Computer Application Research"},{"key":"e_1_2_10_24_2","first-page":"2473","article-title":"An Asynchronous Federated Learning Aggregation Update Algorithm","volume":"12","author":"Chen R.","year":"2021","journal-title":"Small Microcomputer System"},{"key":"e_1_2_10_25_2","doi-asserted-by":"crossref","unstructured":"MasiI. WuY. HassnerT. andNatarajanP. Deep Face Recognition: A Survey 31st SIBGRAPI Conference on Graphics Patterns and Images (SIBGRAPI) IEEE 2018 IEEE 471\u2013478.","DOI":"10.1109\/SIBGRAPI.2018.00067"},{"key":"e_1_2_10_26_2","volume-title":"Computer Vision and Pattern Recognition IEEE","author":"Christoph F.","year":"2016"},{"key":"e_1_2_10_27_2","first-page":"1","article-title":"An Adaptive Multi-Modal Biometrics System Using PSO","volume":"4","author":"Aly O. M.","year":"2013","journal-title":"International Journal of Advanced Computer Science and Applications"},{"key":"e_1_2_10_28_2","unstructured":"DiM. Multi-Modal Biometric Feature Fusion Based on Feature Layer and Fractional Layer 2017 University of Science and Technology of China master\u2019s thesis."},{"key":"e_1_2_10_29_2","unstructured":"RossA. JainA. K. andQianJ. Z. Information Fusion in Biometrics International Conference on Audioand Video-Based Biometric Person Authentication 2006 Springer."},{"key":"e_1_2_10_30_2","doi-asserted-by":"crossref","unstructured":"ZhangX. SunZ. andTanT. Hierarchical Fusion of Face and Iris for Personal Identification International Conference on Pattern Recognition 2010 217\u2013220.","DOI":"10.1109\/ICPR.2010.62"},{"key":"e_1_2_10_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.464560"},{"key":"e_1_2_10_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.57"},{"key":"e_1_2_10_33_2","unstructured":"DongYi ZhenLei LiaoS. andStanZ. Li: \u2019Learning Face Representation from Scratch 2014."},{"key":"e_1_2_10_34_2","volume-title":"Workshop on Faces in\u2019Real-Life\u2019Images: Detection, Alignment, and Recognition","author":"Huang G. B.","year":"2008"},{"key":"e_1_2_10_35_2","doi-asserted-by":"crossref","unstructured":"LuY. XieS. J. YoonS. WangZ. andParkD. S. An Available Database for the Research of Finger Vein Recognition 2013 6th International Congress on Image and Signal Processing (CISP) 2013 no. 1 IEEE 410\u2013415 https:\/\/doi.org\/10.1109\/CISP.2013.6744030 2-s2.0-84897811391.","DOI":"10.1109\/CISP.2013.6744030"},{"key":"e_1_2_10_36_2","doi-asserted-by":"publisher","DOI":"10.3390\/sym10040078"},{"key":"e_1_2_10_37_2","unstructured":"C. A. of Science-Institute of Automation Casia-Iris-v4 Iris Image Database version4.0(Casia-Iris-v4-Irisv4) 2018 http:\/\/biometrics.idealtest.org\/."},{"key":"e_1_2_10_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2022.3173276"},{"key":"e_1_2_10_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2023.3238546"},{"key":"e_1_2_10_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBIOM.2022.3181121"},{"key":"e_1_2_10_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11633-022-1341-4"},{"key":"e_1_2_10_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2021.09.015"},{"key":"e_1_2_10_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.csi.2022.103694"}],"container-title":["IET Biometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ietresearch.onlinelibrary.wiley.com\/doi\/pdf\/10.1049\/2024\/5873909","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T17:24:51Z","timestamp":1762363491000},"score":1,"resource":{"primary":{"URL":"https:\/\/ietresearch.onlinelibrary.wiley.com\/doi\/10.1049\/2024\/5873909"}},"subtitle":[],"editor":[{"given":"M.","family":"Srinivas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.1049\/2024\/5873909"],"URL":"https:\/\/doi.org\/10.1049\/2024\/5873909","archive":["Portico"],"relation":{},"ISSN":["2047-4938","2047-4946"],"issn-type":[{"value":"2047-4938","type":"print"},{"value":"2047-4946","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1]]},"assertion":[{"value":"2023-10-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"5873909"}}