{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,24]],"date-time":"2025-12-24T14:46:07Z","timestamp":1766587567463,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T00:00:00Z","timestamp":1684800000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62076246","2023JKF01ZK07"],"award-info":[{"award-number":["62076246","2023JKF01ZK07"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Fundamental Research Funds for the Central Universities","award":["62076246","2023JKF01ZK07"],"award-info":[{"award-number":["62076246","2023JKF01ZK07"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Visible-infrared person re-identification aims to solve the matching problem between cross-camera and cross-modal person images. Existing methods strive to perform better cross-modal alignment, but often neglect the critical importance of feature enhancement for achieving better performance. Therefore, we proposed an effective method that combines both modal alignment and feature enhancement. Specifically, we introduced Visible-Infrared Modal Data Augmentation (VIMDA) for visible images to improve modal alignment. Margin MMD-ID Loss was also used to further enhance modal alignment and optimize model convergence. Then, we proposed Multi-Grain Feature Extraction (MGFE) Structure for feature enhancement to further improve recognition performance. Extensive experiments have been carried out on SYSY-MM01 and RegDB. The result indicates that our method outperforms the current state-of-the-art method for visible-infrared person re-identification. Ablation experiments verified the effectiveness of the proposed method.<\/jats:p>","DOI":"10.3390\/s23114988","type":"journal-article","created":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T02:02:27Z","timestamp":1684807347000},"page":"4988","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification"],"prefix":"10.3390","volume":"23","author":[{"given":"Ronghui","family":"Lin","sequence":"first","affiliation":[{"name":"School of Information and Cyber Security, People\u2019s Public Security University of China, Beijing 100038, China"}]},{"given":"Rong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information and Cyber Security, People\u2019s Public Security University of China, Beijing 100038, China"},{"name":"Key Laboratory of Security Prevention Technology and Risk Assessment of Ministry of Public Security, Beijing 100038, China"}]},{"given":"Wenjing","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information and Cyber Security, People\u2019s Public Security University of China, Beijing 100038, China"}]},{"given":"Ao","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Information and Cyber Security, People\u2019s Public Security University of China, Beijing 100038, China"}]},{"given":"Yihan","family":"Bi","sequence":"additional","affiliation":[{"name":"School of Information and Cyber Security, People\u2019s Public Security University of China, Beijing 100038, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2872","DOI":"10.1109\/TPAMI.2021.3054775","article-title":"Deep learning for person re-identification: A survey and outlook","volume":"44","author":"Ye","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhou, J., Dong, Q., Zhang, Z., Liu, S., and Durrani, T.S. (2023). Cross-Modality Person Re-Identification via Local Paired Graph Attention Network. Sensors, 23.","DOI":"10.3390\/s23084011"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Saber, S., Meshoul, S., Amin, K., P\u0142awiak, P., and Hammad, M. (2023). A Multi-Attention Approach for Person Re-Identification Using Deep Learning. Sensors, 23.","DOI":"10.3390\/s23073678"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Huang, S.K., Hsu, C.C., and Wang, W.Y. (2022). Person Re-Identification with Improved Performance by Incor-porating Focal Tversky Loss in AGW Baseline. Sensors, 22.","DOI":"10.3390\/s22249852"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ren, D., He, T., and Dong, H. (2022). Joint Cross-Consistency Learning and Multi-Feature Fusion for Person Re-Identification. Sensors, 22.","DOI":"10.3390\/s22239387"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Chen, Y., Wan, L., Li, Z., Jing, Q., and Sun, Z. (2021, January 19\u201325). Neural feature search for rgb-infrared person re-identification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Virtual.","DOI":"10.1109\/CVPR46437.2021.00065"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Fu, C., Hu, Y., Wu, X., Shi, H., Mei, T., and He, R. (2021, January 11\u201317). CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01161"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jiang, K., Zhang, T., Liu, X., Qian, B., Zhang, Y., and Wu, F. (2022, January 23\u201327). Cross-Modality Transformer for Visible-Infrared Person Re-Identification. Proceedings of the Computer Vision\u2013ECCV 2022: 17th European Conference, Tel Aviv, Israel. Proceedings, Part XIV.","DOI":"10.1007\/978-3-031-19781-9_28"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wei, Z., Yang, X., Wang, N., and Gao, X. (2021, January 11\u201317). Syncretic Modality Collaborative Learning for Visible Infrared Person Re-Identification. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00029"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wu, Q., Dai, P., Chen, J., Lin, C.W., Wu, Y., Huang, F., and Ji, R. (2021, January 19\u201325). Discover cross-modality nuances for visible-infrared person re-identification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Virtual.","DOI":"10.1109\/CVPR46437.2021.00431"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ye, M., Lan, X., Li, J., and Yuen, P. (2018, January 2\u20137). Hierarchical Discriminative Learning for Visible Thermal Person Re-Identification. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12293"},{"key":"ref_12","unstructured":"Wang, G., Zhang, T., Cheng, J., Liu, S., Yang, Y., and Hou, Z. (November, January 27). RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, Z., Wang, Z., Zheng, Y., Chuang, Y.-Y., and Satoh, S. (2019, January 15\u201320). Learning to Reduce Dual-Level Discrepancy for Infrared-Visible Person Re-Identification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00071"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ye, M., Ruan, W., Du, B., and Shou, M.Z. (2021, January 11\u201317). Channel augmented joint learning for visible-infrared recognition. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01331"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ling, Y., Zhong, Z., Cao, D., Luo, Z., Lin, Y., Li, S., and Sebe, N. (2022). Cross-Modality Earth Mover\u2019s Distance for Visible Thermal Person Re-Identification. arXiv.","DOI":"10.2139\/ssrn.4342061"},{"key":"ref_16","unstructured":"Jambigi, C., Rawal, R., and Chakraborty, A. (2021). Mmd-reid: A simple but effective solution for visible-thermal person reid. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wu, A., Zheng, W.S., Yu, H.X., Gong, S., and Lai, J. (2017, January 22\u201329). RGB-infrared cross-modality person re-identification. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.575"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gao, Y., Liang, T., Jin, Y., Gu, X., Liu, W., Li, Y., and Lang, C. (2021, January 20\u201324). MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification. Proceedings of the 29th ACM International Conference on Multimedia, New York, NY, USA.","DOI":"10.1145\/3474085.3475643"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4414","DOI":"10.1109\/TMM.2020.3042080","article-title":"Parameter Sharing Exploration and Hetero-Center Triplet Loss for Visible-Thermal Person Re-Identification","volume":"23","author":"Liu","year":"2020","journal-title":"IEEE Trans. Multimedia"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hao, X., Zhao, S., Ye, M., and Shen, J. (2021, January 11\u201317). Cross-Modality Person Re-Identification via Modality Confusion and Center Aggregation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01609"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, H., Cisse, M., Dauphin, Y.N., and Lopez-Paz, D. (2017). mixup: Beyond empirical risk minimization. arXiv.","DOI":"10.1007\/978-1-4899-7687-1_79"},{"key":"ref_22","first-page":"1226","article-title":"Cross-modality person re-identification using local supervision","volume":"40","author":"Kaiwei","year":"2023","journal-title":"Appl. Res. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2843","DOI":"10.11834\/jig.211050","article-title":"Single-modality self-supervised information mining for cross-modality person re-identification","volume":"27","author":"Ancon","year":"2022","journal-title":"J. Image Graph."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., and Zhang, Z. (2022, January 18\u201324). Resnest: Split-attention networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00309"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chen, Q., Wang, Y., Yang, T., Zhang, X., Cheng, J., and Sun, J. (2021, January 19\u201325). You only look one-level feature. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Virtual.","DOI":"10.1109\/CVPR46437.2021.01284"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18\u201323). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00813"},{"key":"ref_30","first-page":"1655","article-title":"Fine-tuning CNN image retrieval with no human annotation","volume":"41","author":"Giorgos","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Nguyen, D.T., Gil Hong, H., Kim, K.W., and Park, K.R. (2017). Person Recognition System Based on a Combination of Body Images from Visible Light and Thermal Cameras. Sensors, 17.","DOI":"10.3390\/s17030605"},{"key":"ref_32","unstructured":"Choi, S., Lee, S., Kim, Y., Kim, T., and Kim, C. (2022, January 18\u201324). Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA."},{"key":"ref_33","first-page":"4610","article-title":"Infrared-Visible Cross-Modal Person Re-Identification with an X Modality","volume":"34","author":"Li","year":"2020","journal-title":"Proc. Conf. AAAI Artif. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ye, M., Shen, J., Crandall, D.J., Shao, L., and Luo, J. (2020, January 23\u201328). Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-identification. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK. Proceedings, Part XVII 16.","DOI":"10.1007\/978-3-030-58520-4_14"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"728","DOI":"10.1109\/TIFS.2020.3001665","article-title":"Visible-Infrared Person Re-Identification via Homogeneous Augmented Tri-Modal Learning","volume":"16","author":"Ye","year":"2020","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Lai, C., Liu, J., Huang, N., and Han, J. (2022, January 18\u201324). FMCNet: Feature-Level Modality Compensation for Visible-Infrared Person Re-Identification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00720"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liu, J., Sun, Y., Zhu, F., Pei, H., Yang, Y., and Li, W. (2022, January 18\u201324). Learning Memory-Augmented Unidirectional Metrics for Cross-modality Person Re-identification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01876"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1109\/TPAMI.2019.2938758","article-title":"Res2net: A new multi-scale backbone architecture","volume":"43","author":"Gao","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2016). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. arXiv.","DOI":"10.1109\/ICCV.2017.74"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/4988\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:40:21Z","timestamp":1760125221000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/4988"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,23]]},"references-count":39,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["s23114988"],"URL":"https:\/\/doi.org\/10.3390\/s23114988","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,5,23]]}}}