{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T10:09:54Z","timestamp":1760609394253,"version":"build-2065373602"},"reference-count":56,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,11,18]],"date-time":"2021-11-18T00:00:00Z","timestamp":1637193600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>RGB\u2013IR cross modality person re-identification (RGB\u2013IR Re-ID) is an important task for video surveillance in poorly illuminated or dark environments. In addition to the common challenge of Re-ID, the large cross-modality variations between RGB and IR images must be considered. The existing RGB\u2013IR Re-ID methods use different network structures to learn the global shared features associated with multi-modalities. However, most global shared feature learning methods are sensitive to background clutter, and contextual feature relationships are not considered among the mined features. To solve these problems, this paper proposes a dual-path attention network architecture MFCNet. SGA (Spatial-Global Attention) module embedded in MFCNet includes spatial attention and global attention branches to mine discriminative features. First, the SGA module proposed in this paper focuses on the key parts of the input image to obtain robust features. Next, the module mines the contextual relationships among features to obtain discriminative features and improve network performance. Finally, extensive experiments demonstrate that the performance of the network architecture proposed in this paper is better than that of state-of-the-art methods under various settings. In the all-search mode of the SYSU and RegDB data sets, the rank-1 accuracy reaches 51.64% and 69.76%, respectively.<\/jats:p>","DOI":"10.3390\/fi13110290","type":"journal-article","created":{"date-parts":[[2021,11,18]],"date-time":"2021-11-18T08:53:56Z","timestamp":1637225636000},"page":"290","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["MFCNet: Mining Features Context Network for RGB\u2013IR Person Re-Identification"],"prefix":"10.3390","volume":"13","author":[{"given":"Jing","family":"Mei","sequence":"first","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huahu","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4915-613X","authenticated-orcid":false,"given":"Yang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Minjie","family":"Bian","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuzhe","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1224","DOI":"10.1109\/TPAMI.2017.2709749","article-title":"SIFT meets CNN: A decade survey of instance retrieval","volume":"40","author":"Zheng","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2553","DOI":"10.1109\/TMM.2016.2605058","article-title":"Person reidentification via ranking aggregation of similarity pulling and dissimilarity pushing","volume":"18","author":"Ye","year":"2016","journal-title":"IEEE Trans. Multimed."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liao, S., Hu, Y., Zhu, X., and Li, S.Z. (2015, January 7\u201312). Person re-identification by local maximal occurrence representation and metric learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298832"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wei, L., Zhang, S., Gao, W., and Tian, Q. (2018, January 18\u201323). Person transfer gan to bridge domain gap for person re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00016"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zheng, Z., Yang, X., Yu, Z., Zheng, L., Yang, Y., and Kautz, J. (2019, January 15\u201320). Joint discriminative and generative learning for person re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00224"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hou, R., Ma, B., Chang, H., Gu, X., Shan, S., and Chen, X. (2019, January 16\u201320). Vrstc: Occlusion-free video person re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00735"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yu, H., Zheng, W., Wu, A., Guo, X., Gong, S., and Lai, J. (2019, January 15\u201320). Unsupervised person re-identification by soft multilabel learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00225"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Shen, X., Jin, Z., Lu, H., and Hua, X.-S. (2019, January 15\u201320). Attribute-driven feature disentangling and temporal aggregation for video person re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00505"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wu, A., Zheng, W., Yu, H., Gong, S., and Lai, J. (2017, January 22\u201329). Rgb-infrared cross-modality person re-identification. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.575"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"11706","DOI":"10.1109\/JSEN.2019.2936916","article-title":"Cross-Modality Person Re-Identification Based on Dual-Path Multi-Branch Network","volume":"19","author":"Xiang","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, D., Li, H., Liu, X., Shen, Y., Shao, J., Yuan, Z., and Wang, X. (2018, January 8\u201314). Improving deep visual representation for person re-identification by global and local image-language association. Proceedings of the 15th European Conference on Computer Vision, ECCV 2018, Munich, Germany.","DOI":"10.1007\/978-3-030-01270-0_4"},{"key":"ref_12","unstructured":"Gong, Y., Zhang, Y., and Poellabauer, C. (November, January 27). Second-order non-local attention networks for person re-identification. Proceedings of the International Conference on Computer Vision (ICCV), Seoul, Korea."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hou, R., Ma, B., Chang, H., Gu, X., Shan, S., and Chen, X. (2019, January 16\u201320). Interaction-and-aggregation network for person re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00954"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, J., Zhu, X., Gong, S., and Li, W. (2018, January 18\u201322). Transferable joint attribute-identity deep learning for unsupervised person re-identification. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00242"},{"key":"ref_15","unstructured":"Fang, P., Zhou, J., Roy, S., Petersson, L., and Harandi, M. (November, January 27). Bilinear attention networks for person retrieval. Proceedings of the International Conference on Computer Vision (ICCV), Seoul, Korea."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, S., Bak, S., Carr, P., and Wang, X. (2018, January 18\u201322). Diversity regularized spatiotemporal attention for video-based person re-identification. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00046"},{"key":"ref_17","unstructured":"Liu, C.-T., Wu, C.-W., Wang, Y.-C.F., and Chien, S.-Y. (2019, January 9\u201312). Spatially and temporally efficient non-local attention network for video-based person re-identification. Proceedings of the 30th British Machine Vision Conference 2019, BMVC 2019, Cardiff, UK."},{"key":"ref_18","unstructured":"Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., and Hoi, S.C.H. (2021, November 14). Deep Learning for Person Re-Identification: A Survey and Outlook. Available online: https:\/\/arxiv.org\/pdf\/2001.04193."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ye, M., Shen, J., Crandall, D.J., Shao, L., and Luo, J. (2020, January 23\u201328). Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-identification. Proceedings of the 2020 European Conference on Computer Vision, ECCV 2020, Glasgow, UK.","DOI":"10.1007\/978-3-030-58520-4_14"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., and Chua, T. (2017, January 21\u201326). Sca-cnn: Spatial and channel-wise attention in convolutional networks for image captioning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.667"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2011","DOI":"10.1109\/TPAMI.2019.2913372","article-title":"Squeeze-and-Excitation Networks","volume":"42","author":"Hu","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","unstructured":"Jaderberg, M., Simonyan, K., Andrew Zisserman, A., and Kavukcuoglu, K. (2015, January 7\u201312). Spatial transformer networks. Proceedings of the Neural Information Processing Systems, Montreal, QB, Canada."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18\u201322). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00813"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1109\/TIFS.2019.2921454","article-title":"Bi-Directional Center-Constrained Top-Ranking for Visible Thermal Person Re-Identification","volume":"15","author":"Ye","year":"2020","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_25","unstructured":"Hao, Y., Wang, N., Li, J., and Gao, X. (February, January 27). HSME: Hypersphere Manifold Embedding for Visible Thermal Person Re-Identification. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.neucom.2020.01.089","article-title":"Enhancing the discriminative feature learning for visible-thermal cross-modality person re-identification","volume":"398","author":"Liu","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2897","DOI":"10.1049\/iet-ipr.2019.0699","article-title":"HPLIN: A feature learning framework for cross-modality person re-identification","volume":"13","author":"Zhao","year":"2020","journal-title":"IET Image Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.neucom.2019.12.100","article-title":"Hetero-Center Loss for Cross-Modality Person Re-Identification","volume":"386","author":"Zhu","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1109\/TIP.2019.2928126","article-title":"Learning Modality-Specific Representations for Visible-Infrared Person Re-Identification","volume":"29","author":"Feng","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lu, Y., Wu, Y., Liu, B., Zhang, T., Li, B., Chu, Q., and Yu, N. (2020, January 13\u201319). Cross-Modality Person Re-Identification With Shared-Specific Feature Transfer. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01339"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, D., Wei, X., Hong, X., and Gong, Y. (2020, January 7\u201312). Infrared-Visible Cross-Modal Person Re-Identification with an X Modality. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i04.5891"},{"key":"ref_32","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems 27 (NIPS 2014), Montreal, QB, Canada."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Dai, P., Ji, R., Wang, H., Wu, Q., and Huang, Y. (2018, January 13\u201319). Cross-Modality Person Re-Identification with Generative Adversarial Training. Proceedings of the 2018 International Joint Conference on Artificial Intelligence, IJCAI 2018, Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/94"},{"key":"ref_34","unstructured":"Wang, G., Zhang, T., Cheng, J., Liu, S., Yang, Y., and Hou, Z. (November, January 27). Rgb-infrared cross-modality person re-identification via joint pixel and feature alignment. Proceedings of the International Conference on Computer Vision (ICCV), Seoul, Korea."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, Z., Wang, Z., Zheng, Y., Chuang, Y., and Satoh, S. (2019, January 15\u201320). Learning to Reduce Dual-Level Discrepancy for Infrared-Visible Person Re-Identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00071"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Choi, S., Lee, S., Kim, Y., Kim, T., and Kim, C. (2020, January 13\u201319). Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01027"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, G., Yang, T., Yang, Y., Yang, T., Cheng, J., Chang, J., Liang, X., and Hou, Z. (2020, January 7\u201312). Cross-Modality Paired-Images Generation for RGB-Infrared Person Re-Identification. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i07.6894"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2020, January 13\u201319). Dual Attention Network for Scene Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR.2019.00326"},{"key":"ref_40","unstructured":"Park, J., Woo, S., Lee, J., and Kweon, I. (2018). BAM: Bottleneck attention module. arXiv."},{"key":"ref_41","unstructured":"Park, J., Woo, S., Lee, J., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the 15th European Conference on Computer Vision, ECCV 2018, Munich, Germany."},{"key":"ref_42","unstructured":"Cao, Y., Xu, J., Lin, S., Wei, F., and Hu, H. (November, January 27). GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond. Proceedings of the International Conference on Computer Vision Workshop, Seoul, Korea."},{"key":"ref_43","first-page":"1655","article-title":"Fine-tuning CNN Image Retrieval with No Human Annotation","volume":"41","author":"Filip","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_44","unstructured":"Zhang, S., Yang, Y., Wang, P., Zhang, X., and Zhang, Y. (2019). Attend to the Difference: Cross-Modality Person Re-identification via Contrastive Correlation. arXiv."},{"key":"ref_45","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201326). Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ye, M., Lan, X., Li, J., and Yuen, P.C. (2018, January 2\u20137). Hierarchical discriminative learning for visible thermal person re-identification. Proceedings of the The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12293"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"9387","DOI":"10.1109\/TIP.2020.2998275","article-title":"Cross-modality person re-identification via modality-aware collaborative ensemble learning","volume":"29","author":"Ye","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Gao, G., Shao, H., Yu, Y., Wu, F., and Yang, M. (2021). Leaning Compact and Representative Features for Cross-Modality Person Re-Identification. arXiv.","DOI":"10.1007\/s11280-022-01014-5"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"6392","DOI":"10.1109\/TIP.2021.3092578","article-title":"Homogeneous-to-Heterogeneous: Unsupervised Learning for RGB-Infrared Person Re-Identification","volume":"30","author":"Liang","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_50","unstructured":"Wei, Z., Yang, X., Wang, N., and Gao, X. (2021). Flexible Body Partition-Based Adversarial Learning for Visible Infrared Person Re-Identification. IEEE Trans. Neural Netw. Learn. Syst., 1\u201312."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Chen, Y., Wan, L., Li, Z., Jing, Q., and Sun, Z. (2021, January 19\u201325). Neural Feature Search for RGB-Infrared Person Re-Identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00065"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Ma, A.J., Yuen, P.C., and Li, J. (2013, January 1\u20138). Domain transfer support vector ranking for person re-identification without target camera label information. Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, Australia.","DOI":"10.1109\/ICCV.2013.443"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1480","DOI":"10.1109\/TIFS.2020.3036800","article-title":"Attribute-Aligned Domain-Invariant Feature Learning for Unsupervised Domain Adaptation Person Re-Identification","volume":"16","author":"Li","year":"2021","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_55","first-page":"C2","article-title":"Triple Adversarial Learning and Multi-view Imaginative Reasoning for Unsupervised Domain Adaptation Person Re-identification","volume":"31","author":"Li","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"103303","DOI":"10.1016\/j.jvcir.2021.103303","article-title":"Camera style transformation with preserved self-similarity and domain-dissimilarity in unsupervised person re-identification","volume":"80","author":"Zhu","year":"2021","journal-title":"J. Vis. Commun. Image Represent."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/11\/290\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:32:21Z","timestamp":1760167941000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/11\/290"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,18]]},"references-count":56,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["fi13110290"],"URL":"https:\/\/doi.org\/10.3390\/fi13110290","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2021,11,18]]}}}