{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T08:06:39Z","timestamp":1784102799181,"version":"3.55.0"},"reference-count":53,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T00:00:00Z","timestamp":1784073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Image\u2013Text retrieval requires accurate semantic alignment between visual content and natural language descriptions. Most existing methods primarily rely on region features, which are typically object-centric and may overlook important contextual information. In contrast, grid features provide denser spatial coverage and richer local details, but often lack explicit semantic structure. To better exploit their complementarity, we propose a novel Region\u2013Grid Interaction and Calibration Network (RGICN) for Image\u2013Text retrieval. Specifically, we first design a Global-Guided Feature Interaction Module to promote information exchange between region and grid features under the guidance of global visual semantics, allowing object-level semantics and contextual cues to complement each other. We then introduce a Text-Guided Feature Calibration Module, which leverages auxiliary image descriptions to calibrate visual features by suppressing redundant and text-irrelevant content. Finally, an Adaptive Gating Fusion Module is developed to dynamically integrate multiple visual representations according to the input image, yielding a more comprehensive and discriminative visual embedding. Extensive experiments on the benchmark datasets MS-COCO and Flickr30K demonstrate the effectiveness of RGICN and its competitive performance against recent state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/s26144483","type":"journal-article","created":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T07:29:39Z","timestamp":1784100579000},"page":"4483","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Enhancing Image\u2013Text Retrieval via Region\u2013Grid Interaction and Semantic Calibration"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-2279-3772","authenticated-orcid":false,"given":"Can","family":"Lu","sequence":"first","affiliation":[{"name":"School of Mechanical and Power Engineering, Nanjing Tech University, Nanjing 211816, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muye","family":"Feng","sequence":"additional","affiliation":[{"name":"School of Mechanical and Power Engineering, Nanjing Tech University, Nanjing 211816, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,7,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7555","DOI":"10.1109\/TMM.2024.3369968","article-title":"A Mutually Textual and Visual Refinement Network for Image\u2013Text Matching","volume":"26","author":"Pang","year":"2024","journal-title":"IEEE Trans. Multimed."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"6542","DOI":"10.1109\/TCSVT.2024.3358411","article-title":"Fast, accurate, and lightweight memory-enhanced embedding learning framework for image\u2013text retrieval","volume":"34","author":"Li","year":"2024","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_3","unstructured":"Faghri, F., Fleet, D.J., Kiros, J.R., and Fidler, S. (2018, January 3\u20136). VSE++: Improving Visual-Semantic Embeddings with Hard Negatives. Proceedings of the British Machine Vision Conference, Newcastle upon Tyne, UK."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, K., Zhang, Y., Li, K., Li, Y., and Fu, Y. (2019). Visual semantic reasoning for image\u2013text matching. Proceedings of the IEEE\/CVF International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV.2019.00475"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lee, K.H., Chen, X., Hua, G., Hu, H., and He, X. (2018). Stacked cross attention for image\u2013text matching. Proceedings of the European Conference on Computer Vision (ECCV), Springer.","DOI":"10.1007\/978-3-030-01225-0_13"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Cao, J., Qian, S., Zhang, H., Fang, Q., and Xu, C. (2021). Global Relation-Aware Attention Network for Image\u2013Text Retrieval. Proceedings of the 2021 International Conference on Multimedia Retrieval, ACM.","DOI":"10.1145\/3460426.3463615"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2973","DOI":"10.1109\/TCSVT.2023.3307554","article-title":"Enhanced semantic similarity learning framework for image\u2013text matching","volume":"34","author":"Zhang","year":"2023","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Anderson, P., He, X., Buehler, C., Teney, D., Johnson, M., Gould, S., and Zhang, L. (2018). Bottom-up and top-down attention for image captioning and visual question answering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2018.00636"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fu, Z., Zhang, L., Xia, H., and Mao, Z. (2024). Linguistic-aware patch slimming framework for fine-grained cross-modal alignment. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52733.2024.02485"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5676","DOI":"10.1609\/aaai.v39i6.32605","article-title":"Asymmetric Visual Semantic Embedding Framework for Efficient Vision-Language Alignment","volume":"Volume 39","author":"Liu","year":"2025","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"24290","DOI":"10.1609\/aaai.v40i29.39609","article-title":"Aligning the True Semantics: Constrained Decoupling and Distribution Sampling for Cross-Modal Alignment","volume":"Volume 40","author":"Ma","year":"2026","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"22200","DOI":"10.1609\/aaai.v40i26.39376","article-title":"Multi-View Differential Mixing and Graph-Guided Structural Region Selection for Cross-Modal Alignment","volume":"Volume 40","author":"Ji","year":"2026","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ma, X., Xu, L., Fang, L., Zhang, C., and Cui, L. (2025). Reliable Cross-modal Alignment via Prototype Iterative Construction. Proceedings of the 33rd ACM International Conference on Multimedia, ACM.","DOI":"10.1145\/3746027.3755216"},{"key":"ref_15","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2866","DOI":"10.1109\/TCSVT.2020.3030656","article-title":"Learning dual semantic relations with graph attention for image\u2013text matching","volume":"31","author":"Wen","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wu, D., Li, H., Gu, C., Guo, L., and Liu, H. (2022). Improving fusion of region features and grid features via two-step interaction for image\u2013text retrieval. Proceedings of the 30th ACM International Conference on Multimedia, ACM.","DOI":"10.1145\/3503161.3548223"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3827","DOI":"10.1109\/TMM.2023.3316077","article-title":"Feature first: Advancing image\u2013text retrieval through improved visual features","volume":"26","author":"Wu","year":"2023","journal-title":"IEEE Trans. Multimed."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chen, H., Ding, G., Liu, X., Lin, Z., Liu, J., and Han, J. (2020). Imram: Iterative matching with recurrent attention memory for cross-modal image\u2013text retrieval. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR42600.2020.01267"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3341","DOI":"10.1109\/TIP.2024.3396063","article-title":"Deep Boosting Learning: A Brand-New Cooperative Approach for Image\u2013Text Matching","volume":"33","author":"Diao","year":"2024","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1921","DOI":"10.1109\/TCSVT.2024.3480949","article-title":"Selectively Hard Negative Mining for Alleviating Gradient Vanishing in Image\u2013Text Matching","volume":"35","author":"Li","year":"2025","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1867","DOI":"10.1109\/TMM.2023.3289753","article-title":"Commonsense-Guided Semantic and Relational Consistencies for Image\u2013Text Retrieval","volume":"26","author":"Li","year":"2024","journal-title":"IEEE Trans. Multimed."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Fu, Z., Mao, Z., Song, Y., and Zhang, Y. (2023). Learning Semantic Relationship among Instances for Image\u2013Text Matching. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52729.2023.01455"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chen, J., Hu, H., Wu, H., Jiang, Y., and Wang, C. (2021). Learning the best pooling strategy for visual semantic embedding. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR46437.2021.01553"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1109\/TIP.2023.3348297","article-title":"USER: Unified Semantic Enhancement with Momentum Contrast for Image\u2013Text Retrieval","volume":"33","author":"Zhang","year":"2024","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"9723","DOI":"10.1109\/TMM.2025.3618550","article-title":"Similarity Shuffled Criss-Cross Transformer with Angle Loss for Image\u2013Text Matching","volume":"27","author":"Chen","year":"2025","journal-title":"IEEE Trans. Multimed."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Pan, Z., Wu, F., and Zhang, B. (2023). Fine-grained image\u2013text matching by cross-modal hard aligning network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52729.2023.01847"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, K., Mao, Z., Wang, Q., and Zhang, Y. (2022). Negative-aware attention framework for image\u2013text matching. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52688.2022.01521"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"19269","DOI":"10.1609\/aaai.v39i18.34121","article-title":"TSVC: Tripartite Learning with Semantic Variation Consistency for Robust Image\u2013Text Retrieval","volume":"Volume 39","author":"Lyu","year":"2025","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3714431","article-title":"Hire: Hybrid-modal interaction with multiple relational enhancements for image\u2013text matching","volume":"16","author":"Ge","year":"2025","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2581","DOI":"10.1109\/TCSVT.2025.3605958","article-title":"Beyond One and Two Tower: Cross-Modal Consensus Learning for Image\u2013Text Retrieval","volume":"36","author":"Shi","year":"2026","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_33","unstructured":"Zong, X., Zhong, X., Liu, W., Ding, J., Yu, Z., and Huang, T. (2026). Brain-Inspired Multimodal Spiking Neural Network for Image\u2013Text Retrieval. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Abdal Hafeth, D., and Kollias, S. (2024). Insights into Object Semantics: Leveraging Transformer Networks for Advanced Image Captioning. Sensors, 24.","DOI":"10.3390\/s24061796"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"23703","DOI":"10.1609\/aaai.v40i28.39544","article-title":"Cross Modal Fine-grained Alignment via Granularity-aware and Region-uncertain Modeling","volume":"Volume 40","author":"Liu","year":"2026","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"130412","DOI":"10.1016\/j.eswa.2025.130412","article-title":"PVMNet: A navel orange defect detection algorithm based on Mamba structure","volume":"300","author":"Huang","year":"2025","journal-title":"Expert Syst. Appl."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1007\/s00530-025-02152-2","article-title":"YOLO-TCS: An enhanced multi-scale network for traffic sign detection integrating multi-level feature fusion and attention","volume":"32","author":"Yu","year":"2026","journal-title":"Multimed. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"124551","DOI":"10.1016\/j.eswa.2024.124551","article-title":"Multi-task learning for hand heat trace time estimation and identity recognition","volume":"255","author":"Yu","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"105223","DOI":"10.1016\/j.infrared.2024.105223","article-title":"Deep soft threshold feature separation network for infrared handprint identity recognition and time estimation","volume":"138","author":"Yu","year":"2024","journal-title":"Infrared Phys. Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"e2500224","DOI":"10.1002\/qute.202500224","article-title":"Dual discriminators quantum generation adversarial network based on quantum convolutional neural network","volume":"8","author":"Gong","year":"2025","journal-title":"Adv. Quantum Technol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2400530","DOI":"10.1002\/qute.202400530","article-title":"Multi-party semi-quantum private comparison protocol of size relation with d-level GHZ states","volume":"8","author":"Zhou","year":"2025","journal-title":"Adv. Quantum Technol."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_43","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"34892","DOI":"10.52202\/075280-1516","article-title":"Visual instruction tuning","volume":"36","author":"Liu","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_45","unstructured":"Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., and Clark, J. (2021). Learning transferable visual models from natural language supervision. Proceedings of the International Conference on Machine Learning, PmLR."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1162\/tacl_a_00166","article-title":"From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions","volume":"2","author":"Young","year":"2014","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.1609\/aaai.v35i2.16209","article-title":"Similarity reasoning and filtration for image\u2013text matching","volume":"Volume 35","author":"Diao","year":"2021","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1007\/s11263-016-0981-7","article-title":"Visual genome: Connecting language and vision using crowdsourced dense image annotations","volume":"123","author":"Krishna","year":"2017","journal-title":"Int. J. Comput. Vis."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Huang, Y., Wu, Q., Song, C., and Wang, L. (2018). Learning semantic concepts and order for image and sentence matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2018.00645"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Gu, J., Cai, J., Joty, S.R., Niu, L., and Wang, G. (2018). Look, imagine and match: Improving textual-visual cross-modal retrieval with generative models. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2018.00750"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Lei, Z., Zhang, Z., and Li, S.Z. (2020). Context-aware attention network for image\u2013text retrieval. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR42600.2020.00359"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Liu, C., Mao, Z., Zhang, T., Xie, H., Wang, B., and Zhang, Y. (2020). Graph structured network for image\u2013text matching. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR42600.2020.01093"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/14\/4483\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T07:31:06Z","timestamp":1784100666000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/14\/4483"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,15]]},"references-count":53,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2026,7]]}},"alternative-id":["s26144483"],"URL":"https:\/\/doi.org\/10.3390\/s26144483","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,15]]}}}