{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T13:58:00Z","timestamp":1763992680369,"version":"3.45.0"},"reference-count":72,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2025,11,22]],"date-time":"2025-11-22T00:00:00Z","timestamp":1763769600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Frontier Research Fund of Institute of Optics and Electronics, China Academy of Sciences","award":["C21K005","C24K003"],"award-info":[{"award-number":["C21K005","C24K003"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62101529"],"award-info":[{"award-number":["62101529"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Multi-modal object tracking (MMOT) has received widespread attention for the ability to overcome single-sensor perception limitations. However, existing methods encounter several critical challenges. Representation learning and generalization capabilities of models are constrained by the inherent heterogeneity of cross-task multi-modal data and inter-modal synergy imbalance. Particularly, in dynamically changing complex scenarios, the reliability and stability of data significantly degrade, further exacerbating the difficulty in multi-modal consistent perception and aggregation. To tackle the above issues, we propose SMUTrack, a unified framework with global shared parameters integrating three downstream MMOT tasks. SMUTrack implements a batch merging-and-splitting alternating strategy, coupled with multi-task joint training, to establish latent correlations across inter- and intra-task modalities, effectively avoiding over-reliance on certain modalities. Concurrently, we design a hierarchical modality synergy and reinforcement (HMSR) module, and a gated fusion and context awareness (GFCA) module to enable progressive multi-modal information exchange and integration, yielding the more discriminative and robust multi-modal representation. More importantly, we introduce a spatial\u2013temporal information propagation (SIP) mechanism, which synchronously learns object trajectory cues and appearance variations to effectively build contextual relationships in long-term video tracking. Experimental results definitively validate the outstanding performance of SMUTrack on mainstream MMOT datasets, exhibiting its powerful adaptability to various MMOT tasks.<\/jats:p>","DOI":"10.3390\/jimaging11120421","type":"journal-article","created":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T13:09:25Z","timestamp":1763989765000},"page":"421","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Unified Multi-Modal Object Tracking Through Spatial\u2013Temporal Propagation and Modality Synergy"],"prefix":"10.3390","volume":"11","author":[{"given":"Jiajia","family":"Wu","sequence":"first","affiliation":[{"name":"State Key Laboratory of Optical Field Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"},{"name":"National Laboratory on Adaptive Optics, Chengdu 610209, China"},{"name":"Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haorui","family":"Zuo","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Optical Field Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"},{"name":"National Laboratory on Adaptive Optics, Chengdu 610209, China"},{"name":"Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuxing","family":"Wei","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Optical Field Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"},{"name":"National Laboratory on Adaptive Optics, Chengdu 610209, China"},{"name":"Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2727-1391","authenticated-orcid":false,"given":"Meihui","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Optical Field Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"},{"name":"National Laboratory on Adaptive Optics, Chengdu 610209, China"},{"name":"Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5284-2942","authenticated-orcid":false,"given":"Jianlin","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Optical Field Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"},{"name":"National Laboratory on Adaptive Optics, Chengdu 610209, China"},{"name":"Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,22]]},"reference":[{"key":"ref_1","unstructured":"Bhat, G., Danelljan, M., Gool, L.V., and Timofte, R. (November, January 27). Learning discriminative model prediction for tracking. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ye, B., Chang, H., Ma, B., Shan, S., and Chen, X. (2022, January 23\u201327). Joint feature learning and relation modeling for tracking: A one-stream framework. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-20047-2_20"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wei, X., Bai, Y., Zheng, Y., Shi, D., and Gong, Y. (2023, January 17\u201324). Autoregressive visual tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00935"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3159","DOI":"10.1109\/TPAMI.2025.3529926","article-title":"OmniTracker: Unifying Visual Object Tracking by Tracking-with-Detection","volume":"47","author":"Wang","year":"2025","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4120","DOI":"10.1109\/TIP.2025.3573527","article-title":"SiamTITP: Incorporating Temporal Information and Trajectory Prediction Siamese Network for Satellite Video Object Tracking","volume":"34","author":"Zhou","year":"2025","journal-title":"IEEE Trans. Image Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"18964","DOI":"10.1109\/TITS.2024.3437645","article-title":"EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving","volume":"25","author":"Lin","year":"2024","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cho, M., and Kim, E. (2023). 3D LiDAR Multi-Object Tracking with Short-Term and Long-Term Multi-Level Associations. Remote Sens., 15.","DOI":"10.3390\/rs15235486"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Wang, L., Patel, V.M., Xie, X., and Lai, J. (2024, January 16\u201322). View-decoupled transformer for person re-identification under aerial-ground camera network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.02077"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Meng, W., Duan, S., Ma, S., and Hu, B. (2025). Motion-Perception Multi-Object Tracking (MPMOT): Enhancing Multi-Object Tracking Performance via Motion-Aware Data Association and Trajectory Connection. J. Imaging, 11.","DOI":"10.3390\/jimaging11050144"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2021.05.011","article-title":"Recent advances of single-object tracking methods: A brief survey","volume":"455","author":"Zhang","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"9509815","DOI":"10.1109\/TIM.2024.3398108","article-title":"Robust object pose tracking for augmented reality guidance and teleoperation","volume":"73","author":"Black","year":"2024","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"101881","DOI":"10.1016\/j.inffus.2023.101881","article-title":"Exploring fusion strategies for accurate RGBT visual object tracking","volume":"99","author":"Tang","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gao, S., Yang, J., Li, Z., Zheng, F., Leonardis, A., and Song, J. (2022, January 23\u201327). Learning dual-fused modality-aware representations for RGBD tracking. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-25085-9_27"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhu, X.-F., Xu, T., Tang, Z., Wu, Z., Liu, H., Yang, X., Wu, X.-J., and Kittler, J. (2023, January 7\u201314). RGBD1K: A large-scale dataset and benchmark for RGB-D object tracking. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.","DOI":"10.1609\/aaai.v37i3.25500"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sun, C., Zhang, J., Wang, Y., Ge, H., Xia, Q., Yin, B., and Yang, X. (2025, January 11\u201317). Exploring Historical Information for RGBE Visual Tracking with Mamba. Proceedings of the Computer Vision and Pattern Recognition Conference, Nashville, TN, USA.","DOI":"10.1109\/CVPR52734.2025.00609"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"113531","DOI":"10.1016\/j.knosys.2025.113531","article-title":"RGB-D visual object tracking with transformer-based multi-modal feature fusion","volume":"322","author":"Gao","year":"2025","journal-title":"Knowl.-Based Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"7386","DOI":"10.1109\/TCSVT.2024.3377471","article-title":"AMNet: Learning to Align Multi-Modality for RGB-T Tracking","volume":"34","author":"Zhang","year":"2024","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhu, Z., Hou, J., and Wu, D.O. (2023, January 1\u20136). Cross-modal orthogonal high-rank augmentation for rgb-event transformer-trackers. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Paris, France.","DOI":"10.1109\/ICCV51070.2023.02015"},{"key":"ref_19","first-page":"5000419","article-title":"Thermal Infrared Target Tracking: A Comprehensive Review","volume":"73","author":"Yuan","year":"2024","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Xue, Y., Zhang, J., Lin, Z., Li, C., Huo, B., and Zhang, Y. (2023). SiamCAF: Complementary Attention Fusion-Based Siamese Network for RGBT Tracking. Remote Sens., 15.","DOI":"10.3390\/rs15133252"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, J., Gao, S., Li, Z., Zheng, F., and Leonardis, A. (2023, January 17\u201324). Resource-efficient rgbd aerial tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01285"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"9102","DOI":"10.1109\/TCSVT.2024.3396289","article-title":"Toward Modalities Correlation for RGB-T Tracking","volume":"34","author":"Hu","year":"2024","journal-title":"IEEE Trans. Circuit Syst. Video Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1997","DOI":"10.1109\/TCYB.2023.3318601","article-title":"Visevent: Reliable object tracking via collaboration of frame and event flows","volume":"54","author":"Wang","year":"2023","journal-title":"IEEE Trans. Cybern."},{"key":"ref_24","unstructured":"Cao, B., Guo, J., Zhu, P., and Hu, Q. (2024, January 20\u201327). Bi-directional adapter for multimodal tracking. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhu, J., Lai, S., Chen, X., Wang, D., and Lu, H. (2023, January 17\u201324). Visual prompt multi-modal tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00918"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hou, X., Xing, J., Qian, Y., Guo, Y., Xin, S., Chen, J., Tang, K., Wang, M., Jiang, Z., and Liu, L. (2024, January 16\u201322). Sdstrack: Self-distillation symmetric adapter learning for multi-modal visual object tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.02507"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2526011","DOI":"10.1109\/TIM.2024.3421435","article-title":"AMATrack: A Unified Network with Asymmetric Multimodal Mixed Attention for RGBD Tracking","volume":"73","author":"Ye","year":"2024","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_28","unstructured":"Tang, Z., Xu, T., Wu, X., Zhu, X.-F., and Kittler, J. (2024, January 20\u201327). Generative-based fusion mechanism for multi-modal tracking. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wu, Z., Zheng, J., Ren, X., Vasluianu, F.-A., Ma, C., Paudel, D.P., Van Gool, L., and Timofte, R. (2024, January 16\u201322). Single-model and any-modality for video object tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.01812"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chen, X., Peng, H., Wang, D., Lu, H., and Hu, H. (2023, January 17\u201324). Seqtrack: Sequence to sequence learning for visual object tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01400"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yan, B., Peng, H., Fu, J., Wang, D., and Lu, H. (2021, January 10\u201317). Learning spatio-temporal transformer for visual tracking. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01028"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"7373","DOI":"10.1109\/TCSVT.2024.3376582","article-title":"PromptVT: Prompting for Efficient and Accurate Visual Tracking","volume":"34","author":"Zhang","year":"2024","journal-title":"IEEE Trans. Circuit Syst. Video Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"111053","DOI":"10.1016\/j.patcog.2024.111053","article-title":"Temporal adaptive bidirectional bridging for RGB-D tracking","volume":"158","author":"Ying","year":"2025","journal-title":"Pattern Recognit."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xie, J., Zhong, B., Mo, Z., Zhang, S., Shi, L., Song, S., and Ji, R. (2024, January 16\u201322). Autoregressive Queries for Adaptive Tracking with Spatio-Temporal Transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.01826"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"15834","DOI":"10.1109\/TPAMI.2023.3307174","article-title":"Towards real-world visual tracking with temporal contexts","volume":"45","author":"Cao","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Cao, Z., Huang, Z., Pan, L., Zhang, S., Liu, Z., and Fu, C. (2022, January 18\u201324). TCTrack: Temporal contexts for aerial tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01438"},{"key":"ref_37","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"He, K., Chen, X., Xie, S., Li, Y., Doll\u00e1r, P., and Girshick, R. (2022, January 18\u201324). Masked autoencoders are scalable vision learners. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Yan, S., Yang, J., K\u00e4pyl\u00e4, J., Zheng, F., Leonardis, A., and K\u00e4m\u00e4r\u00e4inen, J.-K. (2021, January 10\u201317). Depthtrack: Unveiling the power of rgbd tracking. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01055"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1109\/TIP.2021.3130533","article-title":"LasHeR: A large-scale high-diversity benchmark for RGBT tracking","volume":"31","author":"Li","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_41","unstructured":"Loshchilov, I., and Hutter, F. (2017). Decoupled weight decay regularization. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Hong, L., Yan, S., Zhang, R., Li, W., Zhou, X., Guo, P., Jiang, K., Chen, Y., Li, J., and Chen, Z. (2024, January 16\u201322). Onetracker: Unifying visual object tracking with foundation models and efficient tuning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.01805"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yang, J., Li, Z., Zheng, F., Leonardis, A., and Song, J. (2022, January 10\u201314). Prompting for multi-modal tracking. Proceedings of the 30th ACM International Conference on Multimedia, Lisbon, Portugal.","DOI":"10.1145\/3503161.3547851"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Xie, F., Wang, C., Wang, G., Cao, Y., Yang, W., and Zeng, W. (2022, January 18\u201324). Correlation-aware deep tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00855"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Mayer, C., Danelljan, M., Paudel, D.P., and Van Gool, L. (2021, January 10\u201317). Learning target candidate association to keep track of what not to track. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01319"},{"key":"ref_46","unstructured":"Kristan, M., Matas, J., Leonardis, A., Felsberg, M., Pflugfelder, R., K\u00e4m\u00e4r\u00e4inen, J.-K., Chang, H.J., Danelljan, M., Cehovin, L., and Luke\u017ei\u010d, A. (2021, January 10\u201317). The ninth visual object tracking vot2021 challenge results. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Qian, Y., Yan, S., Luke\u017ei\u010d, A., Kristan, M., K\u00e4m\u00e4r\u00e4inen, J.-K., and Matas, J. (2021, January 10\u201315). DAL: A deep depth-aware long-term tracker. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9412984"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Zhao, P., Liu, Q., Wang, W., and Guo, Q. (2021, January 10\u201315). Tsdm: Tracking by siamrpn++ with a depth-refiner and a mask-generator. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9413315"},{"key":"ref_49","unstructured":"Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., K\u00e4m\u00e4r\u00e4inen, J.-K., Danelljan, M., Zajc, L.\u010c., Luke\u017ei\u010d, A., and Drbohlav, O. (2020, January 23\u201328). The eighth visual object tracking VOT2020 challenge results. Proceedings of the Computer Vision\u2013ECCV 2020 Workshops, Glasgow, UK. Proceedings, Part V."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Dai, K., Zhang, Y., Wang, D., Li, J., Lu, H., and Yang, X. (2020, January 13\u201319). High-performance long-term tracking with meta-updater. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00633"},{"key":"ref_51","unstructured":"Kristan, M., Matas, J., Leonardis, A., Felsberg, M., Pflugfelder, R., K\u00e4m\u00e4r\u00e4inen, J.-K., \u010cehovin Zajc, L., Drbohlav, O., Lukezic, A., and Berg, A. (November, January 27). The seventh visual object tracking VOT2019 challenge results. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops, Seoul, Republic of Korea."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Bhat, G., Khan, F.S., and Felsberg, M. (2019, January 15\u201320). Atom: Accurate tracking by overlap maximization. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00479"},{"key":"ref_53","unstructured":"Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., K\u00e4m\u00e4r\u00e4inen, J.-K., Chang, H.J., Danelljan, M., Zajc, L.\u010c., and Luke\u017ei\u010d, A. (2022, January 23\u201327). The tenth visual object tracking vot2022 challenge results. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Wang, H., Liu, X., Li, Y., Sun, M., Yuan, D., and Liu, J. (2024, January 20\u201327). Temporal adaptive rgbt tracking with modality prompt. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.","DOI":"10.1609\/aaai.v38i6.28352"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Hui, T., Xun, Z., Peng, F., Huang, J., Wei, X., Wei, X., Dai, J., Han, J., and Liu, S. (2023, January 17\u201324). Bridging search region interaction with template for rgb-t tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01310"},{"key":"ref_56","unstructured":"Xiao, Y., Yang, M., Li, C., Liu, L., and Tang, J. (March, January 22). Attribute-based progressive fusion network for rgbt tracking. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual Event."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Zhang, P., Zhao, J., Wang, D., Lu, H., and Ruan, X. (2022, January 18\u201324). Visible-thermal UAV tracking: A large-scale benchmark and new baseline. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00868"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., and Lu, H. (2021, January 10\u201317). Transformer tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Montreal, QC, Canada.","DOI":"10.1109\/CVPR46437.2021.00803"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Wang, C., Xu, C., Cui, Z., Zhou, L., Zhang, T., Zhang, X., and Yang, J. (2020, January 13\u201319). Cross-modal pattern-propagation for RGB-T tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00709"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Li, C., Liu, L., Lu, A., Ji, Q., and Tang, J. (2020, January 23\u201328). Challenge-aware RGBT tracking. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58542-6_14"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1109\/TIV.2020.2980735","article-title":"Quality-aware feature aggregation network for robust RGBT tracking","volume":"6","author":"Zhu","year":"2020","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_62","unstructured":"Zhang, L., Danelljan, M., Gonzalez-Garcia, A., Van De Weijer, J., and Shahbaz Khan, F. (November, January 27). Multi-modal fusion for end-to-end RGB-T tracking. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops, Seoul, Republic of Korea."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Li, C., Luo, B., Tang, J., and Wang, X. (2019, January 21\u201325). Dense feature aggregation and pruning for RGBT tracking. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France.","DOI":"10.1145\/3343031.3350928"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Li, C., Zhao, N., Lu, Y., Zhu, C., and Tang, J. (2017, January 23\u201327). Weighted sparse representation regularized graph learning for RGB-T object tracking. Proceedings of the 25th ACM International Conference on Multimedia, Mountain View, CA, USA.","DOI":"10.1145\/3123266.3123289"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"106977","DOI":"10.1016\/j.patcog.2019.106977","article-title":"RGB-T Object Tracking: Benchmark and Baseline","volume":"96","author":"Li","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Guo, D., Wang, J., Cui, Y., Wang, Z., and Chen, S. (2020, January 13\u201319). SiamCAR: Siamese fully convolutional classification and regression for visual tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00630"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Voigtlaender, P., Luiten, J., Torr, P.H., and Leibe, B. (2020, January 13\u201319). Siam r-cnn: Visual tracking by re-detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00661"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Gool, L.V., and Timofte, R. (2020, January 13\u201319). Probabilistic regression for visual tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00721"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Chen, Z., Zhong, B., Li, G., Zhang, S., and Ji, R. (2020, January 13\u201319). Siamese box adaptive network for visual tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00670"},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Wang, Q., Zhang, L., Bertinetto, L., Hu, W., and Torr, P.H. (2019, January 15\u201320). Fast online object tracking and segmentation: A unifying approach. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00142"},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Song, Y., Ma, C., Wu, X., Gong, L., Bao, L., Zuo, W., Shen, C., Lau, R.W., and Yang, M.-H. (2018, January 18\u201323). Vital: Visual tracking via adversarial learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00937"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Nam, H., and Han, B. (2016, January 27\u201330). Learning multi-domain convolutional neural networks for visual tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.465"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/12\/421\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T13:53:15Z","timestamp":1763992395000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/12\/421"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,22]]},"references-count":72,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["jimaging11120421"],"URL":"https:\/\/doi.org\/10.3390\/jimaging11120421","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,22]]}}}