{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T23:06:43Z","timestamp":1789081603235,"version":"build-2803163510"},"reference-count":69,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,12,30]],"date-time":"2024-12-30T00:00:00Z","timestamp":1735516800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,12,30]],"date-time":"2024-12-30T00:00:00Z","timestamp":1735516800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis. Intell."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper, we first investigate the phenomenon of the spatial-temporal initialization dilemma towards realistic visual tracking, which may adversely affect tracking performance. We summarize the aforementioned phenomenon by comparing differences of the initialization manners in existing tracking benchmarks and in real-world applications. The existing tracking benchmarks provide offline sequences and the expert annotations in the initial frame for trackers. However, in real-world applications, a tracker is often initialized by user annotations or an object detector, which may provide rough and inaccurate initialization. Moreover, annotation from the external feedback also introduces extra time costs while the video stream will not pause for waiting. We select four representative trackers and conduct full performance comparison on popular datasets with simulated initialization to intuitively describe the initialization dilemma of the task. Then, we propose a simple compensation framework to address this dilemma. The framework contains spatial-refine and temporal-chasing modules to mitigate performance degradation caused by the initialization dilemma. Furthermore, the proposed framework can be compatible with various popular trackers without retraining. Extensive experiments verify the effectiveness of our compensation framework.<\/jats:p>","DOI":"10.1007\/s44267-024-00068-5","type":"journal-article","created":{"date-parts":[[2024,12,30]],"date-time":"2024-12-30T07:51:01Z","timestamp":1735545061000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Spatial-temporal initialization dilemma: towards realistic visual tracking"],"prefix":"10.1007","volume":"2","author":[{"given":"Chang","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongsheng","family":"Yuan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huchuan","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6976-4004","authenticated-orcid":false,"given":"Dong","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,12,30]]},"reference":[{"key":"68_CR1","first-page":"5374","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"H. Fan","year":"2019","unstructured":"Fan, H., Lin, L., Yang, F., Chu, P., Deng, G., Yu, S., et al. (2019). LaSOT: a high-quality benchmark for large-scale single object tracking. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 5374\u20135383). Piscataway: IEEE."},{"issue":"5","key":"68_CR2","doi-asserted-by":"publisher","first-page":"1562","DOI":"10.1109\/TPAMI.2019.2957464","volume":"43","author":"L. Huang","year":"2021","unstructured":"Huang, L., Zhao, X., & Huang, K. (2021). Got-10k: a large high-diversity benchmark for generic object tracking in the wild. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(5), 1562\u20131577.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"68_CR3","first-page":"300","volume-title":"Proceedings of the 15th European conference on computer vision","author":"M. Muller","year":"2018","unstructured":"Muller, M., Bibi, A., Giancola, S., Alsubaihi, S., & Ghanem, B. (2018). TrackingNet: a large-scale dataset and benchmark for object tracking in the wild. In V. Ferrari, M. Hebert, C. Sminchisescu, et al. (Eds.), Proceedings of the 15th European conference on computer vision (pp. 300\u2013317). Cham: Springer."},{"key":"68_CR4","first-page":"8971","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"B. Li","year":"2018","unstructured":"Li, B., Yan, J., Wu, W., Zhu, Z., & Hu, X. (2018). High performance visual tracking with Siamese region proposal network. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 8971\u20138980). Piscataway: IEEE."},{"key":"68_CR5","first-page":"4282","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"B. Li","year":"2019","unstructured":"Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., & Yan, J. (2019). SiamRPN++: evolution of Siamese visual tracking with very deep networks. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 4282\u20134291). Piscataway: IEEE."},{"key":"68_CR6","first-page":"103","volume-title":"Proceedings of the 15th European conference on computer vision","author":"Z. Zhu","year":"2018","unstructured":"Zhu, Z., Wang, Q., Li, B., Wu, W., Yan, J., & Hu, W. (2018). Distractor-aware Siamese networks for visual object tracking. In V. Ferrari, M. Hebert, C. Sminchisescu, et al. (Eds.), Proceedings of the 15th European conference on computer vision (pp. 103\u2013119). Cham: Springer."},{"key":"68_CR7","first-page":"771","volume-title":"Proceedings of the 16th European conference on computer vision","author":"Z. Zhang","year":"2020","unstructured":"Zhang, Z., Peng, H., Fu, J., Li, B., & Hu, W. (2020). Ocean: object-aware anchor-free tracking. In A. Vedaldi, H. Bischof, T. Brox, et al. (Eds.), Proceedings of the 16th European conference on computer vision (pp. 771\u2013787). Cham: Springer."},{"key":"68_CR8","first-page":"12,549","volume-title":"Proceedings of the 34th AAAI conference on artificial intelligence","author":"Y. Xu","year":"2020","unstructured":"Xu, Y., Wang, Z., Li, Z., Yuan, Y., & Yu, G. (2020). SiamFC++: towards robust and accurate visual tracking with target estimation guidelines. In Proceedings of the 34th AAAI conference on artificial intelligence (pp. 12,549\u201312,556). Palo Alto: AAAI Press."},{"issue":"5","key":"68_CR9","first-page":"6168","volume":"45","author":"J. Zhao","year":"2023","unstructured":"Zhao, J., Dai, K., Zhang, P., Wang, D., & Lu, H. (2023). Robust online tracking with meta-updater. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(5), 6168\u20136182.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"68_CR10","first-page":"6182","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision","author":"G. Bhat","year":"2019","unstructured":"Bhat, G., Danelljan, M., Gool, L. V., & Timofte, R. (2019). Learning discriminative model prediction for tracking. In Proceedings of the IEEE\/CVF international conference on computer vision (pp. 6182\u20136191). Piscataway: IEEE."},{"key":"68_CR11","first-page":"7183","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"M. Danelljan","year":"2020","unstructured":"Danelljan, M., Gool, L. V., & Timofte, R. (2020). Probabilistic regression for visual tracking. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 7183\u20137192). Piscataway: IEEE."},{"key":"68_CR12","first-page":"1571","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"N. Wang","year":"2021","unstructured":"Wang, N., Zhou, W., Wang, J., & Li, H. (2021). Transformer meets tracker: exploiting temporal context for robust visual tracking. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 1571\u20131580). Piscataway: IEEE."},{"key":"68_CR13","first-page":"13,444","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision","author":"C. Mayer","year":"2021","unstructured":"Mayer, C., Danelljan, M., Paudel, D. P., & Van Gool, L. (2021). Learning target candidate association to keep track of what not to track. In Proceedings of the IEEE\/CVF international conference on computer vision (pp. 13,444\u201313,454). Piscataway: IEEE."},{"key":"68_CR14","first-page":"205","volume-title":"Proceedings of the 16th European conference on computer vision","author":"G. Bhat","year":"2020","unstructured":"Bhat, G., Danelljan, M., Gool, L. V., & Timofte, R. (2020). Know your surroundings: exploiting scene information for object tracking. In A. Vedaldi, H. Bischof, T. Brox, et al. (Eds.), Proceedings of the 16th European conference on computer vision (pp. 205\u2013221). Cham: Springer."},{"key":"68_CR15","first-page":"816","volume-title":"Proceedings of the 15th European conference on computer vision","author":"B. Jiang","year":"2018","unstructured":"Jiang, B., Luo, R., Mao, J., Xiao, T., & Jiang, Y. (2018). Acquisition of localization confidence for accurate object detection. In V. Ferrari, M. Hebert, C. Sminchisescu, et al. (Eds.), Proceedings of the 15th European conference on computer vision (pp. 816\u2013832). Cham: Springer."},{"key":"68_CR16","first-page":"10,448","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision","author":"B. Yan","year":"2021","unstructured":"Yan, B., Peng, H., Fu, J., Wang, D., & Lu, H. (2021). Learning spatio-temporal transformer for visual tracking. In Proceedings of the IEEE\/CVF international conference on computer vision (pp. 10,448\u201310,457). Piscataway: IEEE."},{"key":"68_CR17","first-page":"8126","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"X. Chen","year":"2021","unstructured":"Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., & Lu, H. (2021). Transformer tracking. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 8126\u20138135). Piscataway: IEEE."},{"key":"68_CR18","first-page":"1","volume-title":"Proceedings of the 36th international conference on neural information processing systems","author":"L. Lin","year":"2022","unstructured":"Lin, L., Fan, H., Zhang, Z., Xu, Y., & Ling, H. (2022). SwinTrack: a simple and strong baseline for transformer tracking. In A. A. S. Koyejo & S. Mohamed (Eds.), Proceedings of the 36th international conference on neural information processing systems (pp. 1\u201312). Red Hook: Curran Associates."},{"key":"68_CR19","first-page":"341","volume-title":"Proceedings of the 17th European conference on computer vision","author":"B. Ye","year":"2022","unstructured":"Ye, B., Chang, H., Ma, B., Shan, S., & Chen, X. (2022). Joint feature learning and relation modeling for tracking: a one-stream framework. In S. Avidan, G. J. Brostow, M. Ciss\u00e9, et al. (Eds.), Proceedings of the 17th European conference on computer vision (pp. 341\u2013357). Cham: Springer."},{"key":"68_CR20","first-page":"13,608","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Y. Cui","year":"2022","unstructured":"Cui, Y., Jiang, C., Wang, L., & Wu, G. (2022). Mixformer: end-to-end tracking with iterative mixed attention. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 13,608\u201313,618). Piscataway: IEEE."},{"key":"68_CR21","first-page":"8751","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"F. Xie","year":"2022","unstructured":"Xie, F., Wang, C., Wang, G., Cao, Y., Yang, W., & Zeng, W. (2022). Correlation-aware deep tracking. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 8751\u20138760). Piscataway: IEEE."},{"key":"68_CR22","first-page":"375","volume-title":"Proceedings of the 17th European conference on computer vision","author":"B. Chen","year":"2022","unstructured":"Chen, B., Li, P., Bai, L., Qiao, L., Shen, Q., Li, B., et al. (2022). Backbone is all your need: a simplified architecture for visual object tracking. In S. Avidan, G. J. Brostow, M. Ciss\u00e9, et al. (Eds.), Proceedings of the 17th European conference on computer vision (pp. 375\u2013392). Cham: Springer."},{"issue":"2","key":"68_CR23","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1007\/s11263-020-01387-y","volume":"129","author":"H. Fan","year":"2021","unstructured":"Fan, H., Bai, H., Lin, L., Yang, F., & Ling, H. (2021). LaSOT: a high-quality large-scale single object tracking benchmark. International Journal of Computer Vision, 129(2), 439\u2013461.","journal-title":"International Journal of Computer Vision"},{"issue":"9","key":"68_CR24","doi-asserted-by":"publisher","first-page":"1834","DOI":"10.1109\/TPAMI.2014.2388226","volume":"37","author":"Y. Wu","year":"2015","unstructured":"Wu, Y., Lim, J., & Yang, M. H. (2015). Object tracking benchmark. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(9), 1834\u20131848.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"68_CR25","first-page":"629","volume-title":"Proceedings of the Asian conference on computer vision","author":"A. Moudgil","year":"2018","unstructured":"Moudgil, A., & Gandhi, V. (2018). Long-term visual object tracking benchmark. In C. V. Jawahar, H. Li, G. Mori, et al. (Eds.), Proceedings of the Asian conference on computer vision (pp. 629\u2013645). Cham: Springer."},{"key":"68_CR26","first-page":"547","volume-title":"Proceedings of the 16th European conference on computer vision workshops","author":"M. Kristan","year":"2020","unstructured":"Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., K\u00e4m\u00e4r\u00e4inen, J. K., et al. (2020). The eighth visual object tracking VOT2020 challenge results. In A. Vedaldi, H. Bischof, T. Brox, et al. (Eds.), Proceedings of the 16th European conference on computer vision workshops (pp. 547\u2013601). Cham: Springer."},{"key":"68_CR27","first-page":"431","volume-title":"Proceedings of the 17th European conference on computer vision workshops","author":"M. Kristan","year":"2022","unstructured":"Kristan, M., Matas, J., Leonardis, A., Felsberg, M., Pflugfelder, R., Kamarainen, J. K., et al. (2022). The tenth visual object tracking VOT2022 challenge results. In S. Avidan, G. J. Brostow, M. Ciss\u00e9, et al. (Eds.), Proceedings of the 17th European conference on computer vision workshops (pp. 431\u2013460). Cham: Springer."},{"key":"68_CR28","first-page":"445","volume-title":"Proceedings of the 14th European conference on computer vision","author":"M. Mueller","year":"2016","unstructured":"Mueller, M., Smith, N., & Ghanem, B. (2016). A benchmark and simulator for UAV tracking. In B. Leibe, J. Matas, N. Sebe, et al. (Eds.), Proceedings of the 14th European conference on computer vision (pp. 445\u2013461). Cham: Springer."},{"issue":"3","key":"68_CR29","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1145\/1015706.1015720","volume":"23","author":"C. Rother","year":"2004","unstructured":"Rother, C., Kolmogorov, V., & Blake, A. (2004). GrabCut: interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics, 23(3), 309\u2013314.","journal-title":"ACM Transactions on Graphics"},{"key":"68_CR30","first-page":"277","volume-title":"Proceedings of the IEEE international conference on computer vision","author":"V. S. Lempitsky","year":"2009","unstructured":"Lempitsky, V. S., Kohli, P., Rother, C., & Sharp, T. (2009). Image segmentation with a bounding box prior. In Proceedings of the IEEE international conference on computer vision (pp. 277\u2013284). Piscataway: IEEE."},{"key":"68_CR31","first-page":"1","volume-title":"Proceedings of the British machine vision conference","author":"N. Xu","year":"2017","unstructured":"Xu, N., Price, B. L., Cohen, S., Yang, J., & Huang, T. S. (2017). Deep grabcut for object selection. In Proceedings of the British machine vision conference (pp. 1\u201312). Swansea: BMVA Press."},{"key":"68_CR32","first-page":"3335","volume-title":"Proceedings of IEEE international conference on image processing","author":"H. Yu","year":"2017","unstructured":"Yu, H., Zhou, Y., Qian, H., Xian, M., & Wang, S. (2017). Loosecut: interactive image segmentation with loosely bounded boxes. In Proceedings of IEEE international conference on image processing (pp. 3335\u20133339). Piscataway: IEEE."},{"key":"68_CR33","first-page":"373","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"N. Xu","year":"2016","unstructured":"Xu, N., Price, B. L., Cohen, S., Yang, J., & Huang, T. S. (2016). Deep interactive object selection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 373\u2013381). Piscataway: IEEE."},{"key":"68_CR34","first-page":"577","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Z. Li","year":"2018","unstructured":"Li, Z., Chen, Q., & Koltun, V. (2018). Interactive image segmentation with latent diversity. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 577\u2013585). Piscataway: IEEE."},{"key":"68_CR35","first-page":"616","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"K. K. Maninis","year":"2018","unstructured":"Maninis, K. K., Caelles, S., Pont-Tuset, J., & Van Gool, L. (2018). Deep extreme cut: from extreme points to object segmentation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 616\u2013625). Piscataway: IEEE."},{"key":"68_CR36","first-page":"13,339","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Z. Lin","year":"2020","unstructured":"Lin, Z., Zhang, Z., Chen, L. Z., Cheng, M. M., & Lu, S. P. (2020). Interactive image segmentation with first click attention. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 13,339\u201313,348). Piscataway: IEEE."},{"key":"68_CR37","first-page":"12,234","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"S. Zhang","year":"2020","unstructured":"Zhang, S., Liew, J. H., Wei, Y., Wei, S., & Zhao, Y. (2020). Interactive object segmentation with inside-outside guidance. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 12,234\u201312,244). Piscataway: IEEE."},{"key":"68_CR38","first-page":"417","volume-title":"Proceedings of the 16th European conference on computer vision","author":"H. Ding","year":"2020","unstructured":"Ding, H., Cohen, S., Price, B., & Jiang, X. (2020). Phraseclick: toward achieving flexible interactive segmentation by phrase and click. In A. Vedaldi, H. Bischof, T. Brox, et al. (Eds.), Proceedings of the 16th European conference on computer vision (pp. 417\u2013435). Cham: Springer."},{"key":"68_CR39","first-page":"392","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"J. Bai","year":"2014","unstructured":"Bai, J., & Wu, X. (2014). Error-tolerant scribbles based interactive image segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 392\u2013399). Piscataway: IEEE."},{"key":"68_CR40","first-page":"1","volume-title":"Proceedings of the British machine vision conference","author":"S. Mahadevan","year":"2018","unstructured":"Mahadevan, S., Voigtlaender, P., & Leibe, B. (2018). Iteratively trained interactive segmentation. In Proceedings of the British machine vision conference (pp. 1\u201312). Swansea: BMVA Press."},{"key":"68_CR41","first-page":"3141","volume-title":"Proceedings of IEEE international conference on image processing","author":"K. Sofiiuk","year":"2022","unstructured":"Sofiiuk, K., Petrov, I. A., & Konushin, A. (2022). Reviving iterative training with mask guidance for interactive segmentation. In Proceedings of IEEE international conference on image processing (pp. 3141\u20133145). Piscataway: IEEE."},{"key":"68_CR42","first-page":"1290","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"X. Chen","year":"2022","unstructured":"Chen, X., Zhao, Z., Zhang, Y., Duan, M., Qi, D., & Zhao, H. (2022). Focalclick: towards practical interactive image segmentation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 1290\u20131299). Piscataway: IEEE."},{"key":"68_CR43","first-page":"5297","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"W. D. Jang","year":"2019","unstructured":"Jang, W. D., & Kim, C. S. (2019). Interactive image segmentation via backpropagating refinement scheme. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 5297\u20135306). Piscataway: IEEE."},{"key":"68_CR44","first-page":"8620","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"K. Sofiiuk","year":"2020","unstructured":"Sofiiuk, K., Petrov, I. A., Barinova, O., & Konushin, A. (2020). F-BRS: rethinking backpropagating refinement for interactive segmentation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 8620\u20138629). Piscataway: IEEE."},{"key":"68_CR45","first-page":"5247","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"S. W. Oh","year":"2019","unstructured":"Oh, S. W., Lee, J., Xu, N., & Kim, S. J. (2019). Fast user-guided video object segmentation by interaction-and-propagation networks. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 5247\u20135256). Piscataway: IEEE."},{"key":"68_CR46","first-page":"10,363","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"J. Miao","year":"2020","unstructured":"Miao, J., Wei, Y., & Yang, Y. (2020). Memory aggregation networks for efficient interactive video object segmentation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 10,363\u201310,372). Piscataway: IEEE."},{"key":"68_CR47","unstructured":"Benard, A., & Gygli, M. (2018). Interactive video object segmentation in the wild. arXiv preprint. arXiv:1801.00269."},{"key":"68_CR48","first-page":"5559","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"H. K. Cheng","year":"2021","unstructured":"Cheng, H. K., Tai, Y., & Tang, C. (2021). Modular interactive video object segmentation: interaction-to-mask, propagation and difference-aware fusion. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 5559\u20135568). Piscataway: IEEE."},{"key":"68_CR49","first-page":"2912","volume-title":"Proceedings of the IEEE international conference on computer vision","author":"K. M. Yi","year":"2013","unstructured":"Yi, K. M., Jeong, H., Heo, B., Chang, H. J., & Choi, J. Y. (2013). Initialization-insensitive visual tracking through voting with salient local features. In Proceedings of the IEEE international conference on computer vision (pp. 2912\u20132919). Piscataway: IEEE."},{"issue":"2","key":"68_CR50","doi-asserted-by":"publisher","first-page":"821","DOI":"10.1109\/TIP.2016.2633874","volume":"26","author":"H. Zhu","year":"2016","unstructured":"Zhu, H., & Porikli, F. (2016). Automatic refinement strategies for manual initialization of object trackers. IEEE Transactions on Image Processing, 26(2), 821\u2013835.","journal-title":"IEEE Transactions on Image Processing"},{"key":"68_CR51","first-page":"7464","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"C.-Y. Wang","year":"2023","unstructured":"Wang, C.-Y., Bochkovskiy, A., & Liao, H.-Y. M. (2023). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 7464\u20137475). Piscataway: IEEE."},{"key":"68_CR52","unstructured":"Ge, Z., Liu, S., Wang, F., Li, Z., & Sun, J. (2021). YOLOX: exceeding YOLO series in 2021. arXiv preprint. arXiv:2107.08430."},{"key":"68_CR53","first-page":"91","volume-title":"Proceedings of the 29th international conference on neural information processing systems","author":"S. Ren","year":"2015","unstructured":"Ren, S., He, K., Girshick, R. B., & Sun, J. (2015). Faster R-CNN: towards real-time object detection with region proposal networks. In C. Cortes, N. D. Lawrence, D. D. Lee, et al. (Eds.), Proceedings of the 29th international conference on neural information processing systems (pp. 91\u201399). Red Hook: Curran Associates."},{"key":"68_CR54","first-page":"3490","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision","author":"C. Feng","year":"2021","unstructured":"Feng, C., Zhong, Y., Gao, Y., Scott, M. R., & Huang, W. (2021). TOOD: task-aligned one-stage object detection. In Proceedings of the IEEE\/CVF international conference on computer vision (pp. 3490\u20133499). Piscataway: IEEE."},{"key":"68_CR55","first-page":"213","volume-title":"Proceedings of the 16th European conference on computer vision","author":"N. Carion","year":"2020","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020). End-to-end object detection with transformers. In A. Vedaldi, H. Bischof, T. Brox, et al. (Eds.), Proceedings of the 16th European conference on computer vision (pp. 213\u2013229). Cham: Springer."},{"key":"68_CR56","first-page":"19,358","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Y. Fang","year":"2023","unstructured":"Fang, Y., Wang, W., Xie, B., Sun, Q., Wu, L., Wang, X., et al. (2023). EVA: exploring the limits of masked visual representation learning at scale. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 19,358\u201319,369). Piscataway: IEEE."},{"key":"68_CR57","unstructured":"Ouyang-Zhang, J., Cho, J. H., Zhou, X., & Kr\u00e4henb\u00fchl, P. (2022). NMS strikes back. arXiv preprint. arXiv:2212.06137."},{"key":"68_CR58","first-page":"8429","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision","author":"S. Shao","year":"2019","unstructured":"Shao, S., Li, Z., Zhang, T., Peng, C., Yu, G., Zhang, X., et al. (2019). Objects365: a large-scale, high-quality dataset for object detection. In Proceedings of the IEEE\/CVF international conference on computer vision (pp. 8429\u20138438). Piscataway: IEEE."},{"key":"68_CR59","volume-title":"Proceedings of the 9th international conference on learning representations","author":"A. Dosovitskiy","year":"2021","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., et al. (2021). An image is worth 16 x16 words: transformers for image recognition at scale. In Proceedings of the 9th international conference on learning representations. Retrieved November 15., 2024, from https:\/\/openreview.net\/pdf?id=YicbFdNTTy."},{"key":"68_CR60","first-page":"15,979","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"K. He","year":"2022","unstructured":"He, K., Chen, X., Xie, S., Li, Y., Doll\u00e1r, P., & Girshick, R. (2022). Masked autoencoders are scalable vision learners. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 15,979\u201315,988). Piscataway: IEEE."},{"key":"68_CR61","first-page":"740","volume-title":"Proceedings of the 13th European conference on computer vision","author":"T. Y. Lin","year":"2014","unstructured":"Lin, T. Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., et al. (2014). Microsoft COCO: common objects in context. In D. J. Fleet, T. Pajdla, B. Schiele, et al. (Eds.), Proceedings of the 13th European conference on computer vision (pp. 740\u2013755). Cham: Springer."},{"key":"68_CR62","first-page":"5289","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"B. Yan","year":"2021","unstructured":"Yan, B., Zhang, X., Wang, D., Lu, H., & Yang, X. (2021). Alpha-refine: boosting tracking performance by precise bounding box estimation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 5289\u20135298). Piscataway: IEEE."},{"key":"68_CR63","first-page":"4660","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"M. Danelljan","year":"2019","unstructured":"Danelljan, M., Bhat, G., Khan, F. S., & Felsberg, M. (2019). ATOM: accurate tracking by overlap maximization. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 4660\u20134669). Piscataway: IEEE."},{"key":"68_CR64","first-page":"3","volume-title":"Proceedings of the 15th European conference on computer vision workshops","author":"M. Kristan","year":"2018","unstructured":"Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R. P., Zajc, L. C., et al. (2018). The sixth visual object tracking VOT2018 challenge results. In V. Ferrari, M. Hebert, C. Sminchisescu, et al. (Eds.), Proceedings of the 15th European conference on computer vision workshops (pp. 3\u201353). Cham: Springer."},{"key":"68_CR65","first-page":"2206","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision workshops","author":"M. Kristan","year":"2019","unstructured":"Kristan, M., Matas, J., Leonardis, A., Felsberg, M., Pflugfelder, R., K\u00e4m\u00e4r\u00e4inen, J. K., et al. (2019). The seventh visual object tracking VOT2019 challenge results. In Proceedings of the IEEE\/CVF international conference on computer vision workshops (pp. 2206\u20132241). Piscataway: IEEE."},{"key":"68_CR66","first-page":"11,037","volume-title":"Proceedings of the 34nd AAAI conference on artificial intelligence","author":"L. Huang","year":"2020","unstructured":"Huang, L., Zhao, X., & Huang, K. (2020). GlobalTrack: a simple and strong baseline for long-term tracking. In Proceedings of the 34nd AAAI conference on artificial intelligence (pp. 11,037\u201311,044). Palo Alto: AAAI Press."},{"key":"68_CR67","first-page":"952","volume-title":"Proceedings of the 30th international joint conference on artificial intelligence","author":"J. Peng","year":"2021","unstructured":"Peng, J., Jiang, Z., Gu, Y., Wu, Y., Wang, Y., Tai, Y., et al. (2021). SiamRCR: reciprocal classification and regression for visual object tracking. In Z. Zhou (Ed.), Proceedings of the 30th international joint conference on artificial intelligence (pp. 952\u2013958). Palo Alto: AAAI Press."},{"key":"68_CR68","first-page":"145","volume-title":"Proceedings of the 16th European conference on computer vision","author":"J. Peng","year":"2020","unstructured":"Peng, J., Wang, C., Wan, F., Wu, Y., Wang, Y., Tai, Y., et al. (2020). Chained-tracker: chaining paired attentive regression results for end-to-end joint multiple-object detection and tracking. In A. Vedaldi, H. Bischof, T. Brox, et al. (Eds.), Proceedings of the 16th European conference on computer vision (pp. 145\u2013161). Cham: Springer."},{"key":"68_CR69","first-page":"6307","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"B. Pang","year":"2020","unstructured":"Pang, B., Li, Y., Zhang, Y., Li, M., & Lu, C. (2020). TubeTK: adopting tubes to track multi-object in a one-step training model. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 6307\u20136317). Piscataway: IEEE."}],"container-title":["Visual Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44267-024-00068-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44267-024-00068-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44267-024-00068-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,30]],"date-time":"2024-12-30T09:08:49Z","timestamp":1735549729000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44267-024-00068-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,30]]},"references-count":69,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["68"],"URL":"https:\/\/doi.org\/10.1007\/s44267-024-00068-5","relation":{},"ISSN":["2731-9008"],"issn-type":[{"value":"2731-9008","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,30]]},"assertion":[{"value":"10 June 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 December 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 December 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 December 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"35"}}