{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T04:32:41Z","timestamp":1781584361320,"version":"3.54.5"},"reference-count":48,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2024,7,24]],"date-time":"2024-07-24T00:00:00Z","timestamp":1721779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62176041"],"award-info":[{"award-number":["62176041"]}]},{"name":"National Natural Science Foundation of China","award":["XLYC2203014"],"award-info":[{"award-number":["XLYC2203014"]}]},{"name":"National Natural Science Foundation of China","award":["2022RY21"],"award-info":[{"award-number":["2022RY21"]}]},{"name":"Talent Fund of Liaoning Province","award":["62176041"],"award-info":[{"award-number":["62176041"]}]},{"name":"Talent Fund of Liaoning Province","award":["XLYC2203014"],"award-info":[{"award-number":["XLYC2203014"]}]},{"name":"Talent Fund of Liaoning Province","award":["2022RY21"],"award-info":[{"award-number":["2022RY21"]}]},{"name":"Excellent Science and Technique Talent Foundation of Dalian","award":["62176041"],"award-info":[{"award-number":["62176041"]}]},{"name":"Excellent Science and Technique Talent Foundation of Dalian","award":["XLYC2203014"],"award-info":[{"award-number":["XLYC2203014"]}]},{"name":"Excellent Science and Technique Talent Foundation of Dalian","award":["2022RY21"],"award-info":[{"award-number":["2022RY21"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Query decoders have been shown to achieve good performance in object detection. However, they suffer from insufficient object tracking performance. Sequence-to-sequence learning in this context has recently been explored, with the idea of describing a target as a sequence of discrete tokens. In this study, we experimentally determine that, with appropriate representation, a parallel approach for predicting a target coordinate sequence with a query decoder can achieve good performance and speed. We propose a concise query-based tracking framework for predicting a target coordinate sequence in a parallel manner, named QPSTrack. A set of queries are designed to be responsible for different coordinates of the tracked target. All the queries jointly represent a target rather than a traditional one-to-one matching pattern between the query and target. Moreover, we adopt an adaptive decoding scheme including a one-layer adaptive decoder and learnable adaptive inputs for the decoder. This decoding scheme assists the queries in decoding the template-guided search features better. Furthermore, we explore the use of the plain ViT-Base, ViT-Large, and lightweight hierarchical LeViT architectures as the encoder backbone, providing a family of three variants in total. All the trackers are found to obtain a good trade-off between speed and performance; for instance, our tracker QPSTrack-B256 with the ViT-Base encoder achieves a 69.1% AUC on the LaSOT benchmark at 104.8 FPS.<\/jats:p>","DOI":"10.3390\/s24154802","type":"journal-article","created":{"date-parts":[[2024,7,24]],"date-time":"2024-07-24T14:55:47Z","timestamp":1721832947000},"page":"4802","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Query-Based Object Visual Tracking with Parallel Sequence Generation"],"prefix":"10.3390","volume":"24","author":[{"given":"Chang","family":"Liu","sequence":"first","affiliation":[{"name":"School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunjuan","family":"Bo","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Dalian Minzu University, Dalian 116600, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wang, N., Zhou, W., Wang, J., and Li, H. (2021, January 20\u201325). Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Tracking. Proceedings of the CVPR, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00162"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yan, B., Peng, H., Fu, J., Wang, D., and Lu, H. (2021, January 11\u201317). Learning spatio-temporal transformer for visual tracking. Proceedings of the ICCV, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01028"},{"key":"ref_3","unstructured":"Cui, Y., Jiang, C., Wang, L., and Wu, G. (2021). Target transformed regression for accurate tracking. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., and Lu, H. (2021, January 20\u201325). Transformer tracking. Proceedings of the CVPR, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00803"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ye, B., Chang, H., Ma, B., Shan, S., and Chen, X. (2022, January 23\u201327). Joint feature learning and relation modeling for tracking: A one-stream framework. Proceedings of the ECCV, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-20047-2_20"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Cui, Y., Jiang, C., Wang, L., and Wu, G. (2022, January 21\u201324). MixFormer: End-to-End Tracking with Iterative Mixed Attention. Proceedings of the CVPR, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01324"},{"key":"ref_7","unstructured":"Lin, L., Fan, H., Xu, Y., and Ling, H. (2021). Swintrack: A simple and strong baseline for transformer tracking. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., and Yan, J. (2019, January 15\u201320). SiamRPN++: Evolution of siamese visual tracking with very deep networks. Proceedings of the CVPR, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00441"},{"key":"ref_9","unstructured":"Bhat, G., Danelljan, M., Gool, L.V., and Timofte, R. (November, January 27). Learning discriminative model prediction for tracking. Proceedings of the ICCV, Seoul, Republic of Korea."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Peng, H., Fu, J., Li, B., and Hu, W. (2020, January 23\u201328). Ocean: Object-aware anchor-free tracking. Proceedings of the ECCV, Glasgow, UK.","DOI":"10.1007\/978-3-030-58589-1_46"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23\u201328). End-to-end object detection with transformers. Proceedings of the ECCV, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_12","unstructured":"Tolstikhin, I.O., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Steiner, A., Keysers, D., and Uszkoreit, J. (2021, January 6\u201314). MLP-Mixer: An all-MLP Architecture for Vision. Proceedings of the NIPS, Online."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gao, Z., Wang, L., Han, B., and Guo, S. (2022, January 21\u201324). AdaMixer: A Fast-Converging Query-Based Object Detector. Proceedings of the CVPR, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00529"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 15\u201320). Generalized intersection over union: A metric and a loss for bounding box regression. Proceedings of the CVPR, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00075"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"He, K., Chen, X., Xie, S., Li, Y., Doll\u00e1r, P., and Girshick, R. (2022, January 21\u201324). Masked autoencoders are scalable vision learners. Proceedings of the CVPR, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Graham, B., El-Nouby, A., Touvron, H., Stock, P., Joulin, A., J\u00e9gou, H., and Douze, M. (2021, January 11\u201317). LeViT: A Vision Transformer in ConvNet\u2019s Clothing for Faster Inference. Proceedings of the ICCV, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01204"},{"key":"ref_17","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3\u20137). An image is worth 16x16 words: Transformers for image recognition at scale. Proceedings of the ICLR, Virtual."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the CVPR, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, B., Li, P., Bai, L., Qiao, L., Shen, Q., Li, B., Gan, W., Wu, W., and Ouyang, W. (2022, January 23\u201327). Backbone is All Your Need: A Simplified Architecture for Visual Object Tracking. Proceedings of the ECCV, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-20047-2_22"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Law, H., and Deng, J. (2018, January 8\u201314). Cornernet: Detecting objects as paired keypoints. Proceedings of the ECCV, Munich, Germany.","DOI":"10.1007\/978-3-030-01264-9_45"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, H., Wang, Y., Dayoub, F., and Sunderhauf, N. (2021, January 20\u201325). Varifocalnet: An iou-aware dense object detector. Proceedings of the CVPR, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00841"},{"key":"ref_22","unstructured":"Chen, T., Saxena, S., Li, L., Fleet, D.J., and Hinton, G.E. (2022, January 25\u201329). Pix2seq: A Language Modeling Framework for Object Detection. Proceedings of the ICLR, Virtual."},{"key":"ref_23","unstructured":"Liu, S., Li, F., Zhang, H., Yang, X., Qi, X., Su, H., Zhu, J., and Zhang, L. (2022). Dab-detr: Dynamic anchor boxes are better queries for detr. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 8\u201314). Microsoft COCO: Common objects in context. Proceedings of the ECCV, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Fan, H., Lin, L., Yang, F., Chu, P., Deng, G., Yu, S., Bai, H., Xu, Y., Liao, C., and Ling, H. (2019, January 15\u201320). LaSOT: A high-quality benchmark for large-scale single object tracking. Proceedings of the CVPR, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00552"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1562","DOI":"10.1109\/TPAMI.2019.2957464","article-title":"GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild","volume":"43","author":"Huang","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Muller, M., Bibi, A., Giancola, S., Alsubaihi, S., and Ghanem, B. (2018, January 8\u201314). TrackingNet: A large-scale dataset and benchmark for object tracking in the wild. Proceedings of the ECCV, Munich, Germany.","DOI":"10.1007\/978-3-030-01246-5_19"},{"key":"ref_28","unstructured":"Loshchilov, I., and Hutter, F. (2017). Decoupled weight decay regularization. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1007\/s11263-020-01387-y","article-title":"LaSOT: A High-quality Large-scale Single Object Tracking Benchmark","volume":"129","author":"Fan","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Gao, S., Zhou, C., Ma, C., Wang, X., and Yuan, J. (2022, January 23\u201327). Aiatrack: Attention in attention for transformer visual tracking. Proceedings of the ECCV, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-20047-2_9"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Mayer, C., Danelljan, M., Bhat, G., Paul, M., Paudel, D.P., Yu, F., and Van Gool, L. (2022, January 21\u201324). Transforming model prediction for tracking. Proceedings of the CVPR, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00853"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Chen, J., Pei, W., Mao, K., Wang, H., and He, Z. (2022, January 21\u201324). Global tracking via ensemble of local trackers. Proceedings of the CVPR, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00856"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mayer, C., Danelljan, M., Paudel, D.P., and Van Gool, L. (2021, January 11\u201317). Learning target candidate association to keep track of what not to track. Proceedings of the ICCV, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01319"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Voigtlaender, P., Luiten, J., Torr, P.H., and Leibe, B. (2020, January 13\u201319). Siam R-CNN: Visual Tracking by Re-Detection. Proceedings of the CVPR, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00661"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ma, F., Shou, M.Z., Zhu, L., Fan, H., Xu, Y., Yang, Y., and Yan, Z. (2022, January 21\u201324). Unified transformer tracker for object tracking. Proceedings of the CVPR, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00858"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Zhong, B., Zhang, S., Tang, Z., Liu, X., and Zhang, Z. (2021, January 20\u201325). Distractor-aware fast tracking via dynamic convolutions and MOT philosophy. Proceedings of the CVPR, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00108"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Dai, K., Zhang, Y., Wang, D., Li, J., Lu, H., and Yang, X. (2020, January 13\u201319). High-Performance Long-Term Tracking With Meta-Updater. Proceedings of the CVPR, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00633"},{"key":"ref_38","unstructured":"Huang, L., Zhao, X., and Huang, K. (2020, January 7\u201312). GlobalTrack: A Simple and Strong Baseline for Long-term Tracking. Proceedings of the AAAI, New York, NY, USA."},{"key":"ref_39","unstructured":"Yan, B., Zhao, H., Wang, D., Lu, H., and Yang, X. (November, January 27). \u2018Skimming-Perusal\u2019 Tracking: A Framework for Real-Time and Robust Long-Term Tracking. Proceedings of the ICCV, Seoul, Republic of Korea."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Bhat, G., Shahbaz Khan, F., and Felsberg, M. (2017, January 21\u201326). ECO: Efficient convolution operators for tracking. Proceedings of the CVPR, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.733"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Nam, H., and Han, B. (2016, January 27\u201330). Learning multi-domain convolutional neural networks for visual tracking. Proceedings of the CVPR, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.465"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., and Torr, P.H.S. (2016, January 11\u201314). Fully-Convolutional Siamese Networks for Object Tracking. Proceedings of the ECCV, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-48881-3_56"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Mueller, M., Smith, N., and Ghanem, B. (2016, January 11\u201314). A benchmark and simulator for UAV tracking. Proceedings of the ECCV, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_27"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Galoogahi, H.K., Fagg, A., Huang, C., Ramanan, D., and Lucey, S. (2017, January 22\u201329). Need for Speed: A Benchmark for Higher Frame Rate Object Tracking. Proceedings of the ICCV, Venice, Italy.","DOI":"10.1109\/ICCV.2017.128"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Chen, X., Wang, D., Li, D., and Lu, H. (2022). Efficient Visual Tracking via Hierarchical Cross-Attention Transformer. arXiv.","DOI":"10.1007\/978-3-031-25085-9_26"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Blatter, P., Kanakis, M., Danelljan, M., and Gool, L.V. (2023, January 2\u20137). Efficient Visual Tracking with Exemplar Transformers. Proceedings of the WACV, Waikoloa, HI, USA.","DOI":"10.1109\/WACV56688.2023.00162"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Yan, B., Peng, H., Wu, K., Wang, D., Fu, J., and Lu, H. (2021, January 20\u201325). LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search. Proceedings of the CVPR, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01493"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Borsuk, V., Vei, R., Kupyn, O., Martyniuk, T., Krashenyi, I., and Matas, J. (2022, January 23\u201327). FEAR: Fast, Efficient, Accurate and Robust Visual Tracker. Proceedings of the ECCV, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-20047-2_37"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/15\/4802\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:22:36Z","timestamp":1760109756000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/15\/4802"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,24]]},"references-count":48,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["s24154802"],"URL":"https:\/\/doi.org\/10.3390\/s24154802","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,24]]}}}