{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:00:17Z","timestamp":1760148017535,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,24]],"date-time":"2023-03-24T00:00:00Z","timestamp":1679616000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Hansung University"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In detection-free tracking, after users freely designate the location of the object to be tracked in the first frame of the video sequence, the location of the object is continuously found in the following video frame sequence. Recently, technologies using a Siamese network and transformer based on DNN modules have been evaluated as very excellent in terms of tracking accuracy. The high computational complexity due to the usage of the DNN module is not a preferred feature in terms of execution speed, and when tracking two or more objects, a bottleneck effect occurs in the DNN accelerator such as the GPU, which inevitably results in a larger delay. To address this problem, we propose a tracker scheduling framework. First, the computation structures of representative trackers are analyzed, and the scheduling unit suitable for the execution characteristics of each tracker is derived. Based on this analysis, the decomposed workloads of trackers are multi-threaded under the control of the scheduling framework. CPU-side multi-threading leads the GPU to a work-conserving state while enabling parallel processing as much as possible even within a single GPU depending on the resource availability of the internal hardware. The proposed framework is a general-purpose system-level software solution that can be applied not only to GPUs but also to other hardware accelerators. As a result of confirmation through various experiments, when tracking two objects, the execution speed was improved by up to 55% while maintaining almost the same accuracy as the existing method.<\/jats:p>","DOI":"10.3390\/s23073432","type":"journal-article","created":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T03:01:14Z","timestamp":1679886074000},"page":"3432","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Scheduling Framework for Accelerating Multiple Detection-Free Object Trackers"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4254-4009","authenticated-orcid":false,"given":"Myungsun","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Applied Artificial Intelligence, Hansung University, Seoul 02876, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Inmo","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of IT Convergence Engineering, Hansung University, Seoul 02876, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jihyeon","family":"Yong","sequence":"additional","affiliation":[{"name":"Department of IT Convergence Engineering, Hansung University, Seoul 02876, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyuksoo","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of IT Convergence Engineering, Hansung University, Seoul 02876, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,24]]},"reference":[{"key":"ref_1","unstructured":"Liu, L., Xing, J., Ai, H., and Ruan, X. (2012, January 11\u201315). Hand posture recognition using finger geometric feature. Proceedings of the 21st International Conference on Pattern Recognition, Tsukuba, Japan."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4438861","DOI":"10.1155\/2021\/4438861","article-title":"Development of AI-Based Vehicle Detection and Tracking System for C-ITS Application","volume":"2021","author":"Tak","year":"2021","journal-title":"J. Adv. Transp."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Xing, J., Ai, H., and Lao, S. (2010, January 23\u201326). Multiple Human Tracking Based on Multi-view Upper-Body Detection and Discriminative Learning. Proceedings of the 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.420"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhang, G., and Vela, P.A. (2015, January 7\u201312). Good features to Track for Visual SLAM. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298743"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"85403","DOI":"10.1109\/ACCESS.2021.3088861","article-title":"ODMDEF: On-Device Multi-DNN Execution Framework Utilizing Adaptive Layer-Allocation on General Purpose Cores and Accelerators","volume":"9","author":"Lim","year":"2021","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., and Yan, J. (2019, January 15\u201320). SiamRPN++: Evolution of Siamese Visual Tracking With Very Depp Networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00441"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Song, Z., Yu, J., Chen, Y.P.C., and Yang, W. (2022, January 18\u201324). Transformer Tracking With Cyclic Shifiting Window Attention. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00859"},{"key":"ref_8","unstructured":"(2023, February 15). TensorFlow. Available online: https:\/\/www.tensorflow.org."},{"key":"ref_9","unstructured":"(2023, February 15). PyTorch. Available online: https:\/\/pytorch.org."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., and Torr, P.H.S. (2016, January 8\u201310). Fully-Convolutional Siamese Networks for Object Tracking. Proceedings of the Computer Vison\u2014ECCV, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-48881-3_56"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, B., Yan, J., Wu, W., Zhu, Z., and Hu, X. (2018, January 18\u201323). High Performance Visual Tracking With Siamese Region Proposal Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00935"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Jiang, W., Trulls, E., Hosang, J., Tagliasacchi, A., and Yi, K.M. (2021, January 11\u201317). COTR: Correspondence Transformer for Matching Across Images. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00615"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., and Lu, H. (2021, January 20\u201325). Transformer Tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00803"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yan, B., Peng, H., Fu, J., Wang, D., and Lu, H. (2021, January 11\u201317). Learning Saptio-Temporal Transformer for Visual Tracking. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01028"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_18","unstructured":"NVIDIA (2023, February 15). CUDA Deep Neural Network(cuDNN)|NVIDIA Developer. Available online: https:\/\/developer.nvidia.com\/cudnn."},{"key":"ref_19","unstructured":"NVIDIA (2023, February 15). CUDA Toolkit\u2014Free Tools and Training|NVIDIA Developer. Available online: https:\/\/developer.nvidia.com\/cuda-toolkit."},{"key":"ref_20","unstructured":"NVIDIA (2023, February 15). CUDA Multi-Process Service. Available online: https:\/\/docs.nvidia.com\/deploy\/mps\/index.html."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5851","DOI":"10.1007\/s11227-022-04901-w","article-title":"gCFS: Completely fair scheduling on multiple GPUs for improved multi-DNN execution in terms of performance isolation","volume":"79","author":"Cho","year":"2022","journal-title":"J. Supercomput."},{"key":"ref_22","unstructured":"NVIDIA (2023, February 15). NVIDIA RTX 6000 Ada Generation Graphics Card. Available online: https:\/\/www.nvidia.com\/en-us\/design-visualization\/rtx-6000\/."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Muller, M., Bibi, A., Alsubaihi, S., and Ghanem, B. (2018, January 8\u201314). TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01246-5_19"},{"key":"ref_24","unstructured":"Aaron, H., Deepak, N., Amar, P., Vivek, S., Nikhil, R., Gregory, R., and Phillip, B. (2018). PipeDream: Fast and Efficient Pipeline Parallel DNN Training. arXiv."},{"key":"ref_25","unstructured":"NVIDIA (2023, February 15). Jetson AGX Xavier Developer Kit|NVIDIA Developer. Available online: https:\/\/developer.nvidia.com\/embedded\/jetson-agx-xavier-developer-kit."},{"key":"ref_26","unstructured":"Ajitsaria, A. (2023, February 15). What Is the Python Global Interpreter Lock (GIL)?. Available online: https:\/\/realpython.com\/python-gil."},{"key":"ref_27","unstructured":"(2023, February 15). TorchScript. Available online: https:\/\/pytorch.org\/docs\/master\/jit.html."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wu, Y., Lim, J., and Yang, M.H. (2013, January 23\u201328). Online object tracking: A benchmark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.312"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3432\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:02:35Z","timestamp":1760122955000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3432"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,24]]},"references-count":28,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23073432"],"URL":"https:\/\/doi.org\/10.3390\/s23073432","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,3,24]]}}}