{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T18:04:05Z","timestamp":1770228245813,"version":"3.49.0"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T00:00:00Z","timestamp":1734912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2025,1,31]]},"abstract":"<jats:p>Multi-Object Tracking (MOT) is a critical problem in computer vision, yet current research on tracking the motion state of objects relative to the ground remains limited. The extant literature exhibits a notable dearth in the exploration of this aspect. Deep learning methodologies encounter challenges in accurately discerning object motion states, while conventional approaches reliant on comprehensive mathematical modeling may yield sub-optimal tracking accuracy. To address these challenges, we introduce a Model-Data-Driven Motion State Judgment Object Tracking (MoD2T) method. This innovative architecture adeptly amalgamates classical mathematical modeling with deep learning-based MOT frameworks. The integration of mathematical modeling and deep learning within MoD2T enhances the precision of object motion state determination, thereby elevating tracking accuracy. Our empirical investigations comprehensively validate the efficacy of MoD2T across varied scenarios, encompassing unmanned aerial vehicle surveillance and street-level tracking. Furthermore, to gauge the method\u2019s adeptness in discerning object motion states, we introduce the Motion State Validation F1 (MVF1) metric.<\/jats:p>","DOI":"10.1145\/3699960","type":"journal-article","created":{"date-parts":[[2024,10,11]],"date-time":"2024-10-11T16:00:51Z","timestamp":1728662451000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Enhanced Multi-Object Tracking: Inferring Motion States of Tracked Objects"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-9734-2918","authenticated-orcid":false,"given":"Pan","family":"Liao","sequence":"first","affiliation":[{"name":"Northwestern Polytechnical University, Xi\u2019an, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6991-1628","authenticated-orcid":false,"given":"Feng","family":"Yang","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University, Xi\u2019an, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1664-5893","authenticated-orcid":false,"given":"Di","family":"Wu","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University, Xi\u2019an, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9072-3046","authenticated-orcid":false,"given":"Bo","family":"Liu","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University, Xi\u2019an, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8438-5417","authenticated-orcid":false,"given":"Xingle","family":"Zhang","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University, Xi\u2019an, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-9892-5544","authenticated-orcid":false,"given":"Shangjun","family":"Zhou","sequence":"additional","affiliation":[{"name":"Air Force Engineering University, Xi\u2019an, China"}]}],"member":"320","published-online":{"date-parts":[[2024,12,23]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.01813"},{"key":"e_1_3_1_3_2","doi-asserted-by":"crossref","unstructured":"Rui Li and Dong Liu. 2024. Decomposition betters tracking everything everywhere. arXiv:2407.06531. Retrieved from https:\/\/arxiv.org\/abs\/2407.06531","DOI":"10.1007\/978-3-031-73220-1_13"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.179"},{"key":"e_1_3_1_5_2","first-page":"19068","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Dong Qiaole","year":"2024","unstructured":"Qiaole Dong and Yanwei Fu. 2024. MemFlow: Optical flow estimation and prediction with memory. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 19068\u201319078."},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACV.1998.732851"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2013.9"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2010.2101613"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","unstructured":"Nir Aharon Roy Orfaig and Ben-Zion Bobrovsky. 2022. BoT-SORT: Robust associations multi-pedestrian tracking. arXiv:2206.14651 [cs]. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2206.14651","DOI":"10.48550\/arXiv.2206.14651"},{"key":"e_1_3_1_11_2","doi-asserted-by":"crossref","unstructured":"Gerard Maggiolino Adnan Ahmad Jinkun Cao and Kris Kitani. 2023. Deep OC-SORT: Multi-pedestrian tracking by adaptive re-identification. arXiv:2302.11813 [cs]. Retrieved from http:\/\/arxiv.org\/abs\/2302.11813","DOI":"10.1109\/ICIP49359.2023.10222576"},{"key":"e_1_3_1_12_2","unstructured":"Chongwei Liu Haojie Li Zhihui Wang and Rui Xu. 2024. PuTR: A pure transformer for decoupled and online multi-object tracking. arXiv:2405.14119. Retrieved from http:\/\/arxiv.org\/abs\/2407.06531"},{"key":"e_1_3_1_13_2","first-page":"22877","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR \u201923)","author":"Cetintas Orcun","year":"2023","unstructured":"Orcun Cetintas, Guillem Bras\u00f3, and Laura Leal-Taix\u00e9. 2023. Unifying short and long-term tracking with graph hierarchies. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR \u201923), 22877\u201322887."},{"issue":"6","key":"e_1_3_1_14_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3595379","article-title":"PANet: An end-to-end network based on relative motion for online multi-object tracking","volume":"19","author":"Li Rui","year":"2023","unstructured":"Rui Li, Baopeng Zhang, Wei Liu, Zhu Teng, and Jianping Fan. 2023. PANet: An end-to-end network based on relative motion for online multi-object tracking. ACM Transactions on Multimedia Computing, Communications and Applications 19, 6 (2023), 1\u201321.","journal-title":"ACM Transactions on Multimedia Computing, Communications and Applications"},{"key":"e_1_3_1_15_2","first-page":"12352","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Wu Jialian","year":"2021","unstructured":"Jialian Wu, Jiale Cao, Liangchen Song, Yu Wang, Ming Yang, and Junsong Yuan. 2021. Track to detect and segment: An online multi-object tracker. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 12352\u201312361."},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.02112"},{"issue":"4","key":"e_1_3_1_17_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3497746","article-title":"Improving feature discrimination for object tracking by structural-similarity-based metric learning","volume":"18","author":"Wu Jingjing","year":"2022","unstructured":"Jingjing Wu, Jianguo Jiang, Meibin Qi, Cuiqun Chen, and Yimin Liu. 2022. Improving feature discrimination for object tracking by structural-similarity-based metric learning. ACM Transactions on Multimedia Computing, Communications, and Applications 18, 4 (2022), 1\u201323.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_3_1_18_2","unstructured":"Ruopeng Gao Yijun Zhang and Limin Wang. 2024. Multiple object tracking as ID prediction. arXiv:2403.16848. Retrieved from http:\/\/arxiv.org\/abs\/2403.16848"},{"key":"e_1_3_1_19_2","first-page":"168","volume-title":"Proceedings of the IEEE International Conference on Multimedia and Expo (ICME \u201923).","author":"Zhou Huayi","year":"2023","unstructured":"Huayi Zhou, Fei Jiang, and Hongtao Lu. 2023. Body-part joint detection and association via extended object representation. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME \u201923). IEEE, 168\u2013173."},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3131342"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/203330.203343"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.2004.1400815"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2170702"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.2174\/2213275910801030219"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-3647-0"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2018.00115"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","unstructured":"Jun Zhang Mina Henein Robert Mahony and Viorela Ila. 2020. VDO-SLAM: A visual dynamic object-aware SLAM system. arXiv:2005.11052. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2005.11052","DOI":"10.48550\/arXiv.2005.11052"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2022.990453"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-008-0136-6"},{"key":"e_1_3_1_30_2","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1109\/3DV53792.2021.00030","volume-title":"Proceedings of the International Conference on 3D Vision (3DV \u201921)","author":"Gehrig Mathias","year":"2021","unstructured":"Mathias Gehrig, Mario Millh\u00e4usler, Daniel Gehrig, and Davide Scaramuzza. 2021. E-RAFT: Dense optical flow from event cameras. In Proceedings of the International Conference on 3D Vision (3DV \u201921). IEEE, 197\u2013206."},{"key":"e_1_3_1_31_2","first-page":"1996","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA \u201923)","author":"Bouwmeester Rik J.","year":"2023","unstructured":"Rik J. Bouwmeester, Federico Paredes-Vall\u00e9s, and Guido C. H. E. de Croon. 2023. NanoFlowNet: Real-time dense optical flow on a nano quadcopter. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA \u201923). IEEE, 1996\u20132003."},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","unstructured":"Tianci Liu and Jeffrey Regier. [n.d.]. An empirical comparison of GANs and normalizing flows for density estimation. arXiv:2006.10175 [cs stat]. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2006.10175","DOI":"10.48550\/arXiv.2006.10175"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2023.110608"},{"key":"e_1_3_1_34_2","first-page":"402","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV \u201920)","author":"Teed Zachary","year":"2020","unstructured":"Zachary Teed and Jia Deng. 2020. RAFT: Recurrent all-pairs field transforms for optical flow. In Proceedings of the European Conference on Computer Vision (ECCV \u201920).Andrea Vedaldi, Horst Bischof, Thomas Brox, and Jan-Michael Frahm (Eds.), Springer International Publishing, 402\u2013419."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2023.110568"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR48806.2021.9413211"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.3390\/rs12101688"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12145-019-00380-5"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2017.2718622"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.02032"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","unstructured":"Anton Milan Laura Leal-Taixe Ian Reid Stefan Roth and Konrad Schindler. 2016. MOT16: A benchmark for multi-object tracking. arXiv:1603.00831 [cs]. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.1603.00831","DOI":"10.48550\/arXiv.1603.00831"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","unstructured":"Patrick Dendorfer Hamid Rezatofighi Anton Milan Javen Shi Daniel Cremers Ian Reid Stefan Roth Konrad Schindler and Laura Leal-Taix\u00e9. 2020. MOT20: A benchmark for multi object tracking in crowded scenes. arXiv:2003.09003 [cs]. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2003.09003","DOI":"10.48550\/arXiv.2003.09003"},{"key":"e_1_3_1_43_2","unstructured":"Glenn Jocher Ayush Chaurasia and Jing Qiu. 2023. Ultralytics YOLOv8. Retrieved from https:\/\/github.com\/ultralytics\/ultralytics"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2023.3240881"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(01)00103-0"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.09.026"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2023.101881"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.156"},{"key":"e_1_3_1_49_2","first-page":"27229","volume-title":"Multimedia Tools and Applications","volume":"79","author":"Pang Yuhang","year":"2020","unstructured":"Yuhang Pang, Fan Li, Xiaoya Qiao, and Andrew Gilman. 2020. Real-time tracking based on deep feature fusion. Multimedia Tools and Applications 79 (2020), 27229\u201327255."},{"issue":"4","key":"e_1_3_1_50_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3458281","article-title":"Cross-modal hybrid feature fusion for image-sentence matching","volume":"17","author":"Xu Xing","year":"2021","unstructured":"Xing Xu, Yifan Wang, Yixuan He, Yang Yang, Alan Hanjalic, and Heng Tao Shen. 2021. Cross-modal hybrid feature fusion for image-sentence matching. ACM Transactions on Multimedia Computing, Communications, and Applications 17, 4 (2021), 1\u201323.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3410439"},{"issue":"4","key":"e_1_3_1_52_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3630100","article-title":"Robust RGB-T tracking via adaptive modality weight correlation filters and cross-modality learning","volume":"20","author":"Zhou Mingliang","year":"2023","unstructured":"Mingliang Zhou, Xinwen Zhao, Futing Luo, Jun Luo, Huayan Pu, and Tao Xiang. 2023. Robust RGB-T tracking via adaptive modality weight correlation filters and cross-modality learning. ACM Transactions on Multimedia Computing, Communications and Applications 20, 4 (2023), 1\u201320.","journal-title":"ACM Transactions on Multimedia Computing, Communications and Applications"},{"key":"e_1_3_1_53_2","first-page":"10","volume-title":"Proceedings of the 3rd Large-Scale Video Object Segmentation Challenge","volume":"8","author":"Ding Zihan","year":"2021","unstructured":"Zihan Ding, Tianrui Hui, Shaofei Huang, Si Liu, Xuan Luo, Junshi Huang, and Xiaoming Wei. 2021. Progressive multimodal interaction network for referring video object segmentation. In Proceedings of the 3rd Large-Scale Video Object Segmentation Challenge 8, 10."},{"issue":"1","key":"e_1_3_1_54_2","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1007\/s00138-022-01354-2","article-title":"SiamMMF: Multi-modal multi-level fusion object tracking based on Siamese networks","volume":"34","author":"Yang Zhen","year":"2023","unstructured":"Zhen Yang, Peng Huang, Dunyun He, Zhongwang Cai, and Zhijian Yin. 2023. SiamMMF: Multi-modal multi-level fusion object tracking based on Siamese networks. Machine Vision and Applications 34, 1 (2023), 7.","journal-title":"Machine Vision and Applications"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.113"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00380"},{"key":"e_1_3_1_57_2","first-page":"9686","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Cao Jinkun","year":"2023","unstructured":"Jinkun Cao, Jiangmiao Pang, Xinshuo Weng, Rawal Khirodkar, and Kris Kitani. 2023. Observation-centric sort: Rethinking sort for robust multi-object tracking. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 9686\u20139696."},{"key":"e_1_3_1_58_2","first-page":"1","volume-title":"EURASIP Journal on Image and Video Processing","volume":"2008","author":"Bernardin Keni","year":"2008","unstructured":"Keni Bernardin and Rainer Stiefelhagen. 2008. Evaluating multiple object tracking performance: The clear MOT metrics. EURASIP Journal on Image and Video Processing 2008 (2008), 1\u201310."},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2014.126"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10044-019-00845-9"},{"key":"e_1_3_1_61_2","first-page":"3354","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR \u201912)","author":"Geiger Andreas","year":"2012","unstructured":"Andreas Geiger, Philip Lenz, and Raquel Urtasun. 2012. Are we ready for autonomous driving? The KITTI vision benchmark suite. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR \u201912), 3354\u20133361."},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01249-6_23"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-48881-3_2"},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-020-01375-2"},{"key":"e_1_3_1_65_2","first-page":"869","volume-title":"Proceedings of the 14th European Conference on Computer Vision (ECCV \u201916)","author":"Liu Xinchen","year":"2016","unstructured":"Xinchen Liu, Wu Liu, Tao Mei, and Huadong Ma. 2016. A deep learning-based approach to progressive vehicle re-identification for urban surveillance. In Proceedings of the 14th European Conference on Computer Vision (ECCV \u201916). Springer, 869\u2013884."},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","unstructured":"Liang Zheng Liyue Shen Lu Tian Shengjin Wang Jiahao Bu and Qi Tian. 2015. Person re-identification meets image search. arXiv:1502.02171. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.1502.02171","DOI":"10.48550\/arXiv.1502.02171"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-20047-2_1"},{"issue":"6","key":"e_1_3_1_68_2","doi-asserted-by":"crossref","first-page":"1692","DOI":"10.1200\/JCO.2002.20.6.1692","article-title":"Inhibition of KIT tyrosine kinase activity: A n","volume":"20","author":"Heinrich Michael C.","year":"2002","unstructured":"Michael C. Heinrich, Charles D. Blanke, Brian J. Druker, and Christopher L. Corless. 2002. Inhibition of KIT tyrosine kinase activity: A novel molecular approach to the treatment of KIT-positive malignancies. Journal of Clinical Oncology 20, 6 (2002), 1692\u20131703.","journal-title":"Journal of Clinical Oncology"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3699960","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3699960","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:05:57Z","timestamp":1750291557000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3699960"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,23]]},"references-count":67,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1,31]]}},"alternative-id":["10.1145\/3699960"],"URL":"https:\/\/doi.org\/10.1145\/3699960","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,23]]},"assertion":[{"value":"2024-05-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-20","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}