{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T09:30:17Z","timestamp":1780392617269,"version":"3.54.1"},"reference-count":56,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T00:00:00Z","timestamp":1626220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61976040, U1811463"],"award-info":[{"award-number":["61976040, U1811463"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2020YFB1708902"],"award-info":[{"award-number":["2020YFB1708902"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Object tracking from LiDAR point clouds, which are always incomplete, sparse, and unstructured, plays a crucial role in urban navigation. Some existing methods utilize a learned similarity network for locating the target, immensely limiting the advancements in tracking accuracy. In this study, we leveraged a powerful target discriminator and an accurate state estimator to robustly track target objects in challenging point cloud scenarios. Considering the complex nature of estimating the state, we extended the traditional Lucas and Kanade (LK) algorithm to 3D point cloud tracking. Specifically, we propose a state estimation subnetwork that aims to learn the incremental warp for updating the coarse target state. Moreover, to obtain a coarse state, we present a simple yet efficient discrimination subnetwork. It can project 3D shapes into a more discriminatory latent space by integrating the global feature into each point-wise feature. Experiments on KITTI and PandaSet datasets showed that compared with the most advanced of other methods, our proposed method can achieve significant improvements\u2014in particular, up to 13.68% on KITTI.<\/jats:p>","DOI":"10.3390\/rs13142770","type":"journal-article","created":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T10:13:42Z","timestamp":1626257622000},"page":"2770","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Learning the Incremental Warp for 3D Vehicle Tracking in LiDAR Point Clouds"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8109-3581","authenticated-orcid":false,"given":"Shengjing","family":"Tian","sequence":"first","affiliation":[{"name":"School of Mathematical Sciences, Dalian University of Technology, Dalian 116024, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiuping","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Mathematical Sciences, Dalian University of Technology, Dalian 116024, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meng","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer and Technology, Shan Dong Jianzhu University, Jinan 250101, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuhao","family":"Bian","sequence":"additional","affiliation":[{"name":"School of Mathematical Sciences, Dalian University of Technology, Dalian 116024, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junbin","family":"Gao","sequence":"additional","affiliation":[{"name":"Discipline of Business Analytics, Business School, The University of Sydney, Sydney, NSW 2006, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Baocai","family":"Yin","sequence":"additional","affiliation":[{"name":"Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, Dalian 116024, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ma, Y., Anderson, J., Crouch, S., and Shan, J. (2019). Moving Object Detection and Tracking with Doppler LiDAR. Remote Sens., 11.","DOI":"10.3390\/rs11101154"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Giancola, S., Zarzar, J., and Ghanem, B. (2019). Leveraging Shape Completion for 3D Siamese Tracking, CVPR.","DOI":"10.1109\/CVPR.2019.00145"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Comport, A.I., Marchand, E., and Chaumette, F. (2004). Robust Model-Based Tracking for Robot Vision, IROS.","DOI":"10.1163\/156855305774662226"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wang, M., Su, D., Shi, L., Liu, Y., and Mir\u00f3, J.V. (2017). Real-time 3D Human Tracking for Mobile Robots with Multisensors, ICRA.","DOI":"10.1109\/ICRA.2017.7989593"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Luo, W., Yang, B., and Urtasun, R. (2018). Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Net, CVPR.","DOI":"10.1109\/CVPR.2018.00376"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1016\/j.isprsjprs.2010.06.006","article-title":"Automatic detection and tracking of pedestrians from a moving stereo rig","volume":"65","author":"Schindler","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Nam, H., and Han, B. (2016). Learning Multi-Domain Convolutional Neural Networks for Visual Tracking, CVPR.","DOI":"10.1109\/CVPR.2016.465"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","article-title":"High-Speed Tracking with Kernelized Correlation Filters","volume":"37","author":"Henriques","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., and Torr, P.H.S. (2016). Staple: Complementary Learners for Real-Time Tracking, CVPR.","DOI":"10.1109\/CVPR.2016.156"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1109\/TMM.2018.2863604","article-title":"Context-Aware Three-Dimensional Mean-Shift With Occlusion Handling for Robust Object Tracking in RGB-D Videos","volume":"21","author":"Liu","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kart, U., Kamarainen, J.K., and Matas, J. (2018). How to Make an RGBD Tracker?, ECCV.","DOI":"10.1007\/978-3-030-11009-3_8"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bibi, A., Zhang, T., and Ghanem, B. (2016). 3D Part-Based Sparse Tracker with Automatic Synchronization and Registration, CVPR.","DOI":"10.1109\/CVPR.2016.160"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Luber, M., Spinello, L., and Arras, K.O. (2011). People Tracking in RGB-D Data With On-Line Boosted Target Models, IROS.","DOI":"10.1109\/IROS.2011.6048836"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ku, J., Mozifian, M., Lee, J., Harakeh, A., and Waslander, S.L. (2018). Joint 3D Proposal Generation and Object Detection from View, ICRA.","DOI":"10.1109\/IROS.2018.8594049"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yang, B., Luo, W., and Urtasun, R. (2018). PIXOR: Real-Time 3D Object Detection from Point Clouds, CVPR.","DOI":"10.1109\/CVPR.2018.00798"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Qi, H., Feng, C., Cao, Z., Zhao, F., and Xiao, Y. (2020). P2B: Point-to-Box Network for 3D Object Tracking in Point Clouds, CVPR.","DOI":"10.1109\/CVPR42600.2020.00636"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Qi, C.R., Litany, O., He, K., and Guibas, L.J. (2019). Deep Hough Voting for 3D Object Detection in Point Clouds, ICCV.","DOI":"10.1109\/ICCV.2019.00937"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Bhat, G., Khan, F.S., and Felsberg, M. (2019). ATOM: Accurate Tracking by Overlap Maximization, CVPR.","DOI":"10.1109\/CVPR.2019.00479"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wang, C., Galoogahi, H.K., Lin, C.H., and Lucey, S. (2018). Deep-LK for Efficient Adaptive Object Tracking, ICRA.","DOI":"10.1109\/ICRA.2018.8460815"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Bhat, G., Khan, F.S., and Felsberg, M. (2017). ECO: Efficient Convolution Operators for Tracking, CVPR.","DOI":"10.1109\/CVPR.2017.733"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1834","DOI":"10.1109\/TPAMI.2014.2388226","article-title":"Object Tracking Benchmark","volume":"37","author":"Wu","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","unstructured":"Kristan, M., Leonardis, A., Matas, J., and Felsberg, M. (2018). The Sixth Visual Object Tracking VOT2018 Challenge Results, ECCV."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Valmadre, J., Bertinetto, L., Henriques, J.F., Vedaldi, A., and Torr, P.H.S. (2017). End-to-End Representation Learning for Correlation Filter Based Tracking, CVPR.","DOI":"10.1109\/CVPR.2017.531"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., and Torr, P.H.S. (2016). Fully-Convolutional Siamese Networks for Object Tracking, ECCV.","DOI":"10.1007\/978-3-319-48881-3_56"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Held, D., Thrun, S., and Savarese, S. (2016). Learning to Track at 100 FPS with Deep Regression Networks, ECCV.","DOI":"10.1007\/978-3-319-46448-0_45"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Jiang, B., Luo, R., Mao, J., Xiao, T., and Jiang, Y. (2018). Acquisition of Localization Confidence for Accurate Object Detection, ECCV.","DOI":"10.1007\/978-3-030-01264-9_48"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"107679","DOI":"10.1016\/j.patcog.2020.107679","article-title":"Adaptive feature fusion for visual object tracking","volume":"111","author":"Zhao","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bhat, G., Danelljan, M., Gool, L.V., and Timofte, R. (2019). Learning Discriminative Model Prediction for Tracking, ICCV.","DOI":"10.1109\/ICCV.2019.00628"},{"key":"ref_29","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation, CVPR."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"107708","DOI":"10.1016\/j.patcog.2020.107708","article-title":"Connectivity-based convolutional neural network for classifying point clouds","volume":"112","author":"Lee","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhou, Y., and Tuzel, O. (2018). VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection, CVPR.","DOI":"10.1109\/CVPR.2018.00472"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Shi, S., Wang, X., and Li, H. (2019). PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud, CVPR.","DOI":"10.1109\/CVPR.2019.00086"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Yi, L., Zhao, W., Wang, H., Sung, M., and Guibas, L. (2019). GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloud, CVPR.","DOI":"10.1109\/CVPR.2019.00407"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Wang, W., Yu, R., Huang, Q., and Neumann, U. (2018). SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation, CVPR.","DOI":"10.1109\/CVPR.2018.00272"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Song, S., and Xiao, J. (2013). Tracking Revisited Using RGBD Camera: Unified Benchmark and Baselines, ICCV.","DOI":"10.1109\/ICCV.2013.36"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Held, D., Levinson, J., and Thrun, S. (2013). Precision Tracking with Sparse 3D and Dense Color 2D Data, ICRA.","DOI":"10.1109\/ICRA.2013.6630715"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1177\/0278364915593399","article-title":"Robust real-time tracking combining 3D shape, color, and motion","volume":"35","author":"Held","year":"2016","journal-title":"Int. J. Robot. Res."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Spinello, L., Arras, K.O., Triebel, R., and Siegwart, R. (2010). A Layered Approach to People Detection in 3D Range Data, AAAI.","DOI":"10.1609\/aaai.v24i1.7728"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"295","DOI":"10.5194\/isprs-annals-III-3-295-2016","article-title":"Simultaneous detection and tracking of pedestrian from velodyne laser scanning data","volume":"3","author":"Xiao","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zou, H., Cui, J., Kong, X., Zhang, C., Liu, Y., Wen, F., and Li, W. (2020). F-Siamese Tracker: A Frustum-based Double Siamese Network for 3D Single Object Tracking, IROS.","DOI":"10.1109\/IROS45743.2020.9341120"},{"key":"ref_41","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space, NeurIPS."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MRA.2006.250573","article-title":"Visual servo control, Part I: Basic approaches","volume":"13","author":"Chaumette","year":"2006","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_43","unstructured":"Quentin, B., Eric, M., Juxi, L., Fran\u00e7ois, C., and Peter, C. (2017, January 12\u201316). Visual Servoing from Deep Neural Networks. Proceedings of the Robotics: Science and Systems Workshop, Cambridge, MA, USA."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Xiong, X., and la Torre, F.D. (2013). Supervised Descent Method and Its Applications to Face Alignment, CVPR.","DOI":"10.1109\/CVPR.2013.75"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lin, C.H., Zhu, R., and Lucey, S. (2016). The Conditional Lucas-Kanade Algorithm, ECCV.","DOI":"10.1007\/978-3-319-46454-1_48"},{"key":"ref_46","unstructured":"Han, L., Ji, M., Fang, L., and Nie\u00dfner, M. (2018). RegNet: Learning the Optimization of Direct Image-to-Image Pose Registration. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1023\/B:VISI.0000011205.11775.fd","article-title":"Lucas-Kanade 20 years on: A unifying framework","volume":"56","author":"Baker","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Aoki, Y., Goforth, H., Srivatsan, R.A., and Lucey, S. (2019). PointNetLK: Robust & Efficient Point Cloud Registration using PointNet, CVPR.","DOI":"10.1109\/CVPR.2019.00733"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Girshick, R.B. (2015). Fast R-CNN, ICCV.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The KITTI dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_51","unstructured":"Hesai, I.S. (2021, June 24). PandaSet by Hesai and Scale AI. Available online: https:\/\/pandaset.org\/."},{"key":"ref_52","unstructured":"Zarzar, J., Giancola, S., and Ghanem, B. (2019). Efficient Bird Eye View Proposals for 3D Siamese Tracking. arXiv."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Sun, X., Wei, Y., Liang, S., Tang, X., and Sun, J. (2015). Cascaded Hand Pose Regression, CVPR.","DOI":"10.1109\/CVPR.2015.7298683"},{"key":"ref_55","first-page":"1","article-title":"Dynamic Graph CNN for Learning on Point Clouds","volume":"38","author":"Wang","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Liu, X., Qi, C.R., and Guibas, L.J. (2019). FlowNet3D: Learning Scene Flow in 3D Point Clouds, CVPR.","DOI":"10.1109\/CVPR.2019.00062"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/14\/2770\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:30:29Z","timestamp":1760164229000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/14\/2770"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,14]]},"references-count":56,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["rs13142770"],"URL":"https:\/\/doi.org\/10.3390\/rs13142770","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,14]]}}}