{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:59:55Z","timestamp":1760151595990,"version":"build-2065373602"},"reference-count":30,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,4,7]],"date-time":"2022-04-07T00:00:00Z","timestamp":1649289600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100007129","name":"Shandong Provincial Natural Science Foundation","doi-asserted-by":"publisher","award":["ZR2021QD148"],"award-info":[{"award-number":["ZR2021QD148"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the State Key Laboratory of Industrial Control Technology, Zhejiang University, China","award":["ICT2021B17"],"award-info":[{"award-number":["ICT2021B17"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Achieving efficient and accurate feature tracking on event cameras is a fundamental step for practical high-level applications, such as simultaneous localization and mapping (SLAM) and structure from motion (SfM) and visual odometry (VO) in GNSS (Global Navigation Satellite System)-denied environments. Although many asynchronous tracking methods purely using event flow have been proposed, they suffer from high computation demand and drift problems. In this paper, event information is still processed in the form of synthetic event frames to better adapt to the practical demands. Weighted fusion of multiple hypothesis testing with batch processing (WF-MHT-BP) is proposed based on loose integration of event, intensity, and inertial information. More specifically, with inertial information acting as priors, multiple hypothesis testing with batch processing (MHT-BP) produces coarse feature-tracking solutions on event frames in a batch processing way. With a time-related stochastic model, a weighted fusion mechanism fuses feature-tracking solutions from event and intensity frames compared with other state-of-the-art feature-tracking methods on event cameras. Evaluation on public datasets shows significant improvements on accuracy and efficiency and comparable performances in terms of feature-tracking length.<\/jats:p>","DOI":"10.3390\/rs14081773","type":"journal-article","created":{"date-parts":[[2022,4,7]],"date-time":"2022-04-07T21:08:22Z","timestamp":1649365702000},"page":"1773","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Intensity\/Inertial Integration-Aided Feature Tracking on Event Cameras"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0804-3972","authenticated-orcid":false,"given":"Zeyu","family":"Li","sequence":"first","affiliation":[{"name":"College of Geodesy and Geomatics, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute of Cyber-Systems and Control, Zhejiang University, Hangzhou 310027, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Feng","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Geodesy and Geomatics, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaowan","family":"Li","sequence":"additional","affiliation":[{"name":"National Time Service Center, Chinese Academy of Sciences, Xi\u2019an 710600, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,4,7]]},"reference":[{"key":"ref_1","first-page":"1484","article-title":"Event-based visual localization and mapping algorithms: A survey","volume":"47","author":"Ma","year":"2021","journal-title":"Acta Autom. Sin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"994","DOI":"10.1109\/LRA.2018.2793357","article-title":"Ultimate SLAM? Combining events, images, and IMU for robust visual SLAM in HDR and high-speed scenarios","volume":"3","author":"Vidal","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1433","DOI":"10.1109\/TRO.2021.3062252","article-title":"Event-based stereo visual odometry","volume":"37","author":"Zhou","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1109\/JPROC.2014.2312916","article-title":"Small brains, smart machines: From fly vision to robot vision and back again","volume":"102","author":"Franceschini","year":"2014","journal-title":"Proc. IEEE"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Shen, C. (2021). Brain-Like Navigation Technology Based on Inertial\/Vision System. Intelligent Information Processing for Inertial-Based Navigation Systems, Springer.","DOI":"10.1007\/978-981-33-4516-4"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"107861","DOI":"10.1016\/j.patcog.2021.107861","article-title":"Optical flow and scene flow estimation: A survey","volume":"114","author":"Zhai","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Corfu, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_8","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/BF00129684","article-title":"Tracking of point features","volume":"9","author":"Tomasi","year":"1991","journal-title":"Int. J. Comput. Vis."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18\u201323). Superpoint: Self-supervised interest point detection and description. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Dusmanu, M., Rocco, I., Pajdla, T., Pollefeys, M., Sivic, J., Torii, A., and Sattler, T. (2019, January 16\u201317). D2-net: A trainable CNN for joint description and detection of local features. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00828"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhu, A.Z., Atanasov, N., and Daniilidis, K. (June, January 29). Event-based feature tracking with probabilistic data association. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989517"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tedaldi, D., Gallego, G., Mueggler, E., and Scaramuzza, D. (2016, January 13\u201315). Feature detection and tracking with the dynamic and active-pixel vision sensor (DAVIS). Proceedings of the 2016 Second International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP), Krakow, Poland.","DOI":"10.1109\/EBCCSP.2016.7605086"},{"key":"ref_14","unstructured":"Gallego, G., Delbruck, T., Orchard, G.M., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A., Conradt, J., and Daniilidis, K. (2020). Event-based Vision: A Survey. IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","unstructured":"Delbruck, T. (2008, January 6\u20137). Frame-free dynamic digital vision. Proceedings of the International Symposium on Secure-Life Electronics, Advanced Electronics for Quality Life and Society, Tokyo, Japan."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mueggler, E., Forster, C., Baumli, N., Gallego, G., and Scaramuzza, D. (2015, January 26\u201330). Lifetime estimation of events from Dynamic Vision Sensors. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Istanbul, Turkey.","DOI":"10.1109\/ICRA.2015.7139876"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, R., Shi, D., Zhang, Y., Li, K., and Li, R. (2019, January 3\u20138). FA-Harris: A fast and asynchronous corner detector for event cameras. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Venetian Macao, Macau.","DOI":"10.1109\/IROS40897.2019.8968491"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3177","DOI":"10.1109\/LRA.2018.2849882","article-title":"Asynchronous corner detection and tracking for event cameras in real time","volume":"3","author":"Alzugaray","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_19","unstructured":"Alzugaray Lopez, I., and Chli, M. (2020, January 7\u201310). HASTE: Multi-Hypothesis Asynchronous Speeded-up Tracking of Events. Proceedings of the 31st British Machine Vision Virtual Conference (BMVC 2020), Virtual Event."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1007\/s11263-019-01209-w","article-title":"EKLT: Asynchronous photometric feature tracking using events and frames","volume":"128","author":"Gehrig","year":"2020","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Dong, Y., and Zhang, T. (2021, January 25\u201327). Standard and Event Cameras Fusion for Feature Tracking. Proceedings of the 2021 International Conference on Machine Vision and Applications, Singapore.","DOI":"10.1145\/3459066.3459075"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Gallego, G., Rebecq, H., Kneip, L., Li, H., and Scaramuzza, D. (2018, January 8\u201314). Semi-dense 3D reconstruction with a stereo event camera. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01246-5_15"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, D., Parra, A., and Chin, T.-J. (2021, January 19\u201325). Spatiotemporal Registration for Event-based Visual Odometry. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00490"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An open-source slam system for monocular, stereo, and rgb-d cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_25","unstructured":"Shi, J. (1994, January 21\u201323). Good features to track. Proceedings of the 1994 IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rosten, E., and Drummond, T. (2006, January 7\u201313). Machine learning for high-speed corner detection. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_34"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hwangbo, M., Kim, J.-S., and Kanade, T. (2009, January 10\u201315). Inertial-aided KLT feature tracking for a moving camera. Proceedings of the 2009 IEEE\/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA.","DOI":"10.1109\/IROS.2009.5354093"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wei, H., Tang, F., Zhang, C., and Wu, Y. (June, January 30). Highly Efficient Line Segment Tracking with an IMU-KLT Prediction and a Convex Geometric Distance Minimization. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9560931"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1177\/0278364917691115","article-title":"The event-camera dataset and simulator: Event-based data for pose estimation, visual odometry, and SLAM","volume":"36","author":"Mueggler","year":"2017","journal-title":"Int. J. Robot. Res."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Korman, S., Reichman, D., Tsur, G., and Avidan, S. (2013, January 23\u201328). FasT-Match: Fast Affine Template Matching. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition.","DOI":"10.1109\/CVPR.2013.302"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/8\/1773\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:49:38Z","timestamp":1760136578000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/8\/1773"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,7]]},"references-count":30,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["rs14081773"],"URL":"https:\/\/doi.org\/10.3390\/rs14081773","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,4,7]]}}}