{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T01:23:46Z","timestamp":1781659426285,"version":"3.54.5"},"reference-count":73,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T00:00:00Z","timestamp":1709251200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,9]],"date-time":"2024-03-09T00:00:00Z","timestamp":1709942400000},"content-version":"vor","delay-in-days":8,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Natural Science Foundation of China Major Program","award":["42192580"],"award-info":[{"award-number":["42192580"]}]},{"name":"National Natural Science Foundation of China Major Program","award":["42192583"],"award-info":[{"award-number":["42192583"]}]},{"name":"Hubei Province Natural Science Foundation","award":["2021CFA088"],"award-info":[{"award-number":["2021CFA088"]}]},{"name":"Hubei Province Natural Science Foundation","award":["2020CFA003"],"award-info":[{"award-number":["2020CFA003"]}]},{"name":"Hubei Science and Technology Major Project","award":["2021AAA010"],"award-info":[{"award-number":["2021AAA010"]}]},{"name":"Hubei Science and Technology Major Project","award":["2021AAA010-3"],"award-info":[{"award-number":["2021AAA010-3"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Robot Syst"],"published-print":{"date-parts":[[2024,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Despite promising SLAM research in both vision and robotics communities, which fundamentally sustains the autonomy of intelligent unmanned systems, visual challenges still threaten its robust operation severely. Existing SLAM methods usually focus on specific challenges and solve the problem with sophisticated enhancement or multi-modal fusion. However, they are basically limited to particular scenes with a non-quantitative understanding and awareness of challenges, resulting in a significant performance decline with poor generalization and(or) redundant computation with inflexible mechanisms. To push the frontier of visual SLAM, we propose a fully computational reliable evaluation module called CEMS (Challenge Evaluation Module for SLAM) for general visual perception based on a clear definition and systematic analysis. It decomposes various challenges into several common aspects and evaluates degradation with corresponding indicators. Extensive experiments demonstrate our feasibility and outperformance. The proposed module has a high consistency of 88.298% compared with annotation ground truth, and a strong correlation of 0.879 compared with SLAM tracking performance. Moreover, we show the prototype SLAM based on CEMS with better performance and the first comprehensive CET (Challenge Evaluation Table) for common SLAM datasets (EuRoC, KITTI, etc.) with objective and fair evaluations of various challenges. We make it available online to benefit the community on our website.<\/jats:p>","DOI":"10.1007\/s10846-024-02077-4","type":"journal-article","created":{"date-parts":[[2024,3,9]],"date-time":"2024-03-09T07:01:36Z","timestamp":1709967696000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["How Challenging is a Challenge? CEMS: a Challenge Evaluation Module for SLAM Visual Perception"],"prefix":"10.1007","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8401-9718","authenticated-orcid":false,"given":"Xuhui","family":"Zhao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3325-1183","authenticated-orcid":false,"given":"Zhi","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong","family":"Ji","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenyang","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Fang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ben","family":"M.\u00a0Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,3,9]]},"reference":[{"key":"2077_CR1","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1016\/j.eng.2021.10.014","volume":"12","author":"BM Chen","year":"2021","unstructured":"Chen, B.M.: On the trends of autonomous unmanned systems research. Engineering 12, 20\u201323 (2021)","journal-title":"Engineering"},{"key":"2077_CR2","doi-asserted-by":"crossref","unstructured":"Bujanca, M., Shi, X., Spear, M., Zhao, P., Lennox, B., Luj\u00e1n, M.: Robust slam systems: are we there yet? In: 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5320\u20135327 (2021)","DOI":"10.1109\/IROS51168.2021.9636814"},{"key":"2077_CR3","doi-asserted-by":"crossref","unstructured":"Garforth, J., Webb, B.: Visual appearance analysis of forest scenes for monocular slam. In: 2019 International Conference on Robotics and Automation (ICRA), pp. 1794\u20131800 (2019)","DOI":"10.1109\/ICRA.2019.8793771"},{"key":"2077_CR4","doi-asserted-by":"crossref","unstructured":"Park, S., Sch\u00f6ps, T., Pollefeys, M.: Illumination change robustness in direct visual slam. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 4523\u20134530 (2017)","DOI":"10.1109\/ICRA.2017.7989525"},{"key":"2077_CR5","unstructured":"CVPR 2020 SLAM Challenge. https:\/\/sites.google.com\/view\/vislocslamcvpr2020\/slam-challenge"},{"key":"2077_CR6","doi-asserted-by":"publisher","first-page":"538","DOI":"10.1016\/j.neucom.2020.07.130","volume":"453","author":"X Liu","year":"2021","unstructured":"Liu, X., Gao, Z., Chen, B.M.: Ipmgan: integrating physical model and generative adversarial network for underwater image enhancement. Neurocomputing 453, 538\u2013551 (2021)","journal-title":"Neurocomputing"},{"key":"2077_CR7","doi-asserted-by":"crossref","unstructured":"Rahman, S., Li, A.Q., Rekleitis, I.: Svin2: an underwater slam system using sonar, visual, inertial, and depth sensor. In: 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1861\u20131868 (2019)","DOI":"10.1109\/IROS40897.2019.8967703"},{"key":"2077_CR8","doi-asserted-by":"crossref","unstructured":"Zhou, L., Huang, G., Mao, Y., Wang, S., Kaess, M.: Edplvo: efficient direct point-line visual odometry. In: 2022 International Conference on Robotics and Automation, pp. 7559\u20137565 (2022)","DOI":"10.1109\/ICRA46639.2022.9812133"},{"key":"2077_CR9","doi-asserted-by":"crossref","unstructured":"DeTone, D., Malisiewicz, T., Rabinovich, A.: Superpoint: self-supervised interest point detection and description. In: 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 337\u201333712 (2018)","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"2077_CR10","doi-asserted-by":"crossref","unstructured":"Sarlin, P.-E., DeTone, D., Malisiewicz, T., Rabinovich, A.: Superglue: learning feature matching with graph neural networks. In: 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4937\u20134946 (2020)","DOI":"10.1109\/CVPR42600.2020.00499"},{"issue":"10","key":"2077_CR11","doi-asserted-by":"publisher","first-page":"2656","DOI":"10.1109\/TPAMI.2019.2909863","volume":"42","author":"K Joo","year":"2020","unstructured":"Joo, K., Oh, T.-H., Kweon, I.S., Bazin, J.-C.: Globally optimal inlier set maximization for atlanta world understanding. IEEE Trans. Pattern Anal. Mach. Intell. 42(10), 2656\u20132669 (2020)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2077_CR12","doi-asserted-by":"crossref","unstructured":"Yunus, R., Li, Y., Tombari, F.: Manhattanslam: Robust planar tracking and mapping leveraging mixture of manhattan frames. In: 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 6687\u20136693 (2021)","DOI":"10.1109\/ICRA48506.2021.9562030"},{"key":"2077_CR13","doi-asserted-by":"crossref","unstructured":"Qiu, Y., Wang, C., Wang, W., Henein, M., Scherer, S.: Airdos: dynamic slam benefits from articulated objects. In: 2022 International Conference on Robotics and Automation, pp. 8047\u20138053 (2022)","DOI":"10.1109\/ICRA46639.2022.9811667"},{"issue":"2","key":"2077_CR14","doi-asserted-by":"publisher","first-page":"2028","DOI":"10.1109\/LRA.2021.3058909","volume":"6","author":"J Tomasi","year":"2021","unstructured":"Tomasi, J., Wagstaff, B., Waslander, S.L., Kelly, J.: Learned camera gain and exposure control for improved visual feature detection and matching. IEEE Robotics and Automation Letters 6(2), 2028\u20132035 (2021)","journal-title":"IEEE Robotics and Automation Letters"},{"key":"2077_CR15","unstructured":"Brunner, C., Peynot, T., Underwood, J.: Towards discrimination of challenging conditions for ugvs with visual and infrared sensors. In: ARAA Australasian Conference on Robotics and Automation, Sydney, Australia (2009)"},{"key":"2077_CR16","doi-asserted-by":"crossref","unstructured":"Brunner, C., Peynot, T.: Visual metrics for the evaluation of sensor data quality in outdoor perception. In: Proceedings of the 10th Performance Metrics for Intelligent Systems Workshop, pp. 1\u20138 (2010)","DOI":"10.1145\/2377576.2377578"},{"key":"2077_CR17","doi-asserted-by":"crossref","unstructured":"Brunner, C., Peynot, T., Vidal-Calleja, T.: Combining multiple sensor modalities for a localisation robust to smoke. In: 2011 IEEE\/RSJ International Conference on Intelligent Robots and Systems, pp. 2489\u20132496 (2011)","DOI":"10.1109\/IROS.2011.6094614"},{"issue":"4","key":"2077_CR18","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1002\/rob.21464","volume":"30","author":"C Brunner","year":"2013","unstructured":"Brunner, C., Peynot, T., Vidal-Calleja, T., Underwood, J.: Selective combination of visual and thermal imaging for resilient localization in adverse conditions: day and night, smoke and fire. Journal of Field Robotics 30(4), 641\u2013666 (2013)","journal-title":"Journal of Field Robotics"},{"key":"2077_CR19","doi-asserted-by":"crossref","unstructured":"Brunner, C., Peynot, T.: Perception quality evaluation with visual and infrared cameras in challenging environmental conditions. In: Experimental Robotics: The 12th International Symposium on Experimental Robotics, pp. 711\u2013725 (2014). Springer","DOI":"10.1007\/978-3-642-28572-1_49"},{"key":"2077_CR20","doi-asserted-by":"crossref","unstructured":"Kim, P., Coltin, B., Alexandrov, O., Kim, H.J.: Robust visual localization in changing lighting conditions. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 5447\u20135452 (2017)","DOI":"10.1109\/ICRA.2017.7989640"},{"key":"2077_CR21","unstructured":"DARPA Subterranean(SubT) Challenge. www.darpa.mil\/program\/darpa-subterranean-challenge"},{"issue":"66","key":"2077_CR22","doi-asserted-by":"publisher","first-page":"9742","DOI":"10.1126\/scirobotics.abp9742","volume":"7","author":"M Tranzatto","year":"2022","unstructured":"Tranzatto, M., Miki, T., Dharmadhikari, M., Bernreiter, L., Kulkarni, M., Mascarich, F., Andersson, O., Khattak, S., Hutter, M., Siegwart, R., et al.: Cerberus in the darpa subterranean challenge. Sci. Robot. 7(66), 9742 (2022)","journal-title":"Sci. Robot."},{"key":"2077_CR23","doi-asserted-by":"crossref","unstructured":"Carrillo, H., Reid, I., Castellanos, J.A.: On the comparison of uncertainty criteria for active slam. In: 2012 IEEE International Conference on Robotics and Automation, pp. 2080\u20132087 (2012)","DOI":"10.1109\/ICRA.2012.6224890"},{"key":"2077_CR24","unstructured":"Agha, A., Otsu, K., Morrell, B., Fan, D.D., Thakker, R., Santamaria-Navarro, A., Kim, S.-K., Bouman, A., Lei, X., Edlund, J., et al.: Nebula: quest for robotic autonomy in challenging environments; team costar at the darpa subterranean challenge. (2021). arXiv:2103.11470"},{"key":"2077_CR25","doi-asserted-by":"crossref","unstructured":"Santamaria-Navarro, A., Thakker, R., Fan, D.D., Morrell, B., Agha-mohammadi, A.-a.: Towards resilient autonomous navigation of drones. In: Robotics Research: The 19th International Symposium ISRR, pp. 922\u2013937 (2022). Springer","DOI":"10.1007\/978-3-030-95459-8_57"},{"key":"2077_CR26","doi-asserted-by":"crossref","unstructured":"Kramer, A., Stahoviak, C., Santamaria-Navarro, A., Agha-Mohammadi, A.-A., Heckman, C.: Radar-inertial ego-velocity estimation for visually degraded environments. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 5739\u20135746 (2020). IEEE","DOI":"10.1109\/ICRA40945.2020.9196666"},{"key":"2077_CR27","doi-asserted-by":"crossref","unstructured":"Palieri, M., Morrell, B., Thakur, A., Ebadi, K., Nash, J., Chatterjee, A., Kanellakis, C., Carlone, L., Guaragnella, C., Agha-mohammadi, A.-a.: Locus: a multi-sensor lidar-centric solution for high-precision odometry and 3d mapping in real-time. IEEE Robotics and Automation Letters 6(2), 421\u2013428 (2021)","DOI":"10.1109\/LRA.2020.3044864"},{"key":"2077_CR28","doi-asserted-by":"crossref","unstructured":"Tagliabue, A., Tordesillas, J., Cai, X., Santamaria-Navarro, A., How, J.P., Carlone, L., Agha-mohammadi, A.-a.: Lion: Lidar-inertial observability-aware navigator for vision-denied environments. In: Experimental Robotics: The 17th International Symposium, pp. 380\u2013390 (2021). Springer","DOI":"10.1007\/978-3-030-71151-1_34"},{"key":"2077_CR29","doi-asserted-by":"crossref","unstructured":"Ebadi, K., Chang, Y., Palieri, M., Stephens, A., Hatteland, A., Heiden, E., Thakur, A., Funabiki, N., Morrell, B., Wood, S., Carlone, L., Agha-mohammadi, A.-a.: Lamp: large-scale autonomous mapping and positioning for exploration of perceptually-degraded subterranean environments. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 80\u201386 (2020)","DOI":"10.1109\/ICRA40945.2020.9197082"},{"key":"2077_CR30","doi-asserted-by":"crossref","unstructured":"Ebadi, K., Palieri, M., Wood, S., Padgett, C., Agha-mohammadi, A.-a.: Dare-slam: degeneracy-aware and resilient loop closing in perceptually-degraded environments. Journal of Intelligent & Robotic Systems 102, 1\u201325 (2021)","DOI":"10.1007\/s10846-021-01362-w"},{"key":"2077_CR31","doi-asserted-by":"crossref","unstructured":"Rou\u010dek, T., Pecka, M., C\u00ed\u017eek, P., Pet\u0159\u00ed\u010dek, T., Bayer, J., \u0160alansk\u00ec, V., He\u0159t, D., Petrl\u00edk, M., B\u00e1\u010da, T., Spurn\u1ef3, V., et al.: Darpa subterranean challenge: multi-robotic exploration of underground environments. In: Modelling and Simulation for Autonomous Systems: 6th International Conference, MESAS 2019, Palermo, Italy, October 29\u201331, 2019, Revised Selected Papers 6, pp. 274\u2013290 (2020). Springer","DOI":"10.1007\/978-3-030-43890-6_22"},{"issue":"8","key":"2077_CR32","doi-asserted-by":"publisher","first-page":"2378","DOI":"10.1109\/TIP.2011.2109730","volume":"20","author":"L Zhang","year":"2011","unstructured":"Zhang, L., Zhang, L., Mou, X., Zhang, D.: Fsim: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378\u20132386 (2011)","journal-title":"IEEE Trans. Image Process."},{"issue":"12","key":"2077_CR33","doi-asserted-by":"publisher","first-page":"3350","DOI":"10.1109\/TIP.2011.2147325","volume":"20","author":"AK Moorthy","year":"2011","unstructured":"Moorthy, A.K., Bovik, A.C.: Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans. Image Process. 20(12), 3350\u20133364 (2011)","journal-title":"IEEE Trans. Image Process."},{"issue":"3","key":"2077_CR34","doi-asserted-by":"publisher","first-page":"1202","DOI":"10.1109\/TIP.2017.2774045","volume":"27","author":"K Ma","year":"2018","unstructured":"Ma, K., Liu, W., Zhang, K., Duanmu, Z., Wang, Z., Zuo, W.: End-to-end blind image quality assessment using deep neural networks. IEEE Trans. Image Process. 27(3), 1202\u20131213 (2018)","journal-title":"IEEE Trans. Image Process."},{"key":"2077_CR35","doi-asserted-by":"crossref","unstructured":"Zhu, H., Li, L., Wu, J., Dong, W., Shi, G.: Metaiqa: deep meta-learning for no reference image quality assessment. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 14143\u201314152 (2020)","DOI":"10.1109\/CVPR42600.2020.01415"},{"key":"2077_CR36","doi-asserted-by":"crossref","unstructured":"Cheon, M., Yoon, S.-J., Kang, B., Lee, J.: Perceptual image quality assessment with transformers. In: IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 433\u2013442 (2021)","DOI":"10.1109\/CVPRW53098.2021.00054"},{"key":"2077_CR37","volume":"94","author":"N Yang","year":"2021","unstructured":"Yang, N., Zhong, Q., Li, K., Cong, R., Zhao, Y., Kwong, S.: A reference-free underwater image quality assessment metric in frequency domain. Signal Processing: Image Communication 94, 116218 (2021)","journal-title":"Signal Processing: Image Communication"},{"issue":"5","key":"2077_CR38","doi-asserted-by":"publisher","first-page":"1259","DOI":"10.1109\/TMM.2019.2938612","volume":"22","author":"T Xiang","year":"2020","unstructured":"Xiang, T., Yang, Y., Guo, S.: Blind night-time image quality assessment: subjective and objective approaches. IEEE Trans. Multimedia 22(5), 1259\u20131272 (2020)","journal-title":"IEEE Trans. Multimedia"},{"key":"2077_CR39","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1109\/TIP.2020.3033402","volume":"30","author":"W Liu","year":"2021","unstructured":"Liu, W., Zhou, F., Lu, T., Duan, J., Qiu, G.: Image defogging quality assessment: real-world database and method. IEEE Trans. Image Process. 30, 176\u2013190 (2021)","journal-title":"IEEE Trans. Image Process."},{"key":"2077_CR40","unstructured":"Li, X.: Blind image quality assessment. In: 2002 IEEE International Conference on Image Processing, vol. 1, p. (2002)"},{"key":"2077_CR41","doi-asserted-by":"crossref","unstructured":"Mier, J.C., Huang, E., Talebi, H., Yang, F., Milanfar, P.: Deep perceptual image quality assessment for compression. In: 2021 IEEE International Conference on Image Processing, pp. 1484\u20131488 (2021)","DOI":"10.1109\/ICIP42928.2021.9506217"},{"issue":"11","key":"2077_CR42","doi-asserted-by":"publisher","first-page":"3345","DOI":"10.1109\/TIP.2015.2442920","volume":"24","author":"K Ma","year":"2015","unstructured":"Ma, K., Zeng, K., Wang, Z.: Perceptual quality assessment for multi-exposure image fusion. IEEE Trans. Image Process. 24(11), 3345\u20133356 (2015)","journal-title":"IEEE Trans. Image Process."},{"key":"2077_CR43","doi-asserted-by":"publisher","first-page":"5612","DOI":"10.1109\/TIP.2020.2984879","volume":"29","author":"SVR Dendi","year":"2020","unstructured":"Dendi, S.V.R., Channappayya, S.S.: No-reference video quality assessment using natural spatiotemporal scene statistics. IEEE Trans. Image Process. 29, 5612\u20135624 (2020)","journal-title":"IEEE Trans. Image Process."},{"key":"2077_CR44","doi-asserted-by":"crossref","unstructured":"Zhang, J., Kaess, M., Singh, S.: On degeneracy of optimization-based state estimation problems. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 809\u2013816 (2016)","DOI":"10.1109\/ICRA.2016.7487211"},{"key":"2077_CR45","doi-asserted-by":"crossref","unstructured":"Zhang, J., Singh, S.: Enabling aggressive motion estimation at low-drift and accurate mapping in real-time. In: IEEE International Conference on Robotics and Automation, pp. 5051\u20135058 (2017)","DOI":"10.1109\/ICRA.2017.7989589"},{"key":"2077_CR46","doi-asserted-by":"crossref","unstructured":"Thakker, R., Alatur, N., Fan, D.D., Tordesillas, J., Paton, M., Otsu, K., Toupet, O., Agha-mohammadi, A.-a.: Autonomous off-road navigation over extreme terrains with perceptually-challenging conditions. In: Experimental Robotics: The 17th International Symposium, pp. 161\u2013173 (2021). Springer","DOI":"10.1007\/978-3-030-71151-1_15"},{"key":"2077_CR47","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-34372-9","volume-title":"Computer Vision: Algorithms and Applications","author":"R Szeliski","year":"2022","unstructured":"Szeliski, R.: Computer Vision: Algorithms and Applications. Springer, Cham (2022)"},{"key":"2077_CR48","doi-asserted-by":"crossref","unstructured":"Handa, A., Whelan, T., McDonald, J., Davison, A.J.: A benchmark for rgb-d visual odometry, 3d reconstruction and slam. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 1524\u20131531 (2014)","DOI":"10.1109\/ICRA.2014.6907054"},{"key":"2077_CR49","doi-asserted-by":"crossref","unstructured":"Cepeda-Negrete, J., Sanchez-Yanez, R.E.: Gray-world assumption on perceptual color spaces. In: Image and Video Technology: 6th Pacific-Rim Symposium, PSIVT 2013, Guanajuato, Mexico, October 28-November 1, 2013. Proceedings 6, pp. 493\u2013504 (2014). Springer","DOI":"10.1007\/978-3-642-53842-1_42"},{"key":"2077_CR50","doi-asserted-by":"crossref","unstructured":"Tranzatto, M., Mascarich, F., Bernreiter, L., Godinho, C., Camurri, M., Khattak, S., Dang, T., Reijgwart, V., Loeje, J., Wisth, D.: Cerberus: autonomous legged and aerial robotic exploration in the tunnel and urban circuits of the darpa subterranean challenge. (2022). arXiv:2201.07067","DOI":"10.55417\/fr.2022011"},{"issue":"5","key":"2077_CR51","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","volume":"31","author":"R Mur-Artal","year":"2015","unstructured":"Mur-Artal, R., Montiel, J.M.M., Tard\u00f3s, J.D.: Orb-slam: a versatile and accurate monocular slam system. IEEE Trans. Rob. 31(5), 1147\u20131163 (2015)","journal-title":"IEEE Trans. Rob."},{"key":"2077_CR52","unstructured":"Gadkari, D.: Image quality analysis using glcm (2004)"},{"key":"2077_CR53","unstructured":"BT, I.: Methodologies for the subjective assessment of the quality of television images, document recommendation itu-r bt. 500\u201314 (10\/2019). ITU, Geneva, Switzerland (2020)"},{"issue":"10","key":"2077_CR54","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.1177\/0278364915620033","volume":"35","author":"M Burri","year":"2016","unstructured":"Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M.W., Siegwart, R.: The euroc micro aerial vehicle datasets. The International Journal of Robotics Research 35(10), 1157\u20131163 (2016)","journal-title":"The International Journal of Robotics Research"},{"key":"2077_CR55","doi-asserted-by":"crossref","unstructured":"Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of rgb-d slam systems. In: IEEE\/RSJ International Conference on Intelligent Robots and Systems, pp. 573\u2013580 (2012)","DOI":"10.1109\/IROS.2012.6385773"},{"issue":"11","key":"2077_CR56","doi-asserted-by":"publisher","first-page":"1231","DOI":"10.1177\/0278364913491297","volume":"32","author":"A Geiger","year":"2013","unstructured":"Geiger, A., Lenz, P., Stiller, C., Urtasun, R.: Vision meets robotics: the kitti dataset. The International Journal of Robotics Research 32(11), 1231\u20131237 (2013)","journal-title":"The International Journal of Robotics Research"},{"key":"2077_CR57","doi-asserted-by":"crossref","unstructured":"Ferrera, M., Creuze, V., Moras, J., Trouv\u00e9-Peloux, P.: Aqualoc: an underwater dataset for visual\u2013inertial\u2013pressure localization. The International Journal of Robotics Research 38(14), 1549\u20131559 (2019)","DOI":"10.1177\/0278364919883346"},{"key":"2077_CR58","doi-asserted-by":"crossref","unstructured":"Shah, S., Dey, D., Lovett, C., Kapoor, A.: Airsim: high-fidelity visual and physical simulation for autonomous vehicles. In: International Symposium on Field and Service Robotics (2017)","DOI":"10.1007\/978-3-319-67361-5_40"},{"key":"2077_CR59","unstructured":"HoYoverse: Genshin Impact-Step Into a Vast Magical World of Advanture. (2023). https:\/\/genshin.hoyoverse.com\/en"},{"key":"2077_CR60","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J.L., Frahm, J.-M.: Structure-from-motion revisited. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2016)","DOI":"10.1109\/CVPR.2016.445"},{"key":"2077_CR61","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J.L., Zheng, E., Pollefeys, M., Frahm, J.-M.: Pixelwise view selection for unstructured multi-view stereo. In: European Conference on Computer Vision (ECCV) (2016)","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"2077_CR62","unstructured":"Zhao, X.: The Genshin Impact Dataset (GID) for SLAM. https:\/\/github.com\/zhaoxuhui\/Genshin-Impact-Dataset"},{"key":"2077_CR63","doi-asserted-by":"crossref","unstructured":"Cohen, I., Huang, Y., Chen, J., Benesty, J., Benesty, J., Chen, J., Huang, Y., Cohen, I.: Pearson correlation coefficient. Noise reduction in speech processing, 1\u20134 (2009)","DOI":"10.1007\/978-3-642-00296-0_5"},{"key":"2077_CR64","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Scaramuzza, D.: A tutorial on quantitative trajectory evaluation for visual(-inertial) odometry. In: 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 7244\u20137251 (2018). IEEE","DOI":"10.1109\/IROS.2018.8593941"},{"issue":"3","key":"2077_CR65","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","volume":"40","author":"J Engel","year":"2018","unstructured":"Engel, J., Koltun, V., Cremers, D.: Direct sparse odometry. IEEE Trans. Pattern Anal. Mach. Intell. 40(3), 611\u2013625 (2018)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2077_CR66","doi-asserted-by":"crossref","unstructured":"Forster, C., Pizzoli, M., Scaramuzza, D.: Svo: fast semi-direct monocular visual odometry. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 15\u201322 (2014)","DOI":"10.1109\/ICRA.2014.6906584"},{"key":"2077_CR67","doi-asserted-by":"crossref","unstructured":"Campos, C., Elvira, R., Rodr\u00edguez, J.J.G., M. Montiel, J.M., D. Tard\u00f3s, J.: Orb-slam3: an accurate open-source library for visual, visual\u2013inertial, and multimap slam. IEEE Transactions on Robotics 37(6), 1874\u20131890 (2021)","DOI":"10.1109\/TRO.2021.3075644"},{"key":"2077_CR68","first-page":"16558","volume":"34","author":"Z Teed","year":"2021","unstructured":"Teed, Z., Deng, J.: Droid-slam: deep visual slam for monocular, stereo, and rgb-d cameras. Adv. Neural. Inf. Process. Syst. 34, 16558\u201316569 (2021)","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"2077_CR69","unstructured":"Moore, D.S.: Statistics: Concepts and controversies. (1980)"},{"key":"2077_CR70","doi-asserted-by":"crossref","unstructured":"Wang, W., Zhu, D., Wang, X., Hu, Y., Qiu, Y., Wang, C., Hu, Y., Kapoor, A., Scherer, S.: Tartanair: A dataset to push the limits of visual slam. In: 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4909\u20134916 (2020)","DOI":"10.1109\/IROS45743.2020.9341801"},{"key":"2077_CR71","doi-asserted-by":"crossref","unstructured":"Jiao, J., Wei, H., Hu, T., Hu, X., Zhu, Y., He, Z., Wu, J., Yu, J., Xie, X., Huang, H., Geng, R., Wang, L., Liu, M.: Fusionportable: a multi-sensor campus-scene dataset for evaluation of localization and mapping accuracy on diverse platforms, 3851\u20133856 (2022)","DOI":"10.1109\/IROS47612.2022.9982119"},{"key":"2077_CR72","unstructured":"Houston, J., Zuidhof, G., Bergamini, L., Ye, Y., Chen, L., Jain, A., Omari, S., Iglovikov, V., Ondruska, P.: One thousand and one hours: self-driving motion prediction dataset. In: Conference on Robot Learning, pp. 409\u2013418 (2021). PMLR"},{"key":"2077_CR73","doi-asserted-by":"crossref","unstructured":"Caesar, H., Bankiti, V., Lang, A.H., Vora, S., Liong, V.E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., Beijbom, O.: Nuscenes: a multimodal dataset for autonomous driving. In: 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11618\u201311628 (2020)","DOI":"10.1109\/CVPR42600.2020.01164"}],"container-title":["Journal of Intelligent &amp; Robotic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-024-02077-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10846-024-02077-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-024-02077-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,1]],"date-time":"2024-04-01T02:23:14Z","timestamp":1711938194000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10846-024-02077-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3]]},"references-count":73,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3]]}},"alternative-id":["2077"],"URL":"https:\/\/doi.org\/10.1007\/s10846-024-02077-4","relation":{},"ISSN":["0921-0296","1573-0409"],"issn-type":[{"value":"0921-0296","type":"print"},{"value":"1573-0409","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3]]},"assertion":[{"value":"18 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-fnancial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"The authors declare that no human or animal subjects are involved in the study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"Patients signed informed consent regarding publishing their data and photographs.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}}],"article-number":"42"}}