{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T23:40:23Z","timestamp":1774050023425,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T00:00:00Z","timestamp":1691107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"JSPS KAKENHI","award":["21KK0070"],"award-info":[{"award-number":["21KK0070"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Simultaneous Localization and Mapping (SLAM) forms the foundation of vehicle localization in autonomous driving. Utilizing high-precision 3D scene maps as prior information in vehicle localization greatly assists in the navigation of autonomous vehicles within large-scale 3D scene models. However, generating high-precision maps is complex and costly, posing challenges to commercialization. As a result, a global localization system that employs low-precision, city-scale 3D scene maps reconstructed by unmanned aerial vehicles (UAVs) is proposed to optimize visual positioning for vehicles. To address the discrepancies in image information caused by differing aerial and ground perspectives, this paper introduces a wall complementarity algorithm based on the geometric structure of buildings to refine the city-scale 3D scene. A 3D-to-3D feature registration algorithm is developed to determine vehicle location by integrating the optimized city-scale 3D scene with the local scene generated by an onboard stereo camera. Through simulation experiments conducted in a computer graphics (CG) simulator, the results indicate that utilizing a completed low-precision scene model enables achieving a vehicle localization accuracy with an average error of 3.91 m, which is close to the 3.27 m error obtained using the high-precision map. This validates the effectiveness of the proposed algorithm. The system demonstrates the feasibility of utilizing low-precision city-scale 3D scene maps generated by unmanned aerial vehicles (UAVs) for vehicle localization in large-scale scenes.<\/jats:p>","DOI":"10.3390\/rs15153871","type":"journal-article","created":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T09:28:04Z","timestamp":1691141284000},"page":"3871","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Vehicle Localization in a Completed City-Scale 3D Scene Using Aerial Images and an On-Board Stereo Camera"],"prefix":"10.3390","volume":"15","author":[{"given":"Haihan","family":"Zhang","sequence":"first","affiliation":[{"name":"Doctoral Program in Empowerment Informatics, University of Tsukuba, Tsukuba 3058577, Ibaraki Prefecture, Japan"},{"name":"Center for Computational Sciences, University of Tsukuba, Tsukuba 3058577, Ibaraki Prefecture, Japan"}]},{"given":"Chun","family":"Xie","sequence":"additional","affiliation":[{"name":"Center for Computational Sciences, University of Tsukuba, Tsukuba 3058577, Ibaraki Prefecture, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6753-5681","authenticated-orcid":false,"given":"Hisatoshi","family":"Toriya","sequence":"additional","affiliation":[{"name":"Graduate School of International Resource Sciences, Akita University, Akita 0108502, Akita Prefecture, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8575-0617","authenticated-orcid":false,"given":"Hidehiko","family":"Shishido","sequence":"additional","affiliation":[{"name":"Center for Computational Sciences, University of Tsukuba, Tsukuba 3058577, Ibaraki Prefecture, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5186-789X","authenticated-orcid":false,"given":"Itaru","family":"Kitahara","sequence":"additional","affiliation":[{"name":"Center for Computational Sciences, University of Tsukuba, Tsukuba 3058577, Ibaraki Prefecture, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ibragimov, I.Z., and Afanasyev, I.M. (2017, January 25\u201326). Comparison of ROS-based visual SLAM methods in homogeneous indoor environment. Proceedings of the 2017 14th Workshop on Positioning, Navigation and Communications (WPNC), Bremen, Germany.","DOI":"10.1109\/WPNC.2017.8250081"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Blochliger, F., Fehr, M., Dymczyk, M., Schneider, T., and Siegwart, R. (2018, January 21\u201325). Topomap: Topological Mapping and Navigation Based on Visual SLAM Maps. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460641"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Shan, T., and Englot, B. (2018, January 1\u20135). Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594299"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhao, S., Zhang, H., Wang, P., Nogueira, L., and Scherer, S. (October, January 27). Super odometry: IMU-centric LiDAR-visual-inertial estimator for challenging environments. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9635862"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"052037","DOI":"10.1088\/1742-6596\/1168\/5\/052037","article-title":"A monocular ORB-SLAM in dynamic environments","volume":"1168","author":"Cui","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"206","DOI":"10.20965\/jaciii.2022.p0206","article-title":"High-Precision and Fast LiDAR Odometry and Mapping Algorithm","volume":"26","author":"Wang","year":"2022","journal-title":"J. Adv. Comput. Intell. Intell. Inform."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1017\/S0373463319000638","article-title":"High definition map for automated driving: Overview and analysis","volume":"73","author":"Liu","year":"2020","journal-title":"J. Navig."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1109\/MCG.2003.1242382","article-title":"Constructing 3D city models by merging aerial and ground views","volume":"23","author":"Fruh","year":"2003","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Alsadik, B., and Khalaf, Y.H. (2022). Potential Use of Drone Ultra-High-Definition Videos for Detailed 3D City Modeling. ISPRS Int. J. Geo-Inf., 11.","DOI":"10.3390\/ijgi11010034"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, F., Lu, Y., Cai, B., and Xie, X. (2021, January 4\u20138). Multi-Drone Collaborative Trajectory Optimization for Large-Scale Aerial 3D Scanning. Proceedings of the 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Bari, Italy.","DOI":"10.1109\/ISMAR-Adjunct54149.2021.00034"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Esrafilian, O., and Gesbert, D. (2017, January 4\u20138). 3D city map reconstruction from UAV-based radio measurements. Proceedings of the GLOBECOM 2017\u20142017 IEEE Global Communications Conference, Singapore.","DOI":"10.1109\/GLOCOM.2017.8254657"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Huang, J., Stoter, J., Peters, R., and Nan, L. (2022). City3D: Large-scale building reconstruction from airborne LiDAR point clouds. Remote Sens., 14.","DOI":"10.3390\/rs14092254"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sasiadek, J.Z., and Ahmed, A. (2022, January 22\u201325). Multi-Sensor Fusion for Navigation of Ground Vehicles. Proceedings of the 2022 26th International Conference on Methods and Models in Automation and Robotics (MMAR), Mi\u0119dzyzdroje, Poland.","DOI":"10.1109\/MMAR55195.2022.9874342"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"69381","DOI":"10.1109\/ACCESS.2018.2880689","article-title":"Stereo Visual-Inertial SLAM with Points and Lines","volume":"6","author":"Liu","year":"2018","journal-title":"IEEE Access"},{"key":"ref_16","unstructured":"Sun, J., Yang, C., and Yang, Y. (2019, January 22\u201325). The Status and Challenges of High Precision Map for Automated Driving. Proceedings of the China Satellite Navigation Conference (CSNC), Beijing, China."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Guizilini, V., Ambrus, R., Pillai, S., Raventos, A., and Gaidon, A. (2020, January 13\u201319). 3D packing for self-supervised monocular depth estimation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00256"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Avidan, S., Brostow, G., Ciss\u00e9, M., Farinella, G.M., and Hassner, T. (2022, January 23\u201327). Capturing, Reconstructing, and Simulating: The UrbanScene3D Dataset. Proceedings of the Computer Vision\u2014ECCV 2022, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19809-0"},{"key":"ref_19","first-page":"25","article-title":"Large scale graph-based SLAM using aerial images as prior information","volume":"30","author":"Steder","year":"2009","journal-title":"Auton. Robot."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Shi, Y., and Li, H. (2022, January 18\u201324). Beyond cross-view image retrieval: Highly accurate vehicle localization using satellite image. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01650"},{"key":"ref_21","first-page":"405","article-title":"The Interpretation of Structure from Motion","volume":"203","author":"Ullman","year":"1979","journal-title":"Proc. R. Soc. Lond. Ser. B Biol. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hong, H., and Lee, B.H. (2017, January 24\u201328). Probabilistic normal distributions transform representation for accurate 3D point cloud registration. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206170"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo Processing by Semiglobal Matching and Mutual Information","volume":"30","author":"Hirschmuller","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1145\/1360612.1360639","article-title":"AppProp: All-Pairs appearance-space edit propagation","volume":"27","author":"An","year":"2008","journal-title":"ACM Trans. Graph."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1016\/j.ifacol.2018.11.566","article-title":"Fast statistical outlier removal based method for large 3D point clouds of outdoor environments","volume":"51","author":"Balta","year":"2018","journal-title":"IFAC-PapersOnLine"},{"key":"ref_26","unstructured":"Oh, J. (2011). Novel Approach to Epipolar Resampling of HRSI and Satellite Stereo Imagery-Based Georeferencing of Aerial Images. [Ph.D. Thesis, The Ohio State University]."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, K., Li, M., and Hanebeck, U.D. (2020). Towards High-Performance Solid-State-LiDAR-Inertial Odometry and Mapping. arXiv.","DOI":"10.1109\/LRA.2021.3070251"},{"key":"ref_28","unstructured":"Deuflhard, P. (2005). Newton Methods for Nonlinear Problems: Affine Invariance and Adaptive Algorithms, Springer Science & Business Media."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/BF01427149","article-title":"Iterative point matching for registration of free-form curves and surfaces","volume":"13","author":"Zhang","year":"1994","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Shah, S., Dey, D., Lovett, C., and Kapoor, A. (2017, January 12\u201315). AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles. Proceedings of the Field and Service Robotics, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-67361-5_40"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ikeuchi, K. (2014). Computer Vision: A Reference Guide, Springer.","DOI":"10.1007\/978-0-387-31439-6"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kerl, C., Sturm, J., and Cremers, D. (2013, January 6\u201310). Robust odometry estimation for RGB-D cameras. Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6631104"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.robot.2018.07.002","article-title":"Motion removal for reliable RGB-D SLAM in dynamic environments","volume":"108","author":"Sun","year":"2018","journal-title":"Robot. Auton. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhang, J., and Singh, S. (2014, January 12\u201316). LOAM: Lidar odometry and mapping in real-time. Proceedings of the Robotics: Science and Systems, Berkeley, CA, USA.","DOI":"10.15607\/RSS.2014.X.007"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3871\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:25:41Z","timestamp":1760127941000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3871"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,4]]},"references-count":34,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["rs15153871"],"URL":"https:\/\/doi.org\/10.3390\/rs15153871","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,4]]}}}