{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:45:11Z","timestamp":1777657511329,"version":"3.51.4"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,4,11]],"date-time":"2024-04-11T00:00:00Z","timestamp":1712793600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,11]],"date-time":"2024-04-11T00:00:00Z","timestamp":1712793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Shenzhen Key Laboratory of Navigation and Communication Integration","award":["ZDSYS20210623091807023"],"award-info":[{"award-number":["ZDSYS20210623091807023"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis. Intell."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Accurate localization is critical for lunar rovers exploring lunar terrain features. Traditionally, lunar rover localization relies on sensor data from odometers, inertial measurement units and stereo cameras. However, localization errors accumulate over long traverses, limiting the rover\u2019s localization accuracy. This paper presents a metric localization framework based on cross-view images (ground view from a rover and air view from an orbiter) to eliminate accumulated localization errors. First, we employ perspective projection to reduce the geometric differences in cross-view images. Then, we propose an image-based metric localization network to extract image features and generate a location heatmap. This heatmap serves as the basis for accurate estimation of query locations. We also create the first large-area lunar cross-view image (Lunar-CV) dataset to evaluate the localization performance. This dataset consists of 30 digital orthophoto maps (DOMs) with a resolution of 7 m\/pix, collected by the Chang\u2019e-2 lunar orbiter, along with 8100 simulated rover panoramas. Experimental results on the Lunar-CV dataset demonstrate the superior performance of our proposed framework. Compared to the second best method, our method significantly reduces the average localization error by 26% and the median localization error by 22%.<\/jats:p>","DOI":"10.1007\/s44267-024-00045-y","type":"journal-article","created":{"date-parts":[[2024,4,11]],"date-time":"2024-04-11T07:02:21Z","timestamp":1712818941000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Metric localization for lunar rovers via cross-view image matching"],"prefix":"10.1007","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-6030-1800","authenticated-orcid":false,"given":"Zihao","family":"Chen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3297-1824","authenticated-orcid":false,"given":"Kunhong","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0474-3533","authenticated-orcid":false,"given":"Haoran","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3818-5659","authenticated-orcid":false,"given":"Zhiheng","family":"Fu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7689-5611","authenticated-orcid":false,"given":"Hanmo","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7051-841X","authenticated-orcid":false,"given":"Yulan","family":"Guo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,4,11]]},"reference":[{"issue":"5192","key":"45_CR1","doi-asserted-by":"publisher","first-page":"1835","DOI":"10.1126\/science.266.5192.1835","volume":"100","author":"S. Nozette","year":"1994","unstructured":"Nozette, S., Rustan, P., Pleasance, L. P., Kordas, J. F., Lewis, I. T., Park, H. S., et al. (1994). The Clementine mission to the Moon: scientific overview. Science, 100(5192), 1835\u20131839.","journal-title":"Science"},{"issue":"9","key":"45_CR2","doi-asserted-by":"publisher","first-page":"2237","DOI":"10.1007\/s11431-011-4519-5","volume":"54","author":"B. Zhao","year":"2011","unstructured":"Zhao, B., Yang, J., Wen, D., Gao, W., Chang, L., Song, Z., et al. (2011). Overall scheme and on-orbit images of Chang\u2019E-2 lunar satellite CCD stereo camera. Science China. Technological Sciences, 54(9), 2237\u20132242.","journal-title":"Science China. Technological Sciences"},{"issue":"1","key":"45_CR3","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-12278-3","volume":"10","author":"J. Liu","year":"2019","unstructured":"Liu, J., Ren, X., Yan, W., Li, C., Zhang, H., Jia, Y., et al. (2019). Descent trajectory reconstruction and landing site positioning of Chang\u2019E-4 on the lunar farside. Nature Communications, 10(1), 4229.","journal-title":"Nature Communications"},{"issue":"10","key":"45_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11432-020-3047-4","volume":"63","author":"W. Wu","year":"2020","unstructured":"Wu, W., Yu, D., Wang, C., Liu, J., Tang, Y., Zhang, H., et al. (2020). Technological breakthroughs and scientific progress of the Chang\u2019E-4 mission. Science China. Information Sciences, 63(10), 1\u201314.","journal-title":"Science China. Information Sciences"},{"issue":"1","key":"45_CR5","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1002\/navi.291","volume":"66","author":"Y. Yang","year":"2019","unstructured":"Yang, Y., Gao, W., Guo, S., Mao, Y., & Yang, Y. (2019). Introduction to BeiDou-3 navigation satellite system. Navigation, 66(1), 7\u201318.","journal-title":"Navigation"},{"key":"45_CR6","volume-title":"Introduction to GPS: the global positioning system","author":"A. El-Rabbany","year":"2002","unstructured":"El-Rabbany, A. (2002). Introduction to GPS: the global positioning system. Norwood: Artech House."},{"issue":"4","key":"45_CR7","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-019-2796-1","volume":"63","author":"Z. Liu","year":"2020","unstructured":"Liu, Z., Di, K., Li, J., Xie, J., Cui, X., Xi, L., et al. (2020). Landing site topographic mapping and rover localization for Chang\u2019e-4 mission. Science China. Information Sciences, 63(4), 140901.","journal-title":"Science China. Information Sciences"},{"issue":"1","key":"45_CR8","first-page":"1","volume":"58","author":"Z. Liu","year":"2015","unstructured":"Liu, Z., Di, K., Peng, M., Wan, W., Liu, B., Li, L., et al. (2015). High precision landing site mapping and rover localization for Chang\u2019e-3 mission. Science in China. Physics, Mechanics and Astronomy, 58(1), 1\u201311.","journal-title":"Science in China. Physics, Mechanics and Astronomy"},{"key":"45_CR9","first-page":"20","volume-title":"Proceedings of the IEEE international conference on systems, man and cybernetics","author":"K. S. Ali","year":"2005","unstructured":"Ali, K. S., Vanelli, C. A., Biesiadecki, J. J., Maimone, M. W., Cheng, Y., Martin, A.\u00a0M.\u00a0S., et al. (2005). Attitude and position estimation on the Mars exploration rovers. In Proceedings of the IEEE international conference on systems, man and cybernetics (pp.\u00a020\u201327). Piscataway: IEEE."},{"issue":"8","key":"45_CR10","doi-asserted-by":"publisher","first-page":"781","DOI":"10.14358\/PERS.77.8.781","volume":"77","author":"K. Di","year":"2011","unstructured":"Di, K., Liu, Z., & Yue, Z. (2011). Mars rover localization based on feature matching between ground and orbital imagery. Photogrammetric Engineering and Remote Sensing, 77(8), 781\u2013791.","journal-title":"Photogrammetric Engineering and Remote Sensing"},{"issue":"13","key":"45_CR11","doi-asserted-by":"publisher","first-page":"3812","DOI":"10.1093\/nar\/gkg509","volume":"31","author":"P. C. Ng","year":"2003","unstructured":"Ng, P. C., & Henikoff, S. (2003). SIFT: predicting amino acid changes that affect protein function. Nucleic Acids Research, 31(13), 3812\u20133814.","journal-title":"Nucleic Acids Research"},{"key":"45_CR12","first-page":"1689","volume-title":"Proceedings of the 24th international conference on pattern recognition","author":"Z. Fu","year":"2018","unstructured":"Fu, Z., Guo, Y., & An, W. (2018). Simultaneous context feature learning and hashing for large scale loop closure detection. In Proceedings of the 24th international conference on pattern recognition (pp.\u00a01689\u20131694). Piscataway: IEEE."},{"key":"45_CR13","first-page":"236","volume-title":"Proceedings of the 25th DAGM symposium on pattern recognition","author":"O. Chum","year":"2003","unstructured":"Chum, O., Matas, J., & Kittler, J. (2003). Locally optimized RANSAC. In B.\u00a0Michaelis & G. Krell (Eds.), Proceedings of the 25th DAGM symposium on pattern recognition (pp.\u00a0236\u2013243). Berlin: Springer."},{"key":"45_CR14","first-page":"10090","volume-title":"Proceedings of the 33rd international conference on neural information processing systems","author":"Y. Shi","year":"2019","unstructured":"Shi, Y., Liu, L., Yu, X., & Li, H. (2019). Spatial-aware feature aggregation for image based cross-view geo-localization. In H. M. Wallach, H. Larochelle, A.\u00a0Beygelzimer, et al. (Eds.), Proceedings of the 33rd international conference on neural information processing systems (pp.\u00a010090\u201310100). Red Hook: Curran Associates."},{"key":"45_CR15","first-page":"8390","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision","author":"S. Cai","year":"2019","unstructured":"Cai, S., Guo, Y., Khan, S. H., Hu, J., & Wen, G. (2019). Ground-to-aerial image geo-localization with a hard exemplar reweighting triplet loss. In Proceedings of the IEEE\/CVF international conference on computer vision (pp.\u00a08390\u20138399). Piscataway: IEEE."},{"key":"45_CR16","first-page":"4063","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Y. Shi","year":"2020","unstructured":"Shi, Y., Yu, X., Campbell, D., & Li, H. (2020). Where am I looking at? Joint location and orientation estimation by cross-view matching. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp.\u00a04063\u20134071). Piscataway: IEEE."},{"issue":"12","key":"45_CR17","doi-asserted-by":"publisher","first-page":"10009","DOI":"10.1109\/TPAMI.2022.3140750","volume":"44","author":"Y. Shi","year":"2022","unstructured":"Shi, Y., Campbell, D., Yu, X., & Li, H. (2022). Geometry-guided street-view panorama synthesis from satellite imagery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(12), 10009\u201310022.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"3","key":"45_CR18","first-page":"2682","volume":"45","author":"Y. Shi","year":"2023","unstructured":"Shi, Y., Yu, X., Liu, L., Campbell, D., Koniusz, P., & Li, H. (2023). Accurate 3-DoF camera geo-localization via ground-to-satellite image matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3), 2682\u20132697.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"45_CR19","doi-asserted-by":"publisher","first-page":"2094","DOI":"10.1109\/TIP.2022.3152046","volume":"31","author":"Y. Guo","year":"2022","unstructured":"Guo, Y., Choi, M., Li, K., Boussa\u00efd, F., & Bennamoun, M. (2022). Soft exemplar highlighting for cross-view image-based geo-localization. IEEE Transactions on Image Processing, 31, 2094\u20132105.","journal-title":"IEEE Transactions on Image Processing"},{"key":"45_CR20","first-page":"1","volume-title":"Proceedings of the 17th European conference on computer vision","author":"Z. Li","year":"2022","unstructured":"Li, Z., Wang, W., Li, H., Xie, E., Sima, C., Lu, T., et al. (2022). BEVFormer: learning bird\u2019s-eye-view representation from multi-camera images via spatiotemporal transformers. In S. Avidan, G. J. Brostow, M. Ciss\u00e9, et al. (Eds.), Proceedings of the 17th European conference on computer vision (pp.\u00a01\u201318). Cham: Springer."},{"key":"45_CR21","first-page":"1","volume-title":"Proceedings of the 23rd IEEE international conference on intelligent transportation systems","author":"L. Reiher","year":"2020","unstructured":"Reiher, L., Lampe, B., & Eckstein, L. (2020). A sim2real deep learning approach for the transformation of images from multiple vehicle-mounted cameras to a semantically segmented image in bird\u2019s eye view. In Proceedings of the 23rd IEEE international conference on intelligent transportation systems (pp.\u00a01\u20137). Piscataway: IEEE."},{"key":"45_CR22","first-page":"13750","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"B. Zhou","year":"2022","unstructured":"Zhou, B., & Kr\u00e4henb\u00fchl, P. (2022). Cross-view transformers for real-time map-view semantic segmentation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp.\u00a013750\u201313759). Piscataway: IEEE."},{"issue":"4","key":"45_CR23","doi-asserted-by":"publisher","first-page":"590","DOI":"10.3390\/rs13040590","volume":"13","author":"J. Wang","year":"2021","unstructured":"Wang, J., Zhang, Y., Di, K., Chen, M., Duan, J., Kong, J., et al. (2021). Localization of the Chang\u2019e-5 lander using radio-tracking and image-based methods. Remote Sensing, 13(4), 590.","journal-title":"Remote Sensing"},{"key":"45_CR24","first-page":"3640","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"S. Zhu","year":"2021","unstructured":"Zhu, S., Yang, T., & Chen, C. (2021). VIGOR: cross-view image geo-localization beyond one-to-one retrieval. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp.\u00a03640\u20133649). Piscataway: IEEE."},{"key":"45_CR25","first-page":"90","volume-title":"Proceedings of the 17th European conference on computer vision","author":"Z. Xia","year":"2022","unstructured":"Xia, Z., Booij, O., Manfredi, M., & Kooij, J. F. P. (2022). Visual cross-view metric localization with dense uncertainty estimates. In S. Avidan, G. J. Brostow, M. Ciss\u00e9, et al. (Eds.), Proceedings of the 17th European conference on computer vision (pp.\u00a090\u2013106). Cham: Springer."},{"key":"45_CR26","first-page":"5998","volume-title":"Proceedings of the 31st international conference on neural information processing systems","author":"A. Vaswani","year":"2017","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., et al. (2017). Attention is all you need. In I. Guyon U. von Luxburg, S. Bengio, et al. (Eds.), Proceedings of the 31st international conference on neural information processing systems (pp.\u00a05998\u20136008). Red Hook: Curran Associates."},{"key":"45_CR27","first-page":"123","volume-title":"Proceedings of the 16th Asian conference on computer vision","author":"Y. Shi","year":"2022","unstructured":"Shi, Y., Yu, X., Wang, S., & Li, H. (2022). CVLNet: cross-view semantic correspondence learning for video-based camera localization. In L. Wang, J. Gall, T. Chin, et al. (Eds.), Proceedings of the 16th Asian conference on computer vision (pp.\u00a0123\u2013141). Cham: Springer."},{"key":"45_CR28","first-page":"770","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"K. He","year":"2016","unstructured":"He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp.\u00a0770\u2013778). Piscataway: IEEE."},{"key":"45_CR29","first-page":"234","volume-title":"Proceedings of the 18th international conference on medical image computing and computer assisted intervention","author":"O. Ronneberger","year":"2015","unstructured":"Ronneberger, O., Fischer, P., & Brox, T. (2015). U-Net: convolutional networks for biomedical image segmentation. In N. Navab, J. Hornegger, W. M. Wells, et al. (Eds.), Proceedings of the 18th international conference on medical image computing and computer assisted intervention (pp.\u00a0234\u2013241). Cham: Springer."},{"key":"45_CR30","first-page":"327","volume-title":"Proceedings of the 9th international conference on information technology in medicine and education","author":"X. Xiao","year":"2018","unstructured":"Xiao, X., Lian, S., Luo, Z., & Li, S. (2018). Weighted Res-UNet for high-quality retina vessel segmentation. In Proceedings of the 9th international conference on information technology in medicine and education (pp.\u00a0327\u2013331). Piscataway: IEEE."},{"key":"45_CR31","unstructured":"Van den Oord, A., Li, Y., & Vinyals, O. (2018). Representation learning with contrastive predictive coding. arXiv preprint. arXiv:1807.03748."},{"key":"45_CR32","first-page":"5624","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"L. Liu","year":"2019","unstructured":"Liu, L., & Li, H. (2019). Lending orientation to neural networks for cross-view geo-localization. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp.\u00a05624\u20135633). Piscataway: IEEE."},{"key":"45_CR33","first-page":"4132","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"M. Zhai","year":"2017","unstructured":"Zhai, M., Bessinger, Z., Workman, S., & Jacobs, N. (2017). Predicting ground-level scene layout from aerial imagery. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp.\u00a04132\u20134140). Piscataway: IEEE."},{"key":"45_CR34","unstructured":"Devries, T., & Taylor, G. W. (2017). Improved regularization of convolutional neural networks with cutout. arXiv preprint. arXiv:1708.04552."},{"key":"45_CR35","unstructured":"Kingma, D. P., & Ba, J. (2014). Adam: a method for stochastic optimization. arXiv preprint. arXiv:1412.6980."}],"container-title":["Visual Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44267-024-00045-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44267-024-00045-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44267-024-00045-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,11]],"date-time":"2024-04-11T07:20:17Z","timestamp":1712820017000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44267-024-00045-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,11]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["45"],"URL":"https:\/\/doi.org\/10.1007\/s44267-024-00045-y","relation":{},"ISSN":["2731-9008"],"issn-type":[{"value":"2731-9008","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,11]]},"assertion":[{"value":"6 October 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 March 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 March 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 April 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"12"}}