{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T14:18:39Z","timestamp":1774621119971,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T00:00:00Z","timestamp":1713312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2022YFC3301603"],"award-info":[{"award-number":["2022YFC3301603"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Geocoding converts unstructured geographic text into structured spatial data, which is crucial in fields such as urban planning, social media spatial analysis, and emergency response systems. Existing approaches predominantly model geocoding as a geographic grid classification task but struggle with the output space dimensionality explosion as the grid granularity increases. Furthermore, these methods generally overlook the inherent hierarchical structure of geographical texts and grids. In this paper, we propose a hierarchy-aware geocoding model based on cross-attention within the Seq2Seq framework, incorporating S2 geometry to model geocoding as a task for generating grid labels and predicting S2 tokens (labels of S2 grids) character-by-character. By incorporating a cross-attention mechanism into the decoder, the model dynamically perceives the address contexts at the hierarchical level that are most relevant to the current character prediction based on the input address text. Results show that the proposed model significantly outperforms previous approaches across multiple metrics, with a median and mean distance error of 41.46 m and 93.98 m, respectively. Furthermore, our method achieves superior results compared to others in regions with sparse data distribution, reducing the median and mean distance error by 16.27 m and 7.52 m, respectively, suggesting that our model has effectively mitigated the issue of insufficient learning in such regions.<\/jats:p>","DOI":"10.3390\/ijgi13040135","type":"journal-article","created":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T10:52:37Z","timestamp":1713351157000},"page":"135","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Hierarchy-Aware Geocoding Model Based on Cross-Attention within the Seq2Seq Framework"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-4231-723X","authenticated-orcid":false,"given":"Linlin","family":"Liang","sequence":"first","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuanfei","family":"Chang","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yizhuo","family":"Quan","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chengbo","family":"Wang","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,17]]},"reference":[{"key":"ref_1","unstructured":"Kulkarni, S., Jain, S., Hosseini, M.J., Baldridge, J., Ie, E., and Zhang, L. (2020). Spatial Language Representation with Multi-Level Geocoding. arXiv."},{"key":"ref_2","unstructured":"Viegas, D.A.A. (2021). Toponym Resolution in Text with Neural Language Models. [Master\u2019s Thesis, Instituto Superior T\u00e9cnico]."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1007\/s10579-017-9385-8","article-title":"What\u2019s Missing in Geographical Parsing?","volume":"52","author":"Gritta","year":"2018","journal-title":"Lang. Resour. Eval."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1109\/MGRS.2022.3219584","article-title":"Geoinformation Harvesting from Social Media Data: A Community Remote Sensing Approach","volume":"10","author":"Zhu","year":"2022","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_5","first-page":"33","article-title":"From Text to Geographic Coordinates: The Current State of Geocoding","volume":"19","author":"Goldberg","year":"2007","journal-title":"Urisa J."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gritta, M., Pilehvar, M.T., and Collier, N. (2018, January 15\u201320). Which Melbourne? Augmenting Geocoding with Maps. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1119"},{"key":"ref_7","first-page":"37","article-title":"Geocoding Location Expressions in Twitter Messages: A Preference Learning Method","volume":"9","author":"Zhang","year":"2014","journal-title":"JOSIS"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1007\/s10708-014-9553-y","article-title":"Using Machine Learning Methods for Disambiguating Place References in Textual Documents","volume":"80","author":"Santos","year":"2015","journal-title":"GeoJournal"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1111\/tgis.12510","article-title":"GeoTxt: A Scalable Geoparsing System for Unstructured Text Geolocation","volume":"23","author":"Karimzadeh","year":"2019","journal-title":"Trans. GIS"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1080\/13658816.2019.1681431","article-title":"A Deep Learning Architecture for Semantic Address Matching","volume":"34","author":"Lin","year":"2020","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hosseini, K., Nanni, F., and Coll Ardanuy, M. (2020, January 6\u201320). DeezyMatch: A Flexible Deep Learning Approach to Fuzzy String Matching. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, Online.","DOI":"10.18653\/v1\/2020.emnlp-demos.9"},{"key":"ref_12","unstructured":"Kitchin, R., and Thrift, N. (2009). International Encyclopedia of Human Geography, Elsevier."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Fornaciari, T., and Hovy, D. (2019, January 4). Geolocation with Attention-Based Multitask Learning Models. Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019), Hong Kong, China.","DOI":"10.18653\/v1\/D19-5528"},{"key":"ref_14","unstructured":"Moura Oliveira, P., Novais, P., and Reis, L.P. (2019). Using Recurrent Neural Networks for Toponym Resolution in Text, Springer International Publishing."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Huang, J., Wang, H., Sun, Y., Shi, Y., Huang, Z., Zhuo, A., and Feng, S. (2022, January 14\u201318). ERNIE-GeoL: A Geography-and-Language Pre-Trained Model and Its Applications in Baidu Maps. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.","DOI":"10.1145\/3534678.3539021"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Serdyukov, P., Murdock, V., and Van Zwol, R. (2009, January 19). Placing Flickr Photos on a Map. Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Boston, MA, USA.","DOI":"10.1145\/1571941.1572025"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wing, B., and Baldridge, J. (2014, January 25\u201329). Hierarchical Discriminative Classification for Text-Based Geolocation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1039"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"DeLozier, G., Baldridge, J., and London, L. (2015, January 25\u201330). Gazetteer-Independent Toponym Resolution Using Geographic Word Profiles. Proceedings of the AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9531"},{"key":"ref_19","unstructured":"Ferrari, V., Hebert, M., Sminchisescu, C., and Weiss, Y. (2018). Geolocation Estimation of Photos Using a Hierarchical Model and Scene Classification, Springer International Publishing."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/978-3-319-46484-8_3","article-title":"PlaNet\u2014Photo Geolocation with Convolutional Neural Networks","volume":"Volume 9912","author":"Leibe","year":"2016","journal-title":"Computer Vision\u2014ECCV 2016"},{"key":"ref_21","unstructured":"Ferrari, V., Hebert, M., Sminchisescu, C., and Weiss, Y. (2018). CPlaNet: Enhancing Image Geolocalization by Combinatorial Partitioning of Maps, Springer International Publishing."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"74943","DOI":"10.1109\/ACCESS.2020.2988631","article-title":"A Storage Method for Remote Sensing Images Based on Google S2","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access."},{"key":"ref_23","unstructured":"Fuli, C. (2015). A Full-Text Retrieval Method for Spatial Data Search Based on Global Subdivision Grid, Geomatics World."},{"key":"ref_24","first-page":"4","article-title":"A Method of Spatial Association for Multi-Sources Remote Sensing Data Based on Global Subdivision Grid","volume":"40","year":"2015","journal-title":"Sci. Surv. Mapp."},{"key":"ref_25","unstructured":"Cepeda, V.V., Nayak, G.K., and Shah, M. (2023). GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-Localization. arXiv."},{"key":"ref_26","unstructured":"Haas, L., Skreta, M., and Alberti, S. (2023). PIGEON: Predicting Image Geolocations. arXiv."},{"key":"ref_27","unstructured":"Ding, R., Chen, B., Xie, P., Huang, F., Li, X., Zhang, Q., and Xu, Y. (2023). A Multi-Modal Geographic Pre-Training Method. arXiv."},{"key":"ref_28","unstructured":"(2024, April 14). A Survey on Geocoding: Algorithms and Datasets for Toponym Resolution. ACL ARR 2021 November Blind Submission, 17 Nov 2021 (modified: 06 May 2023). Available online: https:\/\/openreview.net\/pdf?id=-koTfmSDsM."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kulkarni, S., Jain, S., Hosseini, M.J., Baldridge, J., Ie, E., and Zhang, L. (2021, January 5\u20136). Multi-Level Gazetteer-Free Geocoding. Proceedings of the Second International Combined Workshop on Spatial Language Understanding and Grounded Communication for Robotics, Online.","DOI":"10.18653\/v1\/2021.splurobonlp-1.9"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"8919","DOI":"10.1007\/s00521-022-06914-1","article-title":"Multi-Task Deep Learning Model Based on Hierarchical Relations of Address Elements for Semantic Address Matching","volume":"34","author":"Li","year":"2022","journal-title":"Neural Comput. Applic."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1145\/1328964.1328989","article-title":"Toponym Resolution in Text: Annotation, Evaluation and Applications of Spatial Grounding","volume":"Volume 41","author":"Leidner","year":"2007","journal-title":"SIGIR Forum"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Karimzadeh, M., Huang, W., Banerjee, S., Wallgr\u00fcn, J.O., Hardisty, F., Pezanowski, S., Mitra, P., and MacEachren, A.M. (2013, January 5). GeoTxt: A Web API to Leverage Place References in Text. Proceedings of the 7th Workshop on Geographic Information Retrieval, Orlando, FL, USA.","DOI":"10.1145\/2533888.2533942"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lieberman, M.D., and Samet, H. (2012, January 12). Adaptive Context Features for Toponym Resolution in Streaming News. Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, Portland, OR, USA.","DOI":"10.1145\/2348283.2348381"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Radford, B.J. (2021). Regressing Location on Text for Probabilistic Geocoding. arXiv.","DOI":"10.18653\/v1\/2021.case-1.8"},{"key":"ref_35","unstructured":"Blunsom, P., Cohen, S., Dhillon, P., and Liang, P. (2015, January 5). Estimating User Location in Social Media with Stacked Denoising Auto-Encoders. Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing, Denver, Colorado."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Fize, J., Moncla, L., and Martins, B. (2021). Deep Learning for Toponym Resolution: Geocoding Based on Pairs of Toponyms. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10120818"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"101473","DOI":"10.1016\/j.compenvurbsys.2020.101473","article-title":"GSAM: A Deep Neural Network Model for Extracting Computational Representations of Chinese Addresses Fused with Geospatial Feature","volume":"81","author":"Xu","year":"2020","journal-title":"Comput. Environ. Urban. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Laparra, E., and Bethard, S. (2020, January 8\u201313). A Dataset and Evaluation Framework for Complex Geographical Description Parsing. Proceedings of the 28th International Conference on Computational Linguistics; International Committee on Computational Linguistics, Barcelona, Spain (Online).","DOI":"10.18653\/v1\/2020.coling-main.81"},{"key":"ref_39","unstructured":"Sutskever, I., Vinyals, O., and Le, Q.V. (2014). Sequence to Sequence Learning with Neural Networks. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Cho, K., Van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25\u201329). Learning Phrase Representations Using RNN Encoder\u2013Decoder for Statistical Machine Translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1179"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Rush, A.M., Chopra, S., and Weston, J. (2015, January 17\u201321). A Neural Attention Model for Abstractive Sentence Summarization. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1044"},{"key":"ref_42","unstructured":"Hermann, K., Kocisk\u00fd, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., and Blunsom, P. (2015). Teaching Machines to Read and Comprehend. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Chan, W., Jaitly, N., Le, Q., and Vinyals, O. (2016, January 20\u201325). Listen, Attend and Spell: A Neural Network for Large Vocabulary Conversational Speech Recognition. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.","DOI":"10.1109\/ICASSP.2016.7472621"},{"key":"ref_44","unstructured":"Vinyals, O., and Le, Q.V. (2015). A Neural Conversational Model. arXiv."},{"key":"ref_45","unstructured":"Yin, P., and Neubig, G. (August, January 30). A Syntactic Neural Model for General-Purpose Code Generation. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada."},{"key":"ref_46","unstructured":"Zhang, Z., Li, M., Lin, X., Wang, Y., and He, F. (2018). Multistep Speed Prediction on Traffic Networks: A Graph Convolutional Sequence-to-Sequence Learning Approach with Attention Mechanism. arXiv."},{"key":"ref_47","unstructured":"Zhong, V., Xiong, C., and Socher, R. (2017). Seq2SQL: Generating Structured Queries from Natural Language Using Reinforcement Learning. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Qian, C., Yi, C., Cheng, C., Pu, G., and Liu, J. (2020). A Coarse-to-Fine Model for Geolocating Chinese Addresses. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9120698"},{"key":"ref_49","first-page":"284","article-title":"Spatial Data Coding Method Based on Global Subdivision Grid","volume":"30","year":"2013","journal-title":"J. Geomat. Sci. Technol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"334","DOI":"10.12928\/telkomnika.v16i1.6985","article-title":"Analysis of S2 (Spherical) Geometry Library Algorithm for GIS Geocoding Engineering","volume":"16","author":"Ekawati","year":"2018","journal-title":"TELKOMNIKA"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Kamalloo, E., and Rafiei, D. (2018, January 23\u201327). A Coherent Unsupervised Model for Toponym Resolution. Proceedings of the 2018 World Wide Web Conference on World Wide Web\u2014WWW\u201918, Lyon, France.","DOI":"10.1145\/3178876.3186027"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Cui, Y., Che, W., Liu, T., Qin, B., Wang, S., and Hu, G. (2020, January 16\u201320). Revisiting Pre-Trained Models for Chinese Natural Language Processing. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, Online.","DOI":"10.18653\/v1\/2020.findings-emnlp.58"},{"key":"ref_53","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv."},{"key":"ref_54","unstructured":"Ba, J., Kiros, J., and Hinton, G.E. (2016). Layer Normalization. arXiv."},{"key":"ref_55","unstructured":"Jurgens, D., Finethy, T., McCorriston, J., Xu, Y., and Ruths, D. (2015, January 26\u201329). Geolocation Prediction in Twitter Using Social Networks: A Critical Analysis and Review of Current Practice. Proceedings of the International AAAI Conference on Web and Social Media, Oxford, UK."},{"key":"ref_56","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/13\/4\/135\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:29:33Z","timestamp":1760106573000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/13\/4\/135"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,17]]},"references-count":56,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,4]]}},"alternative-id":["ijgi13040135"],"URL":"https:\/\/doi.org\/10.3390\/ijgi13040135","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,17]]}}}