{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T00:23:07Z","timestamp":1768868587959,"version":"3.49.0"},"reference-count":54,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2018,6,14]],"date-time":"2018-06-14T00:00:00Z","timestamp":1528934400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41631177"],"award-info":[{"award-number":["41631177"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41671393"],"award-info":[{"award-number":["41671393"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2017YFB0503602"],"award-info":[{"award-number":["2017YFB0503602"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>In Geographical Information Systems, geo-coding is used for the task of mapping from implicitly geo-referenced data to explicitly geo-referenced coordinates. At present, an enormous amount of implicitly geo-referenced information is hidden in unstructured text, e.g., Wikipedia, social data and news. Toponym recognition is the foundation of mining this useful geo-referenced information by identifying words as toponyms in text. In this paper, we propose an adapted toponym recognition approach based on deep belief network (DBN) by exploring two key issues: word representation and model interpretation. A Skip-Gram model is used in the word representation process to represent words with contextual information that are ignored by current word representation models. We then determine the core hyper-parameters of the DBN model by illustrating the relationship between the performance and the hyper-parameters, e.g., vector dimensionality, DBN structures and probability thresholds. The experiments evaluate the performance of the Skip-Gram model implemented by the Word2Vec open-source tool, determine stable hyper-parameters and compare our approach with a conditional random field (CRF) based approach. The experimental results show that the DBN model outperforms the CRF model with smaller corpus. When the corpus size is large enough, their statistical metrics become approaching. However, their recognition results express differences and complementarity on different kinds of toponyms. More importantly, combining their results can directly improve the performance of toponym recognition relative to their individual performances. It seems that the scale of the corpus has an obvious effect on the performance of toponym recognition. Generally, there is no adequate tagged corpus on specific toponym recognition tasks, especially in the era of Big Data. In conclusion, we believe that the DBN-based approach is a promising and powerful method to extract geo-referenced information from text in the future.<\/jats:p>","DOI":"10.3390\/ijgi7060217","type":"journal-article","created":{"date-parts":[[2018,6,14]],"date-time":"2018-06-14T11:06:06Z","timestamp":1528974366000},"page":"217","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Deep Belief Networks Based Toponym Recognition for Chinese Text"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5355-2015","authenticated-orcid":false,"given":"Shu","family":"Wang","sequence":"first","affiliation":[{"name":"Key Laboratory of Virtual Geographic Environment (Nanjing Normal University), Ministry of Education, Nanjing 210023, China"},{"name":"State Key Laboratory Cultivation Base of Geographical Environment Evolution (Jiangsu Province), Nanjing 210023, China"},{"name":"Jiangsu Center for Collaborative Innovation in Geographical Information Resource Development and Application, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xueying","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Virtual Geographic Environment (Nanjing Normal University), Ministry of Education, Nanjing 210023, China"},{"name":"State Key Laboratory Cultivation Base of Geographical Environment Evolution (Jiangsu Province), Nanjing 210023, China"},{"name":"Jiangsu Center for Collaborative Innovation in Geographical Information Resource Development and Application, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2149-8269","authenticated-orcid":false,"given":"Peng","family":"Ye","sequence":"additional","affiliation":[{"name":"Key Laboratory of Virtual Geographic Environment (Nanjing Normal University), Ministry of Education, Nanjing 210023, China"},{"name":"State Key Laboratory Cultivation Base of Geographical Environment Evolution (Jiangsu Province), Nanjing 210023, China"},{"name":"Jiangsu Center for Collaborative Innovation in Geographical Information Resource Development and Application, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mi","family":"Du","sequence":"additional","affiliation":[{"name":"Key Laboratory of Virtual Geographic Environment (Nanjing Normal University), Ministry of Education, Nanjing 210023, China"},{"name":"State Key Laboratory Cultivation Base of Geographical Environment Evolution (Jiangsu Province), Nanjing 210023, China"},{"name":"Jiangsu Center for Collaborative Innovation in Geographical Information Resource Development and Application, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,6,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1145\/1328964.1328989","article-title":"Toponym resolution in text: Annotation, evaluation and applications of spatial grounding","volume":"41","author":"Leidner","year":"2007","journal-title":"ACM SIGIR Forum"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1080\/13658810701626343","article-title":"Geographical information retrieval","volume":"22","author":"Jones","year":"2008","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","article-title":"Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups","volume":"29","author":"Hinton","year":"2012","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_4","first-page":"1349","article-title":"Deep Learning: Yesterday, Today, and Tomorrow","volume":"20","author":"Yu","year":"2013","journal-title":"J. Comput. Res. Dev."},{"key":"ref_5","first-page":"2493","article-title":"Natural language processing (almost) from scratch","volume":"12","author":"Collobert","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_6","unstructured":"Huang, Z., Xu, W., and Yu, K. (2015). Bidirectional LSTM-CRF Models for Sequence Tagging. Comput. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., and Dyer, C. (2016, January 12\u201317). Neural Architectures for Named Entity Recognition. Proceedings of the HLT-NAACL, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-1030"},{"key":"ref_8","unstructured":"Chen, Y., Ouyang, Y., Li, W.J., Zheng, D.Q., and Zhao, T.J. (2010, January 16). Using deep belief nets for Chinese named entity categorization. Proceedings of the 2010 Named Entities Workshop, Uppsala, Sweden."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/s00521-016-2401-x","article-title":"Text classification based on deep belief network and softmax regression","volume":"29","author":"Jiang","year":"2016","journal-title":"Neural Comput. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, T. (2010, January 22\u201325). A Novel Text Classification Approach Based on Deep Belief Network. Proceedings of the International Conference on Neural Information Processing, Sydney, Australia.","DOI":"10.1007\/978-3-642-17537-4_39"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Song, J., Qin, S.J., and Zhang, P.Z. (2016, January 26\u201329). Chinese text categorization based on deep belief networks. Proceedings of the 2016 IEEE\/ACIS 15th International Conference on Computer and Information Science (ICIS), Okayama, Japan.","DOI":"10.1109\/ICIS.2016.7550914"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1075\/li.30.1.03nad","article-title":"A survey of named entity recognition and classification","volume":"30","author":"Nadeau","year":"2007","journal-title":"Lingvisticae Investig."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/tgis.12212","article-title":"Automated Geocoding of Textual Documents: A Survey of Current Approaches","volume":"21","author":"Melo","year":"2017","journal-title":"Trans. Gis"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Moschitti, A., and Basili, R. (2004, January 5\u20137). Complex linguistic features for text classification: A comprehensive study. Proceedings of the European Conference on Information Retrieval, Sunderland, UK.","DOI":"10.1007\/978-3-540-24752-4_14"},{"key":"ref_15","first-page":"175","article-title":"Research on the Chinese Topontm recognition method with two-layer CRF and rules combination","volume":"11","author":"Hong","year":"2014","journal-title":"Comput. Appl. Softw."},{"key":"ref_16","unstructured":"N\u00e9v\u00e9ol, A., Grouin, C., Tannier, X., Hamon, T., Kelly, L., Goeuriot, L., and Zweigenbaum, P. (2018, April 20). CLEF eHealth Evaluation Lab 2015 Task 1b: Clinical Named Entity Recognition. Available online: http:\/\/ceur-ws.org\/Vol-1391\/inv-pap5-CR.pdf."},{"key":"ref_17","unstructured":"Bikel, D.M., Miller, S., Schwartz, R., and Weischedel, R. (April, January 31). Nymble: A high-performance learning name-finder. Proceedings of the Proceedings of the Fifth Conference on Applied Natural Language Processing, Washington, DC, USA."},{"key":"ref_18","unstructured":"Bick, E. (2004, January 26\u201328). A Named Entity Recognizer for Danish. Proceedings of the Fourth International Conference on Language Resources and Evaluation, Lisbon, Portugal."},{"key":"ref_19","unstructured":"Chen, W.L., Zhang, Y.J., and Isahara, H. (2006, January 22\u201323). Chinese named entity recognition with conditional random fields. Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, Sydney, Australia."},{"key":"ref_20","first-page":"1172","article-title":"FASTUS: A finite-state processor for information extraction from real-world text","volume":"93","author":"Appelt","year":"1993","journal-title":"IJCAI"},{"key":"ref_21","first-page":"1185","article-title":"Semi-markov conditional random fields for information extraction","volume":"17","author":"Sarawagi","year":"2004","journal-title":"NIPS"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1162\/089120105775299177","article-title":"Chinese word segmentation and named entity recognition: A pragmatic approach","volume":"31","author":"Gao","year":"2005","journal-title":"Comput. Linguist."},{"key":"ref_23","unstructured":"Turian, J., Ratinov, L., and Bengio, Y. (2010, January 11\u201316). Word representations: A simple and general method for semi-supervised learning. Proceedings of the Meeting of the Association for Computational Linguistics, Uppsala, Sweden."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Collobert, R., and Weston, J. (2008, January 5\u20139). A unified architecture for natural language processing: Deep neural networks with multitask learning. Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland.","DOI":"10.1145\/1390156.1390177"},{"key":"ref_25","first-page":"82","article-title":"Group Sparse Coding","volume":"22","author":"Bengio","year":"2009","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_26","unstructured":"Morin, F., and Bengio, Y. (2005, January 6\u20138). Hierarchical probabilistic neural network language model. Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, Barbados."},{"key":"ref_27","unstructured":"Mnih, A., and Hinton, G.E. (2008, January 8\u201310). A scalable hierarchical distributed language model. Proceedings of the 21st International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_28","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. Comput. Sci."},{"key":"ref_29","unstructured":"Curran, J.R., and Clark, S. (June, January 27). Language independent NER using a maximum entropy tagger. Proceedings of the Seventh Conference on Natural language learning at HLT-NAACL, Edmonton, AB, Canada."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_31","unstructured":"Mccallum, A., and Li, W. (June, January 27). Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. Proceedings of the Seventh Conference on Natural language learning at HLT-NAACL, Edmonton, AB, Canada."},{"key":"ref_32","first-page":"590","article-title":"Interpretation of Event Spatio-temporal and Attribute Information in Chinese Text","volume":"44","author":"Zhang","year":"2015","journal-title":"Acta Geod. Cartogr. Sin."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1155\/2015\/650527","article-title":"Learning document semantic representation with hybrid deep belief network","volume":"2015","author":"Yan","year":"2015","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bordes, A., Chopra, S., and Weston, J. (arXiv, 2014). Question answering with subgraph embeddings, arXiv.","DOI":"10.3115\/v1\/D14-1067"},{"key":"ref_36","unstructured":"Sutskever, I., Vinyals, O., and Le, Q.V. (2014). Sequence to sequence learning with neural networks. Adv. Neural Inf. Process. Syst., 3104\u20133112."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"5947","DOI":"10.4249\/scholarpedia.5947","article-title":"Deep belief networks","volume":"4","author":"Hinton","year":"2009","journal-title":"Scholarpedia"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Hinton, G.E., and Sejnowski, T.J. (1986). Learning and Relearning in Boltzmann Machines, MIT Press.","DOI":"10.1063\/1.36246"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mateescu, A. (2004). On Context-Sensitive Grammars, Springer.","DOI":"10.1007\/978-3-540-39886-8_7"},{"key":"ref_40","unstructured":"Rong, X. (2014). word2vec Parameter Learning Explained. Comput. Sci."},{"key":"ref_41","unstructured":"Goldberg, Y., and Levy, O. (2014). word2vec Explained: Deriving Mikolov et al.\u2019s negative-sampling word-embedding method. Comput. Sci."},{"key":"ref_42","unstructured":"Huang, E.H., Socher, R., Manning, C.D., and Ng, A.Y. (2012, January 8\u201314). Improving word representations via global context and multiple word prototypes. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Jeju, Korea."},{"key":"ref_43","first-page":"256","article-title":"Calculation for depth of deep belief network","volume":"30","author":"Pan","year":"2015","journal-title":"Control. Decis."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1631","DOI":"10.1162\/neco.2008.04-07-510","article-title":"Representational power of restricted Boltzmann machines and deep belief networks","volume":"20","author":"Bengio","year":"2008","journal-title":"Neural Comput."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Tariyal, S., Majumdar, A., Singh, R., and Vatsa, M. (arXiv, 2016). Greedy Deep Dictionary Learning, arXiv.","DOI":"10.1109\/ACCESS.2016.2611583"},{"key":"ref_46","unstructured":"Thiele, J., Diehl, P., and Cook, M. (arXiv, 2017). A wake-sleep algorithm for recurrent, spiking neural networks, arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1158","DOI":"10.1126\/science.7761831","article-title":"The wake-sleep algorithm for self-organizing neural networks","volume":"268","author":"Hinton","year":"1995","journal-title":"Science"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1080\/13658810701626244","article-title":"On metonymy recognition for geographic information retrieval","volume":"22","author":"Leveling","year":"2008","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1080\/13658810701626210","article-title":"An empirical study of the effects of NLP components on Geographic IR performance","volume":"22","author":"Stokes","year":"2008","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_50","unstructured":"Zong, C.Q. (2008). Statistical Natural Language Processing, Tsinghua University Publisher."},{"key":"ref_51","first-page":"115","article-title":"Annotation of Geographical Named Entitiesin Chinese Text","volume":"41","author":"Zhang","year":"2012","journal-title":"Acta Geod. Cartogr. Sin."},{"key":"ref_52","unstructured":"CLDC (2018, April 20). Chinese Toponym Annotation Corpus. Available online: http:\/\/www.chineseldc.org\/resource_list.php?begin=60&count=20."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1023\/A:1014348124664","article-title":"GATE: A General Architecture for Text Engineering","volume":"36","author":"Hamish","year":"2002","journal-title":"Comput. Hum."},{"key":"ref_54","unstructured":"Yeh, A. (August, January 31). More accurate tests for the statistical significance of result differences. Proceedings of the 18th Conference on Computational Linguistics, Saarbr\u00fccken, Germany."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/7\/6\/217\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:08:46Z","timestamp":1760195326000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/7\/6\/217"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,14]]},"references-count":54,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2018,6]]}},"alternative-id":["ijgi7060217"],"URL":"https:\/\/doi.org\/10.3390\/ijgi7060217","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6,14]]}}}