{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T16:47:17Z","timestamp":1780418837879,"version":"3.54.1"},"reference-count":45,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2024,4,16]],"date-time":"2024-04-16T00:00:00Z","timestamp":1713225600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2021YFB3900900"],"award-info":[{"award-number":["2021YFB3900900"]}]},{"name":"National Key Research and Development Program of China","award":["2021C01031"],"award-info":[{"award-number":["2021C01031"]}]},{"name":"National Key Research and Development Program of China","award":["LHZY24A010001"],"award-info":[{"award-number":["LHZY24A010001"]}]},{"name":"National Key Research and Development Program of China","award":["X-202208"],"award-info":[{"award-number":["X-202208"]}]},{"name":"Provincial Key R&amp;D Program of Zhejiang","award":["2021YFB3900900"],"award-info":[{"award-number":["2021YFB3900900"]}]},{"name":"Provincial Key R&amp;D Program of Zhejiang","award":["2021C01031"],"award-info":[{"award-number":["2021C01031"]}]},{"name":"Provincial Key R&amp;D Program of Zhejiang","award":["LHZY24A010001"],"award-info":[{"award-number":["LHZY24A010001"]}]},{"name":"Provincial Key R&amp;D Program of Zhejiang","award":["X-202208"],"award-info":[{"award-number":["X-202208"]}]},{"name":"Deep-time Digital Earth (DDE) Big Science Program","award":["2021YFB3900900"],"award-info":[{"award-number":["2021YFB3900900"]}]},{"name":"Deep-time Digital Earth (DDE) Big Science Program","award":["2021C01031"],"award-info":[{"award-number":["2021C01031"]}]},{"name":"Deep-time Digital Earth (DDE) Big Science Program","award":["LHZY24A010001"],"award-info":[{"award-number":["LHZY24A010001"]}]},{"name":"Deep-time Digital Earth (DDE) Big Science Program","award":["X-202208"],"award-info":[{"award-number":["X-202208"]}]},{"name":"joint Funds of the Zhejiang Provincial Natural Science Foundation of China","award":["2021YFB3900900"],"award-info":[{"award-number":["2021YFB3900900"]}]},{"name":"joint Funds of the Zhejiang Provincial Natural Science Foundation of China","award":["2021C01031"],"award-info":[{"award-number":["2021C01031"]}]},{"name":"joint Funds of the Zhejiang Provincial Natural Science Foundation of China","award":["LHZY24A010001"],"award-info":[{"award-number":["LHZY24A010001"]}]},{"name":"joint Funds of the Zhejiang Provincial Natural Science Foundation of China","award":["X-202208"],"award-info":[{"award-number":["X-202208"]}]},{"name":"Scientific Research Foundation of Zhejiang University City College","award":["2021YFB3900900"],"award-info":[{"award-number":["2021YFB3900900"]}]},{"name":"Scientific Research Foundation of Zhejiang University City College","award":["2021C01031"],"award-info":[{"award-number":["2021C01031"]}]},{"name":"Scientific Research Foundation of Zhejiang University City College","award":["LHZY24A010001"],"award-info":[{"award-number":["LHZY24A010001"]}]},{"name":"Scientific Research Foundation of Zhejiang University City College","award":["X-202208"],"award-info":[{"award-number":["X-202208"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Historical news media reports serve as a vital data source for understanding the risk of urban ground collapse (UGC) events. At present, the application of large language models (LLMs) offers unprecedented opportunities to effectively extract UGC events and their spatiotemporal information from a vast amount of news reports and media data. Therefore, this study proposes an LLM-based inventory construction framework consisting of three steps: news reports crawling, UGC event recognition, and event attribute extraction. Focusing on Zhejiang province, China, as the test region, a total of 27 cases of collapse events from 637 news reports were collected for 11 prefecture-level cities. The method achieved a recall rate of over 60% and a precision below 35%, indicating its potential for effectively and automatically screening collapse events; however, the accuracy needs to be improved to account for confusion with other urban collapse events, such as bridge collapses. The obtained UGC event inventory is the first open access inventory based on internet news reports, event dates and locations, and collapse co-ordinates derived from unstructured contents. Furthermore, this study provides insights into the spatial pattern of UGC frequency in Zhejiang province, effectively supplementing the statistical data provided by the local government.<\/jats:p>","DOI":"10.3390\/ijgi13040133","type":"journal-article","created":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T07:54:36Z","timestamp":1713340476000},"page":"133","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["An LLM-Based Inventory Construction Framework of Urban Ground Collapse Events with Spatiotemporal Locations"],"prefix":"10.3390","volume":"13","author":[{"given":"Yanan","family":"Hao","sequence":"first","affiliation":[{"name":"School of Earth Sciences, Zhejiang University, Hangzhou 310027, China"},{"name":"Zhejiang Provincial Key Laboratory of Geographic Information Science, Hangzhou 310028, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4536-2542","authenticated-orcid":false,"given":"Jin","family":"Qi","sequence":"additional","affiliation":[{"name":"School of Earth Sciences, Zhejiang University, Hangzhou 310027, China"},{"name":"Zhejiang Provincial Key Laboratory of Geographic Information Science, Hangzhou 310028, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaowen","family":"Ma","sequence":"additional","affiliation":[{"name":"Research Center for Intelligent Technology Standardization, Zhejiang Lab, Hangzhou 311121, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9322-0149","authenticated-orcid":false,"given":"Sensen","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Earth Sciences, Zhejiang University, Hangzhou 310027, China"},{"name":"Zhejiang Provincial Key Laboratory of Geographic Information Science, Hangzhou 310028, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Renyi","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Earth Sciences, Zhejiang University, Hangzhou 310027, China"},{"name":"Zhejiang Provincial Key Laboratory of Geographic Information Science, Hangzhou 310028, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3097-0476","authenticated-orcid":false,"given":"Xiaoyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Spatial Planning and Design, Hangzhou City University, Hangzhou 310015, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1007\/s11069-023-06016-8","article-title":"Risk Assessment and Spatial Regulation on Urban Ground Collapse Based on Geo-Detector: A Case Study of Hangzhou Urban Area","volume":"118","author":"Zhang","year":"2023","journal-title":"Nat. Hazards"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11069-022-05304-z","article-title":"Investigation on the Phenomena and Influence Factors of Urban Ground Collapse in China","volume":"113","author":"Wang","year":"2022","journal-title":"Nat. Hazards"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.enggeo.2016.12.011","article-title":"Susceptibility Mapping of Instability Related to Shallow Mining Cavities in a Built-up Environment","volume":"217","author":"Pellicani","year":"2017","journal-title":"Eng. Geol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"107100","DOI":"10.1016\/j.enggeo.2023.107100","article-title":"A Multi-Geophysical Approach to Assess Potential Sinkholes in an Urban Area","volume":"318","author":"Liu","year":"2023","journal-title":"Eng. Geol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1438","DOI":"10.2166\/wst.2023.067","article-title":"An Integrated AHP-PROMETHEE II Ranking Method to Evaluate the Resilience of Sewer Networks Considering Urban Flood and Ground Collapse Risks","volume":"87","author":"Zhang","year":"2023","journal-title":"Water Sci. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2112","DOI":"10.1007\/s12205-022-1061-x","article-title":"Study on Drilling Ground Collapse Induced by Groundwater Flow and Prevention Based on a Coupled CFD-DEM Method","volume":"26","author":"Zhou","year":"2022","journal-title":"KSCE J. Civ. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2577","DOI":"10.1007\/s11069-022-05279-x","article-title":"Anthropogenic Sinkholes of the City of Naples, Italy: An Update","volume":"112","author":"Tufano","year":"2022","journal-title":"Nat. Hazards"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tan, F., Tan, W., Yan, F., Qi, X., Li, Q., and Hong, Z. (2022). Model Test Analysis of Subsurface Cavity and Ground Collapse Due to Broken Pipe Leakage. Appl. Sci., 12.","DOI":"10.3390\/app122413017"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"934452","DOI":"10.3389\/feart.2022.934452","article-title":"Genesis Analysis of Ground Collapse in Wuhan Based on 3D Geological Model","volume":"10","author":"He","year":"2022","journal-title":"Front. Earth Sci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zerhouny, M., Fadil, A., and Hakdaoui, M. (2018). Underground Space Utilization in the Urban Land-Use Planning of Casablanca (Morocco). Land, 7.","DOI":"10.3390\/land7040143"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103414","DOI":"10.1016\/j.cities.2021.103414","article-title":"Underground Hangzhou: The Challenge of Safety vs. Commerciality in a Major Chinese City","volume":"119","author":"Lu","year":"2021","journal-title":"Cities"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.earscirev.2014.08.002","article-title":"A Review on Natural and Human-Induced Geohazards and Impacts in Karst","volume":"138","author":"Parise","year":"2014","journal-title":"Earth-Sci. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103651","DOI":"10.1016\/j.tust.2020.103651","article-title":"A Case Study of Development and Utilization of Urban Underground Space in Shenzhen and the Guangdong-Hong Kong-Macao Greater Bay Area","volume":"107","author":"Xie","year":"2021","journal-title":"Tunn. Undergr. Space Technol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhou, S., and Zhai, G. (2023). A Multi-Hazard Risk Assessment Framework for Urban Disaster Prevention Planning: A Case Study of Xiamen, China. Land, 12.","DOI":"10.3390\/land12101884"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1080\/17538947.2020.1738569","article-title":"Spatiotemporal Event Detection: A Review","volume":"13","author":"Yu","year":"2020","journal-title":"Int. J. Digit. Earth"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.compenvurbsys.2014.11.001","article-title":"Spatiotemporal and Semantic Information Extraction from Web News Reports about Natural Hazards","volume":"50","author":"Wang","year":"2015","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1588","DOI":"10.1080\/13658816.2015.1042380","article-title":"A Method for Discovery and Analysis of Temporal Patterns in Complex Event Data","volume":"29","author":"Peuquet","year":"2015","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"101151","DOI":"10.1016\/j.aei.2020.101151","article-title":"Comparison of Different Machine Learning Techniques on Location Extraction by Utilizing Geo-Tagged Tweets: A Case Study","volume":"46","author":"Dereli","year":"2020","journal-title":"Adv. Eng. Inform."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Feng, Y., and Sester, M. (2018). Extraction of Pluvial Flood Relevant Volunteered Geographic Information (VGI) by Deep Learning from User Generated Texts and Photos. ISPRS Int. J. Geo-Inf., 7.","DOI":"10.3390\/ijgi7020039"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.autcon.2018.12.016","article-title":"Construction Site Accident Analysis Using Text Mining and Natural Language Processing Techniques","volume":"99","author":"Zhang","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"04021062","DOI":"10.1061\/(ASCE)ME.1943-5479.0000959","article-title":"Automated Identification of Substantial Changes in Construction Projects of Airport Improvement Program: Machine Learning and Natural Language Processing Comparative Analysis","volume":"37","author":"Khalef","year":"2021","journal-title":"J. Manag. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Huang, Y., Li, Y., and Shan, J. (2018). Spatial-Temporal Event Detection from Geo-Tagged Tweets. ISPRS Int. J. Geo-Inf., 7.","DOI":"10.3390\/ijgi7040150"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"102274","DOI":"10.1016\/j.lindif.2023.102274","article-title":"ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education","volume":"103","author":"Kasneci","year":"2023","journal-title":"Learn. Individ. Differ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e13386","DOI":"10.1111\/cogs.13386","article-title":"Event Knowledge in Large Language Models: The Gap between the Impossible and the Unlikely","volume":"47","author":"Kauf","year":"2023","journal-title":"Cogn. Sci."},{"key":"ref_25","first-page":"108","article-title":"Analysis on Spatio-Temporal Law and Causation of Urban Road Collapse in China from 2014 to 2018","volume":"51","author":"Chen","year":"2020","journal-title":"Water Resour. Hydropower Eng."},{"key":"ref_26","unstructured":"Yang, S., Feng, D., Qiao, L., Kan, Z., and Li, D. (August, January 28). Exploring Pre-Trained Language Models for Event Extraction and Generation. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_27","unstructured":"Liang, Y., Liu, Y., Wang, X., and Zhao, Z. (2023). Exploring Large Language Models for Human Mobility Prediction under Public Events. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Huang, F., Huang, Q., Zhao, Y., Qi, Z., Wang, B., Huang, Y., and Li, S. (2023, January 20\u201323). A Three-Stage Framework for Event-Event Relation Extraction with Large Language Model. Proceedings of the International Conference on Neural Information Processing, Changsha, China.","DOI":"10.1007\/978-981-99-8181-6_33"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1111\/tgis.12448","article-title":"Extraction of Spatio-Temporal Data about Historical Events from Text Documents","volume":"22","author":"Abraham","year":"2018","journal-title":"Trans. GIS"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kokla, M., and Guilbert, E. (2020). A Review of Geospatial Semantic Information Modeling and Elicitation Approaches. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9030146"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3487890","article-title":"Location Reference Recognition from Texts: A Survey and Comparison","volume":"56","author":"Hu","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1007\/s12145-019-00398-9","article-title":"Towards an Information Centric Flood Ontology for Information Management and Communication","volume":"12","author":"Sermet","year":"2019","journal-title":"Earth Sci. Inform."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"104190","DOI":"10.1016\/j.oregeorev.2021.104190","article-title":"A Semi-Automatic Approach for Generating Geological Profiles by Integrating Multi-Source Data","volume":"134","author":"Wang","year":"2021","journal-title":"Ore Geol. Rev."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Guo, L., Lei, C., and Xiong, C. (2019, January 29\u201331). Application Research of Ground Penetrating Radar Technology in Prevention and Control of Ground Collapse Disaster in Shenzhen. Proceedings of the SEG 2019 Workshop: Geophysics for Smart City Development, Beijing, China.","DOI":"10.1190\/smct-2019-16.1"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"102976","DOI":"10.1016\/j.ijdrr.2022.102976","article-title":"Analysis of Affected Population Vulnerability to Rainstorms and Its Induced Floods at County Level: A Case Study of Zhejiang Province, China","volume":"75","author":"Liao","year":"2022","journal-title":"Int. J. Disaster Risk Reduct."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1319","DOI":"10.1007\/s00477-016-1250-6","article-title":"A Quantitative Model for Estimating Risk from Multiple Interacting Natural Hazards: An Application to Northeast Zhejiang, China","volume":"31","author":"Liu","year":"2017","journal-title":"Stoch. Environ. Res. Risk Assess."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1007\/s12517-021-09303-5","article-title":"The Rainfall Thresholds and Soil Characteristics of Large Geological Disasters in Zhejiang, China","volume":"15","author":"Ding","year":"2022","journal-title":"Arab. J. Geosci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1338877","DOI":"10.3389\/feart.2023.1338877","article-title":"GIS Analysis of Urban Ground Collapse Susceptibility: A Case Study of Eastern Hangzhou, China","volume":"11","author":"Zhou","year":"2024","journal-title":"Front. Earth Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"104127","DOI":"10.1016\/j.tust.2021.104127","article-title":"Investigation of a Large Ground Collapse, Water Inrush and Mud Outburst, and Countermeasures during Subway Excavation in Qingdao: A Case Study","volume":"117","author":"Yan","year":"2021","journal-title":"Tunn. Undergr. Space Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1631\/jzus.A1200120","article-title":"Excavation Collapse of Hangzhou Subway Station in Soft Clay and Numerical Investigation Based on Orthogonal Experiment Method","volume":"13","author":"Gong","year":"2012","journal-title":"J. Zhejiang Univ. Sci. A"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"04014078","DOI":"10.1061\/(ASCE)CF.1943-5509.0000557","article-title":"Failure Investigation at a Collapsed Deep Excavation in Very Sensitive Organic Soft Clay","volume":"29","author":"Chen","year":"2015","journal-title":"J. Perform. Constr. Facil."},{"key":"ref_42","unstructured":"Zeng, A., Liu, X., Du, Z., Wang, Z., Lai, H., Ding, M., Yang, Z., Xu, Y., Zheng, W., and Xia, X. (2022). Glm-130b: An Open Bilingual Pre-Trained Model. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Chen, W., Zhou, Y., Stokes, E.C., and Zhang, X. (2023). Large-Scale Urban Building Function Mapping by Integrating Multi-Source Web-Based Geospatial Data. Geo-Spat. Inf. Sci., 1\u201315.","DOI":"10.1080\/10095020.2023.2264342"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"106268","DOI":"10.1016\/j.agwat.2020.106268","article-title":"The Impact of Soil and Water Resource Conservation on Agricultural Production-an Analysis of the Agricultural Production Performance in Zhejiang, China","volume":"240","author":"Qin","year":"2020","journal-title":"Agric. Water Manag."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"103318","DOI":"10.1016\/j.jmarsys.2020.103318","article-title":"The Impact of Different Historical Typhoon Tracks on Storm Surge: A Case Study of Zhejiang, China","volume":"206","author":"Du","year":"2020","journal-title":"J. Mar. Syst."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/13\/4\/133\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:28:58Z","timestamp":1760106538000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/13\/4\/133"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,16]]},"references-count":45,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,4]]}},"alternative-id":["ijgi13040133"],"URL":"https:\/\/doi.org\/10.3390\/ijgi13040133","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,16]]}}}