{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T03:19:36Z","timestamp":1768879176491,"version":"3.49.0"},"reference-count":34,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2023,9,5]],"date-time":"2023-09-05T00:00:00Z","timestamp":1693872000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Special Fund for Public Welfare Scientific Institutions of Fujian Province","award":["2020R1002002"],"award-info":[{"award-number":["2020R1002002"]}]},{"name":"Special Fund for Public Welfare Scientific Institutions of Fujian Province","award":["cxxl-2023292"],"award-info":[{"award-number":["cxxl-2023292"]}]},{"name":"School-level Innovative Entrepreneurial Training Plan for College Students of Fujian Normal University","award":["2020R1002002"],"award-info":[{"award-number":["2020R1002002"]}]},{"name":"School-level Innovative Entrepreneurial Training Plan for College Students of Fujian Normal University","award":["cxxl-2023292"],"award-info":[{"award-number":["cxxl-2023292"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>With the proliferation and development of social media platforms, social media data have become an important source for acquiring spatiotemporal information on various urban events. Providing accurate spatiotemporal information for events contributes to enhancing the capabilities of urban management and emergency responses. However, existing research regarding mining spatiotemporal information of events often solely focuses on textual content and neglects data from other modalities such as images and videos. Therefore, this study proposes an innovative spatiotemporal information extraction method, which extracts the spatiotemporal information of events from multimodal data on Weibo at coarse- and fine-grained hierarchical levels and serves as a beneficial supplement to existing urban event monitoring methods. This paper utilizes the \u201c20 July 2021 Zhengzhou Heavy Rainfall\u201d incident as an example to evaluate and analyze the effectiveness of the proposed method. Results indicate that in coarse-grained spatial information extraction using only textual data, our method achieved a spatial precision of 87.54% within a 60 m range and reached 100% spatial precision for ranges beyond 200 m. For fine-grained spatial information extraction, the introduction of other modal data, such as images and videos, resulted in a significant improvement in spatial error. These results demonstrate the ability of the MIST-SMMD (Method of Identifying Spatiotemporal Information of Social Media Multimodal Data) to extract spatiotemporal information from urban events at both coarse and fine levels and confirm the significant advantages of multimodal data in enhancing the precision of spatial information extraction.<\/jats:p>","DOI":"10.3390\/ijgi12090368","type":"journal-article","created":{"date-parts":[[2023,9,5]],"date-time":"2023-09-05T09:59:31Z","timestamp":1693907971000},"page":"368","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A Spatial Information Extraction Method Based on Multi-Modal Social Media Data: A Case Study on Urban Inundation"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-0497-6904","authenticated-orcid":false,"given":"Yilong","family":"Wu","sequence":"first","affiliation":[{"name":"College of Geographical Science, Fujian Normal University, Fuzhou 350117, China"},{"name":"Institute of Geography, Fujian Normal University, Fuzhou 350117, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yingjie","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Geographical Science, Fujian Normal University, Fuzhou 350117, China"},{"name":"Institute of Geography, Fujian Normal University, Fuzhou 350117, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rongyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Xiamen University of Technology, Xiamen 361024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenfei","family":"Cui","sequence":"additional","affiliation":[{"name":"College of Geographical Science, Fujian Normal University, Fuzhou 350117, China"},{"name":"Institute of Geography, Fujian Normal University, Fuzhou 350117, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinyi","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Geographical Science, Fujian Normal University, Fuzhou 350117, China"},{"name":"Institute of Geography, Fujian Normal University, Fuzhou 350117, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiayi","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Geographical Science, Fujian Normal University, Fuzhou 350117, China"},{"name":"Institute of Geography, Fujian Normal University, Fuzhou 350117, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4135-5073","authenticated-orcid":false,"given":"Meizhen","family":"Wang","sequence":"additional","affiliation":[{"name":"Ministry of Education Key Laboratory of Virtual Geographic Environment, Nanjing Normal University, Nanjing 210097, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Wu","sequence":"additional","affiliation":[{"name":"College of Geographical Science, Fujian Normal University, Fuzhou 350117, China"},{"name":"Institute of Geography, Fujian Normal University, Fuzhou 350117, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,5]]},"reference":[{"key":"ref_1","unstructured":"(2023, May 15). Weibo Reports Fourth Quarter and Fiscal Year 2022 Unaudited Financial Results. Available online: http:\/\/ir.weibo.com\/node\/8856\/pdf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/j.envpol.2019.06.057","article-title":"Dynamic assessment of PM2.5 exposure and health risk using remote sensing and geo-spatial big data","volume":"253","author":"Song","year":"2019","journal-title":"Environ. Pollut."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1080\/15230406.2016.1271356","article-title":"A novel approach to leveraging social media for rapid flood mapping: A case study of the 2015 South Carolina floods","volume":"45","author":"Li","year":"2018","journal-title":"Cartogr. Geogr. Inf. Sci."},{"key":"ref_4","unstructured":"Zhang, Z. (2019). Spatial Analysis of Internet Sensation Based on Social Media\u2014Taking the Jiuzhaigou Earthquake as an Example. [Master\u2019s Thesis, Nanjing University]."},{"key":"ref_5","first-page":"43","article-title":"Analysis of public opinion and disaster loss estimates from typhoons based on Microblog data","volume":"62","author":"Li","year":"2022","journal-title":"J. Tsinghua Univ. Sci. Technol."},{"key":"ref_6","first-page":"406","article-title":"Effectiveness Analysis of Typhoon Disaster Reflected by Microblog Data Location Information","volume":"36","author":"Wu","year":"2019","journal-title":"J. Geomat. Sci. Technol."},{"key":"ref_7","first-page":"807","article-title":"Assessing the Effectiveness of Social Media Data in Mapping the Distribution of Typhoon Disasters","volume":"20","author":"Liang","year":"2018","journal-title":"J. Geogr. Inf. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1080\/17538947.2020.1738569","article-title":"Spatio-temporal event detection: A review","volume":"13","author":"Yu","year":"2020","journal-title":"Int. J. Digit. Earth"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Etzioni, O., Cafarella, M., Downey, D., Kok, S., Popescu, A.-M., Shaked, T., Soderland, S., Weld, D.S., and Yates, A. (2004, January 17\u201320). Web-scale information extraction in knowitall: (preliminary results). Proceedings of the 13th International Conference on World Wide Web, New York, NY, USA.","DOI":"10.1145\/988672.988687"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ritter, A., Etzioni, O., and Clark, S. (2012, January 12\u201316). Open domain event extraction from twitter. Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Beijing, China.","DOI":"10.1145\/2339530.2339704"},{"key":"ref_11","unstructured":"Huang, Z., Xu, W., and Yu, K. (2015). Bidirectional LSTM-CRF Models for Sequence Tagging. arXiv."},{"key":"ref_12","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1007\/s12145-021-00756-6","article-title":"Extraction of temporal information from social media messages using the BERT model","volume":"15","author":"Ma","year":"2022","journal-title":"Earth Sci. Inform."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yuan, W., Yang, L., Yang, Q., Sheng, Y., and Wang, Z. (2022). Extracting Spatio-Temporal Information from Chinese Archaeological Site Text. ISPRS Int. J. Geo-Inf., 11.","DOI":"10.3390\/ijgi11030175"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"MacEachren, A.M., Jaiswal, A., Robinson, A.C., Pezanowski, S., Savelyev, A., Mitra, P., Zhang, X., and Blanford, J. (2011, January 23\u201328). SensePlace2: GeoTwitter analytics support for situational awareness. Proceedings of the VAST 2011\u2014IEEE Conference on Visual Analytics 458 Science and Technology, Providence, RI, USA.","DOI":"10.1109\/VAST.2011.6102456"},{"key":"ref_16","first-page":"1336","article-title":"A survey of the research progress in image geo-localization","volume":"25","author":"Huang","year":"2023","journal-title":"J. Geo-Inf. Sci."},{"key":"ref_17","unstructured":"Ofli, F., Alam, F., and Imran, M. (2020, January 24\u201327). Analysis of Social Media Data using Multimodal Deep Learning for Disaster Response. Proceedings of the International Conference on Information Systems for Crisis Response and Management, Blacksburg, VA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zou, Z., Gan, H., Huang, Q., Cai, T., and Cao, K. (2021). Disaster image classification by fusing multimodal social media data. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10100636"},{"key":"ref_19","first-page":"423","article-title":"Multimodal machine learning: A survey and taxonomy","volume":"41","author":"Ahuja","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","first-page":"178","article-title":"Internet media-based acquisition and processing model of earthquake disaster situation","volume":"22","author":"Shuai","year":"2013","journal-title":"J. Nat. Disasters"},{"key":"ref_21","first-page":"2584","article-title":"Simulation on Flood Disaster in Urban Building Complex System Based on LBM","volume":"34","author":"Zhang","year":"2022","journal-title":"J. Simul."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"101870","DOI":"10.1016\/j.compenvurbsys.2022.101870","article-title":"Spatio-temporal graph convolutional networks for road network inundation status prediction during urban flooding","volume":"97","author":"Yuan","year":"2022","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3024","DOI":"10.1007\/s11227-020-03381-0","article-title":"Intelligent monitor for typhoon in IoT system of smart city","volume":"77","author":"Wang","year":"2021","journal-title":"J. Supercomput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5582","DOI":"10.1038\/s41598-023-32149-8","article-title":"Flood sensitivity assessment of super cities","volume":"13","author":"Wang","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"104467","DOI":"10.1016\/j.scs.2023.104467","article-title":"Flood vulnerability assessment of urban buildings based on integrating high-resolution remote sensing and street view images","volume":"92","author":"Xing","year":"2023","journal-title":"Sustain. Cities Soc."},{"key":"ref_26","first-page":"37","article-title":"Optimal Design of Urban Waterlogging Monitoring and Warning System in Wuhan Based on Internet of Things and GPRS Technology","volume":"25","author":"Zhang","year":"2018","journal-title":"Saf. Environ. Eng."},{"key":"ref_27","first-page":"463","article-title":"Advances in flood risk identification and dynamic modelling based on remote sensing spatial information","volume":"31","author":"Zeng","year":"2020","journal-title":"Adv. Water Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.cageo.2017.11.008","article-title":"Hyper-resolution monitoring of urban flooding with social media and crowdsourcing data","volume":"111","author":"Wang","year":"2018","journal-title":"Comput. Geosci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"101690","DOI":"10.1016\/j.compenvurbsys.2021.101690","article-title":"Quality assessment of crowdsourced social media data for urban flood management","volume":"90","author":"Songchon","year":"2021","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_30","unstructured":"(2023, May 15). BLE, SOCIAL MEDIA & FLOOD RISK AWARENESS, Available online: https:\/\/www.fema.gov\/sites\/default\/files\/documents\/fema_ble-social-media-flood-risk-awareness.pdf."},{"key":"ref_31","unstructured":"(2023, May 15). JioNLP. Available online: https:\/\/github.com\/dongrixinyu\/JioNLP."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sun, J., Shen, Z., Wang, Y., Bao, H., and Zhou, X. (2021, January 20\u201325). LoFTR: Detector-free local feature matching with transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00881"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23\u201328). End-to-end object detection with transformers. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Schmitt, X., Kubler, S., Robert, J., Papadakis, M., and LeTraon, Y. (2019, January 22\u201325). A replicable comparison study of NER software: StanfordNLP, NLTK, OpenNLP, SpaCy, Gate. Proceedings of the 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS), Granada, Spain.","DOI":"10.1109\/SNAMS.2019.8931850"}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/9\/368\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:46:46Z","timestamp":1760129206000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/9\/368"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,5]]},"references-count":34,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["ijgi12090368"],"URL":"https:\/\/doi.org\/10.3390\/ijgi12090368","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,5]]}}}