{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T08:19:26Z","timestamp":1776845966579,"version":"3.51.2"},"reference-count":47,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T00:00:00Z","timestamp":1638230400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&amp;D Program of China","award":["2018YFC0809100"],"award-info":[{"award-number":["2018YFC0809100"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Online public opinion reflects social conditions and public attitudes regarding special social events. Therefore, analyzing the temporal and spatial distributions of online public opinion topics can contribute to understanding issues of public concern, grasping and guiding the developing trend of public opinion. However, how to evaluate the validity of classification of online public opinion remains a challenging task in the topic mining field. By combining a Bidirectional Encoder Representations from Transformers (BERT) pre-training model with the Latent Dirichlet Allocation (LDA) topic model, we propose an evaluation method to determine the optimal classification number of topics from the perspective of semantic similarity. The effectiveness of the proposed method was verified based on the standard Chinese corpus THUCNews. Taking Coronavirus Disease 2019 (COVID-19)-related geotagged posts on Weibo in Wuhan city as an example, we used the proposed method to generate five categories of public opinion topics. Combining spatial and temporal information with the classification results, we analyze the spatial and temporal distribution patterns of the five optimal public opinion topics, which are found to be consistent with the epidemic development, demonstrating the feasibility of our method when applied to practical cases.<\/jats:p>","DOI":"10.3390\/ijgi10120811","type":"journal-article","created":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T22:01:11Z","timestamp":1638309671000},"page":"811","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Evaluation of the Optimal Topic Classification for Social Media Data Combined with Text Semantics: A Case Study of Public Opinion Analysis Related to COVID-19 with Microblogs"],"prefix":"10.3390","volume":"10","author":[{"given":"Qin","family":"Liang","sequence":"first","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunchun","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Si","family":"Chen","sequence":"additional","affiliation":[{"name":"Wuhan Natural Resources and Planning Information Center, Wuhan 430070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,30]]},"reference":[{"key":"ref_1","unstructured":"(2020, June 24). The 45th China Statistical Report on Internet Development, (In Chinese)."},{"key":"ref_2","first-page":"2490","article-title":"Spatio-Temporal Evolution and Regional Differences of the Public Opinion on the Prevention and Control of COVID-19 Epidemic in China","volume":"75","author":"Wang","year":"2020","journal-title":"Acta Geogr. Sin."},{"key":"ref_3","first-page":"318","article-title":"Analysis and Visualization of Multi-Dimensional Characteristics of Network Public Opinion Situation and Sentiment: Taking COVID-19 Epidemic as an Example","volume":"23","author":"Du","year":"2021","journal-title":"J. Geo-Inf. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Debnath, R., and Bardhan, R. (2020). India Nudges to Contain COVID-19 Pandemic: A Reactive Public Policy Analysis Using Machine-Learning Based Topic Modelling. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0238972"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zheng, H., Goh, D.H.-L., Lee, C.S., Lee, E.W.J., and Theng, Y.L. (2020). Uncovering Temporal Differences in COVID-19 Tweets. Proc. Assoc. Inf. Sci. Technol., 57.","DOI":"10.1002\/pra2.233"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Han, X., Wang, J., Zhang, M., and Wang, X. (2020). Using Social Media to Mine and Analyze Public Opinion Related to COVID-19 in China. Int. J. Environ. Res. Public Health, 17.","DOI":"10.3390\/ijerph17082788"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.ijmedinf.2017.04.013","article-title":"The Public\u2019s Opinions on a New School Meals Policy for Childhood Obesity Prevention in the U.S.: A Social Media Analytics Approach","volume":"103","author":"Kang","year":"2017","journal-title":"Int. J. Med. Inform."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wu, J., Sivaraman, V., Kumar, D., Banda, J.M., and Sontag, D. (2021). Pulse of the Pandemic: Iterative Topic Filtering for Clinical Information Extraction from Social Media. J. Biomed. Inform., 120.","DOI":"10.1016\/j.jbi.2021.103844"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Gorodnichenko, Y., Pham, T., and Talavera, O. (2021). Social Media, Sentiment and Public Opinions: Evidence from #Brexit and #USElection. Eur. Econ. Rev., 136.","DOI":"10.1016\/j.euroecorev.2021.103772"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"416","DOI":"10.3390\/make1010025","article-title":"The Number of Topics Optimization: Clustering Approach","volume":"1","author":"Krasnov","year":"2019","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_11","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2018). BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Barachi, M.E., AlKhatib, M., Mathew, S., and Oroumchian, F. (2021). A Novel Sentiment Analysis Framework for Monitoring the Evolving Public Opinion in Real-Time: Case Study on Climate Change. J. Clean. Prod., 312.","DOI":"10.1016\/j.jclepro.2021.127820"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1016\/j.enpol.2013.09.047","article-title":"Nuclear Power in Australia: A Comparative Analysis of Public Opinion Regarding Climate Change and the Fukushima Disaster","volume":"65","author":"Bird","year":"2014","journal-title":"Energy Policy"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Shibuya, Y., and Tanaka, H. (2018). Public Sentiment and Demand for Used Cars after a Large-Scale Disaster: Social Media Sentiment Analysis with Facebook Pages 2018. arXiv.","DOI":"10.1007\/978-981-15-0825-7_8"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1177\/0165551519828620","article-title":"Twitter Speaks: A Case of National Disaster Situational Awareness","volume":"46","author":"Karami","year":"2020","journal-title":"J. Inf. Sci."},{"key":"ref_16","first-page":"341","article-title":"Analysis of Public Opinion Evolution in COVID-19 Pandemic from a Perspective of Sentiment Variation","volume":"23","author":"Zhang","year":"2021","journal-title":"J. Geo-Inf. Sci."},{"key":"ref_17","first-page":"409","article-title":"Spatial and Temporal Analysis on Public Opinion Evolution of Epidemic Situation about Novel Coronavirus Pneumonia Based on Micro-Blog Data","volume":"57","author":"Chen","year":"2020","journal-title":"J. Sichuan Univ."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Boon-Itt, S., and Skunkan, Y. (2020). Public Perception of the COVID-19 Pandemic on Twitter: Sentiment Analysis and Topic Modeling Study. JMIR Public Health Surveill., 6.","DOI":"10.2196\/preprints.21978"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1775","DOI":"10.1016\/j.neucom.2008.06.011","article-title":"A Density-Based Method for Adaptive LDA Model Selection","volume":"72","author":"Cao","year":"2009","journal-title":"Neurocomputing"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"61","DOI":"10.3166\/dn.17.1.61-84","article-title":"Accurate and Effective Latent Concept Modeling for Ad Hoc Information Retrieval","volume":"17","author":"Deveaud","year":"2014","journal-title":"Doc. Num\u00e9r."},{"key":"ref_21","first-page":"331","article-title":"Research on Public Opinion Analysis Methods in Major Public Health Events: Take COVID-19 Epidemic as an Example","volume":"23","author":"Han","year":"2021","journal-title":"J. Geo-Inf. Sci."},{"key":"ref_22","first-page":"993","article-title":"Latent Dirichlet Allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ye, X., Li, S., Yang, X., and Qin, C. (2016). Use of Social Media for the Detection and Analysis of Infectious Diseases in China. ISPRS Int. J. Geo-Inf., 5.","DOI":"10.3390\/ijgi5090156"},{"key":"ref_24","first-page":"290","article-title":"The Mining and Analysis of Emergency Information in Sudden Events Based on Social Media","volume":"41","author":"Wang","year":"2016","journal-title":"Geomat. Inf. Sci. Wuhan Univ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3052","DOI":"10.1007\/s10489-020-02033-3","article-title":"Multilingual Topic Modeling for Tracking COVID-19 Trends Based on Facebook Data Analysis","volume":"51","author":"Amara","year":"2021","journal-title":"Appl. Intell."},{"key":"ref_26","unstructured":"Guo, J. (2014). Classification for Chinese Short Text Based on Multi LDA Models. [Master\u2019s Thesis, Harbin Institute of Technology]. (In Chinese)."},{"key":"ref_27","first-page":"29","article-title":"Optimizing LDA Model with Various Topic Numbers: Case Study of Scientific Literature","volume":"2","author":"Wang","year":"2018","journal-title":"Data Anal. Knowl. Discov."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5228","DOI":"10.1073\/pnas.0307752101","article-title":"Finding Scientific Topics","volume":"101","author":"Griffiths","year":"2004","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Arun, R., Suresh, V., Madhavan, C.E.V., and Murthy, M.N.N. (2010, January 21\u201324). On Finding the Natural Number of Topics with Latent Dirichlet Allocation: Some Observations. Proceedings of the Pacific-Asia Conference on Advances in Knowledge Discovery & Data Mining, Hyderabad, India.","DOI":"10.1007\/978-3-642-13657-3_43"},{"key":"ref_30","first-page":"59","article-title":"A Research Summary of Topic Discovery Methods Based on Topic Model","volume":"30","author":"Li","year":"2021","journal-title":"J. MUC"},{"key":"ref_31","unstructured":"Guan, P., Wang, Y., and Fu, Z. (2016). Effect Analysis of Scientific Literature Topic Extraction Based on LDA Topic Model with Different Corpus. Libr. Inf. Serv., 60, (In Chinese)."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1566","DOI":"10.1198\/016214506000000302","article-title":"Hierarchical Dirichlet Processes","volume":"101","author":"Teh","year":"2006","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"012025","DOI":"10.1088\/1742-6596\/1163\/1\/012025","article-title":"Fractal Approach for Determining the Optimal Number of Topics in the Field of Topic Modeling","volume":"1163","author":"Ignatenko","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1016\/j.physa.2018.08.050","article-title":"Application of R\u00e9nyi and Tsallis Entropies to Topic Modeling Optimization","volume":"512","author":"Koltcov","year":"2018","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_35","first-page":"1","article-title":"Review of Studies on Text Similarity Measures","volume":"1","author":"Chen","year":"2017","journal-title":"Data Anal. Knowl. Discov."},{"key":"ref_36","unstructured":"Ma, C. (2019). The Hitchhiker\u2019s Guide to LDA. arXiv, (In Chinese)."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Vayansky, I., and Kumar, S.A.P. (2020). A Review of Topic Modeling Methods. Inf. Syst., 94.","DOI":"10.1016\/j.is.2020.101582"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Smith, H., and Cipolli, W. (2021). The Instagram\/Facebook Ban on Graphic Self-Harm Imagery: A Sentiment Analysis and Topic Modeling Approach. Policy Internet.","DOI":"10.1002\/poi3.272"},{"key":"ref_39","unstructured":"(2021, March 30). Scikit-Learn: Machine Learning in Python. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.decomposition."},{"key":"ref_40","unstructured":"Kang, Y., Wang, Y., Zhang, D., Zhou, L., Sun, M., Li, J., Guo, Z., Zhao, Y., Zheng, Y., and Si, X. (2021, April 30). THUCTC: An Efficient Chinese Text Classifier. Available online: http:\/\/thuctc.thunlp.org\/."},{"key":"ref_41","unstructured":"Nikita, M. (2021, March 30). Ldatuning: Tuning of the Latent Dirichlet Allocation Models Parameters. Available online: https:\/\/CRAN.R-project.org\/package=ldatuning."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Hu, Y., Huang, H., Chen, A., and Mao, X.-L. (, January December). Weibo-COV: A Large-Scale COVID-19 Social Media Dataset from Weibo. Proceedings of the 1st Workshop on NLP for COVID-19 (Part 2) at EMNLP 2020, Online.","DOI":"10.18653\/v1\/2020.nlpcovid19-2.34"},{"key":"ref_43","unstructured":"Hu, Y., Huang, H., Chen, A., and Mao, X.-L. (2020, June 24). Weibo-Public-Opinion-Datasets. Available online: https:\/\/github.com\/nghuyong\/weibo-public-opinion-datasets."},{"key":"ref_44","unstructured":"(2021, February 01). Full Daily Statistics of 2019-NCoV. Available online: https:\/\/github.com\/canghailan\/Wuhan-2019-nCoV."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1016\/S0140-6736(20)30183-5","article-title":"Clinical Features of Patients Infected with 2019 Novel Coronavirus in Wuhan, China","volume":"395","author":"Huang","year":"2020","journal-title":"Lancet"},{"key":"ref_46","unstructured":"(2020, June 24). Weibo User Development Report in 2020. (In Chinese)."},{"key":"ref_47","unstructured":"Xiao, H. (2021, April 30). Bert-as-Service. Available online: https:\/\/github.com\/hanxiao\/bert-as-service."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/12\/811\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:38:06Z","timestamp":1760168286000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/12\/811"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,30]]},"references-count":47,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["ijgi10120811"],"URL":"https:\/\/doi.org\/10.3390\/ijgi10120811","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,30]]}}}