{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T07:18:20Z","timestamp":1771917500217,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,11,15]],"date-time":"2020-11-15T00:00:00Z","timestamp":1605398400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>The research focuses on detecting tourist flows in the Province of Styria in Austria based on crowdsourced data. Twitter data were collected in the time range from 2008 until August 2018. Extracted tweets were submitted to an extensive filtering process within non-relational database MongoDB. Hotspot Analysis and Kernel Density Estimation methods were applied, to investigate spatial distribution of tourism relevant tweets under temporal variations. Furthermore, employing the VADER method an integrated semantic analysis provides sentiments of extracted tweets. Spatial analyses showed that detected Hotspots correspond to typical Styrian touristic areas. Apart from mainly successful sentiment analysis, it pointed out also a problematic aspect of working with multilingual data. For evaluation purposes, the official tourism data from the Province of Styria and federal Statistical Office of Austria played a role of ground truth data. An evaluation with Pearson\u2019s correlation coefficient was employed, which proves a statistically significant correlation between Twitter data and reference data. In particular, the paper shows that crowdsourced data on a regional level can serve as accurate indicator for the behaviour and movement of users.<\/jats:p>","DOI":"10.3390\/ijgi9110681","type":"journal-article","created":{"date-parts":[[2020,11,16]],"date-time":"2020-11-16T11:04:20Z","timestamp":1605524660000},"page":"681","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Evaluating Geo-Tagged Twitter Data to Analyze Tourist Flows in Styria, Austria"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3212-8864","authenticated-orcid":false,"given":"Johannes","family":"Scholz","sequence":"first","affiliation":[{"name":"Research Group Geoinformation, Institute of Geodesy, Graz University of Technology, 8010 Graz, Austria"}]},{"given":"Janja","family":"Jeznik","sequence":"additional","affiliation":[{"name":"Research Group Geoinformation, Institute of Geodesy, Graz University of Technology, 8010 Graz, Austria"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"See, L., Mooney, P., Foody, G., Bastin, L., Comber, A., Estima, J., Fritz, S., Kerle, N., Jiang, B., and Laakso, M. (2016). Crowdsourcing, citizen science or volunteered geographic information? The current state of crowdsourced geographic information. ISPRS Int. J. Geo Inf., 5.","DOI":"10.3390\/ijgi5050055"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s10109-018-0282-5","article-title":"Exploring the use of crowdsourced geographic information in defence: Challenges and opportunities","volume":"21","author":"Papapesios","year":"2019","journal-title":"J. Geogr. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"75","DOI":"10.17645\/up.v3i1.1287","article-title":"# London2012: Towards Citizen-Contributed Urban Planning Through Sentiment Analysis of Twitter Data","volume":"3","author":"Ristea","year":"2018","journal-title":"Urban Plan."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Capineri, C., Haklay, M., Huang, H., Antoniou, V., Kettunen, J., Ostermann, F., and Purves, R. (2016). European Handbook of Crowdsourced Geographic Information, Ubiquity Press.","DOI":"10.5334\/bax"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C., and Abdelzaher, T. (2013). Social sensing. Managing and Mining Sensor Data, Springer.","DOI":"10.1007\/978-1-4614-6309-2"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Janowicz, K., McKenzie, G., Hu, Y., Zhu, R., and Gao, S. (2019). Using Semantic Signatures for Social Sensing in Urban Environments. Mobility Patterns, Big Data and Transport Analytics, Elsevier.","DOI":"10.1016\/B978-0-12-812970-8.00003-8"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1080\/00045608.2015.1018773","article-title":"Social Sensing: A New Approach to Understanding Our Socioeconomic Environments","volume":"105","author":"Liu","year":"2015","journal-title":"Ann. Assoc. Am. Geogr."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1080\/13658816.2019.1684500","article-title":"GeoAI: Spatially explicit artificial intelligence techniques for geographic knowledge discovery and beyond","volume":"34","author":"Janowicz","year":"2020","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1553\/giscience2018_01_s344","article-title":"Combining Biosensing Technology and Virtual Environments for Improved Urban Planning","volume":"1","author":"Zeile","year":"2018","journal-title":"GI_Forum"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zheng, Y., Liu, T., Wang, Y., Zhu, Y., Liu, Y., and Chang, E. (2014). Diagnosing New York city\u2019s noises with ubiquitous data. Proceedings of the UbiComp 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Association for Computing Machinery, Inc.","DOI":"10.1145\/2632048.2632102"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1080\/15230406.2014.890072","article-title":"Geo-located Twitter as proxy for global mobility patterns","volume":"41","author":"Hawelka","year":"2014","journal-title":"Cartogr. Geogr. Inf. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"302","DOI":"10.3390\/ijgi6100302","article-title":"Analyzing Refugee Migration Patterns Using Geo-tagged Tweets","volume":"6","author":"Cvetojevic","year":"2017","journal-title":"ISPRS Int. J. Geo Inf."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zagheni, E., Garimella, V.R.K., and Weber, I. (2014, January 7\u201311). Inferring international and internal migration patterns from twitter data. Proceedings of the 23rd International Conference on World Wide Web, Seoul, Korea.","DOI":"10.1145\/2567948.2576930"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Senaratne, H., Br\u00f6ring, A., Schreck, T., and Lehle, D. (2014). Moving on Twitter: Using episodic hotspot and drift analysis to detect and characterise spatial trajectories. Proceedings of the 7th ACM Sigspatial International Workshop on Location-Based Social Networks\u2014LBSN \u201814, ACM Press.","DOI":"10.1145\/2755492.2755497"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cassa, C.A., Chunara, R., Mandl, K., and Brownstein, J.S. (2013). Twitter as a sentinel in emergency situations: Lessons from the Boston marathon explosions. PLoS Curr.","DOI":"10.1371\/currents.dis.ad70cd1c8bc585e9470046cde334ee4b"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sakaki, T., Okazaki, M., and Matsuo, Y. (2010, January 26\u201330). Earthquake shakes Twitter users: Real-time event detection by social sensors. Proceedings of the 19th International Conference on World Wide Web, Raleigh, NC, USA.","DOI":"10.1145\/1772690.1772777"},{"key":"ref_17","first-page":"163","article-title":"Spatial analysis: A critical tool for tourism geographies","volume":"1","author":"Hall","year":"2012","journal-title":"Routledge Handb. Tour. Geogr."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1504\/MEJM.2013.054071","article-title":"Tourism, travel and tweets: Algorithmic text analysis methodologies in tourism","volume":"1","author":"Claster","year":"2013","journal-title":"Middle East J. Manag."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1140\/epjds\/s13688-016-0092-2","article-title":"Predicting human mobility through the assimilation of social media traces into mobility models","volume":"5","author":"Panisson","year":"2016","journal-title":"EPJ Data Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1140\/epjds\/s13688-016-0073-5","article-title":"Touristic site attractiveness seen through Twitter","volume":"5","author":"Bassolas","year":"2016","journal-title":"EPJ Data Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1613\/jair.4200","article-title":"Text-based Twitter user geolocation prediction","volume":"49","author":"Han","year":"2014","journal-title":"J. Artif. Intell. Res."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Khan, S.F., Bergmann, N., Jurdak, R., Kusy, B., and Cameron, M. (2017, January 10\u201312). Mobility in cities: Comparative analysis of mobility models using Geo-tagged tweets in Australia. Proceedings of the 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA), Beijing, China.","DOI":"10.1109\/ICBDA.2017.8078751"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.apgeog.2016.10.002","article-title":"From stay to play\u2014A travel planning tool based on crowdsourcing user-generated contents","volume":"78","author":"Zhou","year":"2017","journal-title":"Appl. Geogr."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.apgeog.2017.11.004","article-title":"Digital footprints: Incorporating crowdsourced geographic information for protected area management","volume":"90","author":"Leung","year":"2018","journal-title":"Appl. Geogr."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1080\/15230406.2016.1211489","article-title":"Spatiotemporal analysis of photo contribution patterns to Panoramio and Flickr","volume":"44","author":"Alivand","year":"2017","journal-title":"Cartogr. Geogr. Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.compenvurbsys.2018.11.001","article-title":"Social Media data: Challenges, opportunities and limitations in urban studies","volume":"74","year":"2019","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1080\/13658816.2018.1427754","article-title":"Geographic space as a living structure for predicting human activities using big data","volume":"33","author":"Jiang","year":"2019","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Sinclair, M., Mayer, M., Woltering, M., and Ghermandi, A. (2020). Using social media to estimate visitor provenance and patterns of recreation in Germany\u2019s national parks. J. Environ. Manag., 263.","DOI":"10.1016\/j.jenvman.2020.110418"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1111\/caim.12224","article-title":"Big data for open innovation in SMEs and large corporations: Trends, opportunities, and challenges","volume":"27","author":"Petruzzelli","year":"2018","journal-title":"Creat. Innov. Manag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.jhtm.2019.10.007","article-title":"Innovation research in tourism: Research streams and actions for the future","volume":"41","author":"Pikkemaat","year":"2019","journal-title":"J. Hosp. Tour. Manag."},{"key":"ref_31","first-page":"1","article-title":"Social media engagement and organic post effectiveness: A roadmap for increasing the effectiveness of social media use in hospitality industry","volume":"29","author":"Aydin","year":"2020","journal-title":"J. Hosp. Mark. Manag."},{"key":"ref_32","first-page":"189","article-title":"A methodological framework to assess social media strategies of event and destination management organizations","volume":"28","author":"Pino","year":"2019","journal-title":"J. Hosp. Mark. Manag."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"M\u00fcller, D. (2019). A Research Agenda for Tourism Geographies, Edward Elgar Publishing.","DOI":"10.4337\/9781786439314.00014"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bauder, M. (2019). Engage! A research agenda for Big Data in tourism geography. A Research Agenda for Tourism Geographies, Edward Elgar Publishing.","DOI":"10.4337\/9781786439314.00023"},{"key":"ref_35","unstructured":"Taspinar, A. (2020, June 16). Twitterscraper. Available online: https:\/\/github.com\/taspinar\/twitterscraper."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Steinert-Threlkeld, Z.C. (2018). Twitter as Data, Cambridge University Press.","DOI":"10.1017\/9781108529327"},{"key":"ref_37","unstructured":"Van Kessel, P. (2020, June 16). An Intro to Topic Models for Text Analysis. Available online: https:\/\/medium.com\/pew-research-center-decoded\/an-intro-to-topic-models-for-text-analysis-de5aa3e72bdb."},{"key":"ref_38","unstructured":"Orange, L.B.U. (2020, May 05). Topic Modelling. Available online: https:\/\/orange3-text.readthedocs.io\/en\/latest\/widgets\/topicmodelling.html."},{"key":"ref_39","first-page":"993","article-title":"Latent Dirichlet Allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1002\/aris.1440380105","article-title":"Latent Semantic Analysis","volume":"38","author":"Dumais","year":"2005","journal-title":"Annu. Rev. Inf. Sci. Technol."},{"key":"ref_41","unstructured":"Wickham, H., and Grolemund, G. (2016). R for Data Science: Import, Tidy, Transform, Visualize, and Model Data, O\u2019Reilly Media, Inc."},{"key":"ref_42","unstructured":"(2020, May 05). Twinword Ideas Dictionary. Available online: https:\/\/www.twinword.com\/ideas\/graph\/dictionary\/."},{"key":"ref_43","unstructured":"Beaver, A. (2012). A Dictionary of Travel and Tourism, Oxford University Press."},{"key":"ref_44","unstructured":"(2020, May 05). Tourismus. Available online: http:\/\/webterm.term-portal.de\/DEUTERM\/tourismus\/tourismus_e.htm."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Gupta, V., and Rattikorn, H. (2017, January 11\u201314). Harnessing of Power of Hashtags in Tweet Analystics. Proceedings of the 2017 IEEE International Conference on Big Data, Boston, MA, USA.","DOI":"10.1109\/BigData.2017.8258194"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Hutto, C.J., and Gilbert, E. (2014, January 1\u20134). Vader: A parsimonious rule-based model for sentiment analysis of social media text. Proceedings of the Eighth International AAAI Conference on Weblogs and Social Media, Ann Arbor, MI, USA.","DOI":"10.1609\/icwsm.v8i1.14550"},{"key":"ref_47","unstructured":"Burchell, J. (2020, November 13). Using VADER to Handle Sentiment Analysis with Social Media Text. Available online: http:\/\/comp.social.gatech.edu\/papers\/icwsm14.vader.hutto.pdf."},{"key":"ref_48","unstructured":"ESRI (2020, May 05). Using Proportional Symbols. Available online: http:\/\/desktop.arcgis.com\/en\/arcmap\/10.3\/map\/working-with-layers\/using-proportional-symbols.htm."},{"key":"ref_49","unstructured":"ArcGIS Pro (2020, May 05). An Overview of the Mapping Clusters Toolset. Available online: http:\/\/pro.arcgis.com\/en\/pro-app\/tool-reference\/spatial-statistics\/an-overview-of-the-spatial-statistics-toolbox.htm."},{"key":"ref_50","unstructured":"Lu, Y. (2000, January 21). Spatial Cluster Analysis for Point Data: Location Quotients versus Kernel Density. Proceedings of the University Consortium of Geographic Information Science Summer Assembly, Portland, Oregon."},{"key":"ref_51","unstructured":"(2016). GIS Analysis Workshop. Proceedings of the 2016 GIS for a Sustainable World Conference, ESRI."},{"key":"ref_52","unstructured":"ESRI (2020, May 05). Optimized Hotspot Analysis. Available online: http:\/\/desktop.arcgis.com\/en\/arcmap\/10.3\/tools\/spatial-statistics-toolbox\/optimized-hot-spot-analysis.htm."},{"key":"ref_53","unstructured":"ESRI (2020, May 05). Differences between Point, Line, and Kernel Density. Available online: http:\/\/pro.arcgis.com\/en\/pro-app\/tool-reference\/spatial-analyst\/differences-between-point-line-and-kernel-density.htm."},{"key":"ref_54","unstructured":"Silverman, B.W. (1986). Density Estimation for Statistics and Data Analysis, Chapman and Hall\/CRC."},{"key":"ref_55","unstructured":"Dempsey, C. (2020, May 05). Heat Maps in GIS. Available online: https:\/\/www.gislounge.com\/heat-maps-in-gis\/."},{"key":"ref_56","unstructured":"Orange3 (2020, May 05). Text Mining Preprocess Text. Available online: https:\/\/orange3-text.readthedocs.io\/en\/latest\/widgets\/preprocesstext.html."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/9\/11\/681\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:33:43Z","timestamp":1760178823000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/9\/11\/681"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,15]]},"references-count":56,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["ijgi9110681"],"URL":"https:\/\/doi.org\/10.3390\/ijgi9110681","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,15]]}}}