{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T19:50:16Z","timestamp":1770061816298,"version":"3.49.0"},"reference-count":131,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2017,11,29]],"date-time":"2017-11-29T00:00:00Z","timestamp":1511913600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020","doi-asserted-by":"publisher","award":["730082"],"award-info":[{"award-number":["730082"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the first hours of a disaster, up-to-date information about the area of interest is crucial for effective disaster management. However, due to the delay induced by collecting and analysing satellite imagery, disaster management systems like the Copernicus Emergency Management Service (EMS) are currently not able to provide information products until up to 48\u201372 h after a disaster event has occurred. While satellite imagery is still a valuable source for disaster management, information products can be improved through complementing them with user-generated data like social media posts or crowdsourced data. The advantage of these new kinds of data is that they are continuously produced in a timely fashion because users actively participate throughout an event and share related information. The research project Evolution of Emergency Copernicus services (E2mC) aims to integrate these novel data into a new EMS service component called Witness, which is presented in this paper. Like this, the timeliness and accuracy of geospatial information products provided to civil protection authorities can be improved through leveraging user-generated data. This paper sketches the developed system architecture, describes applicable scenarios and presents several preliminary case studies, providing evidence that the scientific and operational goals have been achieved.<\/jats:p>","DOI":"10.3390\/s17122766","type":"journal-article","created":{"date-parts":[[2017,11,30]],"date-time":"2017-11-30T03:15:15Z","timestamp":1512011715000},"page":"2766","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["E2mC: Improving Emergency Management Service Practice through Social Media and Crowdsourcing Analysis in Near Real Time"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0390-5094","authenticated-orcid":false,"given":"Clemens","family":"Havas","sequence":"first","affiliation":[{"name":"Department of Geoinformatics\u2013Z_GIS, University of Salzburg, Schillerstrasse 30, 5020 Salzburg, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2233-6926","authenticated-orcid":false,"given":"Bernd","family":"Resch","sequence":"additional","affiliation":[{"name":"Department of Geoinformatics\u2013Z_GIS, University of Salzburg, Schillerstrasse 30, 5020 Salzburg, Austria"},{"name":"Center for Geographic Analysis, Harvard University, Cambridge, MA 02138, USA"}]},{"given":"Chiara","family":"Francalanci","sequence":"additional","affiliation":[{"name":"Department of Electronics, Information and Bioengineering, Politecnico di Milano, Piazza Leonardo da Vinci, 32, 20131 Milano, Italy"}]},{"given":"Barbara","family":"Pernici","sequence":"additional","affiliation":[{"name":"Department of Electronics, Information and Bioengineering, Politecnico di Milano, Piazza Leonardo da Vinci, 32, 20131 Milano, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3305-9220","authenticated-orcid":false,"given":"Gabriele","family":"Scalia","sequence":"additional","affiliation":[{"name":"Department of Electronics, Information and Bioengineering, Politecnico di Milano, Piazza Leonardo da Vinci, 32, 20131 Milano, Italy"}]},{"given":"Jose","family":"Fernandez-Marquez","sequence":"additional","affiliation":[{"name":"Citizen Cyberlab, Centre Universitaire d\u2019Informatique (CUI), University of Geneva, route de Drize CH-1227 Carouge, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4001-7427","authenticated-orcid":false,"given":"Tim","family":"Van Achte","sequence":"additional","affiliation":[{"name":"PM Risk Crisis Change, K. M. Hendrikaplein 57, 9000 Ghent, Belgium"}]},{"given":"Gunter","family":"Zeug","sequence":"additional","affiliation":[{"name":"Terranea, Bahnhofstr. 120, 82269 Geltendorf, Germany"}]},{"given":"Maria","family":"Mondardini","sequence":"additional","affiliation":[{"name":"Citizen Cyberlab, Centre Universitaire d\u2019Informatique (CUI), University of Geneva, route de Drize CH-1227 Carouge, Switzerland"}]},{"given":"Domenico","family":"Grandoni","sequence":"additional","affiliation":[{"name":"e-GEOS S.p.A, Via Tiburtina 965, 00156, Rome, Italy"}]},{"given":"Birgit","family":"Kirsch","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS, Schloss Birlinghoven, 53757 Sankt Augustin, Germany"}]},{"given":"Milan","family":"Kalas","sequence":"additional","affiliation":[{"name":"KAJO s. r. o., Sladkovicova 228\/8, 01401 Bytca, Slovakia"}]},{"given":"Valerio","family":"Lorini","sequence":"additional","affiliation":[{"name":"KAJO s. r. o., Sladkovicova 228\/8, 01401 Bytca, Slovakia"}]},{"given":"Stefan","family":"R\u00fcping","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS, Schloss Birlinghoven, 53757 Sankt Augustin, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2017,11,29]]},"reference":[{"key":"ref_1","unstructured":"(2017, September 10). Copernicus\u2014The European Earth Observation Programme Emergency Management Service. Available online: http:\/\/www.copernicus.eu\/sites\/default\/files\/documents\/Copernicus_Factsheets\/Copernicus_EmergencyMonitoring_Feb2017.pdf."},{"key":"ref_2","unstructured":"Huyck, C.K., and Adams, B.J. (2002). Emergency Response in the Wake of the World Trade Center Attack: The Remote Sensing Perspective, MCEER."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"669","DOI":"10.5194\/nhess-13-669-2013","article-title":"Improving remote sensing flood assessment using volunteered geographical data","volume":"13","author":"Schnebele","year":"2013","journal-title":"Nat. Hazards Earth Syst. Sci."},{"key":"ref_4","unstructured":"Panagiota, M., Jocelyn, C., and Erwan, P. (2011). State of the Art on Remote Sensing for Vulnerability and Damage Assessment on Urban Context, URBASIS Consort."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2876","DOI":"10.1109\/JPROC.2012.2196404","article-title":"Remote sensing and earthquake damage assessment: Experiences, limits, and perspectives","volume":"100","author":"Gamba","year":"2012","journal-title":"Proc. IEEE"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1109\/TGRS.2009.2029236","article-title":"Flood detection in urban areas using TerraSAR-X","volume":"48","author":"Mason","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","unstructured":"Starbird, K. (2011, January 7\u201312). Digital volunteerism during disaster: Crowdsourcing information processing. Proceedings of the Conference on Human Factors in Computing Systems, Vancouver, BC, Canada."},{"key":"ref_8","unstructured":"(2017, September 29). PSCE Evolution of Emergency Copernicus Services (E2mC) Project. Available online: https:\/\/www.e2mc-project.eu\/."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Haworth, B.T. (2017). Implications of volunteered geographic information for disaster management and GIScience: A more complex world of volunteered geography. Ann. Am. Assoc. Geogr., 1\u201315.","DOI":"10.1080\/24694452.2017.1321979"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.compenvurbsys.2016.02.009","article-title":"Emergency management perspectives on volunteered geographic information: Opportunities, challenges and change","volume":"57","author":"Haworth","year":"2016","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Poblet, M., Garc\u00eda-Cuesta, E., and Casanovas, P. (2017). Crowdsourcing roles, methods and tools for data-intensive disaster management. Inf. Syst. Front., 1\u201317.","DOI":"10.1007\/s10796-017-9734-6"},{"key":"ref_12","unstructured":"Starbird, K., and Stamberger, J. (2010, January 2\u20135). Tweak the tweet: Leveraging microblogging proliferation with a prescriptive syntax to support citizen reporting. Proceedings of the 7th International ISCRAM Conference, Seattle, WA, USA."},{"key":"ref_13","first-page":"65","article-title":"Ushahidi, or \u201ctestimony\u201d: Web 2.0 tools for crowdsourcing crisis information","volume":"59","author":"Okolloh","year":"2009","journal-title":"Particip. Learn. Action"},{"key":"ref_14","unstructured":"(2017, June 22). PYBOSSA. Available online: http:\/\/pybossa.com\/."},{"key":"ref_15","unstructured":"Meier, P. (2017, June 22). Digital Humanitarian Response: Moving from Crowdsourcing to Microtasking. Available online: https:\/\/irevolutions.org\/2013\/01\/20\/digital-humanitarian-micro-tasking\/."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C., and Zhai, C. (2012). A survey of text classification algorithms. Mining Text Data, Springer.","DOI":"10.1007\/978-1-4614-3223-4"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Cormack, G.V., G\u00f3mez Hidalgo, J.M., and S\u00e1nz, E.P. (2007, January 6\u201310). Spam filtering for short messages. Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, Lisbon, Portugal.","DOI":"10.1145\/1321440.1321486"},{"key":"ref_18","first-page":"438","article-title":"Beyond trending topics: Real-world event identification on Twitter","volume":"11","author":"Becker","year":"2011","journal-title":"ICWSM"},{"key":"ref_19","unstructured":"Caragea, C., McNeese, N., Jaiswal, A., Traylor, G., Kim, H.-W., Mitra, P., Wu, D., Tapia, A.H., Giles, L., and Jansen, B.J. (2011, January 8\u201311). Classifying text messages for the haiti earthquake. Proceedings of the 8th International Conference on Information Systems for Crisis Response and Management (ISCRAM2011), Lisbon, Portugal."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bermingham, A., and Smeaton, A.F. (2010, January 26\u201330). Classifying sentiment in microblogs: Is brevity an advantage?. Proceedings of the 19th ACM International Conference on Information and Knowledge Management, Toronto, ON, Canada.","DOI":"10.1145\/1871437.1871741"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1016\/j.is.2011.02.002","article-title":"Word co-occurrence features for text classification","volume":"36","author":"Figueiredo","year":"2011","journal-title":"Inf. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"14799","DOI":"10.1016\/j.eswa.2011.05.070","article-title":"Experiments with SVM to classify opinions in different domains","volume":"38","author":"Saleh","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1023\/A:1007692713085","article-title":"Text classification from labeled and unlabeled documents using EM","volume":"39","author":"Nigam","year":"2000","journal-title":"Mach. Learn."},{"key":"ref_24","unstructured":"Jain, A.K., and Dubes, R.C. (1988). Algorithms for Clustering Data, Prentice-Hall, Inc."},{"key":"ref_25","unstructured":"Steinbach, M., Karypis, G., and Kumar, V. (2000, January 20\u201323). A comparison of document clustering techniques. Proceedings of the KDD Workshop on Text Mining, Boston, MA, USA."},{"key":"ref_26","first-page":"993","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hofmann, T. (1999, January 15\u201319). Probabilistic latent semantic indexing. Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Berkeley, CA, USA.","DOI":"10.1145\/312624.312649"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Weng, J., Lim, E.-P., Jiang, J., and He, Q. (2010, January 3\u20136). Twitterrank: Finding topic-sensitive influential twitterers. Proceedings of the Third ACM WSDM 2010, New York, NY, USA.","DOI":"10.1145\/1718487.1718520"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hong, L., and Davison, B. (2010, January 25\u201328). Empirical study of topic modeling in twitter. Proceedings of the First Workshop on Social Media Analytics, Washington, DC, USA.","DOI":"10.1145\/1964858.1964870"},{"key":"ref_30","first-page":"1","article-title":"Learning author-topic models from text corpora","volume":"28","author":"Chemudugunta","year":"2010","journal-title":"ACM Trans. Inf. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yan, X., Guo, J., Lan, Y., and Cheng, X. (2013, January 13\u201317). A biterm topic model for short texts. Proceedings of the WWW\u201913 22nd International Conference on World Wide Web 2013, Rio de Janeiro, Brazil.","DOI":"10.1145\/2488388.2488514"},{"key":"ref_32","unstructured":"Lim, K.W., Chen, C., and Buntine, W. (arXiv, 2013). Twitter-network topic model: A full bayesian treatment for social network and text modeling, arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1111\/j.1538-4632.1995.tb00338.x","article-title":"Local indicators of spatial association: LISA","volume":"27","author":"Anselin","year":"1995","journal-title":"Geogr. Anal."},{"key":"ref_34","unstructured":"Cliff, A.D., and Ord, J.K. (1981). Spatial Processes: Models & Applications, Taylor & Francis."},{"key":"ref_35","unstructured":"Cliff, A., and Ord, J.K. (1973). Spatial Autocorrelation, Pion."},{"key":"ref_36","first-page":"115","article-title":"The contiguity ratio and statistical mapping","volume":"5","author":"Geary","year":"1954","journal-title":"Inc. Stat."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1111\/j.1538-4632.1992.tb00261.x","article-title":"The analysis of spatial association by use of distance statistics","volume":"24","author":"Getis","year":"1992","journal-title":"Geogr. Anal."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"234","DOI":"10.2307\/143141","article-title":"A computer movie simulating urban growth in the Detroit region","volume":"46","author":"Tobler","year":"1970","journal-title":"Econ. Geogr."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1111\/j.0906-7590.2008.05548.x","article-title":"Detecting spatial hot spots in landscape ecology","volume":"31","author":"Nelson","year":"2008","journal-title":"Ecography"},{"key":"ref_40","first-page":"317","article-title":"Spatio-temporal clustering of road accidents: GIS based analysis and assessment","volume":"21","author":"Prasannakumar","year":"2011","journal-title":"Procedia"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2662","DOI":"10.3390\/su7032662","article-title":"A network-constrained integrated method for detecting spatial cluster and risk location of traffic crash: A case study from Wuhan, China","volume":"7","author":"Nie","year":"2015","journal-title":"Sustainability"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1080\/07388940701643623","article-title":"Transnational terrorism hot spots: Identification and impact evaluation","volume":"24","author":"Braithwaite","year":"2007","journal-title":"Confl. Manag. Peace Sci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/1561426042000191305","article-title":"The hotspot matrix: A framework for the spatio-temporal targeting of crime reduction","volume":"5","author":"Ratcliffe","year":"2004","journal-title":"Police Pract. Res."},{"key":"ref_44","unstructured":"Anselin, L., Griffiths, E., and Tita, G. (2008). Crime mapping and hot spot analysis. Environmental Criminology and Crime Analysis, Routledge."},{"key":"ref_45","first-page":"61","article-title":"Visualising space time patterns in crime: The hotspot plot","volume":"1","author":"Townsley","year":"2008","journal-title":"Crime Patterns Anal."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1016\/j.apgeog.2015.08.002","article-title":"Identification of tourist hot spots based on social networks: A comparative analysis of European metropolises using photo-sharing services and GIS","volume":"63","year":"2015","journal-title":"Appl. Geogr."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1080\/15230406.2013.776727","article-title":"Spatial patterns and demographic indicators of effective social media content during theHorsethief Canyon fire of 2012","volume":"40","author":"Kent","year":"2013","journal-title":"Cartogr. Geogr. Inf. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1080\/15230406.2014.905756","article-title":"The impact of using social media data in crime rate calculations: Shifting hot spots and changing spatial patterns","volume":"42","author":"Malleson","year":"2015","journal-title":"Cartogr. Geogr. Inf. Sci."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/disa.12092","article-title":"Social media and disasters: A functional framework for social media use in disaster planning, response, and research","volume":"39","author":"Houston","year":"2015","journal-title":"Disasters"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1109\/MIS.2013.126","article-title":"Real-time crisis mapping of natural disasters using social media","volume":"29","author":"Middleton","year":"2014","journal-title":"IEEE Intell. Syst."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1080\/13658816.2014.996567","article-title":"A geographic approach for combining social media and authoritative data towards identifying useful information for disaster management","volume":"29","author":"Herfort","year":"2015","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1549","DOI":"10.3390\/ijgi4031549","article-title":"Geographic situational awareness: Mining tweets for disaster preparedness, emergency response, impact, and recovery","volume":"4","author":"Huang","year":"2015","journal-title":"ISPRS Int. J. Geo-Inf."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.5194\/nhess-14-1007-2014","article-title":"Road assessment after flood events using non-authoritative data","volume":"14","author":"Schnebele","year":"2014","journal-title":"Nat. Hazards Earth Syst. Sci."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Sakaki, T., Okazaki, M., and Matsuo, Y. (2010, January 26\u201330). Earthquake shakes Twitter users: Real-time event detection by social sensors. Proceedings of the 19th International Conference on World Wide Web, Raleigh, NC, USA.","DOI":"10.1145\/1772690.1772777"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.cag.2013.10.008","article-title":"Public behavior response analysis in disaster events utilizing visual analytics of microblog data","volume":"38","author":"Chae","year":"2014","journal-title":"Comput. Graph."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.cageo.2015.04.001","article-title":"Development of a spatial decision support system for flood risk management in Brazil that combines volunteered geographic information with wireless sensor networks","volume":"80","author":"Horita","year":"2015","journal-title":"Comput. Geosci."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.patcog.2006.04.045","article-title":"A survey of content-based image retrieval with high-level semantics","volume":"40","author":"Liu","year":"2007","journal-title":"Pattern Recognit."},{"key":"ref_58","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems, M. Kaufmann Publishers."},{"key":"ref_59","unstructured":"Steidl, M., and Riecks, D. (2017, September 18). IPTC Releases Results of 2016 Social Media Sites Photo Metadata Test. Available online: https:\/\/iptc.org\/news\/many-social-media-sites-still-remove-image-rights-information-from-photos\/."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Serdyukov, P., Murdock, V., and Van Zwol, R. (2009, January 19\u201323). Placing flickr photos on a map. Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Boston, MA, USA.","DOI":"10.1145\/1571941.1572025"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Hays, J., and Efros, A.A. (2008, January 23\u201328). IM2GPS: Estimating geographic information from a single image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587784"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Hauff, C., and Houben, G.-J. (2012, January 1\u20135). Geo-Location estimation of flickr images: Social web based enrichment. Proceedings of the European Conference on Information Retrieval, Barcelona, Spain.","DOI":"10.1007\/978-3-642-28997-2_8"},{"key":"ref_63","unstructured":"Li, Y., Crandall, D.J., and Huttenlocher, D.P. (October, January 27). Landmark classification in large-scale image collections. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Francalanci, C., Guglielmino, P., Montalcini, M., Scalia, G., and Pernici, B. (2017, January 10\u201312). IMEXT: A method and system to extract geolocated images from Tweets\u2014Analysis of a case study. Proceedings of the IEEE RCIS\u201917, Brighton, UK.","DOI":"10.1109\/RCIS.2017.7956563"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Inkpen, D., Liu, J., Farzindar, A., Kazemi, F., and Ghazi, D. (2015, January 14\u201320). Detecting and disambiguating locations mentioned in Twitter messages. Proceedings of the International Conference on Intelligent Text Processing and Computational Linguistics, Cairo, Egypt.","DOI":"10.1007\/978-3-319-18117-2_24"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"17013","DOI":"10.3390\/s150717013","article-title":"Contextual sensing: Integrating contextual information with human and technical geo-sensor information for smart cities","volume":"15","author":"Sagl","year":"2015","journal-title":"Sensors"},{"key":"ref_67","unstructured":"Scalia, G. (2017). Network-Based Content Geolocation on Social Media for Emergency Management. [Master\u2019s Thesis, Politecnico di Milano]."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.geomorph.2012.08.021","article-title":"\u201cStructure-from-Motion\u201d photogrammetry: A low-cost, effective tool for geoscience applications","volume":"179","author":"Westoby","year":"2012","journal-title":"Geomorphology"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s11263-007-0107-3","article-title":"Modeling the world from internet photo collections","volume":"80","author":"Snavely","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_70","first-page":"40","article-title":"Reconstructing rome","volume":"43","author":"Agarwal","year":"2010","journal-title":"Computer (Long Beach Calif.)"},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/j.compenvurbsys.2015.09.007","article-title":"Twitter as an indicator for whereabouts of people Correlating Twitter","volume":"54","author":"Steiger","year":"2015","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_72","first-page":"2493","article-title":"Natural language processing (almost) from scratch","volume":"12","author":"Collobert","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.ipm.2013.08.006","article-title":"The impact of preprocessing on text classification","volume":"50","author":"Uysal","year":"2014","journal-title":"Inf. Process. Manag."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Resch, B., Usl\u00e4nder, F., and Havas, C. (2017). Combining machine-learning topic models and spatiotemporal analysis of social media data for disaster footprint and damage assessment. Cartogr. Geogr. Inf. Sci., 1\u201315.","DOI":"10.1080\/15230406.2017.1356242"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1108\/eb046814","article-title":"An algorithm for suffix stripping","volume":"14","author":"Porter","year":"1980","journal-title":"Program"},{"key":"ref_76","unstructured":"Porter, M.F. (2017, September 19). Snowball: A Language for Stemming Algorithms. Available online: http:\/\/snowball.tartarus.org\/texts\/introduction.html."},{"key":"ref_77","first-page":"424","article-title":"Probabilistic topic models","volume":"Volume 427","author":"Steyvers","year":"2007","journal-title":"Handbook of Latent Semantic Analysis"},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1023\/B:INRT.0000009439.19151.4c","article-title":"Monolingual document retrieval for European languages","volume":"7","author":"Hollink","year":"2004","journal-title":"Inf. Retr."},{"key":"ref_79","first-page":"1973","article-title":"Rethinking LDA: Why priors matter","volume":"Volume 22","author":"Wallach","year":"2009","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Olteanu, A., Castillo, C., Diaz, F., and Vieweg, S. (2014, January 1\u20134). CrisisLex: A lexicon for collecting and filtering microblogged communications in crises. Proceedings of the 8th International Conference Weblogs Social Media, Ann Arbor, MI, USA.","DOI":"10.1609\/icwsm.v8i1.14538"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1007\/s10994-013-5413-0","article-title":"Interactive topic modeling","volume":"95","author":"Hu","year":"2014","journal-title":"Mach. Learn."},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Wang, S., Chen, Z., Fei, G., Liu, B., and Emery, S. (2016, January 13\u201317). Targeted Topic Modeling for Focused Analysis. Proceedings of the 22nd ACM Conference on Knowledge Discovery and Data Mining\u2014KDD \u201816, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939743"},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Wallach, H.M., Murray, I., Salakhutdinov, R., and Mimno, D. (2009, January 14\u201318). Evaluation Methods for Topic Models. Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, QC, Canada.","DOI":"10.1145\/1553374.1553515"},{"key":"ref_84","unstructured":"Newman, D., Lau, J., Grieser, K., and Baldwin, T. (2010, January 1\u20136). Automatic evaluation of topic coherence. Poceedings of the Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Los Angeles, CA, USA."},{"key":"ref_85","unstructured":"Chang, J., Gerrish, S., Wang, C., and Blei, D.M. (2010, January 6). Reading tea leaves: How humans interpret topic models. Proceedings of the 23rd Annual Conference on Neural Information Processing Systems (NIPS), Vancouver, BC, Canada."},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Lau, J.H., Newman, D., and Baldwin, T. (2014, January 26\u201330). Machine reading tea leaves: Automatically evaluating topic coherence and topic model quality. Poceedings of the EACL, Gothenburg, Sweden.","DOI":"10.3115\/v1\/E14-1056"},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J.R., Bethard, S., and McClosky, D. (2014, January 22\u201327). The stanford corenlp natural language processing toolkit. Poceedings of the ACL (System Demonstrations), Baltimore, MD, USA.","DOI":"10.3115\/v1\/P14-5010"},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Al-Rfou, R., Kulkarni, V., Perozzi, B., and Skiena, S. (May, January 30). Polyglot-NER: Massive multilingual named entity recognition. Proceedings of the 2015 SIAM International Conference on Data Mining, Vancouver, BC, Canada.","DOI":"10.1137\/1.9781611974010.66"},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"919","DOI":"10.1109\/TKDE.2012.29","article-title":"Tweet analysis for real-time event detection and earthquake reporting system development","volume":"25","author":"Sakaki","year":"2013","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/MPRV.2008.80","article-title":"Openstreetmap: User-generated street maps","volume":"7","author":"Haklay","year":"2008","journal-title":"IEEE Pervasive Comput."},{"key":"ref_91","unstructured":"(2017, September 19). GeoNames. Available online: http:\/\/www.geonames.org\/."},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Castillo, C. (2016). Big Crisis Data: Social Media in DISASTERs and Time-Critical Situations, Cambridge University Press.","DOI":"10.1017\/CBO9781316476840"},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Oquab, M., Bottou, L., Laptev, I., and Sivic, J. (2014, January 23\u201328). Learning and transferring mid-level image representations using convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.222"},{"key":"ref_94","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (arXiv, 2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems, arXiv."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1080\/15230406.2014.901901","article-title":"Web-based 4D visualization of marine geo-data using WebGL","volume":"41","author":"Resch","year":"2014","journal-title":"Cartogr. Geogr. Inf. Sci."},{"key":"ref_96","unstructured":"Poblet, M., Garc\u00eda-Cuesta, E., and Casanovas, P. (2014, January 8\u20139). IT enabled crowds: Leveraging the geomobile revolution for disaster management. Proceedings of the Sintelnet WG5 Workshop on Crowd Intelligence: Foundations, Methods and Practices, Barcelona, Spain."},{"key":"ref_97","unstructured":"(2017, September 20). Geotag-X. Available online: https:\/\/geotagx.org\/."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"69","DOI":"10.15346\/hc.v3i1.5","article-title":"Data analytics in citizen cyberscience: Evaluating participant learning and engagement with analytics","volume":"3","author":"Schneider","year":"2016","journal-title":"Hum. Comput."},{"key":"ref_99","unstructured":"(2017, September 20). Citizen Cyberlab. Available online: http:\/\/archive.citizencyberlab.org\/."},{"key":"ref_100","unstructured":"(2017, September 20). OSM Tasking Manager. Available online: http:\/\/tasks.hotosm.org\/."},{"key":"ref_101","unstructured":"Brugghemans, B., and Van Achte, T. (2017, September 20). Crisis Intelligence Manual. Available online: http:\/\/crisisintelligence.org."},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychol. Bull."},{"key":"ref_103","doi-asserted-by":"crossref","unstructured":"Davis, J., and Goadrich, M. (2006, January 25\u201329). The relationship between Precision-Recall and ROC curves. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.","DOI":"10.1145\/1143844.1143874"},{"key":"ref_104","doi-asserted-by":"crossref","unstructured":"Lewis, D.D. (1995, January 9\u201313). Evaluating and optimizing autonomous text classification systems. Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, WA, USA.","DOI":"10.1145\/215206.215366"},{"key":"ref_105","unstructured":"GovEd Ltd. (2017, September 29). Crowd4S. Available online: http:\/\/www.crowd4sat.org\/."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1111\/j.1538-4632.1995.tb00912.x","article-title":"Local spatial autocorrelation statistics: Distributional issues and an application","volume":"27","author":"Ord","year":"1995","journal-title":"Geogr. Anal."},{"key":"ref_107","unstructured":"(2017, September 19). Haiti: Hurricane Matthew\u2014Situation Report No. 10 (14 October 2016). Available online: http:\/\/reliefweb.int\/report\/haiti\/haiti-hurricane-matthew-situation-report-no-10-14-october-2016."},{"key":"ref_108","unstructured":"(2017, September 19). Haiti: Hurricane Matthew\u2014Situation Report No. 17 (28 October 2016). Available online: https:\/\/reliefweb.int\/report\/haiti\/haiti-hurricane-matthew-situation-report-no-17-28-october-2016."},{"key":"ref_109","unstructured":"(2017, September 19). EMSR185: Tropical Cyclone in Haiti. Available online: http:\/\/emergency.copernicus.eu\/mapping\/list-of-components\/EMSR185."},{"key":"ref_110","unstructured":"(2017, September 19). Copernicus\u2014The European Earth Observation Programme EMSR185: Tropical cyclone in Haiti\u2013Jeremie. Available online: http:\/\/emergency.copernicus.eu\/mapping\/list-of-components\/EMSR185\/ALL\/EMSR185_11JEREMIE."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"1737","DOI":"10.1080\/13658816.2011.604636","article-title":"The convergence of GIS and social media: Challenges for GIScience","volume":"25","author":"Sui","year":"2011","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"1694","DOI":"10.1080\/13658816.2015.1099658","article-title":"Exploration of spatiotemporal and semantic clusters of Twitter data using unsupervised neural networks","volume":"30","author":"Steiger","year":"2016","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_113","doi-asserted-by":"crossref","unstructured":"Resch, B. (2013). People as sensors and collective sensing-contextual observations complementing geo-sensor network measurements. Progress in Location-Based Services, Springer.","DOI":"10.1007\/978-3-642-34203-5_22"},{"key":"ref_114","unstructured":"Leson, H. (2017, September 28). How Is Social Media Helping Disaster Response?. Available online: https:\/\/www.weforum.org\/agenda\/2016\/04\/how-is-social-media-helping-disaster-response\/."},{"key":"ref_115","unstructured":"Phillips, J., and Verity, A. (2017, August 28). Guidance for Developing a Local Digital Response Network. Available online: http:\/\/thegovlab.org\/guidance-for-developing-a-local-digital-response-network\/."},{"key":"ref_116","unstructured":"Capelo, L., Chang, N., and Verity, A. (2017, September 28). Guidance for Collaborating with Volunteer and Technical Communities. Available online: http:\/\/digitalhumanitarians.com\/content\/guidance-collaborating-volunteer-technical-communities."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1080\/13658816.2016.1189556","article-title":"A review of volunteered geographic information quality assessment methods","volume":"31","author":"Senaratne","year":"2017","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"345","DOI":"10.5194\/isprsannals-II-3-W5-345-2015","article-title":"Measures and indicators of VGI quality: An overview","volume":"1","author":"Antoniou","year":"2015","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.spasta.2012.03.002","article-title":"Assuring the quality of volunteered geographic information","volume":"1","author":"Goodchild","year":"2012","journal-title":"Spat. Stat."},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.biocon.2013.07.037","article-title":"Statistical solutions for error and bias in global citizen science datasets","volume":"173","author":"Bird","year":"2014","journal-title":"Biol. Conserv."},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"1436","DOI":"10.1126\/science.1251554","article-title":"Next steps for citizen science","volume":"343","author":"Bonney","year":"2014","journal-title":"Science"},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.biocon.2013.05.025","article-title":"Realising the full potential of citizen science monitoring programs","volume":"165","author":"Tulloch","year":"2013","journal-title":"Biol. Conserv."},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1890\/110273","article-title":"Data validation in citizen science: A case study from Project FeederWatch","volume":"10","author":"Bonter","year":"2012","journal-title":"Front. Ecol. Environ."},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1146\/annurev-ecolsys-102209-144636","article-title":"Citizen science as an ecological research tool: Challenges and benefits","volume":"41","author":"Dickinson","year":"2010","journal-title":"Annu. Rev. Ecol. Evol. Syst."},{"key":"ref_125","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/j.tree.2009.03.017","article-title":"A new dawn for citizen science","volume":"24","author":"Silvertown","year":"2009","journal-title":"Trends Ecol. Evol."},{"key":"ref_126","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1111\/2041-210X.12031","article-title":"Comparing diversity data collected using a protocol designed for volunteers with results from a professional alternative","volume":"4","author":"Holt","year":"2013","journal-title":"Methods Ecol. Evol."},{"key":"ref_127","first-page":"265","article-title":"Thinking scientifically during participation in a citizen-science project","volume":"84","author":"Trumbull","year":"2000","journal-title":"Sci. Educ."},{"key":"ref_128","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.jenvman.2004.01.009","article-title":"Promoting the use of environmental data collected by concerned citizens through information and communication technologies","volume":"71","author":"Gouveia","year":"2004","journal-title":"J. Environ. Manag."},{"key":"ref_129","doi-asserted-by":"crossref","first-page":"3239","DOI":"10.1007\/s10661-011-2185-5","article-title":"Comparing volunteer and professionally collected monitoring data from the rocky subtidal reefs of Southern California, USA","volume":"184","author":"Gillett","year":"2012","journal-title":"Environ. Monit. Assess."},{"key":"ref_130","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1007\/s00267-011-9789-y","article-title":"Evaluating the performance of volunteers in mapping invasive plants in public conservation lands","volume":"49","author":"Jordan","year":"2012","journal-title":"Environ. Manag."},{"key":"ref_131","unstructured":"Yanenko, O., and Schlieder, C. (2014, January 3). Game principles for enhancing the quality of user-generated data collections. Proceedings of the AGILE on Workshop Geogames Geoplay, Castell\u00f3n, Spain."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/12\/2766\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:51:55Z","timestamp":1760208715000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/12\/2766"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,29]]},"references-count":131,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["s17122766"],"URL":"https:\/\/doi.org\/10.3390\/s17122766","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,11,29]]}}}