{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T10:01:16Z","timestamp":1773396076173,"version":"3.50.1"},"reference-count":64,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2019,7,15]],"date-time":"2019-07-15T00:00:00Z","timestamp":1563148800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Several scientific processes benefit from Citizen Science (CitSci) and VGI (Volunteered Geographical Information) with the help of mobile and geospatial technologies. Studies on landslides can also take advantage of these approaches to a great extent. However, the quality of the collected data by both approaches is often questionable, and automated procedures to check the quality are needed for this purpose. In the present study, a convolutional neural network (CNN) architecture is proposed to validate landslide photos collected by citizens or nonexperts and integrated into a mobile- and web-based GIS environment designed specifically for a landslide CitSci project. The VGG16 has been used as the base model since it allows finetuning, and high performance could be achieved by selecting the best hyper-parameters. Although the training dataset was small, the proposed CNN architecture was found to be effective as it could identify the landslide photos with 94% precision. The accuracy of the results is sufficient for purpose and could even be improved further using a larger amount of training data, which is expected to be obtained with the help of volunteers.<\/jats:p>","DOI":"10.3390\/ijgi8070300","type":"journal-article","created":{"date-parts":[[2019,7,16]],"date-time":"2019-07-16T02:23:16Z","timestamp":1563243796000},"page":"300","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":67,"title":["A Convolutional Neural Network Architecture for Auto-Detection of Landslide Photographs to Assess Citizen Science and Volunteered Geographic Information Data Quality"],"prefix":"10.3390","volume":"8","author":[{"given":"Recep","family":"Can","sequence":"first","affiliation":[{"name":"Hacettepe University, Department of Geomatics Engineering, 06800 Beytepe, Ankara, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2775-7914","authenticated-orcid":false,"given":"Sultan","family":"Kocaman","sequence":"additional","affiliation":[{"name":"Hacettepe University, Department of Geomatics Engineering, 06800 Beytepe, Ankara, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4762-9933","authenticated-orcid":false,"given":"Candan","family":"Gokceoglu","sequence":"additional","affiliation":[{"name":"Hacettepe University, Department of Geological Engineering, 06800 Beytepe, Ankara, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.enggeo.2008.01.004","article-title":"An assessment on the use of logistic regression and artificial neural networks with different sampling strategies for the preparation of landslide susceptibility maps","volume":"97","author":"Nefeslioglu","year":"2008","journal-title":"Eng. Geol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1016\/j.envsoft.2016.07.005","article-title":"A comparative study of different machine learning methods for landslide susceptibility assessment: A case study of Uttarakhand area (India)","volume":"84","author":"Pham","year":"2016","journal-title":"Environ. Model. Softw."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.ijsrc.2017.09.008","article-title":"A hybrid machine learning ensemble approach based on a Radial Basis Function neural network and Rotation Forest for landslide susceptibility modeling: A case study in the Himalayan area, India","volume":"33","author":"Pham","year":"2018","journal-title":"Int. J. Sediment Res."},{"key":"ref_4","unstructured":"CSA (2019, March 24). Citizen Science Association. Available online: https:\/\/www.citizenscience.org\/."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/j.tree.2009.03.017","article-title":"A new dawn for CitSci","volume":"24","author":"Silvertown","year":"2009","journal-title":"Trends Ecol. Evol."},{"key":"ref_6","unstructured":"ECSA (2019, June 01). European Citizen Science Association. Available online: https:\/\/ecsa.citizen-science.net\/."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"See, L., Mooney, P., Foody, G., Bastin, L., Comber, A., Estima, J., Fritz, S., Kerle, N., Jiang, B., and Laakso, M. (2016). Crowdsourcing, Citizen Science or Volunteered Geographic Information? The Current State of Crowdsourced Geographic Information. ISPRS Int. J. Geo-Inf., 5.","DOI":"10.3390\/ijgi5050055"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s10708-007-9111-y","article-title":"Citizens as sensors: The world of volunteered geography","volume":"69","author":"Goodchild","year":"2007","journal-title":"GeoJournal"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sui, D., Elwood, S., and Goodchild, M. (2013). Citizen Science and Volunteered Geographic Information: Overview and Typology of Participation. Crowdsourcing Geographic Knowledge, Springer.","DOI":"10.1007\/978-94-007-4587-2"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"69","DOI":"10.5194\/isprs-archives-XLII-5-69-2018","article-title":"On the use of Citsci and VGI in Natural Hazard Assessment","volume":"42","author":"Kocaman","year":"2018","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.spasta.2012.03.002","article-title":"Assuring the quality of volunteered geographic information","volume":"1","author":"Goodchild","year":"2012","journal-title":"Spat. Stat."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1683","DOI":"10.1080\/13658816.2019.1572893","article-title":"VGTrust: Measuring trust for volunteered geographic information","volume":"33","author":"Severinsen","year":"2019","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1080\/13658816.2017.1409353","article-title":"Volunteered geographic information quality assessment using trust and reputation modelling in land administration systems in developing countries","volume":"32","author":"Moreri","year":"2018","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1111\/tgis.12300","article-title":"Validity of historical volunteered geographic information: Evaluating citizen data for mapping historical geographic phenomena","volume":"22","author":"Zhang","year":"2018","journal-title":"Trans. GIS"},{"key":"ref_15","first-page":"W4","article-title":"A Review on Citizen Science (Citsci) Applications for Disaster Management","volume":"42","author":"Kocaman","year":"2018","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_16","unstructured":"(2011). National Climate Assessment Report. Climate Change Impacts and Responses."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Altan, O., Chandra, M., Sunar, F., and Tanzi, T. (2019). CitSci as a New Approach for Landslide Researches. Intelligent Systems for Crisis Management, Springer. Lecture Notes in Geoinformation and Cartography.","DOI":"10.1007\/978-3-030-05330-7"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s10346-018-1101-2","article-title":"A CitSci app for landslide data collection","volume":"16","author":"Kocaman","year":"2019","journal-title":"Landslides"},{"key":"ref_19","unstructured":"(2019, April 13). Landslide Reporter, Available online: https:\/\/www.nasa.gov\/solve\/landslide_reporter\/."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.patcog.2017.10.013","article-title":"Recent advances in convolutional neural networks","volume":"77","author":"Gu","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.mineng.2018.12.011","article-title":"Flotation froth image recognition with convolutional neural networks","volume":"132","author":"Fu","year":"2019","journal-title":"Miner. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.autcon.2019.02.013","article-title":"A vision-based method for crack detection in gusset plate welded joints of steel bridges using deep convolutional neural networks","volume":"102","author":"Dung","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1016\/j.neucom.2017.09.012","article-title":"Long-range terrain perception using convolutional neural networks","volume":"275","author":"Zhang","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.energy.2019.03.081","article-title":"Short-term load forecasting by using a combined method of convolutional neural networks and fuzzy time series","volume":"175","author":"Sadaei","year":"2019","journal-title":"Energy"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.ecoinf.2019.01.012","article-title":"Automatic detection of woody vegetation in repeat landscape photographs using a convolutional neural network","volume":"50","author":"Bayr","year":"2019","journal-title":"Ecol. Inform."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.isprsjprs.2018.04.003","article-title":"Multi-scale object detection in remote sensing imagery with convolutional neural networks","volume":"145","author":"Deng","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.compind.2019.02.003","article-title":"Deep neural networks with transfer learning in millet crop images","volume":"108","author":"Coulibaly","year":"2019","journal-title":"Comput. Ind."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.marmicro.2019.01.005","article-title":"Automated species-level identification of planktic foraminifera using convolutional neural networks, with comparison to human performance","volume":"147","author":"Mitra","year":"2019","journal-title":"Mar. Micropaleontol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.petrol.2018.11.023","article-title":"Lithological facies classification using deep convolutional neural network","volume":"174","author":"Imamverdiyev","year":"2019","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.cageo.2016.12.015","article-title":"Automated detection of geological landforms on Mars using Convolutional Neural Networks","volume":"101","author":"Palafox","year":"2017","journal-title":"Comput. Geosci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.neunet.2018.12.006","article-title":"Image-based velocity estimation of rock using Convolutional Neural Networks","volume":"111","author":"Karimpouli","year":"2019","journal-title":"Neural Netw."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1215","DOI":"10.1016\/j.scib.2018.08.006","article-title":"Seeing permeability from images: Fast prediction with convolutional neural networks","volume":"63","author":"Wu","year":"2018","journal-title":"Sci. Bull."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1016\/j.scitotenv.2019.02.263","article-title":"Comparison of convolutional neural networks for landslide susceptibility mapping in Yanshan County, China","volume":"666","author":"Wang","year":"2019","journal-title":"Sci. Total Environ."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.image.2019.02.002","article-title":"Automatic detection of passable roads after floods in remote sensed and social media data","volume":"74","author":"Ahmad","year":"2019","journal-title":"Signal Process. Image Commun."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1016\/j.procs.2016.07.144","article-title":"Geological Disaster Recognition on Optical Remote Sensing Images Using Deep Learning","volume":"91","author":"Liu","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.earscirev.2019.02.023","article-title":"Deep learning and its application in geochemical mapping","volume":"192","author":"Zuo","year":"2019","journal-title":"Earth Sci. Rev."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/j.jhydrol.2018.11.069","article-title":"An enhanced extreme learning machine model for river flow forecasting: State-of-the-art, practical applications in water resource engineering area and future research direction","volume":"569","author":"Yaseen","year":"2019","journal-title":"J. Hydrol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/j.compenvurbsys.2018.10.008","article-title":"Artificial neural networks and deep learning in urban geography: A systematic review and meta-analysis","volume":"74","author":"Grekousis","year":"2019","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.tust.2018.07.006","article-title":"Micro-seismic event detection and location in underground mines by using Convolutional Neural Networks (CNN) and deep learning","volume":"81","author":"Huang","year":"2018","journal-title":"Tunn. Undergr. Space Technol."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Derakhshani, A., and Foruzan, A.H. (2019). Predicting the principal strong ground motion parameters: A deep learning approach. Appl. Soft Comput.","DOI":"10.1016\/j.asoc.2019.03.029"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.cageo.2017.10.011","article-title":"Earthquake prediction in California using regression algorithms and cloud-based big data infrastructure","volume":"115","author":"Shang","year":"2018","journal-title":"Comput. Geosci."},{"key":"ref_42","unstructured":"(2019, June 23). Google. Available online: http:\/\/www.google.com."},{"key":"ref_43","unstructured":"(2019, June 23). Flickr. Available online: http:\/\/www.flickr.com."},{"key":"ref_44","unstructured":"(2019, June 23). Bing. Available online: http:\/\/www.bing.com."},{"key":"ref_45","unstructured":"(2019, June 23). Baidu. Available online: http:\/\/www.baidu.com."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","article-title":"Places: A 10 Million Image Database for Scene Recognition","volume":"40","author":"Zhou","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_47","unstructured":"(2019, March 24). Natural Scene Statistics in Vision Science. Available online: http:\/\/natural-scenes.cps.utexas.edu\/db.shtml."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1167\/11.12.14","article-title":"Statistics for optimal point prediction in natural images","volume":"11","author":"Geisler","year":"2011","journal-title":"J. Vis."},{"key":"ref_49","unstructured":"(2019, June 01). Python. Available online: https:\/\/www.python.org\/."},{"key":"ref_50","unstructured":"(2019, June 01). OpenCV. Available online: https:\/\/opencv.org\/."},{"key":"ref_51","unstructured":"Zheng, L., Zhao, Y., Wang, S., Wang, J., and Tian, Q. (arXiv, 2016). Good practice in CNN feature transfer, arXiv."},{"key":"ref_52","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet classification with deep convolutional neural networks. Proceedings of the 25th Neural Information Processing Systems Conference (NIPS 2012), Lake Tahoe, NV, USA."},{"key":"ref_53","unstructured":"(2019, March 24). Keras: The Python Deep Learning library. Available online: https:\/\/keras.io\/."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 24\u201327). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_55","unstructured":"Simonyan, K., and Zisserman, A. (arXiv, 2014). Very deep convolutional networks for large-scale image recognition, arXiv."},{"key":"ref_56","unstructured":"ILSVRC (2019, March 24). Large Scale Visual Recognition Challenge 2014 (ILSVRC 2014). Available online: http:\/\/www.image-net.org\/challenges\/LSVRC\/2014\/results."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Deng, J., Socher, R., Li, F.-F., Dong, W., Li, K., and Li, L.J. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_58","first-page":"26","article-title":"Lecture 6.5\u2014RmsProp: Divide the gradient by a running average of its recent magnitude","volume":"4","author":"Tieleman","year":"2012","journal-title":"COURSERA Neural Netw. Mach. Learn."},{"key":"ref_59","unstructured":"Bushaev, V. (2019, June 23). Stochastic Gradient Descent with Momentum. Available online: https:\/\/towardsdatascience.com\/stochastic-gradient-descent-with-momentum-a84097641a5d."},{"key":"ref_60","unstructured":"Wilson, A.C., Roelofs, R., Stern, M., Srebro, N., and Recht, B. (2017, January 4\u20139). The marginal value of adaptive gradient methods in machine learning. Proceedings of the Advances in Neural Information Processing Systems (NIPS 2007), Long Beach, CA, USA."},{"key":"ref_61","unstructured":"Xu, B., Wang, N., Chen, T., and Li, M. (arXiv, 2015). Empirical Evaluation of Rectified Activations in Convolution Network, arXiv."},{"key":"ref_62","first-page":"1929","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Bengio, Y. (arXiv, 2012). Practical Recommendations for Gradient-Based Training of Deep Architectures, arXiv.","DOI":"10.1007\/978-3-642-35289-8_26"},{"key":"ref_64","unstructured":"Masters, D., and Luschi, C. (arXiv, 2018). Revisiting small batch training for deep neural networks, arXiv."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/8\/7\/300\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:05:51Z","timestamp":1760187951000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/8\/7\/300"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,15]]},"references-count":64,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,7]]}},"alternative-id":["ijgi8070300"],"URL":"https:\/\/doi.org\/10.3390\/ijgi8070300","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,15]]}}}