{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:07:57Z","timestamp":1760234877163,"version":"build-2065373602"},"reference-count":66,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,6,25]],"date-time":"2021-06-25T00:00:00Z","timestamp":1624579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>The quality of the user-generated content of citizen science platforms has been discussed widely among researchers. Content is categorized into data and information: data is content stored in a database of a citizen science platform, while information is context-dependent content generated by users. Understanding data and information quality characteristics and utilizing them during design improves citizen science platforms\u2019 overall quality. This research investigates the integration of data and information quality characteristics into a citizen science platform for collecting information from the general public with no scientific training in the area where content is collected. The primary goal is to provide a framework for selecting and integrating data and information quality characteristics into the design for improving the content quality on platforms. The design and implementation of a citizen science platform that collects walking path conditions are presented, and the resulting implication is evaluated. The results show that the platform\u2019s content quality can be improved by introducing quality characteristics during the design stage of the citizen science platform.<\/jats:p>","DOI":"10.3390\/ijgi10070434","type":"journal-article","created":{"date-parts":[[2021,6,25]],"date-time":"2021-06-25T04:46:57Z","timestamp":1624596417000},"page":"434","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["An Approach to Improve the Quality of User-Generated Content of Citizen Science Platforms"],"prefix":"10.3390","volume":"10","author":[{"given":"Jiri","family":"Musto","sequence":"first","affiliation":[{"name":"Industrial Engineering and Management, School of Engineering Science, LUT University, 53850 Lappeenranta, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ajantha","family":"Dahanayake","sequence":"additional","affiliation":[{"name":"Industrial Engineering and Management, School of Engineering Science, LUT University, 53850 Lappeenranta, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,25]]},"reference":[{"key":"ref_1","unstructured":"Cornell Lab of Ornithology (2021, March 09). eBird. Available online: https:\/\/ebird.org\/home."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1111\/j.1365-2966.2010.17432.x","article-title":"Galaxy Zoo 1: Data release of morphological classifications for nearly 900 000 galaxies","volume":"410","author":"Lintott","year":"2011","journal-title":"Mon. Not. R. Astron. Soc."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1038\/s41587-020-0694-x","article-title":"Leveling up citizen science","volume":"38","author":"Szantner","year":"2020","journal-title":"Nat. Biotechnol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"See, L., Mooney, P., Foody, G., Bastin, L., Comber, A., Estima, J., Fritz, S., Kerle, N., Jiang, B., and Laakso, M. (2016). Crowdsourcing, Citizen Science or Volunteered Geographic Information? The Current State of Crowdsourced Geographic Information. ISPRS Int. J. Geo-Inf., 5.","DOI":"10.3390\/ijgi5050055"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Simpson, R., Page, K.R., and De Roure, D. (2014). Zooniverse: Observing the world\u2019s largest citizen science platform. WWW 2014 Companion, Proceedings of the 23rd International Conference on World Wide Web, Seoul, Korea, 7\u201311 April 2014, Association for Computing Machinery, Inc.","DOI":"10.1145\/2567948.2579215"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1287\/isre.2014.0537","article-title":"The IQ of the Crowd: Understanding and Improving Information Quality in Structured User-Generated Content","volume":"25","author":"Lukyanenko","year":"2014","journal-title":"Inf. Syst. Res."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Arthur, R., Boulton, C.A., Shotton, H., and Williams, H.T.P. (2018). Social sensing of floods in the UK. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0189327"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1007\/s10115-017-1051-3","article-title":"CITIESData: A smart city data management framework","volume":"53","author":"Liu","year":"2017","journal-title":"Knowl. Inf. Syst."},{"key":"ref_9","unstructured":"SciStarter (2021, January 09). SciStarter. Available online: https:\/\/scistarter.com\/."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1111\/cobi.12706","article-title":"Emerging problems of data quality in citizen science","volume":"30","author":"Lukyanenko","year":"2016","journal-title":"Conserv. Biol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Nasiri, A., Abbaspour, R.A., Chehreghan, A., and Arsanjani, J.J. (2018). Improving the Quality of Citizen Contributed Geodata through Their Historical Contributions: The Case of the Road Network in OpenStreetMap. ISPRS Int. J. Geo-Inf., 7.","DOI":"10.3390\/ijgi7070253"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Leibovici, D.G., Rosser, J.F., Hodges, C., Evans, B., Jackson, M.J., and Higgins, C.I. (2017). On Data Quality Assurance and Conflation Entanglement in Crowdsourcing for Environmental Studies. ISPRS Int. J. Geo-Information, 6.","DOI":"10.3390\/ijgi6030078"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sheppard, S.A., Wiggins, A., and Terveen, L. (2014, January 15\u201319). Capturing quality. Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing\u2014CSCW \u201814, Baltimore, MD, USA.","DOI":"10.1145\/2531602.2531689"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1111\/j.1523-1739.2011.01740.x","article-title":"The Value, Limitations, and Challenges of Employing Local Experts in Conservation Research","volume":"25","author":"Elbroch","year":"2011","journal-title":"Conserv. Biol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1179\/000870410X12911304958827","article-title":"How Many Volunteers Does It Take to Map an Area Well? The Validity of Linus\u2019 Law to Volunteered Geographic Information","volume":"47","author":"Haklay","year":"2010","journal-title":"Cartogr. J."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mitchell, N., Triska, M., Liberatore, A., Ashcroft, L., Weatherill, R., and Longnecker, N. (2017). Benefits and challenges of incorporating citizen science into university education. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0186285"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1080\/17538947.2014.976774","article-title":"On predicting and improving the quality of Volunteer Geographic Information projects","volume":"9","author":"Bordogna","year":"2016","journal-title":"Int. J. Digit. Earth"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1007\/978-3-030-16181-1_61","article-title":"Solutions for Data Quality in GIS and VGI: A Systematic Literature Review","volume":"930","author":"Medeiros","year":"2019","journal-title":"Adv. Intell. Syst. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Torre, M., Nakayama, S., Tolbert, T.J., and Porfiri, M. (2019). Producing knowledge by admitting ignorance: Enhancing data quality through an \u201cI don\u2019t know\u201d option in citizen science. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0211907"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1657","DOI":"10.3390\/ijgi4031657","article-title":"Quality Evaluation of VGI Using Authoritative Data\u2014A Comparison with Land Use Data in Southern Germany","volume":"4","author":"Dorn","year":"2015","journal-title":"ISPRS Int. J. Geo-Inf."},{"key":"ref_21","first-page":"141","article-title":"Improving Data Quality, Privacy and Provenance in Citizen Science Applications","volume":"321","author":"Musto","year":"2020","journal-title":"Front. Artif. Intell. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"239","DOI":"10.3389\/fevo.2018.00239","article-title":"Do Big Unstructured Biodiversity Data Mean More Knowledge?","volume":"6","author":"Bayraktarov","year":"2019","journal-title":"Front. Ecol. Evol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.ijinfomgt.2017.01.003","article-title":"Open data: Quality over quantity","volume":"37","author":"Sadiq","year":"2017","journal-title":"Int. J. Inf. Manag."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1111\/cobi.12481","article-title":"Influence of volunteer and project characteristics on data quality of biological surveys","volume":"29","author":"Lewandowski","year":"2015","journal-title":"Conserv. Biol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/07421222.1996.11518099","article-title":"Beyond Accuracy: What Data Quality Means to Data Consumers","volume":"12","author":"Wang","year":"1996","journal-title":"J. Manag. Inf. Syst."},{"key":"ref_26","unstructured":"Batini, C., and Scannapieco, M. (2006). Data Quality: Concepts, Methodologies and Techniques, Springer."},{"key":"ref_27","unstructured":"Redman, T.C. (1996). Data Quality for the Information Age, Artech House."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1002\/int.10074","article-title":"A conceptual framework and belief-function approach to assessing overall information quality","volume":"18","author":"Bovee","year":"2003","journal-title":"Int. J. Intell. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1108\/02635570910991292","article-title":"A classification model of ERP system data quality","volume":"109","author":"Haug","year":"2009","journal-title":"Ind. Manag. Data Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Han, J., Jiang, D., and Ding, Z. (2009). Assessing Data Quality Within Available Context. Data Quality and High-Dimensional Data Analysis Proceedings of the DASFAA 2008 Workshops, New Delhi, India, 19\u201322 March 2008, World Scientific.","DOI":"10.1142\/9789814273497_0004"},{"key":"ref_31","first-page":"447","article-title":"Data Quality in Remote Sensing","volume":"42","author":"Batini","year":"2009","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"623","DOI":"10.25300\/MISQ\/2019\/14439","article-title":"Expecting the Unexpected: Effects of Data Collection Design Choices on the Quality of Crowdsourced User-Generated Content","volume":"43","author":"Lukyanenko","year":"2019","journal-title":"MIS Q."},{"key":"ref_33","unstructured":"International Organization for Standardization (ISO) (2013). ISO 19157:2013 Geographic Information\u2014Data Quality, ISO."},{"key":"ref_34","unstructured":"International Organization for Standardization (ISO) (2008). ISO\/IEC 25012:2008 Software Engineering\u2014Software Product Quality Requirements and Evaluation (SQuaRE)\u2014Data Quality Model, ISO."},{"key":"ref_35","unstructured":"International Organization for Standardization (ISO) (2011). ISO\/TS 8000:2011 Data Quality, ISO."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.dss.2009.07.012","article-title":"Data quality assessment in context: A cognitive perspective","volume":"48","author":"Watts","year":"2009","journal-title":"Decis. Support Syst."},{"key":"ref_37","unstructured":"Davenport, T.H., and Prusak, L. (1998). Working Knowledge: How Organizations Manage What They Know, Harvard Business School Press."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1541880.1541883","article-title":"Methodologies for data quality assessment and improvement","volume":"41","author":"Batini","year":"2009","journal-title":"ACM Comput. Surv."},{"key":"ref_39","unstructured":"iNaturalist (2021, March 29). A Community for Naturalists. Available online: https:\/\/www.inaturalist.org\/."},{"key":"ref_40","first-page":"10","article-title":"E Bird: A human\/computer learning network to improve biodiversity conservation and research","volume":"34","author":"Kelling","year":"2013","journal-title":"AI Mag."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Rajaram, G., and Manjula, K. (2019). Exploiting the Potential of VGI Metadata to Develop A Data-Driven Framework for Predicting User\u2019s Proficiency in OpenStreetMap Context. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8110492"},{"key":"ref_42","first-page":"122","article-title":"Understanding Data Quality in a Data Warehouse","volume":"30","author":"Shanks","year":"1998","journal-title":"J. Res. Pract. Inf. Technol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2","DOI":"10.5334\/dsj-2015-002","article-title":"The Challenges of Data Quality and Data Quality Assessment in the Big Data Era","volume":"14","author":"Cai","year":"2015","journal-title":"Data Sci. J."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2028","DOI":"10.1109\/ACCESS.2015.2490723","article-title":"Evaluating the Quality of Social Media Data in Big Data Architecture","volume":"3","author":"Immonen","year":"2015","journal-title":"IEEE Access"},{"key":"ref_45","first-page":"20","article-title":"Citizen OBservatory WEB (COBWEB): A Generic Infrastructure Platform to Facilitate the Collection of Citizen Science data for Environmental Monitoring","volume":"11","author":"Higgins","year":"2016","journal-title":"Int. J. Spat. Data Infrastruct. Res."},{"key":"ref_46","first-page":"76","article-title":"Maintaining Quality in Information Systems","volume":"40","author":"Fox","year":"1999","journal-title":"J. Comput. Inf. Syst."},{"key":"ref_47","unstructured":"Fonte, C.C., Antoniou, V., Bastin, L., Estima, J., Arsanjani, J.J., Bayas, J.-C.L., See, L., and Vatseva, R. (2017). Assessing VGI Data Quality. Mapping and the Citizen Sensor, Ubiquity Press."},{"key":"ref_48","unstructured":"Atlas of Living Australia (2021, March 17). Open access to Australia\u2019s Biodiversity Data. Available online: http:\/\/www.ala.org.au\/."},{"key":"ref_49","unstructured":"(2021, April 27). Globe at Night. International Citizen-Science Campaign to Raise Public Awareness of the Impact of Light Pollution. Available online: https:\/\/www.globeatnight.org\/."},{"key":"ref_50","unstructured":"(2021, April 27). Budburst. An Online Database of Plant Observations, a Citizen-Science Project of the Chicago Botanic Garden. Glencoe, Illinois. Available online: https:\/\/budburst.org\/."},{"key":"ref_51","unstructured":"(2021, June 07). Intersoft Consulting. General Data Protection Regulation (GDPR)\u2014Official Legal Text. Available online: https:\/\/gdpr-info.eu\/."},{"key":"ref_52","unstructured":"California Legislative Information (2021, June 07). Bill Text-SB-1121 California Consumer Privacy Act of 2018, Available online: https:\/\/leginfo.legislature.ca.gov\/faces\/billTextClient.xhtml?bill_id=201720180SB1121."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Teorey, T., Lightstone, S., Nadeau, T., and Jagadish, H.V. (2011). Business Intelligence. Database Modeling and Design, Elsevier.","DOI":"10.1016\/B978-0-12-382020-4.00012-4"},{"key":"ref_54","unstructured":"GPS.gov (2021, April 19). GPS Accuracy, Available online: https:\/\/www.gps.gov\/systems\/gps\/performance\/accuracy\/."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Merry, K., and Bettinger, P. (2019). Smartphone GPS accuracy study in an urban environment. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0219890"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1111\/area.12172","article-title":"Assessing absolute and relative accuracy of recreation-grade and mobile phone GNSS devices: A method for informing device choice","volume":"47","author":"Schaefer","year":"2015","journal-title":"Area"},{"key":"ref_57","first-page":"187","article-title":"Horizontal accuracy and applicability of smartphone GNSS positioning in forests","volume":"90","author":"Piroh","year":"2016","journal-title":"Forestry"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1376","DOI":"10.1038\/srep01376","article-title":"Unique in the Crowd: The privacy bounds of human mobility","volume":"3","author":"Hidalgo","year":"2013","journal-title":"Sci. Rep."},{"key":"ref_59","first-page":"465","article-title":"Citizen Science 2.0: Data Management Principles to Harness the Power of the Crowd","volume":"Volume 6629","author":"Lukyanenko","year":"2011","journal-title":"DESRIST 2011: Service-Oriented Perspectives in Design Science Research"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.envsci.2019.09.002","article-title":"Incentives and barriers for participation in community-based environmental monitoring and information systems: A critical analysis and integration of the literature","volume":"101","author":"Wehn","year":"2019","journal-title":"Environ. Sci. Policy"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/j.jnc.2012.08.002","article-title":"Motivations and barriers in relation to community participation in biodiversity recording","volume":"20","author":"Hobbs","year":"2012","journal-title":"J. Nat. Conserv."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"317","DOI":"10.5194\/isprsannals-II-3-W5-317-2015","article-title":"Vgi Quality Control","volume":"2","author":"Fonte","year":"2015","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"14340","DOI":"10.1109\/ACCESS.2019.2894578","article-title":"An Incentive Mechanism Based on a Bayesian Game for Spatial Crowdsourcing","volume":"7","author":"Pang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1080\/15420353.2015.1009609","article-title":"The Benefits and Risks of Volunteered Geographic Information","volume":"11","author":"Blatt","year":"2015","journal-title":"J. Map Geogr. Libr."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"See, L., Comber, A., Salk, C., Fritz, S., van der Velde, M., Perger, C., Schill, C., McCallum, I., Kraxner, F., and Obersteiner, M. (2013). Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0069958"},{"key":"ref_66","first-page":"716","article-title":"Automatic Data Quality Control of Observations in Wireless Sensor Network","volume":"12","author":"Guo","year":"2014","journal-title":"IEEE Geosci. Remote. Sens. Lett."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/7\/434\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:23:43Z","timestamp":1760163823000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/7\/434"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,25]]},"references-count":66,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["ijgi10070434"],"URL":"https:\/\/doi.org\/10.3390\/ijgi10070434","relation":{},"ISSN":["2220-9964"],"issn-type":[{"type":"electronic","value":"2220-9964"}],"subject":[],"published":{"date-parts":[[2021,6,25]]}}}