{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T09:19:46Z","timestamp":1777799986553,"version":"3.51.4"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,9,11]],"date-time":"2017-09-11T00:00:00Z","timestamp":1505088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"BMBF","award":["01IS12051"],"award-info":[{"award-number":["01IS12051"]}]},{"name":"FP7","award":["610510"],"award-info":[{"award-number":["610510"]}]},{"DOI":"10.13039\/100008383","name":"BMVI","doi-asserted-by":"crossref","award":["19F2003A"],"award-info":[{"award-number":["19F2003A"]}],"id":[{"id":"10.13039\/100008383","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2017,9,11]]},"abstract":"<jats:p>Citizen Science with mobile and wearable technology holds the possibility of unprecedented observation systems. Experts and policy makers are torn between enthusiasm and scepticism regarding the value of the resulting data, as their decision making traditionally relies on high-quality instrumentation and trained personnel measuring in a standardized way. In this paper, we (1) present an empirical behavior taxonomy of errors exhibited in non-expert smartphone-based sensing, based on four small exploratory studies, and discuss measures to mitigate their effects. We then present a large summative study (N=535) that compares instructions and technical measures to address these errors, both from the perspective of improvements to error frequency and perceived usability. Our results show that (2) technical measures without explanation notably reduce the perceived usability and (3) technical measures and instructions nicely complement each other: Their combination achieves a significant reduction in observed error rates while not affecting the user experience negatively.<\/jats:p>","DOI":"10.1145\/3131900","type":"journal-article","created":{"date-parts":[[2017,9,11]],"date-time":"2017-09-11T12:12:26Z","timestamp":1505131946000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":44,"title":["Participatory Sensing or Participatory Nonsense?"],"prefix":"10.1145","volume":"1","author":[{"given":"Matthias","family":"Budde","sequence":"first","affiliation":[{"name":"Karlsruhe Institute of Technology (KIT), TECO, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Schankin","sequence":"additional","affiliation":[{"name":"Karlsruhe Institute of Technology (KIT), TECO, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julien","family":"Hoffmann","sequence":"additional","affiliation":[{"name":"Karlsruhe Institute of Technology (KIT), TECO, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcel","family":"Danz","sequence":"additional","affiliation":[{"name":"Karlsruhe Institute of Technology (KIT), TECO, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Till","family":"Riedel","sequence":"additional","affiliation":[{"name":"Karlsruhe Institute of Technology (KIT), TECO, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Beigl","sequence":"additional","affiliation":[{"name":"Karlsruhe Institute of Technology (KIT), TECO, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,9,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557155"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327051HCI16234_05"},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Rick Bonney Jennifer L Shirk Tina B Phillips Andrea Wiggins Heidi L Ballard Abraham J Miller-Rushing Julia K Parrish etal 2014. Next steps for citizen science. Science 343 6178 (2014).  Rick Bonney Jennifer L Shirk Tina B Phillips Andrea Wiggins Heidi L Ballard Abraham J Miller-Rushing Julia K Parrish et al. 2014. Next steps for citizen science. Science 343 6178 (2014).","DOI":"10.1126\/science.1251554"},{"key":"e_1_2_1_4_1","unstructured":"John Brooke. 1996. SUS -- A quick and dirty usability scale. Usability evaluation in industry 189 (1996).  John Brooke. 1996. SUS -- A quick and dirty usability scale. Usability evaluation in industry 189 (1996)."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493988.2494342"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2802083.2808406"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3001773.3001832"},{"key":"e_1_2_1_8_1","volume-title":"Approaches. In ProScience","volume":"1","author":"Budde Matthias","year":"2014"},{"key":"e_1_2_1_9_1","unstructured":"Jeffrey A Burke Deborah Estrin Mark Hansen Andrew Parker Nithya Ramanathan Sasank Reddy and Mani B Srivastava. 2006. Participatory sensing. Center for Embedded Network Sensing (2006).  Jeffrey A Burke Deborah Estrin Mark Hansen Andrew Parker Nithya Ramanathan Sasank Reddy and Mani B Srivastava. 2006. Participatory sensing. Center for Embedded Network Sensing (2006)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2011.06.073"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s007790170019"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518832"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"J St BT Evans. 1988. The knowledge elicitation problem: a psychological perspective. Behaviour 8 Information Technology 7 2 (1988).  J St BT Evans. 1988. The knowledge elicitation problem: a psychological perspective. Behaviour 8 Information Technology 7 2 (1988).","DOI":"10.1080\/01449298808901868"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1890\/110185"},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Steven K. Gibb. 2015. Volunteers Against Pollution. Chemical 8 Engineering News (C8EN) 93 36 (Sept. 2015).  Steven K. Gibb. 2015. Volunteers Against Pollution. Chemical 8 Engineering News (C8EN) 93 36 (Sept. 2015).","DOI":"10.1021\/cen-09336-cover1"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702255"},{"key":"e_1_2_1_17_1","volume-title":"1994 IEEE International Conference on","volume":"2","author":"Hoyt John D","year":"1994"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868521.1868526"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11036-009-0217-y"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441940"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979251"},{"key":"e_1_2_1_22_1","unstructured":"Eli Kintisch. 2011. How to Grow Your Own Army of Citizen Scientists. (24 Feb. 2011).  Eli Kintisch. 2011. How to Grow Your Own Army of Citizen Scientists. (24 Feb. 2011)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2971590"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2010.5560598"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89350-9_6"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518741"},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Nicolas Maisonneuve Matthias Stevens and Bartek Ochab. 2010. Participatory noise pollution monitoring using mobile phones. In Information Polity. Vol. 15. 51 -- 71. Issue 1.   Nicolas Maisonneuve Matthias Stevens and Bartek Ochab. 2010. Participatory noise pollution monitoring using mobile phones. In Information Polity. Vol. 15. 51 -- 71. Issue 1.","DOI":"10.3233\/IP-2010-0200"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-24500-8_36"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0043158"},{"key":"e_1_2_1_30_1","volume-title":"2011 IEEE International Conference on Consumer Electronics - Berlin (ICCE -Berlin). 17--21","author":"Muratori L. A."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2163.358092"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sheji.2016.01.002"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1166324.1166329"},{"key":"e_1_2_1_34_1","doi-asserted-by":"crossref","unstructured":"L. Peterson and M. Peterson. 1959. Short-term retention of individual verbal items. Journal of Experimental Psychology 58 (1959).  L. Peterson and M. Peterson. 1959. Short-term retention of individual verbal items. Journal of Experimental Psychology 58 (1959).","DOI":"10.1037\/h0049234"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1791212.1791226"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12654-3_9"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"I. Schweizer R. B\u00e4rtl A. Schulz F. Probst and M. M\u00fchl\u00e4user. 2011. NoiseMap -- real-time participatory noise maps. In PhoneSense\u201911.  I. Schweizer R. B\u00e4rtl A. Schulz F. Probst and M. M\u00fchl\u00e4user. 2011. NoiseMap -- real-time participatory noise maps. In PhoneSense\u201911.","DOI":"10.1145\/2389148.2389157"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","unstructured":"L. See A. Comber C. Salk S. Fritz M. van der Velde C. Perger C. Schill I. McCallum F. Kraxner and M. Obersteiner. 2013. Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts. PLoS ONE 8 7 (2013).  L. See A. Comber C. Salk S. Fritz M. van der Velde C. Perger C. Schill I. McCallum F. Kraxner and M. Obersteiner. 2013. Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts. PLoS ONE 8 7 (2013).","DOI":"10.1371\/journal.pone.0069958"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038558.2038565"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531689"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1002\/2014GL061462"},{"key":"e_1_2_1_42_1","volume-title":"International Workshop on Dynamic Visualizations and Learning.","author":"Sweller John","year":"2002"},{"key":"e_1_2_1_43_1","unstructured":"Brett Amy Thelen and Rachel K. Thiet. 2008. Cultivating connection: Incorporating meaningful citizen science into Cape Cod National Seashore\u2019s estuarine research and monitoring programs. Park Science 25 1 (2008).  Brett Amy Thelen and Rachel K. Thiet. 2008. Cultivating connection: Incorporating meaningful citizen science into Cape Cod National Seashore\u2019s estuarine research and monitoring programs. Park Science 25 1 (2008)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2011.29"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979146"},{"key":"e_1_2_1_46_1","unstructured":"VDA-QMC. 2011. Messsystem und Messprozess sind zweierlei. QZ 56 5 (2011).  VDA-QMC. 2011. Messsystem und Messprozess sind zweierlei. QZ 56 5 (2011)."},{"key":"e_1_2_1_47_1","unstructured":"Christopher D Wickens John Lee Yili D Liu and Sallie Gordon-Becker. 2014. Introduction to Human Factors Engineering: Pearson New International Edition. Pearson Higher Ed. Second Edition.   Christopher D Wickens John Lee Yili D Liu and Sallie Gordon-Becker. 2014. Introduction to Human Factors Engineering: Pearson New International Edition. Pearson Higher Ed. Second Edition."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2820063"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Patricia Wright. 1981. \u201cThe instructions clearly state \u2026\u201d can\u2019t people read? Applied Ergonomics 12 (September 1981) 131--141. Issue 3.  Patricia Wright. 1981. \u201cThe instructions clearly state \u2026\u201d can\u2019t people read? Applied Ergonomics 12 (September 1981) 131--141. Issue 3.","DOI":"10.1016\/0003-6870(81)90002-8"},{"key":"e_1_2_1_50_1","unstructured":"Poonam Yadav and John Darlington. 2016. Design Guidelines for the User-Centred Collaborative Citizen Science Platforms. arXiv preprint arXiv:1605.00910 (2016).  Poonam Yadav and John Darlington. 2016. Design Guidelines for the User-Centred Collaborative Citizen Science Platforms. arXiv preprint arXiv:1605.00910 (2016)."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3131900","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3131900","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:30:33Z","timestamp":1750217433000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3131900"}},"subtitle":["Mitigating the Effect of Human Error on Data Quality in Citizen Science"],"short-title":[],"issued":{"date-parts":[[2017,9,11]]},"references-count":50,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9,11]]}},"alternative-id":["10.1145\/3131900"],"URL":"https:\/\/doi.org\/10.1145\/3131900","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,11]]},"assertion":[{"value":"2017-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-09-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}