{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:28:27Z","timestamp":1750220907053,"version":"3.41.0"},"reference-count":33,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,9,30]],"date-time":"2019-09-30T00:00:00Z","timestamp":1569801600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100013266","name":"Science and Technology Facilities Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100013266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000104","name":"National Aeronautics and Space Administration","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000104","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Trans. Soc. Comput."],"published-print":{"date-parts":[[2019,9,30]]},"abstract":"<jats:p>The increasing size of datasets with which researchers in a variety of domains are confronted has led to a range of creative responses, including the deployment of modern machine learning techniques and the advent of large scale \u201ccitizen science projects.\u201d However, the ability of the latter to provide suitably large training sets for the former is stretched as the size of the problem (and competition for attention amongst projects) grows. We explore the application of unsupervised learning to leverage structure that exists in an initially unlabelled dataset. We simulate grouping similar points before presenting those groups to volunteers to label. Citizen science labelling of grouped data is more efficient, and the gathered labels can be used to improve efficiency further for labelling future data.<\/jats:p>\n          <jats:p>To demonstrate these ideas, we perform experiments using data from the Pan-STARRS Survey for Transients (PSST) with volunteer labels gathered by the Zooniverse project, Supernova Hunters and a simulated project using the MNIST handwritten digit dataset. Our results show that, in the best case, we might expect to reduce the required volunteer effort by 87.0% and 92.8% for the two datasets, respectively. These results illustrate a symbiotic relationship between machine learning and citizen scientists where each empowers the other with important implications for the design of citizen science projects in the future.<\/jats:p>","DOI":"10.1145\/3362741","type":"journal-article","created":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T22:07:36Z","timestamp":1573769256000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Help Me to Help You"],"prefix":"10.1145","volume":"2","author":[{"given":"Darryl E.","family":"Wright","sequence":"first","affiliation":[{"name":"University of Minnesota, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lucy","family":"Fortson","sequence":"additional","affiliation":[{"name":"University of Minnesota, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris","family":"Lintott","sequence":"additional","affiliation":[{"name":"University of Oxford, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Laraia","sequence":"additional","affiliation":[{"name":"University of Minnesota, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mike","family":"Walmsley","sequence":"additional","affiliation":[{"name":"University of Oxford, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,11,14]]},"reference":[{"unstructured":"E. Aljalbout V. Golkov Y. Siddiqui M. Strobel and D. Cremers. 2018. Clustering with deep learning: Taxonomy and new methods. ArXiv E-prints (Jan. 2018). arxiv:1801.07648  E. Aljalbout V. Golkov Y. Siddiqui M. Strobel and D. Cremers. 2018. Clustering with deep learning: Taxonomy and new methods. ArXiv E-prints (Jan. 2018). arxiv:1801.07648","key":"e_1_2_1_1_1"},{"volume-title":"Weld","year":"2018","author":"Bansal Gagan","key":"e_1_2_1_2_1"},{"unstructured":"T. Boyajian S. Croft J. Wright A. Siemion M. Muterspaugh M. Siegel B. Gary S. Wright J. Maire A. Duenas C. Hultgren and J. Ramos. 2017. A drop in optical flux from Boyajian\u2019s star. The Astronomer\u2019s Telegram 10405 (May 2017).  T. Boyajian S. Croft J. Wright A. Siemion M. Muterspaugh M. Siegel B. Gary S. Wright J. Maire A. Duenas C. Hultgren and J. Ramos. 2017. A drop in optical flux from Boyajian\u2019s star. The Astronomer\u2019s Telegram 10405 (May 2017).","key":"e_1_2_1_3_1"},{"unstructured":"T. S. Boyajian D. M. LaCourse S. A. Rappaport D. Fabrycky D. A. Fischer D. Gandolfi G. M. Kennedy H. Korhonen M. C. Liu A. Moor K. Olah K. Vida M. C. Wyatt W. M. J. Best J. Brewer F. Ciesla B. Csak H. J. Deeg T. J. Dupuy G. Handler K. Heng S. B. Howell S. T. Ishikawa J. Kovacs T. Kozakis L. Kriskovics J. Lehtinen C. Lintott S. Lynn D. Nespral S. Nikbakhsh K. Schawinski J. R. Schmitt A. M. Smith Gy. Szabo R. Szabo J. Viuho J. Wang A. Weiksnar M. Bosch J. L. Connors S. Goodman G. Green A. J. Hoekstra T. Jebson K. J. Jek M. R. Omohundro H. M. Schwengeler and A. Szewczyk. 2016. Planet Hunters IX. KIC8462852\u2014Where\u2019s the flux?Monthly Notices of the Royal Astronomical Society 457 4 (2016) 3988--4004. DOI:http:\/\/dx.doi.org\/10.1093\/mnras\/stw218 eprint&equals;\/oup\/backfile\/content_public\/journal\/mnras\/457\/4\/10.1093_mnras_stw218\/3\/stw218.pdf.  T. S. Boyajian D. M. LaCourse S. A. Rappaport D. Fabrycky D. A. Fischer D. Gandolfi G. M. Kennedy H. Korhonen M. C. Liu A. Moor K. Olah K. Vida M. C. Wyatt W. M. J. Best J. Brewer F. Ciesla B. Csak H. J. Deeg T. J. Dupuy G. Handler K. Heng S. B. Howell S. T. Ishikawa J. Kovacs T. Kozakis L. Kriskovics J. Lehtinen C. Lintott S. Lynn D. Nespral S. Nikbakhsh K. Schawinski J. R. Schmitt A. M. Smith Gy. Szabo R. Szabo J. Viuho J. Wang A. Weiksnar M. Bosch J. L. Connors S. Goodman G. Green A. J. Hoekstra T. Jebson K. J. Jek M. R. Omohundro H. M. Schwengeler and A. Szewczyk. 2016. Planet Hunters IX. KIC8462852\u2014Where\u2019s the flux?Monthly Notices of the Royal Astronomical Society 457 4 (2016) 3988--4004. DOI:http:\/\/dx.doi.org\/10.1093\/mnras\/stw218 eprint&equals;\/oup\/backfile\/content_public\/journal\/mnras\/457\/4\/10.1093_mnras_stw218\/3\/stw218.pdf.","key":"e_1_2_1_4_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_5_1","DOI":"10.1109\/CVPR.2017.647"},{"doi-asserted-by":"crossref","unstructured":"C. Cardamone K. Schawinski M. Sarzi S. P. Bamford N. Bennert C. M. Urry C. Lintott W. C. Keel J. Parejko R. C. Nichol D. Thomas D. Andreescu P. Murray M. J. Raddick A. Slosar A. Szalay and J. Vandenberg. 2009. Galaxy zoo green peas: Discovery of a class of compact extremely star-forming galaxies. Monthly Notices of the Royal Astronomical Society 399 (Nov. 2009) 1191--1205. DOI:https:\/\/doi.org\/10.1111\/j.1365-2966.2009.15383.x arxiv:0907.4155  C. Cardamone K. Schawinski M. Sarzi S. P. Bamford N. Bennert C. M. Urry C. Lintott W. C. Keel J. Parejko R. C. Nichol D. Thomas D. Andreescu P. Murray M. J. Raddick A. Slosar A. Szalay and J. Vandenberg. 2009. Galaxy zoo green peas: Discovery of a class of compact extremely star-forming galaxies. Monthly Notices of the Royal Astronomical Society 399 (Nov. 2009) 1191--1205. DOI:https:\/\/doi.org\/10.1111\/j.1365-2966.2009.15383.x arxiv:0907.4155","key":"e_1_2_1_6_1","DOI":"10.1111\/j.1365-2966.2009.15383.x"},{"unstructured":"K. C. Chambers E. A. Magnier N. Metcalfe H. A. Flewelling M. E. Huber C. Z. Waters L. Denneau P. W. Draper D. Farrow D. P. Finkbeiner C. Holmberg J. Koppenhoefer P. A. Price A. Rest R. P. Saglia E. F. Schlafly S. J. Smartt W. Sweeney R. J. Wainscoat W. S. Burgett S. Chastel T. Grav J. N. Heasley K. W. Hodapp R. Jedicke N. Kaiser R.-P. Kudritzki G. A. Luppino R. H. Lupton D. G. Monet J. S. Morgan P. M. Onaka B. Shiao C. W. Stubbs J. L. Tonry R. White E. Ba\u00f1ados E. F. Bell R. Bender E. J. Bernard M. Boegner F. Boffi M. T. Botticella A. Calamida S. Casertano W.-P. Chen X. Chen S. Cole N. Deacon C. Frenk A. Fitzsimmons S. Gezari V. Gibbs C. Goessl T. Goggia R. Gourgue B. Goldman P. Grant E. K. Grebel N. C. Hambly G. Hasinger A. F. Heavens T. M. Heckman R. Henderson T. Henning M. Holman U. Hopp W.-H. Ip S. Isani M. Jackson C. D. Keyes A. M. Koekemoer R. Kotak D. Le D. Liska K. S. Long J. R. Lucey M. Liu N. F. Martin G. Masci B. McLean E. Mindel P. Misra E. Morganson D. N. A. Murphy A. Obaika G. Narayan M. A. Nieto-Santisteban P. Norberg J. A. Peacock E. A. Pier M. Postman N. Primak C. Rae A. Rai A. Riess A. Riffeser H. W. Rix S. R\u00f6ser R. Russel L. Rutz E. Schilbach A. S. B. Schultz D. Scolnic L. Strolger A. Szalay S. Seitz E. Small K. W. Smith D. R. Soderblom P. Taylor R. Thomson A. N. Taylor A. R. Thakar J. Thiel D. Thilker D. Unger Y. Urata J. Valenti J. Wagner T. Walder F. Walter S. P. Watters S. Werner W. M. Wood-Vasey and R. Wyse. 2016. The pan-STARRS1 surveys. Arxiv E-prints (Dec. 2016). arxiv:astro-ph.IM\/1612.05560  K. C. Chambers E. A. Magnier N. Metcalfe H. A. Flewelling M. E. Huber C. Z. Waters L. Denneau P. W. Draper D. Farrow D. P. Finkbeiner C. Holmberg J. Koppenhoefer P. A. Price A. Rest R. P. Saglia E. F. Schlafly S. J. Smartt W. Sweeney R. J. Wainscoat W. S. Burgett S. Chastel T. Grav J. N. Heasley K. W. Hodapp R. Jedicke N. Kaiser R.-P. Kudritzki G. A. Luppino R. H. Lupton D. G. Monet J. S. Morgan P. M. Onaka B. Shiao C. W. Stubbs J. L. Tonry R. White E. Ba\u00f1ados E. F. Bell R. Bender E. J. Bernard M. Boegner F. Boffi M. T. Botticella A. Calamida S. Casertano W.-P. Chen X. Chen S. Cole N. Deacon C. Frenk A. Fitzsimmons S. Gezari V. Gibbs C. Goessl T. Goggia R. Gourgue B. Goldman P. Grant E. K. Grebel N. C. Hambly G. Hasinger A. F. Heavens T. M. Heckman R. Henderson T. Henning M. Holman U. Hopp W.-H. Ip S. Isani M. Jackson C. D. Keyes A. M. Koekemoer R. Kotak D. Le D. Liska K. S. Long J. R. Lucey M. Liu N. F. Martin G. Masci B. McLean E. Mindel P. Misra E. Morganson D. N. A. Murphy A. Obaika G. Narayan M. A. Nieto-Santisteban P. Norberg J. A. Peacock E. A. Pier M. Postman N. Primak C. Rae A. Rai A. Riess A. Riffeser H. W. Rix S. R\u00f6ser R. Russel L. Rutz E. Schilbach A. S. B. Schultz D. Scolnic L. Strolger A. Szalay S. Seitz E. Small K. W. Smith D. R. Soderblom P. Taylor R. Thomson A. N. Taylor A. R. Thakar J. Thiel D. Thilker D. Unger Y. Urata J. Valenti J. Wagner T. Walder F. Walter S. P. Watters S. Werner W. M. Wood-Vasey and R. Wyse. 2016. The pan-STARRS1 surveys. Arxiv E-prints (Dec. 2016). arxiv:astro-ph.IM\/1612.05560","key":"e_1_2_1_7_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_8_1","DOI":"10.1093\/mnras\/stv632"},{"doi-asserted-by":"publisher","key":"e_1_2_1_9_1","DOI":"10.1093\/mnras\/sty338"},{"doi-asserted-by":"crossref","unstructured":"J. E. Geach A. More A. Verma P. J. Marshall N. Jackson P.-E. Belles R. Beswick E. Baeten M. Chavez C. Cornen B. E. Cox T. Erben N. J. Erickson S. Garrington P. A. Harrison K. Harrington D. H. Hughes R. J. Ivison C. Jordan Y.-T. Lin A. Leauthaud C. Lintott S. Lynn A. Kapadia J.-P. Kneib C. Macmillan M. Makler G. Miller A. Monta\u00f1a R. Mujica T. Muxlow G. Narayanan D. O\u2019Briain T. O\u2019Brien M. Oguri E. Paget M. Parrish N. P. Ross E. Rozo C. E. Rusu E. S. Rykoff D. Sanchez-Arg\u00fcelles R. Simpson C. Snyder F. P. Schloerb M. Tecza W.-H. Wang L. Van Waerbeke J. Wilcox M. Viero G. W. Wilson M. S. Yun and M. Zeballos. 2015. The Red Radio Ring: A gravitationally lensed hyperluminous infrared radio galaxy at z &emp;equals; 2.553 discovered through the citizen science project SPACE WARPS. Monthly Notices of the Royal Astronomical Society 452 (Sept. 2015) 502--510. DOI:https:\/\/doi.org\/10.1093\/mnras\/stv1243 arxiv:1503.05824  J. E. Geach A. More A. Verma P. J. Marshall N. Jackson P.-E. Belles R. Beswick E. Baeten M. Chavez C. Cornen B. E. Cox T. Erben N. J. Erickson S. Garrington P. A. Harrison K. Harrington D. H. Hughes R. J. Ivison C. Jordan Y.-T. Lin A. Leauthaud C. Lintott S. Lynn A. Kapadia J.-P. Kneib C. Macmillan M. Makler G. Miller A. Monta\u00f1a R. Mujica T. Muxlow G. Narayanan D. O\u2019Briain T. O\u2019Brien M. Oguri E. Paget M. Parrish N. P. Ross E. Rozo C. E. Rusu E. S. Rykoff D. Sanchez-Arg\u00fcelles R. Simpson C. Snyder F. P. Schloerb M. Tecza W.-H. Wang L. Van Waerbeke J. Wilcox M. Viero G. W. Wilson M. S. Yun and M. Zeballos. 2015. The Red Radio Ring: A gravitationally lensed hyperluminous infrared radio galaxy at z &emp;equals; 2.553 discovered through the citizen science project SPACE WARPS. Monthly Notices of the Royal Astronomical Society 452 (Sept. 2015) 502--510. DOI:https:\/\/doi.org\/10.1093\/mnras\/stv1243 arxiv:1503.05824","key":"e_1_2_1_11_1","DOI":"10.1093\/mnras\/stv1243"},{"doi-asserted-by":"publisher","key":"e_1_2_1_12_1","DOI":"10.1007\/978-3-319-70096-0_39"},{"volume-title":"The Elements of Statistical Learning","author":"Hastie Trevor","key":"e_1_2_1_13_1"},{"volume-title":"What size window for image classification? A cognitive perspective. PE 8 RS- Photogrammetric Engineering and Remote Sensing 64, 8","year":"1998","author":"Hodgson Michael E.","key":"e_1_2_1_14_1"},{"volume-title":"2008. LSST: From science drivers to reference design and anticipated data products. ArXiv E-prints (May","year":"2008","author":"Kahn S. M.","key":"e_1_2_1_15_1"},{"volume-title":"Variational deep embedding: An unsupervised and generative approach to clustering. Arxiv Preprint","year":"2016","author":"Jiang Zhuxi","key":"e_1_2_1_16_1"},{"volume-title":"Adam: A method for stochastic optimization. ArXiv E-prints (Dec.","year":"2014","author":"Kingma D. P.","key":"e_1_2_1_17_1"},{"key":"e_1_2_1_18_1","first-page":"2","article-title":"Identifying unknown unknowns in the open world: Representations and policies for guided exploration","volume":"1","author":"Lakkaraju Himabindu","year":"2017","journal-title":"AAAI"},{"doi-asserted-by":"publisher","key":"e_1_2_1_19_1","DOI":"10.1109\/5.726791"},{"volume-title":"Galaxy Zoo: Morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey. Monthly Notices of the Royal Astronomical Society 389 (Sept.","year":"2008","author":"Lintott C. J.","key":"e_1_2_1_20_1"},{"volume":"1","volume-title":"Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability","author":"James","key":"e_1_2_1_21_1"},{"doi-asserted-by":"crossref","unstructured":"P. J. Marshall A. Verma A. More C. P. Davis S. More A. Kapadia M. Parrish C. Snyder J. Wilcox E. Baeten C. Macmillan C. Cornen M. Baumer E. Simpson C. J. Lintott D. Miller E. Paget R. Simpson A. M. Smith R. K\u00fcng P. Saha and T. E. Collett. 2016. SPACE WARPS\u2014I. Crowdsourcing the discovery of gravitational lenses. Monthly Notices of the Royal Astronomical Society 455 (Jan. 2016) 1171--1190. DOI:https:\/\/doi.org\/10.1093\/mnras\/stv2009 arxiv:astro-ph.IM\/1504.06148  P. J. Marshall A. Verma A. More C. P. Davis S. More A. Kapadia M. Parrish C. Snyder J. Wilcox E. Baeten C. Macmillan C. Cornen M. Baumer E. Simpson C. J. Lintott D. Miller E. Paget R. Simpson A. M. Smith R. K\u00fcng P. Saha and T. E. Collett. 2016. SPACE WARPS\u2014I. Crowdsourcing the discovery of gravitational lenses. Monthly Notices of the Royal Astronomical Society 455 (Jan. 2016) 1171--1190. DOI:https:\/\/doi.org\/10.1093\/mnras\/stv2009 arxiv:astro-ph.IM\/1504.06148","key":"e_1_2_1_22_1","DOI":"10.1093\/mnras\/stv2009"},{"unstructured":"M. S. Norouzzadeh A. Nguyen M. Kosmala A. Swanson C. Packer and J. Clune. 2017. Automatically identifying wild animals in camera trap images with deep learning. Arxiv Preprint (2017). arXiv:1703.05830  M. S. Norouzzadeh A. Nguyen M. Kosmala A. Swanson C. Packer and J. Clune. 2017. Automatically identifying wild animals in camera trap images with deep learning. Arxiv Preprint (2017). arXiv:1703.05830","key":"e_1_2_1_23_1"},{"volume-title":"Feature visualization. Distill","year":"2017","author":"Olah Chris","key":"e_1_2_1_24_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_25_1","DOI":"10.1145\/1180639.1180831"},{"volume-title":"Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907)","year":"2007","author":"Rosenberg Andrew","key":"e_1_2_1_26_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_27_1","DOI":"10.5555\/3019233"},{"unstructured":"E. Simpson S. Roberts I. Psorakis and A. Smith. 2012. Dynamic Bayesian combination of multiple imperfect classifiers. ArXiv E-prints (June 2012). arxiv:math.ST\/1206.1831  E. Simpson S. Roberts I. Psorakis and A. Smith. 2012. Dynamic Bayesian combination of multiple imperfect classifiers. ArXiv E-prints (June 2012). arxiv:math.ST\/1206.1831","key":"e_1_2_1_28_1"},{"doi-asserted-by":"crossref","unstructured":"A. Swanson M. Kosmala C. Lintott R. Simpson A. Smith and C. Packer. 2015. Snapshot Serengeti high-frequency annotated camera trap images of 40 mammalian species in an African savanna. Scientific Data 2 150026 (2015). http:\/\/dx.doi.org\/10.1038\/sdata.2015.26  A. Swanson M. Kosmala C. Lintott R. Simpson A. Smith and C. Packer. 2015. Snapshot Serengeti high-frequency annotated camera trap images of 40 mammalian species in an African savanna. Scientific Data 2 150026 (2015). http:\/\/dx.doi.org\/10.1038\/sdata.2015.26","key":"e_1_2_1_29_1","DOI":"10.1038\/sdata.2015.26"},{"key":"e_1_2_1_30_1","article-title":"Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion","author":"Vincent Pascal","year":"2010","journal-title":"Journal of Machine Learning Research 11"},{"doi-asserted-by":"crossref","unstructured":"K. W. Willett C. J. Lintott S. P. Bamford K. L. Masters B. D. Simmons K. R. V. Casteels E. M. Edmondson L. F. Fortson S. Kaviraj W. C. Keel T. Melvin R. C. Nichol M. J. Raddick K. Schawinski R. J. Simpson R. A. Skibba A. M. Smith and D. Thomas. 2013. Galaxy Zoo 2: Detailed morphological classifications for 304 122 galaxies from the sloan digital sky survey. Monthly Notices of the Royal Astronomical Society 435 (Nov. 2013) 2835--2860. DOI:https:\/\/doi.org\/10.1093\/mnras\/stt1458 arxiv:1308.3496  K. W. Willett C. J. Lintott S. P. Bamford K. L. Masters B. D. Simmons K. R. V. Casteels E. M. Edmondson L. F. Fortson S. Kaviraj W. C. Keel T. Melvin R. C. Nichol M. J. Raddick K. Schawinski R. J. Simpson R. A. Skibba A. M. Smith and D. Thomas. 2013. Galaxy Zoo 2: Detailed morphological classifications for 304 122 galaxies from the sloan digital sky survey. Monthly Notices of the Royal Astronomical Society 435 (Nov. 2013) 2835--2860. DOI:https:\/\/doi.org\/10.1093\/mnras\/stt1458 arxiv:1308.3496","key":"e_1_2_1_31_1","DOI":"10.1093\/mnras\/stt1458"},{"doi-asserted-by":"publisher","key":"e_1_2_1_33_1","DOI":"10.1093\/mnras\/stx1812"},{"volume-title":"International Conference on Machine Learning. 478--487","year":"2016","author":"Xie Junyuan","key":"e_1_2_1_34_1"},{"volume-title":"Zeiler and Rob Fergus","year":"2014","author":"Matthew","key":"e_1_2_1_35_1"}],"container-title":["ACM Transactions on Social Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3362741","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3362741","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3362741","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:54Z","timestamp":1750203894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3362741"}},"subtitle":["Machine Augmented Citizen Science"],"short-title":[],"issued":{"date-parts":[[2019,9,30]]},"references-count":33,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,9,30]]}},"alternative-id":["10.1145\/3362741"],"URL":"https:\/\/doi.org\/10.1145\/3362741","relation":{},"ISSN":["2469-7818","2469-7826"],"issn-type":[{"type":"print","value":"2469-7818"},{"type":"electronic","value":"2469-7826"}],"subject":[],"published":{"date-parts":[[2019,9,30]]},"assertion":[{"value":"2019-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-11-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}