{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T04:56:30Z","timestamp":1755838590936,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":58,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,5,2]],"date-time":"2017-05-02T00:00:00Z","timestamp":1493683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"SAP"},{"DOI":"10.13039\/100006785","name":"Google","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006785","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,5,2]]},"DOI":"10.1145\/3025453.3025769","type":"proceedings-article","created":{"date-parts":[[2017,5,3]],"date-time":"2017-05-03T12:34:28Z","timestamp":1493814868000},"page":"6825-6836","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Gut Instinct"],"prefix":"10.1145","author":[{"given":"Vineet","family":"Pandey","sequence":"first","affiliation":[{"name":"University of California, San Diego, La Jolla, CA, USA"}]},{"given":"Amnon","family":"Amir","sequence":"additional","affiliation":[{"name":"University of California, San Diego, La Jolla, CA, USA"}]},{"given":"Justine","family":"Debelius","sequence":"additional","affiliation":[{"name":"University of California, San Diego, La Jolla, CA, USA"}]},{"given":"Embriette R.","family":"Hyde","sequence":"additional","affiliation":[{"name":"University of California, San Diego, La Jolla, CA, USA"}]},{"given":"Tomasz","family":"Kosciolek","sequence":"additional","affiliation":[{"name":"University of California, San Diego, La Jolla, CA, USA"}]},{"given":"Rob","family":"Knight","sequence":"additional","affiliation":[{"name":"University of California, San Diego, La Jolla, CA, USA"}]},{"given":"Scott","family":"Klemmer","sequence":"additional","affiliation":[{"name":"University of California, San Diego, La Jolla, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2017,5,2]]},"reference":[{"volume-title":"Retrieved","year":"2015","key":"e_1_3_2_1_1_1","unstructured":"23andMe. 2015 . Something to Chew On . Retrieved December 31, 2016 from https:\/\/blog.23andme.com\/23andmeresearch\/somethingto-chew-on 23andMe. 2015. Something to Chew On. Retrieved December 31, 2016 from https:\/\/blog.23andme.com\/23andmeresearch\/somethingto-chew-on"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124782"},{"key":"e_1_3_2_1_3_1","volume-title":"reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321","author":"Ahn Luis Von","year":"2008","unstructured":"Luis Von Ahn , Benjamin Maurer , Colin Mcmillen , David Abraham , and Manuel Blum . 2008. reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321 , 12 September 2008 : 1465--1468. Luis Von Ahn, Benjamin Maurer, Colin Mcmillen, David Abraham, and Manuel Blum. 2008. reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321, 12 September 2008: 1465--1468."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1435344.1435346"},{"volume-title":"Retrieved","year":"2016","key":"e_1_3_2_1_5_1","unstructured":"Amazon. 2016 . Mechanical Turk . Retrieved December 31, 2016 from https:\/\/www.mturk.com Amazon. 2016. Mechanical Turk. Retrieved December 31, 2016 from https:\/\/www.mturk.com"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207687"},{"volume-title":"Retrieved","year":"2016","key":"e_1_3_2_1_7_1","unstructured":"Audubon. 2016 . Audubon Science. Using data to realize the best conservation outcomes . Retrieved December 31, 2016 from http:\/\/www.audubon.org\/conservation\/science\/christmas -bird-count Audubon. 2016. Audubon Science. Using data to realize the best conservation outcomes. Retrieved December 31, 2016 from http:\/\/www.audubon.org\/conservation\/science\/christmas -bird-count"},{"key":"e_1_3_2_1_8_1","volume-title":"Retrieved","author":"Bernstein Michael S.","year":"2012","unstructured":"Michael S. Bernstein . 2012 . Crowd-powered Systems . Retrieved December 31, 2016 from http:\/\/hci.stanford.edu\/msb\/files\/job_search\/researchstatement.pdf Michael S. Bernstein. 2012. Crowd-powered Systems. Retrieved December 31, 2016 from http:\/\/hci.stanford.edu\/msb\/files\/job_search\/researchstatement.pdf"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866078"},{"volume-title":"The Creative Mind: Myths and Mechanisms","author":"Boden Margaret A.","key":"e_1_3_2_1_10_1","unstructured":"Margaret A. Boden . 2004. \" The Story so far\". The Creative Mind: Myths and Mechanisms . Routledge . Margaret A. Boden. 2004. \"The Story so far\". The Creative Mind: Myths and Mechanisms. Routledge."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/105256299902300302"},{"volume-title":"Enhancing learning through selfassessment. Kogan Page","author":"Boud David","key":"e_1_3_2_1_12_1","unstructured":"David Boud . 1995. Enhancing learning through selfassessment. Kogan Page , London . David Boud. 1995. Enhancing learning through selfassessment. Kogan Page, London."},{"key":"e_1_3_2_1_13_1","volume-title":"Retrieved","author":"BudBurst Boulder Colorado Project","year":"2016","unstructured":"Project BudBurst Boulder Colorado . 2016 . Project BudBurst: An online database of plant phenological observations . Retrieved December 31, 2016 from http:\/\/budburst.org\/ Project BudBurst Boulder Colorado. 2016. Project BudBurst: An online database of plant phenological observations. Retrieved December 31, 2016 from http:\/\/budburst.org\/"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jebo.2013.03.003"},{"key":"e_1_3_2_1_15_1","first-page":"1","article-title":"Can Learners be Earners' Investigating a Design to Enable MOOC Learners to Apply their Skills and Earn Money in an Online Market Place","volume":"99","author":"Chen Guanliang","year":"2016","unstructured":"Guanliang Chen , Dan Davis , Markus Krause , Efthimia Aivaloglou , Claudia Hauff , and Geert-Jan Houben . 2016 . Can Learners be Earners' Investigating a Design to Enable MOOC Learners to Apply their Skills and Earn Money in an Online Market Place . IEEE Transactions on Learning Technologies PP , 99 : 1 . Guanliang Chen, Dan Davis, Markus Krause, Efthimia Aivaloglou, Claudia Hauff, and Geert-Jan Houben. 2016. Can Learners be Earners' Investigating a Design to Enable MOOC Learners to Apply their Skills and Earn Money in an Online Market Place. IEEE Transactions on Learning Technologies PP, 99: 1.","journal-title":"IEEE Transactions on Learning Technologies PP"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrg3182"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"The Human Microbiome Project Consortium. 2012. A framework for human microbiome research. Nature 486 7402: 215--221.  The Human Microbiome Project Consortium. 2012. A framework for human microbiome research. Nature 486 7402: 215--221.","DOI":"10.1038\/nature11209"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"crossref","unstructured":"The Human Microbiome Project Consortium. 2013. Structure Function and Diversity of the Healthy Human Microbiome. Nature 486 7402: 207--214.  The Human Microbiome Project Consortium. 2013. Structure Function and Diversity of the Healthy Human Microbiome. Nature 486 7402: 207--214.","DOI":"10.1038\/nature11234"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Seth Cooper Firas Khatib Adrien Treuille Janos Barbero Jeehyung Lee Michael Beenen Andrew Leaver-Fay David Baker Zoran Popovi\u0107 and Foldit Players. 2010. Predicting protein structures with a multiplayer online game. Nature 466 7307: 756--760.  Seth Cooper Firas Khatib Adrien Treuille Janos Barbero Jeehyung Lee Michael Beenen Andrew Leaver-Fay David Baker Zoran Popovi\u0107 and Foldit Players. 2010. Predicting protein structures with a multiplayer online game. Nature 466 7307: 756--760.","DOI":"10.1038\/nature09304"},{"key":"e_1_3_2_1_20_1","volume-title":"Retrieved","author":"Michael","year":"2016","unstructured":"Michael J. Coren and Fast Company. 2011. Foldit Gamers Solve Riddle of HIV Enzyme within 3 Weeks . Retrieved December 31, 2016 from https:\/\/www.scientificamerican.com\/article\/folditgamers-solve-riddle\/ Michael J. Coren and Fast Company. 2011. Foldit Gamers Solve Riddle of HIV Enzyme within 3 Weeks. Retrieved December 31, 2016 from https:\/\/www.scientificamerican.com\/article\/folditgamers-solve-riddle\/"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.1374249"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1128\/jmbe.v17i1.1034"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145355"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3182\/20091006-3-US-4006.00010"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470765"},{"key":"e_1_3_2_1_26_1","volume-title":"Gelman and Cristine H Legare","author":"Susan","year":"2011","unstructured":"Susan A. Gelman and Cristine H Legare . 2011 . Concepts and folk theories. Annu Rev Anthropol : 379-- 398. Susan A. Gelman and Cristine H Legare. 2011. Concepts and folk theories. Annu Rev Anthropol: 379-- 398."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"SR Gill Mihai Pop RT DeBoy and PB Eckburg. 2006. Metagenomic analysis of the human distal gut microbiome. Science 312 5778: 1355--1359.  SR Gill Mihai Pop RT DeBoy and PB Eckburg. 2006. Metagenomic analysis of the human distal gut microbiome. Science 312 5778: 1355--1359.","DOI":"10.1126\/science.1124234"},{"key":"e_1_3_2_1_28_1","unstructured":"Severin Benedict Hans Hacker. 2014. Duolingo: Learning a Language while Translating the Web. Ph.D Dissertation.  Severin Benedict Hans Hacker. 2014. Duolingo: Learning a Language while Translating the Web. Ph.D Dissertation."},{"key":"e_1_3_2_1_29_1","volume-title":"Most People are not WEIRD. Nature","author":"Henrich Joseph","year":"2010","unstructured":"Joseph Henrich , Steven J Heine , and Ara Norenzayan . 2010. Most People are not WEIRD. Nature 466, July 2010 . Joseph Henrich, Steven J Heine, and Ara Norenzayan. 2010. Most People are not WEIRD. Nature 466, July 2010."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1037\/1076-898X.5.2.205"},{"volume-title":"Democratizing innovation: The evolving phenomenon of user innovation","author":"von Hippel Eric","key":"e_1_3_2_1_31_1","unstructured":"Eric von Hippel . 2005. Democratizing innovation: The evolving phenomenon of user innovation . MIT Press . Eric von Hippel. 2005. Democratizing innovation: The evolving phenomenon of user innovation. MIT Press."},{"volume-title":"Eight Guidelines for Designing Virtual Citizen Science Projects. Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP '14)","author":"Jennett Charlene","key":"e_1_3_2_1_32_1","unstructured":"Charlene Jennett and Anna L. Cox . 2014 . Eight Guidelines for Designing Virtual Citizen Science Projects. Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP '14) : 16-- 17. Charlene Jennett and Anna L. Cox. 2014. Eight Guidelines for Designing Virtual Citizen Science Projects. Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP '14): 16-- 17."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0031362"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1001_3"},{"key":"e_1_3_2_1_36_1","volume-title":"Gut Check: Exploring Your Microbiome. Coursera. Retrieved","author":"Knight R.","year":"2016","unstructured":"R. Knight , J. Metcalf , and K. Amato . 2016 . Gut Check: Exploring Your Microbiome. Coursera. Retrieved December 31, 2016 from https:\/\/www.coursera.org\/learn\/microbiome R. Knight, J. Metcalf, and K. Amato. 2016. Gut Check: Exploring Your Microbiome. Coursera. Retrieved December 31, 2016 from https:\/\/www.coursera.org\/learn\/microbiome"},{"volume-title":"Login. Retrieved","year":"2016","key":"e_1_3_2_1_37_1","unstructured":"KnightLab. 2016 . American Gut Project . Login. Retrieved December 31, 2016 from http:\/\/microbio.me\/americangut\/ KnightLab. 2016. American Gut Project. Login. Retrieved December 31, 2016 from http:\/\/microbio.me\/americangut\/"},{"volume-title":"Retrieved","year":"2016","key":"e_1_3_2_1_38_1","unstructured":"KnightLab. 2016 . American Gut - What's in your gut ? Retrieved December 31, 2016 from http:\/\/americangut.org\/ KnightLab. 2016. American Gut - What's in your gut? Retrieved December 31, 2016 from http:\/\/americangut.org\/"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724676"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518927"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505057"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858144"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v4i1.13273"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1313039111"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702349"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979366"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.59.1.14"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675246"},{"volume-title":"Building Successful Online Communities: Evidence-based social design","author":"Resnick R.","key":"e_1_3_2_1_49_1","unstructured":"R. Resnick , P. and Kraut . 2011. Building Successful Online Communities: Evidence-based social design . MIT Press, Cambridge , MA. R. Resnick, P. and Kraut. 2011. Building Successful Online Communities: Evidence-based social design. MIT Press, Cambridge, MA."},{"key":"e_1_3_2_1_50_1","first-page":"31","article-title":"Problem based learning: An instructional model and its constructivist framework","volume":"35","author":"Savery John R","year":"1995","unstructured":"John R Savery and Thomas M Duffy . 1995 . Problem based learning: An instructional model and its constructivist framework . Educational Technology 35 , 5: 31 -- 38 . https:\/\/doi.org\/47405--1006 John R Savery and Thomas M Duffy. 1995. Problem based learning: An instructional model and its constructivist framework. Educational Technology 35, 5: 31--38. https:\/\/doi.org\/47405--1006","journal-title":"Educational Technology"},{"key":"e_1_3_2_1_51_1","volume-title":"By The Numbers: MOOCS","author":"Shah Dhawal","year":"2015","unstructured":"Dhawal Shah . 2015. By The Numbers: MOOCS in 2015 . Class Central. Retrieved from https:\/\/www.classcentral.com\/report\/moocs-2015-stats\/ Dhawal Shah. 2015. By The Numbers: MOOCS in 2015. Class Central. Retrieved from https:\/\/www.classcentral.com\/report\/moocs-2015-stats\/"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613751"},{"key":"e_1_3_2_1_53_1","unstructured":"James Surowiecki. 2005. The Wisdom of Crowds. Anchor.   James Surowiecki. 2005. The Wisdom of Crowds. Anchor."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702420"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"crossref","unstructured":"T Yatsunenko F E Rey M J Manary I Trehan M G Dominguez-Bello M Contreras M Magris G Hidalgo R N Baldassano A P Anokhin A C Heath B Warner J Reeder J Kuczynski J G Caporaso C A Lozupone C Lauber J C Clemente D Knights R Knight and J I Gordon. 2012. Human gut microbiome viewed across age and geography. Nature 486 7402: 222--227.  T Yatsunenko F E Rey M J Manary I Trehan M G Dominguez-Bello M Contreras M Magris G Hidalgo R N Baldassano A P Anokhin A C Heath B Warner J Reeder J Kuczynski J G Caporaso C A Lozupone C Lauber J C Clemente D Knights R Knight and J I Gordon. 2012. Human gut microbiome viewed across age and geography. Nature 486 7402: 222--227.","DOI":"10.1038\/nature11053"},{"key":"e_1_3_2_1_56_1","volume-title":"Collective Intelligence Conference: 1--8.","author":"Yu Lixiu","year":"2012","unstructured":"Lixiu Yu , Jeffrey V Nickerson , and Yasuaki Sakamoto . 2012 . Collective creativity: Where we are and where we might go . Collective Intelligence Conference: 1--8. Lixiu Yu, Jeffrey V Nickerson, and Yasuaki Sakamoto. 2012. Collective creativity: Where we are and where we might go. Collective Intelligence Conference: 1--8."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141753.1141807"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1038\/nm.3914"},{"volume-title":"Retrieved","year":"2007","key":"e_1_3_2_1_59_1","unstructured":"Zooniverse. 2007 . Galaxy Zoo . Retrieved December 31, 2016 from www.galaxyzoo.org Zooniverse. 2007. Galaxy Zoo. Retrieved December 31, 2016 from www.galaxyzoo.org"}],"event":{"name":"CHI '17: CHI Conference on Human Factors in Computing Systems","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Denver Colorado USA","acronym":"CHI '17"},"container-title":["Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3025453.3025769","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3025453.3025769","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:03:24Z","timestamp":1750215804000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3025453.3025769"}},"subtitle":["Creating Scientific Theories with Online Learners"],"short-title":[],"issued":{"date-parts":[[2017,5,2]]},"references-count":58,"alternative-id":["10.1145\/3025453.3025769","10.1145\/3025453"],"URL":"https:\/\/doi.org\/10.1145\/3025453.3025769","relation":{},"subject":[],"published":{"date-parts":[[2017,5,2]]},"assertion":[{"value":"2017-05-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}