{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:43:11Z","timestamp":1776116591378,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":62,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T00:00:00Z","timestamp":1620259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,6]]},"DOI":"10.1145\/3411764.3445668","type":"proceedings-article","created":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T02:33:36Z","timestamp":1620441216000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Galileo: Citizen-led Experimentation Using a Social Computing System"],"prefix":"10.1145","author":[{"given":"Vineet","family":"Pandey","sequence":"first","affiliation":[{"name":"Computer Science Harvard University, United States"}]},{"given":"Tushar","family":"Koul","sequence":"additional","affiliation":[{"name":"Design Lab UC San Diego, United States"}]},{"given":"Chen","family":"Yang","sequence":"additional","affiliation":[{"name":"Design Lab UC San Diego, United States"}]},{"given":"Daniel","family":"McDonald","sequence":"additional","affiliation":[{"name":"UCSD, United States"}]},{"given":"Mad","family":"Price Ball","sequence":"additional","affiliation":[{"name":"Open Humans Foundation, United States"}]},{"given":"Bastian","family":"Greshake Tzovaras","sequence":"additional","affiliation":[{"name":"Open Humans Foundation, United States"}]},{"given":"Rob","family":"Knight","sequence":"additional","affiliation":[{"name":"Department of Pediatrics UC San Diego, United States"}]},{"given":"Scott","family":"Klemmer","sequence":"additional","affiliation":[{"name":"Design Lab UC San Diego, United States"}]}],"member":"320","published-online":{"date-parts":[[2021,5,7]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Engineering, and Medicine","author":"National Academies of Sciences","year":"2018","unstructured":"National Academies of Sciences , Engineering, and Medicine . 2018 . Learning through citizen science: enhancing opportunities by design. National Academies Press . National Academies of Sciences , Engineering, and Medicine. 2018. Learning through citizen science: enhancing opportunities by design. National Academies Press."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"crossref","unstructured":"Tim Althoff Rok Sosi\u010d Jennifer L. Hicks Abby C. King Scott L. Delp and Jure Leskovec. 2017. Large-scale physical activity data reveal worldwide activity inequality. Nature 547 7663: 336\u2013339. Tim Althoff Rok Sosi\u010d Jennifer L. Hicks Abby C. King Scott L. Delp and Jure Leskovec. 2017. Large-scale physical activity data reveal worldwide activity inequality. Nature 547 7663: 336\u2013339.","DOI":"10.1038\/nature23018"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047201"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1525\/bio.2009.59.11.9"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2966.2009.15383.x"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jebo.2013.03.003"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"crossref","unstructured":"William G Chase and Herbert A Simon. 1973. Perception in chess. Cognitive psychology 4 1: 55\u201381. William G Chase and Herbert A Simon. 1973. Perception in chess. Cognitive psychology 4 1: 55\u201381.","DOI":"10.1016\/0010-0285(73)90004-2"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300761"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531635"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.3390\/nu7010390"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0106508"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Seth Cooper Firas Khatib Adrien Treuille and Et Al. 2010. Predicting protein structures with a multiplayer online game. Nature 466 7307: 756\u2013760. Seth Cooper Firas Khatib Adrien Treuille and Et Al. 2010. Predicting protein structures with a multiplayer online game. Nature 466 7307: 756\u2013760.","DOI":"10.1038\/nature09304"},{"key":"e_1_3_2_2_13_1","volume-title":"Fowler","author":"Coviello Lorenzo","year":"2014","unstructured":"Lorenzo Coviello , Yunkyu Sohn , Adam D.I. Kramer , Cameron Marlow , Massimo Franceschetti , Nicholas A. Christakis , and James H . Fowler . 2014 . Detecting emotional contagion in massive social networks. PLoS ONE. Lorenzo Coviello, Yunkyu Sohn, Adam D.I. Kramer, Cameron Marlow, Massimo Franceschetti, Nicholas A. Christakis, and James H. Fowler. 2014. Detecting emotional contagion in massive social networks. PLoS ONE."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130911"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145355"},{"key":"e_1_3_2_2_16_1","first-page":"213","article-title":"What having a \u201cgrowth mindset\u201d actually means","volume":"13","author":"Dweck Carol","year":"2016","unstructured":"Carol Dweck . 2016 . What having a \u201cgrowth mindset\u201d actually means . Harvard Business Review 13 : 213 \u2013 226 . Carol Dweck. 2016. What having a \u201cgrowth mindset\u201d actually means. Harvard Business Review 13: 213\u2013226.","journal-title":"Harvard Business Review"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/acer.12006"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"crossref","unstructured":"Randall W Engle. 2002. Working memory capacity as executive attention. Current directions in psychological science 11 1: 19\u201323. Randall W Engle. 2002. Working memory capacity as executive attention. Current directions in psychological science 11 1: 19\u201323.","DOI":"10.1111\/1467-8721.00160"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1159\/000071667"},{"key":"e_1_3_2_2_20_1","unstructured":"f.lux. 2019. f.lux: sleep research. Retrieved from justgetflux.com\/research.html f.lux. 2019. f.lux: sleep research. Retrieved from justgetflux.com\/research.html"},{"key":"e_1_3_2_2_21_1","article-title":"Why journalists report science as they do","author":"Fj\u00e6stad Bj\u00f6rn","year":"2007","unstructured":"Bj\u00f6rn Fj\u00e6stad . 2007 . Why journalists report science as they do . Journalism, science and society: 123. Bj\u00f6rn Fj\u00e6stad. 2007. Why journalists report science as they do. Journalism, science and society: 123.","journal-title":"Journalism, science and society: 123."},{"key":"e_1_3_2_2_22_1","unstructured":"James Paul Gee. 2005. Semiotic social spaces and affinity spaces. Beyond communities of practice language power and social context 214232. James Paul Gee. 2005. Semiotic social spaces and affinity spaces. Beyond communities of practice language power and social context 214232."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Fiona Godlee Jane Smith and Harvey Marcovitch. 2011. Wakefield's article linking MMR vaccine and autism was fraudulent. BMJ 342. Fiona Godlee Jane Smith and Harvey Marcovitch. 2011. Wakefield's article linking MMR vaccine and autism was fraudulent. BMJ 342.","DOI":"10.1136\/bmj.c7452"},{"key":"e_1_3_2_2_24_1","volume-title":"The data journalism handbook: How journalists can use data to improve the news","author":"Gray Jonathan","unstructured":"Jonathan Gray , Lucy Chambers , and Liliana Bounegru . 2012. The data journalism handbook: How journalists can use data to improve the news . O'Reilly Media, Inc. Jonathan Gray, Lucy Chambers, and Liliana Bounegru. 2012. The data journalism handbook: How journalists can use data to improve the news. O'Reilly Media, Inc."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"crossref","unstructured":"John D Hansen and Justin Reich. 2015. Democratizing education? Examining access and usage patterns in massive open online courses. Science 350 6265: 1245\u20131248. John D Hansen and Justin Reich. 2015. Democratizing education? Examining access and usage patterns in massive open online courses. Science 350 6265: 1245\u20131248.","DOI":"10.1126\/science.aab3782"},{"key":"e_1_3_2_2_26_1","unstructured":"National Institute of Health. 2018. Colloidal Silver | NCCIH. Retrieved from http:\/\/nccih.nih.gov\/health\/silver National Institute of Health. 2018. Colloidal Silver | NCCIH. Retrieved from http:\/\/nccih.nih.gov\/health\/silver"},{"key":"e_1_3_2_2_27_1","volume-title":"Citizen science: innovation in open science, society and policy","author":"Hecker Susanne","unstructured":"Susanne Hecker , Muki Haklay , Anne Bowser , Zen Makuch , and Johannes Vogel . 2018. Citizen science: innovation in open science, society and policy . UCL Press . Susanne Hecker, Muki Haklay, Anne Bowser, Zen Makuch, and Johannes Vogel. 2018. Citizen science: innovation in open science, society and policy. UCL Press."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Eric von Hippel. 2005. Democratizing innovation: The evolving phenomenon of user innovation. MIT. Eric von Hippel. 2005. Democratizing innovation: The evolving phenomenon of user innovation. MIT.","DOI":"10.7551\/mitpress\/2333.001.0001"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2598510.2598539"},{"key":"e_1_3_2_2_30_1","volume-title":"Not an Encyclopedia: A Social Network Perspective on Wikipedia Collaboration","author":"Kane Gerald C","unstructured":"Gerald C Kane . 2009. It's a Network , Not an Encyclopedia: A Social Network Perspective on Wikipedia Collaboration . In Academy of management proceedings, 1\u20136. Gerald C Kane. 2009. It's a Network, Not an Encyclopedia: A Social Network Perspective on Wikipedia Collaboration. In Academy of management proceedings, 1\u20136."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025480"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858289"},{"key":"e_1_3_2_2_33_1","unstructured":"Paul A Kirschner and Jeroen Van Merri\u00ebnboer. 2008. Ten steps to complex learning a new approach to instruction and instructional design. Paul A Kirschner and Jeroen Van Merri\u00ebnboer. 2008. Ten steps to complex learning a new approach to instruction and instructional design."},{"key":"e_1_3_2_2_34_1","volume-title":"Gut Check: Exploring Your Microbiome. Coursera.","author":"Knight Rob","year":"2016","unstructured":"Rob Knight , J. Metcalf , and K. Amato . 2016 . Gut Check: Exploring Your Microbiome. Coursera. Retrieved from https:\/\/www.coursera.org\/learn\/microbiome Rob Knight, J. Metcalf, and K. Amato. 2016. Gut Check: Exploring Your Microbiome. Coursera. Retrieved from https:\/\/www.coursera.org\/learn\/microbiome"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274364"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724670"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380122"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3325480.3326582"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v4i1.13273"},{"key":"e_1_3_2_2_41_1","unstructured":"Jayne Leonard. 2016. 15 Reasons You Need A Bottle Of Colloidal Silver In Your Home. Retrieved from naturallivingideas.com\/colloidal-silver-benefits-and-uses\/ Jayne Leonard. 2016. 15 Reasons You Need A Bottle Of Colloidal Silver In Your Home. Retrieved from naturallivingideas.com\/colloidal-silver-benefits-and-uses\/"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1177\/1932296816665635"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518741"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240840"},{"key":"e_1_3_2_2_45_1","unstructured":"D. W. Martin. 2007. Doing psychology experiments. Cengage Learning. D. W. Martin. 2007. Doing psychology experiments. Cengage Learning."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173583"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"crossref","unstructured":"Daniel McDonald Embriette Hyde Justine W Debelius James T Morton Antonio Gonzalez Gail Ackermann Alexander A Aksenov Bahar Behsaz Caitriona Brennan and Yingfeng Chen. 2018. American Gut: an Open Platform for Citizen Science Microbiome Research. mSystems 3 3: e00031-18. Daniel McDonald Embriette Hyde Justine W Debelius James T Morton Antonio Gonzalez Gail Ackermann Alexander A Aksenov Bahar Behsaz Caitriona Brennan and Yingfeng Chen. 2018. American Gut: an Open Platform for Citizen Science Microbiome Research. mSystems 3 3: e00031-18.","DOI":"10.1128\/mSystems.00031-18"},{"key":"e_1_3_2_2_48_1","unstructured":"UK National Council for Voluntary Organisations. 2018. Why Volunteer? Retrieved from ncvo.org.uk\/ncvo-volunteering\/why-volunteer UK National Council for Voluntary Organisations. 2018. Why Volunteer? Retrieved from ncvo.org.uk\/ncvo-volunteering\/why-volunteer"},{"key":"e_1_3_2_2_49_1","unstructured":"NIH. 2015. NIH Clinical Trials Research and You. Retrieved from nih.gov\/health-information\/nih-clinical-research-trials-you\/basics NIH. 2015. NIH Clinical Trials Research and You. Retrieved from nih.gov\/health-information\/nih-clinical-research-trials-you\/basics"},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025769"},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3231644.3231646"},{"key":"e_1_3_2_2_52_1","unstructured":"Michael J Breus Ph.D. Alcohol and Sleep: What You Need to Know. Psychology Today. Retrieved from psychologytoday.com\/us\/blog\/sleep-newzzz\/201801\/alcohol-and-sleep-what-you-need-know Michael J Breus Ph.D. Alcohol and Sleep: What You Need to Know. Psychology Today. Retrieved from psychologytoday.com\/us\/blog\/sleep-newzzz\/201801\/alcohol-and-sleep-what-you-need-know"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557052"},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675246"},{"key":"e_1_3_2_2_55_1","volume-title":"CrowdLayout. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI \u201918 (CHI \u201918)","author":"Singh Divit P","year":"2018","unstructured":"Divit P Singh , Lee Lisle , T M Murali , and Kurt Luther . 2018 . CrowdLayout. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI \u201918 (CHI \u201918) , 1\u201314. Divit P Singh, Lee Lisle, T M Murali, and Kurt Luther. 2018. CrowdLayout. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI \u201918 (CHI \u201918), 1\u201314."},{"key":"e_1_3_2_2_56_1","first-page":"40","article-title":"Building a culture of experimentation","volume":"98","author":"Thomke Stefan","year":"2020","unstructured":"Stefan Thomke . 2020 . Building a culture of experimentation . Harvard Business Review 98 , 2: 40 \u2013 47 . Stefan Thomke. 2020. Building a culture of experimentation. Harvard Business Review 98, 2: 40\u201347.","journal-title":"Harvard Business Review"},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274447"},{"key":"e_1_3_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.1837"},{"key":"e_1_3_2_2_59_1","unstructured":"Wikipedia. Community Insights\/2018 Report. 2018. Retrieved from https:\/\/meta.wikimedia.org\/wiki\/Community_Insights\/2018_Report#What_progress_has_been_made_in_the_diversity_of_Wikimedia_communities Wikipedia. Community Insights\/2018 Report. 2018. Retrieved from https:\/\/meta.wikimedia.org\/wiki\/Community_Insights\/2018_Report#What_progress_has_been_made_in_the_diversity_of_Wikimedia_communities"},{"key":"e_1_3_2_2_60_1","unstructured":"Wikipedia. 2018. Bristol stool scale. Retrieved from en.wikipedia.org\/wiki\/Bristol_stool_scale Wikipedia. 2018. Bristol stool scale. Retrieved from en.wikipedia.org\/wiki\/Bristol_stool_scale"},{"key":"e_1_3_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979407"},{"key":"e_1_3_2_2_62_1","volume-title":"Retrieved","year":"2007","unstructured":"Zooniverse. 2007 . Galaxy Zoo . Retrieved December 31, 2016 from galaxyzoo.org Zooniverse. 2007. Galaxy Zoo. Retrieved December 31, 2016 from galaxyzoo.org"}],"event":{"name":"CHI '21: CHI Conference on Human Factors in Computing Systems","location":"Yokohama Japan","acronym":"CHI '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445668","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411764.3445668","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:38Z","timestamp":1750195718000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445668"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,6]]},"references-count":62,"alternative-id":["10.1145\/3411764.3445668","10.1145\/3411764"],"URL":"https:\/\/doi.org\/10.1145\/3411764.3445668","relation":{},"subject":[],"published":{"date-parts":[[2021,5,6]]},"assertion":[{"value":"2021-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}