{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T02:14:49Z","timestamp":1772590489049,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":94,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T00:00:00Z","timestamp":1651190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,29]]},"DOI":"10.1145\/3491102.3517707","type":"proceedings-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T16:33:27Z","timestamp":1651163607000},"page":"1-15","source":"Crossref","is-referenced-by-count":5,"title":["Ap\u00e9ritif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods Descriptions"],"prefix":"10.1145","author":[{"given":"Yuren","family":"Pang","sequence":"first","affiliation":[{"name":"Paul G. Allen School of Computer Science and Engineering, University of Washington, United States"}]},{"given":"Katharina","family":"Reinecke","sequence":"additional","affiliation":[{"name":"Paul G. Allen School of Computer Science and Engineering, University of Washington, United States"}]},{"given":"Ren\u00e9","family":"Just","sequence":"additional","affiliation":[{"name":"Paul G. Allen School of Computer Science and Engineering, University of Washington, United States"}]}],"member":"320","published-online":{"date-parts":[[2022,4,29]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"2021. Heroku. Retrieved 2021-09-08 from https:\/\/www.heroku.com\/  2021. Heroku. Retrieved 2021-09-08 from https:\/\/www.heroku.com\/"},{"key":"e_1_3_2_2_2_1","unstructured":"2021. MongoDB. Retrieved 2021-09-08 from https:\/\/www.mongodb.com\/  2021. MongoDB. Retrieved 2021-09-08 from https:\/\/www.mongodb.com\/"},{"key":"e_1_3_2_2_3_1","unstructured":"2021. Statsmodels. Retrieved 2022-12-30 from https:\/\/www.statsmodels.org  2021. Statsmodels. Retrieved 2022-12-30 from https:\/\/www.statsmodels.org"},{"key":"e_1_3_2_2_4_1","unstructured":"Anne Adams Peter Lunt and Paul Cairns. 2008. A qualititative approach to HCI research. (2008).  Anne Adams Peter Lunt and Paul Cairns. 2008. A qualititative approach to HCI research. (2008)."},{"key":"e_1_3_2_2_5_1","unstructured":"David Thomas\u00a0Mellor Alexandra\u00a0Hartman Florian\u00a0Kern. 2018. Preregistration for Qualitative Research Template. Retrieved Accessed: 2021-12-30 from https:\/\/osf.io\/j7ghv\/  David Thomas\u00a0Mellor Alexandra\u00a0Hartman Florian\u00a0Kern. 2018. Preregistration for Qualitative Research Template. Retrieved Accessed: 2021-12-30 from https:\/\/osf.io\/j7ghv\/"},{"key":"e_1_3_2_2_6_1","unstructured":"American\u00a0Economic Association. 2012. American Economic Association\u2019s registry for randomized controlled trials. Retrieved Accessed: 2021-09-08 from https:\/\/www.socialscienceregistry.org  American\u00a0Economic Association. 2012. American Economic Association\u2019s registry for randomized controlled trials. Retrieved Accessed: 2021-09-08 from https:\/\/www.socialscienceregistry.org"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445584"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3310432"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0003055419000194"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858498"},{"key":"e_1_3_2_2_11_1","first-page":"1","article-title":"HCI... not as it should be: inferential statistics in HCI research. In Proceedings of HCI 2007 The 21st British HCI Group Annual Conference University of Lancaster","volume":"21","author":"Cairns Paul","year":"2007","unstructured":"Paul Cairns . 2007 . HCI... not as it should be: inferential statistics in HCI research. In Proceedings of HCI 2007 The 21st British HCI Group Annual Conference University of Lancaster , UK 21. 1 \u2013 7 . Paul Cairns. 2007. HCI... not as it should be: inferential statistics in HCI research. In Proceedings of HCI 2007 The 21st British HCI Group Annual Conference University of Lancaster, UK 21. 1\u20137.","journal-title":"UK"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.3934\/Neuroscience.2014.1.4"},{"key":"e_1_3_2_2_13_1","volume-title":"Sara Lucia Brazuna\u00a0Tavares Gomes","author":"Claesen Aline","year":"2019","unstructured":"Aline Claesen , Sara Lucia Brazuna\u00a0Tavares Gomes , 2019 . Preregistration : Comparing dream to reality. (2019). Aline Claesen, Sara Lucia Brazuna\u00a0Tavares Gomes, 2019. Preregistration: Comparing dream to reality. (2019)."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360311"},{"key":"e_1_3_2_2_15_1","volume-title":"HARK No More: On the Preregistration of CHI Experiments","author":"Cockburn Andy","unstructured":"Andy Cockburn , Carl Gutwin , and Alan Dix . 2018. HARK No More: On the Preregistration of CHI Experiments . Association for Computing Machinery , New York, NY, USA , 1\u201312. https:\/\/doi.org\/10.1145\/3173574.3173715 Andy Cockburn, Carl Gutwin, and Alan Dix. 2018. HARK No More: On the Preregistration of CHI Experiments. Association for Computing Machinery, New York, NY, USA, 1\u201312. https:\/\/doi.org\/10.1145\/3173574.3173715"},{"key":"e_1_3_2_2_16_1","volume-title":"Statistical power analysis for the behavioral sciences","author":"Cohen Jacob","unstructured":"Jacob Cohen . 2013. Statistical power analysis for the behavioral sciences . Academic press . Jacob Cohen. 2013. Statistical power analysis for the behavioral sciences. Academic press."},{"key":"e_1_3_2_2_17_1","volume-title":"2020 Online Mining Software\u00a0Repositories Conference. [n.d.]. Registered Reports (MSR 2020","author":"The","year":"2021","unstructured":"The 2020 Online Mining Software\u00a0Repositories Conference. [n.d.]. Registered Reports (MSR 2020 ). Retrieved Accessed : 2021 -09-09 from https:\/\/2020.msrconf.org\/track\/msr-2020-Registered-Reports? The 2020 Online Mining Software\u00a0Repositories Conference. [n.d.]. Registered Reports (MSR 2020). Retrieved Accessed: 2021-09-09 from https:\/\/2020.msrconf.org\/track\/msr-2020-Registered-Reports?"},{"key":"e_1_3_2_2_18_1","volume-title":"Congress. [n.d.]. Food and Drug Administration Amendments Act of 2007 (FDAAA).","author":"US","unstructured":"US Congress. [n.d.]. Food and Drug Administration Amendments Act of 2007 (FDAAA). US Congress. [n.d.]. Food and Drug Administration Amendments Act of 2007 (FDAAA)."},{"key":"e_1_3_2_2_19_1","volume-title":"Targeting Next Generations to Change the Common Practice of Underpowered Research. Frontiers in psychology 8","author":"Crutzen Rik","year":"2017","unstructured":"Rik Crutzen and Gjalt-Jorn\u00a0 Y Peters . 2017. Targeting Next Generations to Change the Common Practice of Underpowered Research. Frontiers in psychology 8 ( 2017 ), 1184. Rik Crutzen and Gjalt-Jorn\u00a0Y Peters. 2017. Targeting Next Generations to Change the Common Practice of Underpowered Research. Frontiers in psychology 8 (2017), 1184."},{"key":"e_1_3_2_2_20_1","volume-title":"Preregistration: A plan, not a prison. Retrieved October 29(2017)","author":"DeHaven Alexander","year":"2017","unstructured":"Alexander DeHaven . 2017 . Preregistration: A plan, not a prison. Retrieved October 29(2017) , 2019. Alexander DeHaven. 2017. Preregistration: A plan, not a prison. Retrieved October 29(2017), 2019."},{"key":"e_1_3_2_2_21_1","volume-title":"Preregistration of exploratory research: Learning from the golden age of discovery. PLoS biology 18, 3","author":"Dirnagl Ulrich","year":"2020","unstructured":"Ulrich Dirnagl . 2020. Preregistration of exploratory research: Learning from the golden age of discovery. PLoS biology 18, 3 ( 2020 ), e3000690. Ulrich Dirnagl. 2020. Preregistration of exploratory research: Learning from the golden age of discovery. PLoS biology 18, 3 (2020), e3000690."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.2200\/S00974ED1V01Y201912HCI044"},{"key":"e_1_3_2_2_23_1","volume-title":"Fair Statistical Communication in HCI","author":"Dragicevic Pierre","unstructured":"Pierre Dragicevic . 2016. Fair Statistical Communication in HCI . In MModern Statistical Methods for HCI. Springer , 291\u2013330. Pierre Dragicevic. 2016. Fair Statistical Communication in HCI. In MModern Statistical Methods for HCI. Springer, 291\u2013330."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300295"},{"key":"e_1_3_2_2_25_1","volume-title":"Touchstone2: An Interactive Environment for Exploring Trade-Offs in HCI Experiment Design(CHI \u201919)","author":"Eiselmayer Alexander","unstructured":"Alexander Eiselmayer , Chat Wacharamanotham , Michel Beaudouin-Lafon , and Wendy\u00a0 E. Mackay . 2019. Touchstone2: An Interactive Environment for Exploring Trade-Offs in HCI Experiment Design(CHI \u201919) . Association for Computing Machinery , New York, NY, USA , 1\u201311. https:\/\/doi.org\/10.1145\/3290605.3300447 Alexander Eiselmayer, Chat Wacharamanotham, Michel Beaudouin-Lafon, and Wendy\u00a0E. Mackay. 2019. Touchstone2: An Interactive Environment for Exploring Trade-Offs in HCI Experiment Design(CHI \u201919). Association for Computing Machinery, New York, NY, USA, 1\u201311. https:\/\/doi.org\/10.1145\/3290605.3300447"},{"key":"e_1_3_2_2_26_1","unstructured":"Association for Computing Machinery\u00a0(ACM). [n.d.]. Artifact Review and Badging. Retrieved Accessed: 2021-09-08 from https:\/\/www.acm.org\/publications\/policies\/artifact-review-and-badging-current  Association for Computing Machinery\u00a0(ACM). [n.d.]. Artifact Review and Badging. Retrieved Accessed: 2021-09-08 from https:\/\/www.acm.org\/publications\/policies\/artifact-review-and-badging-current"},{"key":"e_1_3_2_2_27_1","unstructured":"Center for Open\u00a0Science. 2011. Open Science Badges enhance openness a core value of scientific practice.Retrieved Accessed: 2021-09-08 from https:\/\/www.cos.io\/initiatives\/badges?_ga=2.74055258.93961764.1630280699-1403603742.1629748234  Center for Open\u00a0Science. 2011. Open Science Badges enhance openness a core value of scientific practice.Retrieved Accessed: 2021-09-08 from https:\/\/www.cos.io\/initiatives\/badges?_ga=2.74055258.93961764.1630280699-1403603742.1629748234"},{"key":"e_1_3_2_2_28_1","unstructured":"Center for Open\u00a0Science. 2011. Open Science Framework. Retrieved Accessed: 2021-09-08 from https:\/\/osf.io  Center for Open\u00a0Science. 2011. Open Science Framework. Retrieved Accessed: 2021-09-08 from https:\/\/osf.io"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.5195\/jmla.2017.88"},{"key":"e_1_3_2_2_30_1","volume-title":"\u201cfishing expedition","author":"Gelman Andrew","year":"2013","unstructured":"Andrew Gelman and Eric Loken . 2013. The garden of forking paths: Why multiple comparisons can be a problem, even when there is no \u201cfishing expedition \u201d or \u201cp-hacking\u201d and the research hypothesis was posited ahead of time. Department of Statistics, Columbia University 348 ( 2013 ). Andrew Gelman and Eric Loken. 2013. The garden of forking paths: Why multiple comparisons can be a problem, even when there is no \u201cfishing expedition\u201d or \u201cp-hacking\u201d and the research hypothesis was posited ahead of time. Department of Statistics, Columbia University 348 (2013)."},{"key":"e_1_3_2_2_31_1","volume-title":"Reducing waste from incomplete or unusable reports of biomedical research. The Lancet 383, 9913","author":"Glasziou Paul","year":"2014","unstructured":"Paul Glasziou , Douglas\u00a0 G Altman , Patrick Bossuyt , Isabelle Boutron , Mike Clarke , Steven Julious , Susan Michie , David Moher , and Elizabeth Wager . 2014. Reducing waste from incomplete or unusable reports of biomedical research. The Lancet 383, 9913 ( 2014 ), 267\u2013276. Paul Glasziou, Douglas\u00a0G Altman, Patrick Bossuyt, Isabelle Boutron, Mike Clarke, Steven Julious, Susan Michie, David Moher, and Elizabeth Wager. 2014. Reducing waste from incomplete or unusable reports of biomedical research. The Lancet 383, 9913 (2014), 267\u2013276."},{"key":"e_1_3_2_2_32_1","volume-title":"O\u2019Reilly Media","author":"Grinberg Miguel","unstructured":"Miguel Grinberg . 2018. Flask web development: developing web applications with python . \u201d O\u2019Reilly Media , Inc .\u201d. Miguel Grinberg. 2018. Flask web development: developing web applications with python. \u201d O\u2019Reilly Media, Inc.\u201d."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240826"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/1609406920976417"},{"key":"e_1_3_2_2_35_1","unstructured":"Transparent\u00a0Statistics in Human\u2013Computer Interaction Working\u00a0Group. 2019. Transparent Statistics Guidelines. https:\/\/doi.org\/10.5281\/zenodo.1186169 (Available at https:\/\/transparentstats.github.io\/guidelines).  Transparent\u00a0Statistics in Human\u2013Computer Interaction Working\u00a0Group. 2019. Transparent Statistics Guidelines. https:\/\/doi.org\/10.5281\/zenodo.1186169 (Available at https:\/\/transparentstats.github.io\/guidelines)."},{"key":"e_1_3_2_2_36_1","unstructured":"Berkeley Institute of Governmental Studies at the University\u00a0of California. 2020. Evidence in Governance and Politics. Retrieved Accessed: 2021-09-08 from https:\/\/egap.org\/  Berkeley Institute of Governmental Studies at the University\u00a0of California. 2020. Evidence in Governance and Politics. Retrieved Accessed: 2021-09-08 from https:\/\/egap.org\/"},{"key":"e_1_3_2_2_37_1","volume-title":"Why Most Published Research Findings Are False. PLoS medicine 2, 8","author":"Ioannidis PA","year":"2005","unstructured":"John\u00a0 PA Ioannidis . 2005. Why Most Published Research Findings Are False. PLoS medicine 2, 8 ( 2005 ), e124. John\u00a0PA Ioannidis. 2005. Why Most Published Research Findings Are False. PLoS medicine 2, 8 (2005), e124."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1537592720001164"},{"key":"e_1_3_2_2_39_1","volume-title":"Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling. Psychological science 23, 5","author":"John K","year":"2012","unstructured":"Leslie\u00a0 K John , George Loewenstein , and Drazen Prelec . 2012. Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling. Psychological science 23, 5 ( 2012 ), 524\u2013532. Leslie\u00a0K John, George Loewenstein, and Drazen Prelec. 2012. Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling. Psychological science 23, 5 (2012), 524\u2013532."},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476980"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347940"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0132382"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2886442"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3027084"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858465"},{"key":"e_1_3_2_2_46_1","volume-title":"HARKing: Hypothesizing After the Results are Known. Personality and social psychology review 2, 3","author":"Kerr L","year":"1998","unstructured":"Norbert\u00a0 L Kerr . 1998. HARKing: Hypothesizing After the Results are Known. Personality and social psychology review 2, 3 ( 1998 ), 196\u2013217. Norbert\u00a0L Kerr. 1998. HARKing: Hypothesizing After the Results are Known. Personality and social psychology review 2, 3 (1998), 196\u2013217."},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300322"},{"key":"e_1_3_2_2_48_1","unstructured":"Goran Kne\u017eevi\u0107 Ljiljana\u00a0B Lazarevic and Michael Bosnjak. [n.d.]. As Predicted PreRegistration. ([n. d.]).  Goran Kne\u017eevi\u0107 Ljiljana\u00a0B Lazarevic and Michael Bosnjak. [n.d.]. As Predicted PreRegistration. ([n. d.])."},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1080\/08989621.2019.1580147"},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1049096516002365"},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173610"},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445488"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347908"},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376533"},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.3028985"},{"key":"e_1_3_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3427323"},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240840"},{"key":"e_1_3_2_2_58_1","doi-asserted-by":"crossref","unstructured":"Xiaojun Meng Pin\u00a0Sym Foong Simon\u00a0Tangi Perrault and Shengdong Zhao. 2017. NexP: A Beginner Friendly Toolkit for Designing and Conducting Controlled Experiments. In INTERACT.  Xiaojun Meng Pin\u00a0Sym Foong Simon\u00a0Tangi Perrault and Shengdong Zhao. 2017. NexP: A Beginner Friendly Toolkit for Designing and Conducting Controlled Experiments. In INTERACT.","DOI":"10.1007\/978-3-319-67687-6_10"},{"key":"e_1_3_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1049096515000189"},{"key":"e_1_3_2_2_60_1","volume-title":"A manifesto for reproducible science. Nature human behaviour 1, 1","author":"Munaf\u00f2 R","year":"2017","unstructured":"Marcus\u00a0 R Munaf\u00f2 , Brian\u00a0 A Nosek , Dorothy\u00a0 VM Bishop , Katherine\u00a0 S Button , Christopher\u00a0 D Chambers , Nathalie\u00a0Percie Du\u00a0Sert , Uri Simonsohn , Eric-Jan Wagenmakers , Jennifer\u00a0 J Ware , and John\u00a0 PA Ioannidis . 2017. A manifesto for reproducible science. Nature human behaviour 1, 1 ( 2017 ), 1\u20139. Marcus\u00a0R Munaf\u00f2, Brian\u00a0A Nosek, Dorothy\u00a0VM Bishop, Katherine\u00a0S Button, Christopher\u00a0D Chambers, Nathalie\u00a0Percie Du\u00a0Sert, Uri Simonsohn, Eric-Jan Wagenmakers, Jennifer\u00a0J Ware, and John\u00a0PA Ioannidis. 2017. A manifesto for reproducible science. Nature human behaviour 1, 1 (2017), 1\u20139."},{"key":"e_1_3_2_2_61_1","volume-title":"Promoting an open research culture. Science 348, 6242","author":"Nosek A","year":"2015","unstructured":"Brian\u00a0 A Nosek , George Alter , George\u00a0 C Banks , Denny Borsboom , Sara\u00a0 D Bowman , Steven\u00a0 J Breckler , Stuart Buck , Christopher\u00a0 D Chambers , Gilbert Chin , Garret Christensen , 2015. Promoting an open research culture. Science 348, 6242 ( 2015 ), 1422\u20131425. Brian\u00a0A Nosek, George Alter, George\u00a0C Banks, Denny Borsboom, Sara\u00a0D Bowman, Steven\u00a0J Breckler, Stuart Buck, Christopher\u00a0D Chambers, Gilbert Chin, Garret Christensen, 2015. Promoting an open research culture. Science 348, 6242 (2015), 1422\u20131425."},{"key":"e_1_3_2_2_62_1","volume-title":"Anna\u00a0E van\u2019t Veer, and Simine Vazire","author":"Nosek A","year":"2019","unstructured":"Brian\u00a0 A Nosek , Emorie\u00a0 D Beck , Lorne Campbell , Jessica\u00a0 K Flake , Tom\u00a0 E Hardwicke , David\u00a0 T Mellor , Anna\u00a0E van\u2019t Veer, and Simine Vazire . 2019 . Preregistration is hard, and worthwhile. Trends in cognitive sciences 23, 10 (2019), 815\u2013818. Brian\u00a0A Nosek, Emorie\u00a0D Beck, Lorne Campbell, Jessica\u00a0K Flake, Tom\u00a0E Hardwicke, David\u00a0T Mellor, Anna\u00a0E van\u2019t Veer, and Simine Vazire. 2019. Preregistration is hard, and worthwhile. Trends in cognitive sciences 23, 10 (2019), 815\u2013818."},{"key":"e_1_3_2_2_63_1","volume-title":"Addressing the theory crisis in psychology. Psychonomic bulletin & review 26, 5","author":"Oberauer Klaus","year":"2019","unstructured":"Klaus Oberauer and Stephan Lewandowsky . 2019. Addressing the theory crisis in psychology. Psychonomic bulletin & review 26, 5 ( 2019 ), 1596\u20131618. Klaus Oberauer and Stephan Lewandowsky. 2019. Addressing the theory crisis in psychology. Psychonomic bulletin & review 26, 5 (2019), 1596\u20131618."},{"key":"e_1_3_2_2_64_1","volume-title":"National\u00a0Library of Medicine. [n.d.]. ClinicalTrials.gov. Retrieved","author":"S.","year":"2021","unstructured":"U. S. National\u00a0Library of Medicine. [n.d.]. ClinicalTrials.gov. Retrieved September 8, 2021 from https:\/\/clinicaltrials.gov U.S. National\u00a0Library of Medicine. [n.d.]. ClinicalTrials.gov. Retrieved September 8, 2021 from https:\/\/clinicaltrials.gov"},{"key":"e_1_3_2_2_65_1","unstructured":"Wharton\u00a0School of\u00a0the University\u00a0of Pennsylvania. 2017. AsPredicted. Retrieved Accessed: 2021-09-08 from https:\/\/aspredicted.org  Wharton\u00a0School of\u00a0the University\u00a0of Pennsylvania. 2017. AsPredicted. Retrieved Accessed: 2021-09-08 from https:\/\/aspredicted.org"},{"key":"e_1_3_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.29.3.61"},{"key":"e_1_3_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025769"},{"key":"e_1_3_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3401335.3401814"},{"key":"e_1_3_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1002\/jcpy.1209"},{"key":"e_1_3_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3312862"},{"key":"e_1_3_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03195449"},{"key":"e_1_3_2_2_72_1","volume-title":"Pedagogical Strategies for Reflection in Project-Based HCI Education with End Users","author":"Roldan Wendy","year":"1846","unstructured":"Wendy Roldan , Ziyue Li , Xin Gao , Sarah Kay\u00a0Strickler , Allison Marie\u00a0Hishikawa , Jon E.\u00a0 Froehlich , and Jason Yip . 2021. Pedagogical Strategies for Reflection in Project-Based HCI Education with End Users . Association for Computing Machinery , New York, NY, USA , 1846 \u20131860. https:\/\/doi.org\/10.1145\/3461778.3462113 Wendy Roldan, Ziyue Li, Xin Gao, Sarah Kay\u00a0Strickler, Allison Marie\u00a0Hishikawa, Jon E.\u00a0Froehlich, and Jason Yip. 2021. Pedagogical Strategies for Reflection in Project-Based HCI Education with End Users. Association for Computing Machinery, New York, NY, USA, 1846\u20131860. https:\/\/doi.org\/10.1145\/3461778.3462113"},{"key":"e_1_3_2_2_73_1","volume-title":"The file drawer problem and tolerance for null results.Psychological bulletin 86, 3","author":"Rosenthal Robert","year":"1979","unstructured":"Robert Rosenthal . 1979. The file drawer problem and tolerance for null results.Psychological bulletin 86, 3 ( 1979 ), 638. Robert Rosenthal. 1979. The file drawer problem and tolerance for null results.Psychological bulletin 86, 3 (1979), 638."},{"key":"e_1_3_2_2_74_1","unstructured":"Jacob O.\u00a0Wobbrock Scott\u00a0Klemmer. [n.d.]. Designing Running and Analyzing Experiments. Retrieved Accessed: 2021-09-08 from https:\/\/www.coursera.org\/learn\/designexperiments  Jacob O.\u00a0Wobbrock Scott\u00a0Klemmer. [n.d.]. Designing Running and Analyzing Experiments. Retrieved Accessed: 2021-09-08 from https:\/\/www.coursera.org\/learn\/designexperiments"},{"key":"e_1_3_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797611417632"},{"key":"e_1_3_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1002\/jcpy.1207"},{"key":"e_1_3_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/174809.174813"},{"key":"e_1_3_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0253950"},{"key":"e_1_3_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1177\/1745691616658637"},{"key":"e_1_3_2_2_80_1","volume-title":"Grounded theory in practice","author":"Strauss Anselm","unstructured":"Anselm Strauss and Juliet\u00a0 M Corbin . 1997. Grounded theory in practice . Sage . Anselm Strauss and Juliet\u00a0M Corbin. 1997. Grounded theory in practice. Sage."},{"key":"e_1_3_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2017.00390"},{"key":"e_1_3_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10869-020-09695-3"},{"key":"e_1_3_2_2_83_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2016.03.004"},{"key":"e_1_3_2_2_84_1","volume-title":"Statistical Significance Testing at CHI PLAY: Challenges and Opportunities for More Transparency","author":"Vornhagen B.","unstructured":"Jan\u00a0 B. Vornhagen , April Tyack , and Elisa\u00a0 D. Mekler . 2020. Statistical Significance Testing at CHI PLAY: Challenges and Opportunities for More Transparency . Association for Computing Machinery , New York, NY, USA , 4\u201318. https:\/\/doi.org\/10.1145\/3410404.3414229 Jan\u00a0B. Vornhagen, April Tyack, and Elisa\u00a0D. Mekler. 2020. Statistical Significance Testing at CHI PLAY: Challenges and Opportunities for More Transparency. Association for Computing Machinery, New York, NY, USA, 4\u201318. https:\/\/doi.org\/10.1145\/3410404.3414229"},{"key":"e_1_3_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376448"},{"key":"e_1_3_2_2_86_1","volume-title":"Special Interest Group on Transparent Statistics Guidelines. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA \u201918)","author":"Wacharamanotham Chat","year":"2018","unstructured":"Chat Wacharamanotham , Matthew Kay , Steve Haroz , Shion Guha , and Pierre Dragicevic . 2018 . Special Interest Group on Transparent Statistics Guidelines. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA \u201918) . Association for Computing Machinery, New York, NY, USA, 1\u20134. https:\/\/doi.org\/10.1145\/3170427.3 185374 Chat Wacharamanotham, Matthew Kay, Steve Haroz, Shion Guha, and Pierre Dragicevic. 2018. Special Interest Group on Transparent Statistics Guidelines. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA \u201918). Association for Computing Machinery, New York, NY, USA, 1\u20134. https:\/\/doi.org\/10.1145\/3170427.3185374"},{"key":"e_1_3_2_2_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702347"},{"key":"e_1_3_2_2_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274447"},{"key":"e_1_3_2_2_89_1","volume-title":"Argus: Interactive a priori Power Analysis","author":"Wang Xiaoyi","year":"2020","unstructured":"Xiaoyi Wang , Alexander Eiselmayer , Wendy\u00a0 E Mackay , Kasper Hornb\u00e6k , and Chat Wacharamanotham . 2020 . Argus: Interactive a priori Power Analysis . IEEE Transactions on Visualization and Computer Graphics ( 2020). Xiaoyi Wang, Alexander Eiselmayer, Wendy\u00a0E Mackay, Kasper Hornb\u00e6k, and Chat Wacharamanotham. 2020. Argus: Interactive a priori Power Analysis. IEEE Transactions on Visualization and Computer Graphics (2020)."},{"key":"e_1_3_2_2_90_1","volume-title":"Degrees of freedom in planning, running, analyzing, and reporting psychological studies: A checklist to avoid p-hacking. Frontiers in psychology 7","author":"Wicherts M","year":"2016","unstructured":"Jelte\u00a0 M Wicherts , Coosje\u00a0 LS Veldkamp , Hilde\u00a0 EM Augusteijn , Marjan Bakker , Robbie Van\u00a0Aert , and Marcel\u00a0 ALM Van\u00a0Assen . 2016. Degrees of freedom in planning, running, analyzing, and reporting psychological studies: A checklist to avoid p-hacking. Frontiers in psychology 7 ( 2016 ), 1832. Jelte\u00a0M Wicherts, Coosje\u00a0LS Veldkamp, Hilde\u00a0EM Augusteijn, Marjan Bakker, Robbie Van\u00a0Aert, and Marcel\u00a0ALM Van\u00a0Assen. 2016. Degrees of freedom in planning, running, analyzing, and reporting psychological studies: A checklist to avoid p-hacking. Frontiers in psychology 7 (2016), 1832."},{"key":"e_1_3_2_2_91_1","volume-title":"Statistical methods in psychology journals: Guidelines and explanations.American psychologist 54, 8","author":"Wilkinson Leland","year":"1999","unstructured":"Leland Wilkinson . 1999. Statistical methods in psychology journals: Guidelines and explanations.American psychologist 54, 8 ( 1999 ), 594. Leland Wilkinson. 1999. Statistical methods in psychology journals: Guidelines and explanations.American psychologist 54, 8 (1999), 594."},{"key":"e_1_3_2_2_92_1","unstructured":"Jacob\u00a0O Wobbrock. 2015. Catchy Titles Are Good: But Avoid Being Cute. (2015).  Jacob\u00a0O Wobbrock. 2015. Catchy Titles Are Good: But Avoid Being Cute. (2015)."},{"key":"e_1_3_2_2_93_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7610.1976.tb00381.x"},{"key":"e_1_3_2_2_94_1","volume-title":"How to Crack Pre-registration: Toward Transparent and Open Science. Frontiers in psychology 9","author":"Yamada Yuki","year":"2018","unstructured":"Yuki Yamada . 2018. How to Crack Pre-registration: Toward Transparent and Open Science. Frontiers in psychology 9 ( 2018 ), 1831. Yuki Yamada. 2018. How to Crack Pre-registration: Toward Transparent and Open Science. Frontiers in psychology 9 (2018), 1831."}],"event":{"name":"CHI '22: CHI Conference on Human Factors in Computing Systems","location":"New Orleans LA USA","acronym":"CHI '22","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3517707","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3491102.3517707","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:00Z","timestamp":1750191420000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3517707"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,29]]},"references-count":94,"alternative-id":["10.1145\/3491102.3517707","10.1145\/3491102"],"URL":"https:\/\/doi.org\/10.1145\/3491102.3517707","relation":{},"subject":[],"published":{"date-parts":[[2022,4,29]]}}}