{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T17:48:59Z","timestamp":1784569739588,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,4,21]],"date-time":"2020-04-21T00:00:00Z","timestamp":1587427200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,4,21]]},"DOI":"10.1145\/3313831.3376454","type":"proceedings-article","created":{"date-parts":[[2020,5,27]],"date-time":"2020-05-27T16:16:47Z","timestamp":1590596207000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":58,"title":["How Visualizing Inferential Uncertainty Can Mislead Readers About Treatment Effects in Scientific Results"],"prefix":"10.1145","author":[{"given":"Jake M.","family":"Hofman","sequence":"first","affiliation":[{"name":"Microsoft Research, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel G.","family":"Goldstein","sequence":"additional","affiliation":[{"name":"Microsoft Research, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica","family":"Hullman","sequence":"additional","affiliation":[{"name":"Northwestern University, Evanston, IL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,4,23]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797610363543"},{"key":"e_1_3_2_2_2_1","volume-title":"Publication manual","author":"American Psychological Association and others. 2001.","unstructured":"American Psychological Association and others. 2001. Publication manual (5th edition). American Psychological Association Washington, DC.","edition":"5"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1198\/0003130032369"},{"key":"e_1_3_2_2_4_1","volume-title":"Researchers misunderstand confidence intervals and standard error bars. Psychological methods 10, 4","author":"Belia Sarah","year":"2005","unstructured":"Sarah Belia, Fiona Fidler, Jennifer Williams, and Geoff Cumming. 2005. Researchers misunderstand confidence intervals and standard error bars. Psychological methods 10, 4 (2005), 389."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1093\/annonc\/mdx064"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Lonni Besan\u00e7on and Pierre Dragicevic. 2019. The Continued Prevalence of Dichotomous Inferences at CHI. (2019).","DOI":"10.1145\/3290607.3310432"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3475"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-018-0399-z"},{"key":"e_1_3_2_2_9_1","volume-title":"The challenge of developing statistical literacy, reasoning and thinking","author":"Chance Beth","unstructured":"Beth Chance, Robert del Mas, and Joan Garfield. 2004. Reasoning about sampling distribitions. In The challenge of developing statistical literacy, reasoning and thinking. Springer, 295--323."},{"key":"e_1_3_2_2_10_1","volume-title":"Estimating the reproducibility of psychological science. Science 349, 6251","author":"Collaboration Open Science","year":"2015","unstructured":"Open Science Collaboration and others. 2015. Estimating the reproducibility of psychological science. Science 349, 6251 (2015), aac4716."},{"key":"e_1_3_2_2_11_1","first-page":"2142","article-title":"Error bars considered harmful: Exploring alternate encodings for mean and error. Visualization and Computer Graphics","volume":"20","author":"Correll Michael","year":"2014","unstructured":"Michael Correll and Michael Gleicher. 2014. Error bars considered harmful: Exploring alternate encodings for mean and error. Visualization and Computer Graphics, IEEE Transactions on 20, 12 (2014), 2142--2151.","journal-title":"IEEE Transactions on"},{"key":"e_1_3_2_2_12_1","volume-title":"Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis","author":"Cumming Geoff","unstructured":"Geoff Cumming. 2013. Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. Routledge."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1742-9536.2011.00037.x"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.60.2.170"},{"key":"e_1_3_2_2_15_1","volume-title":"Arguments for and against standardized mean differences (effect sizes). Archives of pediatrics & adolescent medicine 165, 7","author":"Cummings Peter","year":"2011","unstructured":"Peter Cummings. 2011. Arguments for and against standardized mean differences (effect sizes). Archives of pediatrics & adolescent medicine 165, 7 (2011), 592--596."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300295"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173718"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963721413491570"},{"key":"e_1_3_2_2_19_1","volume-title":"Subjective probability","author":"Gigerenzer Gerd","unstructured":"Gerd Gigerenzer. 1994. Why the distinction between single-event probabilities and frequencies is important for psychology (and vice versa). In Subjective probability. Wiley, 129--161."},{"key":"e_1_3_2_2_20_1","volume-title":"How to improve Bayesian reasoning without instruction: frequency formats. Psychological review 102, 4","author":"Gigerenzer Gerd","year":"1995","unstructured":"Gerd Gigerenzer and Ulrich Hoffrage. 1995. How to improve Bayesian reasoning without instruction: frequency formats. Psychological review 102, 4 (1995), 684."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1086\/589562"},{"key":"e_1_3_2_2_22_1","volume-title":"Lay understanding of probability distributions. Judgment & Decision Making 9, 1","author":"Goldstein Daniel G","year":"2014","unstructured":"Daniel G Goldstein and David Rothschild. 2014. Lay understanding of probability distributions. Judgment & Decision Making 9, 1 (2014)."},{"key":"e_1_3_2_2_23_1","volume-title":"Robust misinterpretation of confidence intervals. Psychonomic bulletin & review 21, 5","author":"Hoekstra Rink","year":"2014","unstructured":"Rink Hoekstra, Richard D Morey, Jeffrey N Rouder, and Eric-Jan Wagenmakers. 2014. Robust misinterpretation of confidence intervals. Psychonomic bulletin & review 21, 5 (2014), 1157--1164."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-199805000-00024"},{"key":"e_1_3_2_2_25_1","volume-title":"Imagining Replications: Graphical Prediction & Discrete Visualizations Improve Recall & Estimation of Effect Uncertainty","author":"Hullman Jessica","year":"2018","unstructured":"Jessica Hullman, Matthew Kay, Yea-Seul Kim, and Samana Shrestha. 2018. Imagining Replications: Graphical Prediction & Discrete Visualizations Improve Recall & Estimation of Effect Uncertainty. IEEE transactions on visualization and computer graphics 24, 1 (2018), 446--456."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0142444"},{"key":"e_1_3_2_2_27_1","volume-title":"Graphical communication of uncertain quantities to nontechnical people. Risk analysis 7, 4","author":"Ibrekk Harald","year":"1987","unstructured":"Harald Ibrekk and M Granger Morgan. 1987. Graphical communication of uncertain quantities to nontechnical people. Risk analysis 7, 4 (1987), 519--529."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1198\/000313008X370843"},{"key":"e_1_3_2_2_29_1","volume-title":"Hypothetical Outcome Plots Help Untrained Observers Judge Trends in Ambiguous Data","author":"Kale Alex","year":"2018","unstructured":"Alex Kale, Francis Nguyen, Matthew Kay, and Jessica Hullman. 2018. Hypothetical Outcome Plots Help Untrained Observers Judge Trends in Ambiguous Data. IEEE transactions on visualization and computer graphics (2018)."},{"key":"e_1_3_2_2_30_1","volume-title":"Beanplot: A boxplot alternative for visual comparison of distributions.","author":"Kampstra Peter","year":"2008","unstructured":"Peter Kampstra and others. 2008. Beanplot: A boxplot alternative for visual comparison of distributions. (2008)."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858558"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300912"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"crossref","unstructured":"Martin Krzywinski and Naomi Altman. 2013. Points of significance: error bars. (2013).","DOI":"10.1038\/nmeth.2659"},{"key":"e_1_3_2_2_34_1","volume-title":"Bar graphs depicting averages are perceptually misinterpreted: The within-the-bar bias. Psychonomic bulletin & review 19, 4","author":"Newman George E","year":"2012","unstructured":"George E Newman and Brian J Scholl. 2012. Bar graphs depicting averages are perceptually misinterpreted: The within-the-bar bias. Psychonomic bulletin & review 19, 4 (2012), 601--607."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1198\/000313001317097960"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963721417708229"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.1186169"},{"key":"e_1_3_2_2_38_1","volume-title":"Statistical methods in psychology journals: Guidelines and explanations. American psychologist 54, 8","author":"Wilkinson Leland","year":"1999","unstructured":"Leland Wilkinson. 1999. Statistical methods in psychology journals: Guidelines and explanations. American psychologist 54, 8 (1999), 594."}],"event":{"name":"CHI '20: CHI Conference on Human Factors in Computing Systems","location":"Honolulu HI USA","acronym":"CHI '20","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3313831.3376454","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3313831.3376454","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:34Z","timestamp":1750199914000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3313831.3376454"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,21]]},"references-count":38,"alternative-id":["10.1145\/3313831.3376454","10.1145\/3313831"],"URL":"https:\/\/doi.org\/10.1145\/3313831.3376454","relation":{},"subject":[],"published":{"date-parts":[[2020,4,21]]},"assertion":[{"value":"2020-04-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}