{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T15:38:56Z","timestamp":1767973136891,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":71,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,4,19]],"date-time":"2023-04-19T00:00:00Z","timestamp":1681862400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Department of the Navy","award":["N6833517-C-0410"],"award-info":[{"award-number":["N6833517-C-0410"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,4,19]]},"DOI":"10.1145\/3544548.3580869","type":"proceedings-article","created":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T04:28:44Z","timestamp":1681964924000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["MetaExplorer : Facilitating Reasoning with Epistemic Uncertainty in Meta-analysis"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7668-2800","authenticated-orcid":false,"given":"Alex","family":"Kale","sequence":"first","affiliation":[{"name":"Computer Science, Data Science Institute, University of Chicago, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4982-6447","authenticated-orcid":false,"given":"Sarah","family":"Lee","sequence":"additional","affiliation":[{"name":"Stottler Henke Associates, Inc., United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8498-6767","authenticated-orcid":false,"given":"Terrance","family":"Goan","sequence":"additional","affiliation":[{"name":"Stottler Henke Associates, Inc., United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5608-1282","authenticated-orcid":false,"given":"Elizabeth","family":"Tipton","sequence":"additional","affiliation":[{"name":"Statistics, Northwestern University, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6826-3550","authenticated-orcid":false,"given":"Jessica","family":"Hullman","sequence":"additional","affiliation":[{"name":"Computer Science, Northwestern University, United States"}]}],"member":"320","published-online":{"date-parts":[[2023,4,19]]},"reference":[{"key":"e_1_3_3_2_1_1","unstructured":"Elsevier 2022. Mendeley. Elsevier. https:\/\/www.mendeley.com\/reference-management\/reference-manager"},{"key":"e_1_3_3_2_2_1","volume-title":"Standardized or simple effect size: What should be reported?British journal of psychology 100, 3","author":"Baguley Thom","year":"2009","unstructured":"Thom Baguley. 2009. Standardized or simple effect size: What should be reported?British journal of psychology 100, 3 (2009), 603\u2013617."},{"key":"e_1_3_3_2_3_1","volume-title":"How to perform a meta-analysis with R: a practical tutorial. Evidence-Based Mental Health22","author":"Balduzzi Sara","year":"2019","unstructured":"Sara Balduzzi, Gerta R\u00fccker, and Guido Schwarzer. 2019. How to perform a meta-analysis with R: a practical tutorial. Evidence-Based Mental Health22 (2019), 153\u2013160."},{"key":"e_1_3_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-6-50"},{"key":"e_1_3_3_2_5_1","doi-asserted-by":"crossref","unstructured":"Betsy\u00a0Jane Becker. 2017. Improving the design and use of meta-analyses of career interventions. Integrating theory research and practice in vocational psychology: Current status and future directions(2017) 95.","DOI":"10.17125\/svp2016.ch10"},{"key":"e_1_3_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.10.4.389"},{"key":"e_1_3_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-7373(91)90030-B"},{"key":"e_1_3_3_2_8_1","unstructured":"M Borenstein L Hedges J Higgins and H Rothstein. 2005. Comprehensive Meta-Analysis 2. Engelwood NJ Biostat."},{"key":"e_1_3_3_2_9_1","unstructured":"Mike Bostock. 2012. D3.js - Data-Driven Documents. http:\/\/d3js.org\/"},{"key":"e_1_3_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025738"},{"key":"e_1_3_3_2_11_1","volume-title":"Behavioural science is unlikely to change the world without a heterogeneity revolution. Nature human behaviour 5, 8","author":"Bryan J","year":"2021","unstructured":"Christopher\u00a0J Bryan, Elizabeth Tipton, and David\u00a0S Yeager. 2021. Behavioural science is unlikely to change the world without a heterogeneity revolution. Nature human behaviour 5, 8 (2021), 980\u2013989."},{"key":"e_1_3_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3114803"},{"key":"e_1_3_3_2_13_1","volume-title":"Stupid. British Educational Research Association Annual Conference, 1\u201318","author":"Coe Robert","year":"2002","unstructured":"Robert Coe. 2002. It\u2019s the Effect Size, Stupid. British Educational Research Association Annual Conference, 1\u201318."},{"key":"e_1_3_3_2_14_1","volume-title":"Review Manager (RevMan) 5.1.0","author":"Collaboration The\u00a0Cochrane","unstructured":"The\u00a0Cochrane Collaboration. 2014. Review Manager (RevMan) 5.1.0. Copenhagen: The Nordic Cochrane Centre."},{"key":"e_1_3_3_2_15_1","volume-title":"The handbook of research synthesis and meta-analysis","author":"Cooper Harris","unstructured":"Harris Cooper, Larry\u00a0V Hedges, and Jeffrey\u00a0C Valentine. 2019. The handbook of research synthesis and meta-analysis. Russell Sage Foundation."},{"key":"e_1_3_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346298"},{"key":"e_1_3_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797613504966"},{"key":"e_1_3_3_2_18_1","doi-asserted-by":"publisher","unstructured":"Michael Fernandes Logan Walls Sean\u00a0A Munson Jessica Hullman and Matthew Kay. 2018. Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making. In ACM Transactions on Computer-Human Interaction. Montreal. https:\/\/doi.org\/10.1145\/3173574.3173718","DOI":"10.1145\/3173574.3173718"},{"key":"e_1_3_3_2_19_1","unstructured":"Roy Rosenzweig\u00a0Center for History and New Media. 2016. Zotero. https:\/\/www.zotero.org\/download"},{"key":"e_1_3_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1930297500007981"},{"key":"e_1_3_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.102.4.684"},{"key":"e_1_3_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1093\/biostatistics"},{"key":"e_1_3_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.39489.470347.AD"},{"key":"e_1_3_3_2_24_1","unstructured":"JPT Higgins and S Green (Eds.). 2011. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. The Cochrane Collaboration. www.cochrane-handbook.org."},{"key":"e_1_3_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1186"},{"key":"e_1_3_3_2_26_1","doi-asserted-by":"publisher","unstructured":"Julian P\u00a0T Higgins Douglas\u00a0G Altman Peter\u00a0C G\u00f8tzsche Peter J\u00fcni David Moher Andrew\u00a0D Oxman Jelena Savovi\u0107 Kenneth\u00a0F Schulz Laura Weeks and Jonathan A\u00a0C Sterne. 2011. The Cochrane Collaboration\u2019s tool for assessing risk of bias in randomised trials. BMJ 343(2011). https:\/\/doi.org\/10.1136\/bmj.d5928 arXiv:https:\/\/www.bmj.com\/content\/343\/bmj.d5928.full.pdf","DOI":"10.1136\/bmj.d5928"},{"key":"e_1_3_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-013-0572-3"},{"key":"e_1_3_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-199805000-00024"},{"key":"e_1_3_3_2_29_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0142444"},{"key":"e_1_3_3_2_30_1","doi-asserted-by":"crossref","unstructured":"Ben Hutchinson Negar Rostamzadeh Christina Greer Katherine Heller and Vinodkumar Prabhakaran. 2022. Evaluation Gaps in Machine Learning Practice. arXiv preprint arXiv:2205.05256(2022).","DOI":"10.1145\/3531146.3533233"},{"key":"e_1_3_3_2_31_1","unstructured":"Veritas\u00a0Health Innovation. 2022. Covidence systematic review software. https:\/\/www.covidence.org"},{"key":"e_1_3_3_2_32_1","volume-title":"Tisane: Authoring Statistical Models via Formal Reasoning from Conceptual and Data Relationships. In ACM Human Factors in Computing Systems (CHI)","author":"Jun Eunice","year":"2022","unstructured":"Eunice Jun, Audrey Seo, Jeffrey Heer, and Ren\u00e9 Just. 2022. Tisane: Authoring Statistical Models via Formal Reasoning from Conceptual and Data Relationships. In ACM Human Factors in Computing Systems (CHI). http:\/\/idl.cs.washington.edu\/papers\/tisane"},{"key":"e_1_3_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300432"},{"key":"e_1_3_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.3030335"},{"key":"e_1_3_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864909"},{"key":"e_1_3_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858558"},{"key":"e_1_3_3_2_37_1","unstructured":"M.W. Lipsey and D.B. Wilson. 2001. Practical Meta-Analysis. SAGE Publications."},{"key":"e_1_3_3_2_38_1","volume-title":"Paths Omitted","author":"Liu Yang","unstructured":"Yang Liu, Tim Althoff, and Jeffrey Heer. 2020. Paths Explored, Paths Omitted, Paths Obscured: Decision Points & Selective Reporting in End-to-End Data Analysis. In ACM Human Factors in Computing Systems (CHI). http:\/\/idl.cs.washington.edu\/papers\/analysis-decision-points"},{"key":"e_1_3_3_2_39_1","volume-title":"Boba: Authoring and Visualizing Multiverse Analyses","author":"Liu Yang","year":"2021","unstructured":"Yang Liu, Alex Kale, Tim Althoff, and Jeffrey Heer. 2021. Boba: Authoring and Visualizing Multiverse Analyses. IEEE Trans. Visualization & Comp. Graphics (Proc. VAST) (2021). http:\/\/idl.cs.washington.edu\/papers\/boba"},{"key":"e_1_3_3_2_40_1","doi-asserted-by":"publisher","unstructured":"C.KL. Lo D. Mertz and M. Loeb. 2014. Newcastle-Ottawa Scale: comparing reviewers\u2019 to authors\u2019 assessments. BMC Med Res Methodol 45(2014). Issue 14. https:\/\/doi.org\/10.1186\/1471-2288-14-45","DOI":"10.1186\/1471-2288-14-45"},{"key":"e_1_3_3_2_41_1","volume-title":"Science as Social Knowledge: Values and Objectivity in Scientific Inquiry","author":"Longino E.","unstructured":"Helen\u00a0E. Longino. 1990. Science as Social Knowledge: Values and Objectivity in Scientific Inquiry. Princeton University Press."},{"key":"e_1_3_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1722389115"},{"key":"e_1_3_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.3386\/w25504"},{"key":"e_1_3_3_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864913"},{"key":"e_1_3_3_2_45_1","unstructured":"Microsoft Corporation. 2019. Microsoft Excel. https:\/\/office.microsoft.com\/excel"},{"key":"e_1_3_3_2_46_1","volume-title":"England) 3, 12","author":"Moher D","year":"1999","unstructured":"D Moher, DJ Cook, Alejandro\u00a0R Jadad, P Tugwell, M Moher, A Jones, B Pham, and TP Klassen. 1999. Assessing the quality of reports of randomised trials: implications for the conduct of meta-analyses. Health Technology Assessment (Winchester, England) 3, 12 (1999), i\u201398."},{"key":"e_1_3_3_2_47_1","volume-title":"Exploring the Effect of Companion Robots on Emotional Expressions in Older Adults with Dementia: A Pilot Randomized Controlled Trial. Journal of Gerontological Nursing 39","author":"Moyle Wendy","year":"2013","unstructured":"Wendy Moyle, Marie Cooke, Elizabeth Beattie, Cindy Jones, Barbara Klein, Glenda Cook, and Chrystal Gray. 2013. Exploring the Effect of Companion Robots on Emotional Expressions in Older Adults with Dementia: A Pilot Randomized Controlled Trial. Journal of Gerontological Nursing 39 (2013). Issue 5."},{"key":"e_1_3_3_2_48_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1708274114"},{"key":"e_1_3_3_2_49_1","doi-asserted-by":"publisher","unstructured":"Mourad Ouzzani Hossam Hammady Zbys Fedorowicz and Ahmed Elmagarmid. 2016. Rayyan - a web and mobile app for systematic reviews. https:\/\/doi.org\/10.1186\/s13643-016-0384-4","DOI":"10.1186\/s13643-016-0384-4"},{"key":"e_1_3_3_2_50_1","doi-asserted-by":"publisher","unstructured":"R.\u00a0K. Owen N. Bradbury Y. Xin N. Cooper and A. Sutton. 2019. MetaInsight: An interactive web-based tool for analyzing interrogating and visualizing network meta-analyses using R-shiny and netmeta.Research synthesis methods 10 4 (2019) 569\u2013581. https:\/\/doi.org\/10.1002\/jrsm.1373","DOI":"10.1002\/jrsm.1373"},{"key":"e_1_3_3_2_51_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2020.579267"},{"key":"e_1_3_3_2_52_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.n160"},{"key":"e_1_3_3_2_53_1","unstructured":"Evidence Partners. 2021. DistillerSR. https:\/\/www.evidencepartners.com"},{"key":"e_1_3_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.1093\/geront"},{"key":"e_1_3_3_2_55_1","volume-title":"What is your research question? An introduction to the PICOT format for clinicians.The Journal of the Canadian Chiropractic Association 56 3","author":"Riva J.","year":"2012","unstructured":"John\u00a0J. Riva, Keshena Malik, Stephen\u00a0J. Burnie, Andrea\u00a0R Endicott, and Jason\u00a0Walter Busse. 2012. What is your research question? An introduction to the PICOT format for clinicians.The Journal of the Canadian Chiropractic Association 56 3 (2012), 167\u2013171."},{"key":"e_1_3_3_2_56_1","unstructured":"M.S. Rosenberg D.C. Adams and J. Gurevitch. 1997. MetaWin: Statistical Software for Meta-Analysis with Resampling Tests. (1997)."},{"key":"e_1_3_3_2_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467591"},{"key":"e_1_3_3_2_58_1","volume-title":"Educating the Reflective Practitioner","author":"Schon A.","unstructured":"Donald\u00a0A. Schon. 1987. Educating the Reflective Practitioner. John Wiley & Sons Inc., San Francisco, CA."},{"key":"e_1_3_3_2_59_1","unstructured":"William\u00a0R. Shadish Thomas\u00a0D. Cook and Donald\u00a0T. Campbell. 2001. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Houghton Mifflin."},{"key":"e_1_3_3_2_60_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2010.01830.x"},{"key":"e_1_3_3_2_61_1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.2694998"},{"key":"e_1_3_3_2_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2012.02.004"},{"key":"e_1_3_3_2_63_1","doi-asserted-by":"publisher","DOI":"10.1177\/1745691616658637"},{"key":"e_1_3_3_2_64_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2200732119"},{"key":"e_1_3_3_2_66_1","unstructured":"James Thomas Sergio Graziosi Jeff Brunton Z. Ghouze Patrick O\u2019Driscoll M. Bond and A. Koryakina. 2022. EPPI-Reviewer: advanced software for systematic reviews maps and evidence synthesis.(2022)."},{"key":"e_1_3_3_2_67_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-985X.2008.00547.x"},{"key":"e_1_3_3_2_68_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v036.i03"},{"key":"e_1_3_3_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702347"},{"key":"e_1_3_3_2_70_1","volume-title":"Closing the Gap between Methodologists and End-Users: R as a Computational Back-End. Journal of Statistical Software 5","author":"Wallace C.","year":"2012","unstructured":"Byron\u00a0C. Wallace, Issa\u00a0J. Dahabreh, Thomas\u00a0A. Trikalinos, Joseph Lau, Paul Trow, and Christopher\u00a0H. Schmid. 2012. Closing the Gap between Methodologists and End-Users: R as a Computational Back-End. Journal of Statistical Software 5 (2012). Issue 49."},{"key":"e_1_3_3_2_71_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2016.01832"},{"key":"e_1_3_3_2_72_1","doi-asserted-by":"crossref","unstructured":"J. Zhou M. Glueck S. Breslav F. Chevalier and A. Khan. 2017. Annotation graphs: a graph-based visualization for meta-analysis of data based on user-authored annotations.IEEE transactions on visualization and computer graphics 23 1(2017) 261\u2013270.","DOI":"10.1109\/TVCG.2016.2598543"}],"event":{"name":"CHI '23: CHI Conference on Human Factors in Computing Systems","location":"Hamburg Germany","acronym":"CHI '23","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3544548.3580869","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3544548.3580869","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3544548.3580869","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:47:17Z","timestamp":1750178837000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3544548.3580869"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,19]]},"references-count":71,"alternative-id":["10.1145\/3544548.3580869","10.1145\/3544548"],"URL":"https:\/\/doi.org\/10.1145\/3544548.3580869","relation":{},"subject":[],"published":{"date-parts":[[2023,4,19]]},"assertion":[{"value":"2023-04-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}