{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T05:01:26Z","timestamp":1770958886618,"version":"3.50.1"},"reference-count":27,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T00:00:00Z","timestamp":1670371200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2023,7,31]]},"abstract":"<jats:p>\n            Bayesian data analysis is gaining traction in many fields, including empirical studies in software engineering. Bayesian approaches provide many advantages over traditional, or frequentist, data analysis, but the mechanics often remain opaque to beginners due to the underlying computational complexity. Introductory articles, while successful in explaining the theory and principles, fail to provide a totally transparent operationalization. To address this gap, this tutorial provides a step-by-step illustration of Bayesian hypothesis testing in the context of software engineering research using a fully developed example and in comparison to the frequentist hypothesis testing approach. It shows how Bayesian analysis can help build evidence over time incrementally through a family of experiments. It also discusses chief advantages and disadvantages in an applied manner. A\n            <jats:italic>figshare<\/jats:italic>\n            package is provided for reproducing all calculations.\n          <\/jats:p>","DOI":"10.1145\/3533383","type":"journal-article","created":{"date-parts":[[2022,5,11]],"date-time":"2022-05-11T11:59:28Z","timestamp":1652270368000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Bayesian Hypothesis Testing Illustrated: An Introduction for Software Engineering Researchers"],"prefix":"10.1145","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7987-5621","authenticated-orcid":false,"given":"Hakan","family":"Erdogmus","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,12,7]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1177\/01632780122034885"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2001.972773"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1037\/\/0033-2909.112.1.155"},{"key":"e_1_3_2_5_2","volume-title":"Bayesian Analysis of Software Cost and Quality Models","author":"Devnani-Chulani S.","year":"1999","unstructured":"S. Devnani-Chulani. 1999. Bayesian Analysis of Software Cost and Quality Models. Ph.D. Dissertation. University of Southern California."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198841296.001.0001"},{"key":"e_1_3_2_7_2","unstructured":"H. Erdogmus. 2021. Bayesian Hypothesis Testing vs NHST. Dataset. Retrieved from https:\/\/figshare.com\/articles\/dataset\/Bayesian_Hypothesis_Testing_vs_NHST\/14109770."},{"key":"e_1_3_2_8_2","unstructured":"ESEM 2019. 2019. Retrieved February 20 2021 from http:\/\/eseiw2019.com\/esem\/."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2935974"},{"key":"e_1_3_2_10_2","unstructured":"C. A. Furia R. Torkar and R. Feldt. 2021. Applying Bayesian analysis guidelines to empirical software engineering data: The case of programming languages and code quality. arXiv:2101.12591 (2021). Retrieved from https:\/\/arxiv.org\/abs\/2101.12591."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.17605\/OSF.IO\/CKNXM"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25231-0_2"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1995.10476572"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198841296.001.0001"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TEM.1967.6446985"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1201\/9780429029608"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0164-1212(00)00024-8"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989x.5.2.241"},{"key":"e_1_3_2_19_2","volume-title":"Bayesian Inference","author":"Ortega A.","year":"2017","unstructured":"A. Ortega and G. Navarrete. 2017. Bayesian hypothesis testing: An alternative to null hypothesis testing (NHST) in Psychology. In Bayesian Inference, J. P. Tejedor (Ed.). IntechOpen, London."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2864633"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/1810295.1810438"},{"key":"e_1_3_2_22_2","unstructured":"The JASP Team. 2021. JASP: A Fresh Way to Do Statistics. Retrieved Feb 20 2021 from https:\/\/jasp-stats.org\/."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32489-6_11"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion52605.2021.00140"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3048991"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-016-1015-8"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.2016.1154108"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1080\/10691898.2013.11889663"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3533383","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3533383","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:17Z","timestamp":1750186817000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3533383"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,7]]},"references-count":27,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,7,31]]}},"alternative-id":["10.1145\/3533383"],"URL":"https:\/\/doi.org\/10.1145\/3533383","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,7]]},"assertion":[{"value":"2021-08-25","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}