{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T07:15:28Z","timestamp":1778138128303,"version":"3.51.4"},"reference-count":61,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,21]],"date-time":"2022-01-21T00:00:00Z","timestamp":1642723200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council","doi-asserted-by":"publisher","award":["CRC-2018-00246 - Research"],"award-info":[{"award-number":["CRC-2018-00246 - Research"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>We discuss hypothesis testing and compare different theories in light of observed or experimental data as fundamental endeavors in the sciences. Issues associated with the p-value approach and null hypothesis significance testing are reviewed, and the Bayesian alternative based on the Bayes factor is introduced, along with a review of computational methods and sensitivity related to prior distributions. We demonstrate how Bayesian testing can be practically implemented in several examples, such as the t-test, two-sample comparisons, linear mixed models, and Poisson mixed models by using existing software. Caveats and potential problems associated with Bayesian testing are also discussed. We aim to inform researchers in the many fields where Bayesian testing is not in common use of a well-developed alternative to null hypothesis significance testing and to demonstrate its standard implementation.<\/jats:p>","DOI":"10.3390\/e24020161","type":"journal-article","created":{"date-parts":[[2022,1,21]],"date-time":"2022-01-21T08:37:18Z","timestamp":1642754238000},"page":"161","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A Review of Bayesian Hypothesis Testing and Its Practical Implementations"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1866-2320","authenticated-orcid":false,"given":"Zhengxiao","family":"Wei","sequence":"first","affiliation":[{"name":"Department of Mathematics and Statistics, University of Victoria, Victoria, BC V8W 2Y2, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9166-4421","authenticated-orcid":false,"given":"Aijun","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, University of Victoria, Victoria, BC V8W 2Y2, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1036-8063","authenticated-orcid":false,"given":"Leno","family":"Rocha","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, University of Victoria, Victoria, BC V8W 2Y2, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2673-4307","authenticated-orcid":false,"given":"Michelle F.","family":"Miranda","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, University of Victoria, Victoria, BC V8W 2Y2, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2569-3507","authenticated-orcid":false,"given":"Farouk S.","family":"Nathoo","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, University of Victoria, Victoria, BC V8W 2Y2, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,21]]},"reference":[{"key":"ref_1","unstructured":"Evett, I.W. (1991, January 15\u201320). Implementing Bayesian Methods in Forensic Science. Proceedings of the 4th Valencia International Meeting on Bayesian Statistics, Valencia, Spain."},{"key":"ref_2","first-page":"922","article-title":"Online Controlled Experiments and A\/B Testing","volume":"7","author":"Kohavi","year":"2017","journal-title":"Encycl. Mach. Learn. Data Min."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1080\/00224065.2000.11980013","article-title":"Controversies and Contradictions in Statistical Process Control","volume":"32","author":"Woodall","year":"2000","journal-title":"J. Qual. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jmp.2016.01.002","article-title":"Editors\u2019 Introduction to the Special Issue \u201cBayes Factors for Testing Hypotheses in Psychological Research: Practical Relevance and New Developments\u201d","volume":"72","author":"Mulder","year":"2016","journal-title":"J. Math. Psychol."},{"key":"ref_5","unstructured":"Cranmer, K.S. (2003). Frequentist Hypothesis Testing with Background Uncertainty. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.jmp.2015.10.003","article-title":"How Bayes Factors Change Scientific Practice","volume":"72","author":"Dienes","year":"2016","journal-title":"J. Math. Psychol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1016\/j.jmp.2015.11.001","article-title":"The Philosophy of Bayes Factors and the Quantification of Statistical Evidence","volume":"72","author":"Morey","year":"2016","journal-title":"J. Math. Psychol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"779","DOI":"10.3758\/BF03194105","article-title":"A Practical Solution to the Pervasive Problems of p Values","volume":"14","author":"Wagenmakers","year":"2007","journal-title":"Psychon. Bull. Rev."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1038\/137252a0","article-title":"The Design of Experiments","volume":"137","author":"Fisher","year":"1936","journal-title":"Nature"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e3239","DOI":"10.1002\/cem.3239","article-title":"p Values and Ronald Fisher","volume":"34","author":"Brereton","year":"2020","journal-title":"J. Chemom."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1080\/00031305.2018.1537891","article-title":"Before p < 0.05 to Beyond p < 0.05: Using History to Contextualize p-Values and Significance Testing","volume":"73","year":"2019","journal-title":"Am. Stat."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1080\/00031305.2016.1154108","article-title":"The ASA Statement on p-Values: Context, Process, and Purpose","volume":"70","author":"Wasserstein","year":"2016","journal-title":"Am. Stat."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.jmp.2015.03.003","article-title":"Bayesian Alternatives to Null-Hypothesis Significance Testing for Repeated-Measures Designs","volume":"72","author":"Nathoo","year":"2016","journal-title":"J. Math. Psychol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1007\/s10654-016-0149-3","article-title":"Statistical Tests, p Values, Confidence Intervals, and Power: A Guide to Misinterpretations","volume":"31","author":"Greenland","year":"2016","journal-title":"Eur. J. Epidemiol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1053\/j.seminhematol.2008.04.003","article-title":"A Dirty Dozen: Twelve p-Value Misconceptions","volume":"45","author":"Goodman","year":"2008","journal-title":"Semin. Hematol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/BF00485294","article-title":"Explicativity, Corroboration, and the Relative Odds of Hypotheses","volume":"30","author":"Good","year":"1975","journal-title":"Synthese"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1080\/01621459.1995.10476572","article-title":"Bayes Factors","volume":"90","author":"Kass","year":"1995","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_18","unstructured":"Jeffreys, H. (1961). Theory of Probability, Oxford University Press. [3rd ed.]."},{"key":"ref_19","first-page":"141","article-title":"Harold Jeffreys\u2019s Theory of Probability Revisited","volume":"24","author":"Robert","year":"2009","journal-title":"Stat. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1198\/000313006X152649","article-title":"The Difference Between \u201cSignificant\u201d and \u201cNot Significant\u201d is not Itself Statistically Significant","volume":"60","author":"Gelman","year":"2006","journal-title":"Am. Stat."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1146\/annurev-statistics-031017-100307","article-title":"On p-Values and Bayes Factors","volume":"5","author":"Held","year":"2018","journal-title":"Annu. Rev. Stat. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1017\/S030500410001330X","article-title":"Some Tests of Significance, Treated by the Theory of Probability","volume":"31","author":"Jeffreys","year":"1935","journal-title":"Math. Proc. Camb. Philos. Soc."},{"key":"ref_23","unstructured":"Morey, R.D., and Rouder, J.N. (2021, October 25). BayesFactor: Computation of Bayes Factors for Common Designs. 2018. Available online: https:\/\/cran.r-project.org\/package=BayesFactor."},{"key":"ref_24","first-page":"1","article-title":"Bayesian Item Response Modeling in R with brms and Stan","volume":"100","year":"2021","journal-title":"J. Stat. Softw."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v100.i18","article-title":"BFpack: Flexible Bayes Factor Testing of Scientific Theories in R","volume":"100","author":"Mulder","year":"2021","journal-title":"J. Stat. Softw."},{"key":"ref_26","unstructured":"JASP Team (2021, October 25). JASP Computer Software. Available online: https:\/\/jasp-stats.org\/."},{"key":"ref_27","unstructured":"IEEE Spectrum (2021, October 30). Top Programming Languages 2021. Available online: https:\/\/spectrum.ieee.org\/top-programming-languages\/."},{"key":"ref_28","unstructured":"TIOBE (2021, October 30). TIOBE Index for November. Available online: https:\/\/www.tiobe.com\/tiobe-index\/."},{"key":"ref_29","unstructured":"Gautier, L. (2021, October 30). rpy2 Package Version 3.5.0. Available online: https:\/\/rpy2.github.io\/doc\/latest\/html\/index.html."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1037\/xhp0000431","article-title":"Time Course of Motor Affordances Evoked by Pictured Objects and Words","volume":"44","author":"Bub","year":"2018","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1080\/20445911.2014.944914","article-title":"Are Bilingual Advantages Dependent upon Specific Tasks or Specific Bilingual Experiences?","volume":"26","author":"Paap","year":"2014","journal-title":"J. Cogn. Psychol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1176\/appi.ajp.2016.16020224","article-title":"Internet Gaming Disorder: Investigating the Clinical Relevance of a New Phenomenon","volume":"174","author":"Przybylski","year":"2017","journal-title":"Am. J. Psychiatry"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.jmp.2017.09.005","article-title":"A Tutorial on Bridge Sampling","volume":"81","author":"Gronau","year":"2017","journal-title":"J. Math. Psychol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1214\/aoms\/1177693507","article-title":"The Weighted Likelihood Ratio, Linear Hypotheses on Normal Location Parameters","volume":"42","author":"Dickey","year":"1971","journal-title":"Ann. Math. Stat."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"614","DOI":"10.1080\/01621459.1995.10476554","article-title":"Computing Bayes Factors using a Generalization of the Savage-Dickey Density Ratio","volume":"90","author":"Verdinelli","year":"1995","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1214\/ss\/1177009938","article-title":"Methods for Approximating Integrals in Statistics with Special Emphasis on Bayesian Integration Problems","volume":"10","author":"Evans","year":"1995","journal-title":"Stat. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Evans, M., and Swartz, T. (2000). Approximating Integrals via Monte Carlo and Deterministic Methods, Oxford University Press.","DOI":"10.1093\/oso\/9780198502784.001.0001"},{"key":"ref_38","first-page":"831","article-title":"Simulating Ratios of Normalizing Constants via a Simple Identity: A Theoretical Exploration","volume":"6","author":"Meng","year":"1996","journal-title":"Stat. Sin."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v076.i01","article-title":"Stan: A Probabilistic Programming Language","volume":"76","author":"Carpenter","year":"2017","journal-title":"J. Stat. Softw."},{"key":"ref_40","unstructured":"Plummer, M. (2003, January 20\u201322). JAGS: A program for Analysis of Bayesian Graphical Models Using Gibbs Sampling. Proceedings of the 3rd International Workshop on Distributed Statistical Computing, Vienna, Austria."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v092.i10","article-title":"bridgesampling: An R Package for Estimating Normalizing Constants","volume":"92","author":"Gronau","year":"2020","journal-title":"J. Stat. Softw."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1016\/j.jmp.2008.03.002","article-title":"Bayes Factors: Prior Sensitivity and Model Generalizability","volume":"52","author":"Liu","year":"2008","journal-title":"J. Math. Psychol."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Gelman, A., Carlin, J.B., Stern, H.S., and Rubin, D.B. (2013). Bayesian Data Analysis, Chapman and Hall. [3rd ed.].","DOI":"10.1201\/b16018"},{"key":"ref_44","first-page":"3","article-title":"Experiences in Elicitation","volume":"47","author":"Kadane","year":"1998","journal-title":"J. R. Stat. Soc. Ser. D Stat."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1111\/j.2517-6161.1979.tb01066.x","article-title":"Reference Posterior Distributions for Bayesian Inference","volume":"41","author":"Bernardo","year":"1979","journal-title":"J. R. Stat. Soc. Ser. B Stat. Methodol."},{"key":"ref_46","unstructured":"Hartmann, M., Agiashvili, G., B\u00fcrkner, P., and Klami, A. (2020, January 3\u20136). Flexible Prior Elicitation via the Prior Predictive Distribution. Proceedings of the 36th Conference on Uncertainty in Artificial Intelligence, Online."},{"key":"ref_47","unstructured":"da Silva, E.d.S., Ku\u015bmierczyk, T., Hartmann, M., and Klami, A. (2019). Prior Specification via Prior Predictive Matching: Poisson Matrix Factorization and Beyond. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1198\/000313002137","article-title":"On the Sensitivity of Bayes Factors to the Prior Distributions","volume":"56","author":"Sinharay","year":"2002","journal-title":"Am. Stat."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1016\/j.jmp.2010.07.003","article-title":"Prior Sensitivity in Theory Testing: An Apologia for the Bayes Factor","volume":"54","author":"Vanpaemel","year":"2010","journal-title":"J. Math. Psychol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"608045","DOI":"10.3389\/fpsyg.2020.608045","article-title":"The Importance of Prior Sensitivity Analysis in Bayesian Statistics: Demonstrations Using an Interactive Shiny App","volume":"11","author":"Depaoli","year":"2020","journal-title":"Front. Psychol."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.jmp.2015.06.004","article-title":"Harold Jeffreys\u2019s Default Bayes Factor Hypothesis Tests: Explanation, Extension, and Application in Psychology","volume":"72","author":"Ly","year":"2016","journal-title":"J. Math. Psychol."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"225","DOI":"10.3758\/PBR.16.2.225","article-title":"Bayesian t Tests for Accepting and Rejecting the Null Hypothesis","volume":"16","author":"Rouder","year":"2009","journal-title":"Psychon. Bull. Rev."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1016\/j.jmp.2012.08.001","article-title":"Default Bayes Factors for ANOVA Designs","volume":"56","author":"Rouder","year":"2012","journal-title":"J. Math. Psychol."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1080\/00273171.2012.734737","article-title":"Default Bayes Factors for Model Selection in Regression","volume":"47","author":"Rouder","year":"2012","journal-title":"Multivar. Behav. Res."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1113\/jphysiol.1905.sp001097","article-title":"The Action of Optical Isomers: II. Hyoscines","volume":"32","author":"Cushny","year":"1905","journal-title":"J. Physiol."},{"key":"ref_56","unstructured":"Su, Y.S., and Yajima, M. (2021, December 04). R2jags: Using R to Run \u2019JAGS\u2019, 2021. Available online: https:\/\/cran.r-project.org\/package=R2jags."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1093\/jn\/33.5.491","article-title":"The Growth of the Odontoblasts of the Incisor Tooth as a Criterion of the Vitamin C Intake of the Guinea Pig","volume":"33","author":"Crampton","year":"1947","journal-title":"J. Nutr."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"370","DOI":"10.2307\/2344614","article-title":"Generalized Linear Models","volume":"135","author":"Nelder","year":"1972","journal-title":"J. R. Stat. Soc. Ser. A"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.cogpsych.2009.12.001","article-title":"Bayesian Hypothesis Testing for Psychologists: A Tutorial on the Savage\u2013Dickey Method","volume":"60","author":"Wagenmakers","year":"2010","journal-title":"Cogn. Psychol."},{"key":"ref_60","unstructured":"Plummer, M. (2021, November 21). rjags: Bayesian Graphical Models Using MCMC. Available online: https:\/\/cran.r-project.org\/package=rjags."},{"key":"ref_61","unstructured":"Kooperberg, C. (2021, November 21). polspline: Polynomial Spline Routines. Available online: https:\/\/cran.r-project.org\/package=polspline."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/161\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:05:12Z","timestamp":1760133912000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/161"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,21]]},"references-count":61,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["e24020161"],"URL":"https:\/\/doi.org\/10.3390\/e24020161","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,21]]}}}