{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T04:54:37Z","timestamp":1776315277350,"version":"3.50.1"},"reference-count":46,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T00:00:00Z","timestamp":1776297600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:p>Empirical investigation requires dealing with fundamental uncertainty. In experimental psychology, research questions are often addressed using Null Hypothesis Significance Testing (NHST), an approach rooted in the frequentist statistical tradition. In scenarios that do not consent to reject the null hypothesis using the NHST paradigm (i.e., results are non-significant), researchers may be tempted to reframe their analysis in the Bayesian framework, either as a complementary alternative or alongside the original NHST approach. In fact, the Bayesian approach is gaining increasing appeal in the social sciences as an alternative to the frequentist NHST framework, and Bayesian methods for hypothesis testing (i.e., the Bayes Factor) can be used to help determine whether a failure to reject the null hypothesis reflects merely insufficient evidence for the alternative hypothesis or provides affirmative evidence for the (point) null hypothesis. Nevertheless, using the two approaches interchangeably carries the risk of conceptual confusion, as NHST and Bayesian frameworks address different inferential questions. This study provides an empirical, real-world opportunity to examine how NHST and Bayesian methods can be applied to the same hypothesis test when using Generalized Linear Mixed Models with a Binary Outcome. Importantly, this application incorporates common experimental constraints into the design-analysis planning, defining a reachable, realistic albeit underpowered sample size, assuming the classical 0.80 power threshold. This research report provides a valuable opportunity to examine how Bayesian and NHST approaches potentially differ in their workflow, performance, and inferential interpretation under realistic experimental conditions.<\/jats:p>","DOI":"10.3389\/fpsyg.2026.1770212","type":"journal-article","created":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T04:21:05Z","timestamp":1776313265000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Null hypothesis significance testing vs. Bayesian inference using generalized linear mixed models with binary outcomes: a case study under practical design constraints"],"prefix":"10.3389","volume":"17","author":[{"given":"Stefano","family":"Dalla Bona","sequence":"first","affiliation":[{"name":"Department of General Psychology, Universita Degli Studi di Padova","place":["Padova, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Spoto","sequence":"additional","affiliation":[{"name":"Department of General Psychology, Universita Degli Studi di Padova","place":["Padova, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marta","family":"Caserotti","sequence":"additional","affiliation":[{"name":"Department of Developmental Psychology and Socialisation, Universit\u00e0 degli Studi di Padova","place":["Padova, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lorella","family":"Lotto","sequence":"additional","affiliation":[{"name":"Department of Developmental Psychology and Socialisation, Universit\u00e0 degli Studi di Padova","place":["Padova, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michela","family":"Sarlo","sequence":"additional","affiliation":[{"name":"Department of Communication Sciences, Humanities and International Studies, Universita degli Studi di Urbino Carlo Bo","place":["Urbino, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicola","family":"Cellini","sequence":"additional","affiliation":[{"name":"Department of General Psychology, Universita Degli Studi di Padova","place":["Padova, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simone","family":"Cutini","sequence":"additional","affiliation":[{"name":"Department of General Psychology, Universita Degli Studi di Padova","place":["Padova, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni","family":"Bruno","sequence":"additional","affiliation":[{"name":"Department of General Psychology, Universita Degli Studi di Padova","place":["Padova, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2026,4,16]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical model identification","volume":"19","author":"Akaike","year":"1974","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.1177\/0956797616647519","article-title":"Researchers\u2019 intuitions about power in psychological research","volume":"27","author":"Bakker","year":"2016","journal-title":"Psychol. Sci."},{"key":"ref4","doi-asserted-by":"publisher","first-page":"882","DOI":"10.1111\/2041-210X.13407","article-title":"The use of Bayesian priors in ecology: the good, the bad, and the not great","volume":"11","author":"Banner","year":"2020","journal-title":"Methods Ecol. Evol."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting linear mixed-effects models using lme4","volume":"67","author":"Bates","year":"2015","journal-title":"J. Stat. Softw."},{"key":"ref6","doi-asserted-by":"publisher","first-page":"1573","DOI":"10.1126\/science.aaf2654","article-title":"The social dilemma of autonomous vehicles","volume":"352","author":"Bonnefon","year":"2016","journal-title":"Science"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"13159","DOI":"10.1007\/s12144-021-02511-y","article-title":"Moral judgment, decision times and emotional salience of a new developed set of sacrificial manual driving dilemmas","volume":"42","author":"Bruno","year":"","journal-title":"Curr. Psychol."},{"key":"ref8","doi-asserted-by":"publisher","first-page":"781","DOI":"10.1007\/s11031-023-10024-3","article-title":"Framing self-sacrifice in the investigation of moral judgment and moral emotions in human and autonomous driving dilemmas","volume":"47","author":"Bruno","year":"","journal-title":"Motiv. Emot."},{"key":"ref9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v080.i01","article-title":"Brms: an R package for Bayesian multilevel models using Stan","volume":"80","author":"B\u00fcrkner","year":"2017","journal-title":"J. Stat. Softw."},{"key":"ref10","doi-asserted-by":"publisher","first-page":"395","DOI":"10.32614\/RJ-2018-017","article-title":"Advanced Bayesian multilevel modeling with the R package brms","volume":"10","author":"B\u00fcrkner","year":"2018","journal-title":"R J."},{"key":"ref11","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1037\/a0015972","article-title":"The seemingly quixotic pursuit of a cumulative psychological science: introduction to the special issue","volume":"14","author":"Curran","year":"2009","journal-title":"Psychol. Methods"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"781","DOI":"10.3389\/fpsyg.2014.00781","article-title":"Using Bayes to get the most out of non-significant results","volume":"5","author":"Dienes","year":"2014","journal-title":"Front. Psychol."},{"key":"ref13","doi-asserted-by":"publisher","first-page":"e0149794","DOI":"10.1371\/journal.pone.0149794","article-title":"A Bayesian perspective on the reproducibility project: psychology","volume":"11","author":"Etz","year":"2016","journal-title":"PLoS One"},{"key":"ref14","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.1.3923.554-a","volume-title":"The Design of Experiments","author":"Fisher","year":""},{"key":"ref15","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198522294.001.0001","volume-title":"Statistical Methods, Experimental Design, and Scientific Inference: A re-Issue of Statistical Methods for Research Workers, The Design of Experiments, and Statistical Methods and Scientific Inference","author":"Fisher","year":"1990"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1111\/bjop.12585","article-title":"Before\/after Bayes: a comparison of frequentist and Bayesian mixed-effects models in applied psychological research","volume":"113","author":"Flores","year":"2022","journal-title":"British J. Psychol."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"1360","DOI":"10.1214\/08-AOAS191","article-title":"A weakly informative default prior distribution for logistic and other regression models","volume":"2","author":"Gelman","year":"2008","journal-title":"Ann. Appl. Stat."},{"key":"ref18","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1214\/17-BA1051","article-title":"On the use of Cauchy prior distributions for Bayesian logistic regression","volume":"13","author":"Ghosh","year":"2018","journal-title":"Bayesian Analysis"},{"key":"ref9001","first-page":"587","article-title":"Mindless statistics","volume-title":"Journal of Socio-Economics","author":"Gigerenzer","year":"2004"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1093\/ije\/dyi312","article-title":"Bayesian perspectives for epidemiological research: I. Foundations and basic methods","volume":"35","author":"Greenland","year":"2006","journal-title":"Int. J. Epidemiol."},{"key":"ref20","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1016\/j.jmp.2017.09.005","article-title":"A tutorial on bridge sampling","volume":"81","author":"Gronau","year":"2017","journal-title":"J. Math. Psychol."},{"key":"ref21","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1111\/1468-0009.12210","article-title":"The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses","volume":"94","author":"Ioannidis","year":"2016","journal-title":"Milbank Q."},{"key":"ref22","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1007\/s11222-023-10366-5","article-title":"Detecting and diagnosing prior and likelihood sensitivity with power-scaling","volume":"34","author":"Kallioinen","year":"2024","journal-title":"Stat. Comput."},{"key":"ref23","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1186\/s12874-020-00980-6","article-title":"Bayesian alternatives to null hypothesis significance testing in biomedical research: a non-technical introduction to Bayesian inference with JASP","volume":"20","author":"Kelter","year":"2020","journal-title":"BMC Med. Res. Methodol."},{"key":"ref24","doi-asserted-by":"publisher","first-page":"1263","DOI":"10.1007\/s00180-020-01034-7","article-title":"Analysis of type I and II error rates of Bayesian and frequentist parametric and nonparametric two-sample hypothesis tests under preliminary assessment of normality","volume":"36","author":"Kelter","year":"2021","journal-title":"Comput. Stat."},{"key":"ref25","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1093\/biomet\/30.1-2.81","article-title":"A new measure of rank correlation","volume":"30","author":"Kendall","year":"1938","journal-title":"Biometrika"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"486","DOI":"10.1080\/00131911.2017.1350636","article-title":"Bayesian statistics in educational research: a look at the current state of affairs","volume":"70","author":"K\u00f6nig","year":"2018","journal-title":"Educ. Rev."},{"key":"ref27","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1177\/1745691611406925","article-title":"Bayesian assessment of null values via parameter estimation and model comparison","volume":"6","author":"Kruschke","year":"2011","journal-title":"Perspect. Psychol. Sci."},{"key":"ref28","volume-title":"Doing Bayesian data Analysis: A Tutorial with R, JAGS, and Stan","author":"Kruschke","year":"2014"},{"key":"ref30","volume-title":"Statistical Analysis in Educational Research","author":"Lindquist","year":"1940"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"2767","DOI":"10.3389\/fpsyg.2019.02767","article-title":"Indices of effect existence and significance in the Bayesian framework","volume":"10","author":"Makowski","year":"","journal-title":"Front. Psychol."},{"key":"ref32","doi-asserted-by":"publisher","first-page":"1541","DOI":"10.21105\/joss.01541","article-title":"BayestestR: describing effects and their uncertainty, existence and significance within the Bayesian framework","volume":"4","author":"Makowski","year":"","journal-title":"J. Open Source Softw."},{"key":"ref33","doi-asserted-by":"publisher","first-page":"103","DOI":"10.3758\/s13423-015-0947-8","article-title":"The fallacy of placing confidence in confidence intervals","volume":"23","author":"Morey","year":"2016","journal-title":"Psychon. Bull. Rev."},{"key":"ref9002","first-page":"611","article-title":"In defense of P values","volume-title":"Ecology","author":"Murtaugh","year":"2014"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"79","DOI":"10.3758\/BF03210778","article-title":"Applying Occam\u2019s razor in modeling cognition: a Bayesian approach","volume":"4","author":"Myung","year":"1997","journal-title":"Psychon. Bull. Rev."},{"key":"ref35","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1016\/j.jmp.2015.03.003","article-title":"Bayesian alternatives to null-hypothesis significance testing for repeated-measures designs","volume":"72","author":"Nathoo","year":"2016","journal-title":"J. Math. Psychol."},{"key":"ref36","doi-asserted-by":"publisher","first-page":"175","DOI":"10.2307\/2331945","article-title":"On the use and interpretation of certain test criteria for purposes of statistical inference: part I","author":"Neyman","year":"1928","journal-title":"Biometrika"},{"key":"ref37","first-page":"235","volume-title":"Bayesian Inference","author":"Ortega","year":"2017"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"223","DOI":"10.3389\/fpsyg.2015.00223","article-title":"Fisher, Neyman-Pearson or NHST? A tutorial for teaching data testing","volume":"6","author":"Perezgonzalez","year":"2015","journal-title":"Front. Psychol."},{"key":"ref39","volume-title":"R: A Language and Environment for Statistical Computing","year":"2024"},{"key":"ref41","first-page":"1","article-title":"Penalising model component complexity: a principled, practical approach to constructing priors","volume-title":"Statistical Science,","author":"Simpson","year":"2015"},{"key":"ref42","article-title":"Stan reference manual","year":"2025"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1037\/met0000221","article-title":"A review of issues about null hypothesis Bayesian testing","volume":"24","author":"Tendeiro","year":"2019","journal-title":"Psychol. Methods"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.1177\/25152459231213371","article-title":"Diagnosing the misuse of the Bayes factor in applied research. Advances in methods and practices","volume":"7","author":"Tendeiro","year":"2024","journal-title":"Psychol. Sci."},{"key":"ref45","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1037\/met0000100","article-title":"A systematic review of Bayesian articles in psychology: the last 25 years","volume":"22","author":"van de Schoot","year":"2017","journal-title":"Psychol. Methods"},{"key":"ref46","doi-asserted-by":"publisher","first-page":"35","DOI":"10.3758\/s13423-017-1343-3","article-title":"Bayesian inference for psychology. Part I: theoretical advantages and practical ramifications","volume":"25","author":"Wagenmakers","year":"2018","journal-title":"Psychon. Bull. Rev."},{"key":"ref47","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1080\/00031305.2016.1154108","article-title":"The asa\u2019s statement on p-values: context, process, and purpose","volume":"70","author":"Wasserstein","year":"2016","journal-title":"Am. Statist."}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1770212\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T04:21:08Z","timestamp":1776313268000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1770212\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,16]]},"references-count":46,"alternative-id":["10.3389\/fpsyg.2026.1770212"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2026.1770212","relation":{},"ISSN":["1664-1078"],"issn-type":[{"value":"1664-1078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,16]]},"article-number":"1770212"}}