{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T03:25:26Z","timestamp":1791861926066,"version":"4.3.4"},"reference-count":77,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T00:00:00Z","timestamp":1769126400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T00:00:00Z","timestamp":1769126400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Behav Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    The planning of sample size for research studies often focuses on obtaining a significant result given a specified level of power, significance, and an anticipated effect size. This planning requires prior knowledge of the study design and a statistical analysis to calculate the proposed sample size. However, there may not be one specific testable analysis from which to derive power (Silberzahn et al.,\n                    <jats:italic>Advances in Methods and Practices in Psychological Science<\/jats:italic>\n                    ,\n                    <jats:italic>1<\/jats:italic>\n                    (3), 337356, 2018) or a hypothesis to test for the project (e.g., creation of a stimuli database). Modern power and sample size planning suggestions include accuracy in parameter estimation (AIPE, Kelley,\n                    <jats:italic>Behavior Research Methods<\/jats:italic>\n                    ,\n                    <jats:italic>39<\/jats:italic>\n                    (4), 755\u2013766, 2007; Maxell et al.,\n                    <jats:italic>Annual Review of Psychology<\/jats:italic>\n                    ,\n                    <jats:italic>59<\/jats:italic>\n                    , 537\u2013563, 2008) and simulation of proposed analyses (Chalmers &amp; Adkins,\n                    <jats:italic>The Quantitative Methods for Psychology<\/jats:italic>\n                    ,\n                    <jats:italic>16<\/jats:italic>\n                    (4), 248\u2013280, 2020). These toolkits offer flexibility in traditional power analyses that focus on the if-this, then-that approach. However, both AIPE and simulation require either a specific parameter (e.g., mean, effect size, etc.) or a statistical test for planning sample size. In this tutorial, we explore how AIPE and simulation approaches can be combined to accommodate studies that may not have a specific hypothesis test or wish to account for the potential of a multiverse of analyses. Specifically, we focus on studies that use multiple items and suggest that sample sizes can be planned to measure those items adequately and precisely, regardless of the statistical test. This tutorial also provides multiple code vignettes and package functionality that researchers can adapt and apply to their own measures.\n                  <\/jats:p>","DOI":"10.3758\/s13428-025-02860-7","type":"journal-article","created":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T21:18:37Z","timestamp":1769203117000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Accuracy in parameter estimation and simulation approaches for sample-size planning accounting for item effects"],"prefix":"10.3758","volume":"58","author":[{"given":"Erin M.","family":"Buchanan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mahmoud M.","family":"Elsherif","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Geller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chris L.","family":"Aberson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Necdet","family":"Gurkan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ettore","family":"Ambrosini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Heyman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Montefinese","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wolf","family":"Vanpaemel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Krystian","family":"Barzykowski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlota","family":"Batres","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katharina","family":"Fellnhofer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guanxiong","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph","family":"McFall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gianni","family":"Ribeiro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan P.","family":"R\u00f6er","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jos\u00e9 L.","family":"Ulloa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timo B.","family":"Roettger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"K. D.","family":"Valentine","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonino","family":"Visalli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathleen","family":"Schmidt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin R.","family":"Vasilev","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Giada","family":"Viviani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jacob F.","family":"Miranda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Savannah C.","family":"Lewis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,1,23]]},"reference":[{"key":"2860_CR1","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/j.jesp.2017.09.004","volume":"74","author":"C Albers","year":"2018","unstructured":"Albers, C., & Lakens, D. (2018). When power analyses based on pilot data are biased: inaccurate effect size estimators and follow-up bias. Journal of Experimental Social Psychology, 74, 187\u2013195. https:\/\/doi.org\/10.1016\/j.jesp.2017.09.004","journal-title":"Journal of Experimental Social Psychology"},{"issue":"2","key":"2860_CR2","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1037\/0033-2909.115.2.308","volume":"115","author":"RA Alexander","year":"1994","unstructured":"Alexander, R. A., & DeShon, R. P. (1994). Effect of error variance heterogeneity on the power of tests for regression slope differences. Psychological Bulletin, 115(2), 308\u2013314. https:\/\/doi.org\/10.1037\/0033-2909.115.2.308","journal-title":"Psychological Bulletin"},{"issue":"11","key":"2860_CR3","doi-asserted-by":"publisher","first-page":"1547","DOI":"10.1177\/0956797617723724","volume":"28","author":"SF Anderson","year":"2017","unstructured":"Anderson, S. F., Kelley, K., & Maxwell, S. E. (2017). Sample-size planning for more accurate statistical power: a method adjusting sample effect sizes for publication bias and uncertainty. Psychological Science, 28(11), 1547\u20131562. https:\/\/doi.org\/10.1177\/0956797617723724","journal-title":"Psychological Science"},{"key":"2860_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2021.104159","volume":"96","author":"F Anvari","year":"2021","unstructured":"Anvari, F., & Lakens, D. (2021). Using anchor-based methods to determine the smallest effect size of interest. Journal of Experimental Social Psychology, 96, Article 104159. https:\/\/doi.org\/10.1016\/j.jesp.2021.104159","journal-title":"Journal of Experimental Social Psychology"},{"key":"2860_CR5","doi-asserted-by":"crossref","unstructured":"Aust, F., Barth, M., Diedenhofen, B., Stahl, C., Casillas, J. V., & Siegel, R. (2022). Papaja: Prepare american psychological association journal articles with r markdown. https:\/\/CRAN.R-project.org\/package=papaja","DOI":"10.32614\/CRAN.package.papaja"},{"issue":"8","key":"2860_CR6","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.1177\/0956797616647519","volume":"27","author":"M Bakker","year":"2016","unstructured":"Bakker, M., Hartgerink, C. H. J., Wicherts, J. M., & Van Der Maas, H. L. J. (2016). Researchers\u2019 intuitions about power in psychological research. Psychological Science, 27(8), 1069\u20131077. https:\/\/doi.org\/10.1177\/0956797616647519","journal-title":"Psychological Science"},{"issue":"3","key":"2860_CR7","doi-asserted-by":"publisher","first-page":"445","DOI":"10.3758\/BF03193014","volume":"39","author":"DA Balota","year":"2007","unstructured":"Balota, D. A., Yap, M. J., Hutchison, K. A., Cortese, M. J., Kessler, B., Loftis, B., Neely, J. H., Nelson, D. L., Simpson, G. B., & Treiman, R. (2007). The english lexicon project. Behavior Research Methods, 39(3), 445\u2013459. https:\/\/doi.org\/10.3758\/BF03193014","journal-title":"Behavior Research Methods"},{"key":"2860_CR8","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/j.concog.2019.03.011","volume":"72","author":"K Barzykowski","year":"2019","unstructured":"Barzykowski, K., Nied\u017awie\u0144ska, A., & Mazzoni, G. (2019). How intention to retrieve a memory and expectation that a memory will come to mind influence the retrieval of autobiographical memories. Consciousness and Cognition, 72, 31\u201348. https:\/\/doi.org\/10.1016\/j.concog.2019.03.011","journal-title":"Consciousness and Cognition"},{"issue":"3","key":"2860_CR9","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1016\/j.ptsp.2005.05.004","volume":"6","author":"AM Batterham","year":"2005","unstructured":"Batterham, A. M., & Atkinson, G. (2005). How big does my sample need to be? a primer on the murky world of sample size estimation. Physical Therapy in Sport, 6(3), 153\u2013163. https:\/\/doi.org\/10.1016\/j.ptsp.2005.05.004","journal-title":"Physical Therapy in Sport"},{"key":"2860_CR10","doi-asserted-by":"publisher","unstructured":"Beribisky, N., Alter, U., & Cribbie, R. (2019). A multi-faceted mess: A systematic review of statistical power analysis in psychology journal articles. https:\/\/doi.org\/10.31234\/osf.io\/3bdfu","DOI":"10.31234\/osf.io\/3bdfu"},{"issue":"1","key":"2860_CR11","doi-asserted-by":"publisher","first-page":"16","DOI":"10.5334\/joc.72","volume":"2","author":"M Brysbaert","year":"2019","unstructured":"Brysbaert, M. (2019). How many participants do we have to include in properly powered experiments? a tutorial of power analysis with reference tables. Journal of Cognition, 2(1), 16. https:\/\/doi.org\/10.5334\/joc.72","journal-title":"Journal of Cognition"},{"issue":"1","key":"2860_CR12","doi-asserted-by":"publisher","first-page":"9","DOI":"10.5334\/joc.10","volume":"1","author":"M Brysbaert","year":"2018","unstructured":"Brysbaert, M., & Stevens, M. (2018). Power analysis and effect size in mixed effects models: a tutorial. Journal of Cognition, 1(1), 9. https:\/\/doi.org\/10.5334\/joc.10","journal-title":"Journal of Cognition"},{"issue":"3","key":"2860_CR13","doi-asserted-by":"publisher","first-page":"904","DOI":"10.3758\/s13428-013-0403-5","volume":"46","author":"M Brysbaert","year":"2014","unstructured":"Brysbaert, M., Warriner, A. B., & Kuperman, V. (2014). Concreteness ratings for 40 thousand generally known english word lemmas. Behavior Research Methods, 46(3), 904\u2013911. https:\/\/doi.org\/10.3758\/s13428-013-0403-5","journal-title":"Behavior Research Methods"},{"issue":"4","key":"2860_CR14","doi-asserted-by":"publisher","first-page":"1878","DOI":"10.3758\/s13428-018-1130-8","volume":"51","author":"EM Buchanan","year":"2019","unstructured":"Buchanan, E. M., Valentine, K. D., & Maxwell, N. P. (2019). Lab: linguistic annotated bibliography -a searchable portal for normed database information. Behavior Research Methods, 51(4), 1878\u20131888. https:\/\/doi.org\/10.3758\/s13428-018-1130-8","journal-title":"Behavior Research Methods"},{"issue":"1","key":"2860_CR15","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1177\/2515245918823199","volume":"2","author":"P-C B\u00fcrkner","year":"2019","unstructured":"B\u00fcrkner, P.-C., & Vuorre, M. (2019). Ordinal regression models in psychology: a tutorial. Advances in Methods and Practices in Psychological Science, 2(1), 77\u2013101. https:\/\/doi.org\/10.1177\/2515245918823199","journal-title":"Advances in Methods and Practices in Psychological Science"},{"key":"2860_CR16","doi-asserted-by":"publisher","DOI":"10.1101\/2023.09.21.558661","author":"CDG Burns","year":"2023","unstructured":"Burns, C. D. G., Fracasso, A., & Rousselet, G. A. (2023). Data-driven estimates of the reproducibility of univariate BWAS are biased. https:\/\/doi.org\/10.1101\/2023.09.21.558661","journal-title":"Data-driven estimates of the reproducibility of univariate BWAS are biased."},{"key":"2860_CR17","doi-asserted-by":"publisher","unstructured":"Chalmers, R. P., & Adkins, M. C. (2020). Writing effective and reliable monte carlo simulations with the SimDesign package. The Quantitative Methods for Psychology, 16(4), 248\u2013280. https:\/\/doi.org\/10.20982\/tqmp.16.4.p248","DOI":"10.20982\/tqmp.16.4.p248"},{"issue":"1","key":"2860_CR18","doi-asserted-by":"publisher","first-page":"4","DOI":"10.3934\/Neuroscience.2014.1.4","volume":"1","author":"Chambers, C. D., Feredoes, E., D. Muthukumaraswamy, S., J. Etchells, P., & 1 Cardiff University Brain Research Imaging Centre, School of Psychology, Cardiff University;","year":"2014","unstructured":"Chambers, C. D., Feredoes, E., D. Muthukumaraswamy, S., J. Etchells, P., & 1 Cardiff University Brain Research Imaging Centre, School of Psychology, Cardiff University; (2014). Instead of \u201cplaying the game\u2019\u2019 it is time to change the rules: registered reports at aims neuroscience and beyond. AIMS Neuroscience, 1(1), 4\u201317. https:\/\/doi.org\/10.3934\/Neuroscience.2014.1.4","journal-title":"AIMS Neuroscience"},{"key":"2860_CR19","unstructured":"Champely, S., Ekstrom, C., Dalgaard, P., Gill, J., Weibelzahl, S., Anandkumar, A., Ford, C., Volcic, R., & De Rosario, H. (2017). Pwr: Basic functions for power analysis."},{"key":"2860_CR20","doi-asserted-by":"publisher","unstructured":"Chattopadhyay, B., & Banerjee, S. (2021). Estimation of location parameter within pre-specified error bound with second-order efficient two-stage procedure. South African Statistical Journal, 55(1), 45\u201354. https:\/\/doi.org\/10.37920\/sasj.2021.55.1.4","DOI":"10.37920\/sasj.2021.55.1.4"},{"key":"2860_CR21","doi-asserted-by":"publisher","unstructured":"Chow, S.-C., & Chang, M. (2006). Adaptive Design Methods in Clinical Trials (0th ed.). Chapman; Hall\/CRC. https:\/\/doi.org\/10.1201\/9781584887775","DOI":"10.1201\/9781584887775"},{"issue":"12","key":"2860_CR22","doi-asserted-by":"publisher","first-page":"1304","DOI":"10.1037\/0003-066X.45.12.1304","volume":"45","author":"J Cohen","year":"1990","unstructured":"Cohen, J. (1990). Things i have learned (so far). American Psychologist, 45(12), 1304\u20131312. https:\/\/doi.org\/10.1037\/0003-066X.45.12.1304","journal-title":"American Psychologist"},{"key":"2860_CR23","doi-asserted-by":"publisher","unstructured":"Coretta, S., Casillas, J. V., Roessig, S., Franke, M., Ahn, B., Al-Hoorie, A. H., Al-Tamimi, J., Alotaibi, N. E., AlShakhori, M. K., Altmiller, R. M., Arantes, P., Athanasopoulou, A., Baese-Berk, M. M., Bailey, G., Sangma, C. B. A., Beier, E. J., Benavides, G. M., Benker, N., BensonMeyer, E. P., ..., & Roettger, T. B. (2023). Multidimensional signals and analytic flexibility: estimating degrees of freedom in human-speech analyses. Advances in Methods and Practices in Psychological Science, 6(3), 25152459231162570. https:\/\/doi.org\/10.1177\/25152459231162567","DOI":"10.1177\/25152459231162567"},{"issue":"4","key":"2860_CR24","doi-asserted-by":"publisher","first-page":"1030","DOI":"10.3758\/brm.40.4.1030","volume":"40","author":"S De Deyne","year":"2008","unstructured":"De Deyne, S., Verheyen, S., Ameel, E., Vanpaemel, W., Dry, M. J., Voorspoels, W., & Storms, G. (2008). Exemplar by feature applicability matrices and other dutch normative data for semantic concepts. Behavior Research Methods, 40(4), 1030\u20131048. https:\/\/doi.org\/10.3758\/brm.40.4.1030","journal-title":"Behavior Research Methods"},{"key":"2860_CR25","doi-asserted-by":"publisher","DOI":"10.5281\/ZENODO.2669586","author":"L DeBruine","year":"2021","unstructured":"DeBruine, L. (2021). Faux: simulation for factorial designs. Zenodo. https:\/\/doi.org\/10.5281\/ZENODO.2669586","journal-title":"Zenodo"},{"issue":"452","key":"2860_CR26","doi-asserted-by":"publisher","first-page":"1293","DOI":"10.1080\/01621459.2000.10474333","volume":"95","author":"B Efron","year":"2000","unstructured":"Efron, B. (2000). The bootstrap and modern statistics. Journal of the American Statistical Association, 95(452), 1293\u20131296. https:\/\/doi.org\/10.1080\/01621459.2000.10474333","journal-title":"Journal of the American Statistical Association"},{"issue":"7","key":"2860_CR27","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1037\/0003-066X.63.7.591","volume":"63","author":"DM Erceg-Hurn","year":"2008","unstructured":"Erceg-Hurn, D. M., & Mirosevich, V. M. (2008). Modern robust statistical methods: an easy way to maximize the accuracy and power of your research. American Psychologist, 63(7), 591\u2013601. https:\/\/doi.org\/10.1037\/0003-066X.63.7.591","journal-title":"American Psychologist"},{"issue":"1","key":"2860_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3758\/BF03203630","volume":"28","author":"E Erdfelder","year":"1996","unstructured":"Erdfelder, E., Faul, F., & Buchner, A. (1996). Gpower: a general power analysis program. Behavior Research Methods, Instruments, & Computers, 28(1), 1\u201311. https:\/\/doi.org\/10.3758\/BF03203630","journal-title":"Behavior Research Methods, Instruments, & Computers"},{"key":"2860_CR29","doi-asserted-by":"publisher","unstructured":"Errington, T. M., Mathur, M., Soderberg, C. K., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021). Investigating the replicability of preclinical cancer biology. eLife, 10, e71601. https:\/\/doi.org\/10.7554\/eLife.71601","DOI":"10.7554\/eLife.71601"},{"issue":"2","key":"2860_CR30","doi-asserted-by":"publisher","first-page":"175","DOI":"10.3758\/BF03193146","volume":"39","author":"F Faul","year":"2007","unstructured":"Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175\u2013191. https:\/\/doi.org\/10.3758\/BF03193146","journal-title":"Behavior Research Methods"},{"issue":"1","key":"2860_CR31","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1177\/1948550615612150","volume":"7","author":"K Fiedler","year":"2016","unstructured":"Fiedler, K., & Schwarz, N. (2016). Questionable research practices revisited. Social Psychological and Personality Science, 7(1), 45\u201352. https:\/\/doi.org\/10.1177\/1948550615612150","journal-title":"Social Psychological and Personality Science"},{"key":"2860_CR32","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.brat.2017.05.013","volume":"98","author":"AP Field","year":"2017","unstructured":"Field, A. P., & Wilcox, R. R. (2017). Robust statistical methods: a primer for clinical psychology and experimental psychopathology researchers. Behaviour Research and Therapy, 98, 19\u201338. https:\/\/doi.org\/10.1016\/j.brat.2017.05.013","journal-title":"Behaviour Research and Therapy"},{"key":"2860_CR33","doi-asserted-by":"publisher","unstructured":"Grahe, J., Chalk, H., Cramblet Alvarez, L., Faas, C., Hermann, A., McFall, J., & Molyneux, K. (2022). EAMMi2 public data. Open Science Framework. https:\/\/doi.org\/10.17605\/OSF.IO\/X7MP2","DOI":"10.17605\/OSF.IO\/X7MP2"},{"issue":"4","key":"2860_CR34","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1111\/2041-210X.12504","volume":"7","author":"P Green","year":"2016","unstructured":"Green, P., & MacLeod, C. J. (2016). Simr: an r package for power analysis of generalized linear mixed models by simulation. Methods in Ecology and Evolution, 7(4), 493\u2013498. https:\/\/doi.org\/10.1111\/2041-210X.12504","journal-title":"Methods in Ecology and Evolution"},{"issue":"1","key":"2860_CR35","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1177\/1745691620979806","volume":"17","author":"TE Hardwicke","year":"2022","unstructured":"Hardwicke, T. E., Thibault, R. T., Kosie, J. E., Wallach, J. D., Kidwell, M. C., & Ioannidis, J. P. A. (2022). Estimating the prevalence of transparency and reproducibility-related research practices in psychology (2014\u20132017). Perspectives on Psychological Science, 17(1), 239\u2013251. https:\/\/doi.org\/10.1177\/1745691620979806","journal-title":"Perspectives on Psychological Science"},{"issue":"2","key":"2860_CR36","doi-asserted-by":"publisher","DOI":"10.1098\/rsos.190806","volume":"7","author":"TE Hardwicke","year":"2020","unstructured":"Hardwicke, T. E., Wallach, J. D., Kidwell, M. C., Bendixen, T., Cr\u00fcwell, S., & Ioannidis, J. P. A. (2020). An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014\u20132017). Royal Society Open Science, 7(2), Article 190806. https:\/\/doi.org\/10.1098\/rsos.190806","journal-title":"Royal Society Open Science"},{"issue":"2","key":"2860_CR37","doi-asserted-by":"publisher","first-page":"580","DOI":"10.3758\/s13428-014-0496-5","volume":"47","author":"T Heyman","year":"2014","unstructured":"Heyman, T., De Deyne, S., Hutchison, K. A., & Storms, G. (2014). Using the speeded word fragment completion task to examine semantic priming. Behavior Research Methods, 47(2), 580\u2013606. https:\/\/doi.org\/10.3758\/s13428-014-0496-5","journal-title":"Behavior Research Methods"},{"issue":"5","key":"2860_CR38","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.3758\/s13423-013-0572-3","volume":"21","author":"R Hoekstra","year":"2014","unstructured":"Hoekstra, R., Morey, R. D., Rouder, J. N., & Wagenmakers, E.-J. (2014). Robust misinterpretation of confidence intervals. Psychonomic Bulletin & Review, 21(5), 1157\u20131164. https:\/\/doi.org\/10.3758\/s13423-013-0572-3","journal-title":"Psychonomic Bulletin & Review"},{"issue":"5","key":"2860_CR39","doi-asserted-by":"publisher","first-page":"524","DOI":"10.1177\/0956797611430953","volume":"23","author":"LK John","year":"2012","unstructured":"John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23(5), 524\u2013532. https:\/\/doi.org\/10.1177\/0956797611430953","journal-title":"Psychological Science"},{"issue":"4","key":"2860_CR40","doi-asserted-by":"publisher","first-page":"755","DOI":"10.3758\/BF03192966","volume":"39","author":"K Kelley","year":"2007","unstructured":"Kelley, K. (2007). Sample size planning for the coefficient of variation from the accuracy in parameter estimation approach. Behavior Research Methods, 39(4), 755\u2013766. https:\/\/doi.org\/10.3758\/BF03192966","journal-title":"Behavior Research Methods"},{"issue":"2","key":"2860_CR41","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1037\/met0000127","volume":"23","author":"K Kelley","year":"2018","unstructured":"Kelley, K., Darku, F. B., & Chattopadhyay, B. (2018). Accuracy in parameter estimation for a general class of effect sizes: a sequential approach. Psychological Methods, 23(2), 226\u2013243. https:\/\/doi.org\/10.1037\/met0000127","journal-title":"Psychological Methods"},{"issue":"3","key":"2860_CR42","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1037\/1082-989X.8.3.305","volume":"8","author":"K Kelley","year":"2003","unstructured":"Kelley, K., & Maxwell, S. E. (2003). Sample size for multiple regression: obtaining regression coefficients that are accurate. Not Simply Significant. Psychological Methods, 8(3), 305\u2013321. https:\/\/doi.org\/10.1037\/1082-989X.8.3.305","journal-title":"Not Simply Significant. Psychological Methods"},{"key":"2860_CR43","doi-asserted-by":"publisher","unstructured":"Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., Elsherif, M., Breznau, N., Robertson, O., Kalandadze, T., Yu, S., Baker, B. J., O\u2019Mahony, A., Olsnes, J. \u00d8. -S., Shaw, J. J., Gjoneska, B., Yamada, Y., R\u00f6er, J. P., Murphy, J., ..., & Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. Communications Psychology, 1(1), 1\u201313. https:\/\/doi.org\/10.1038\/s44271-023-00003-2","DOI":"10.1038\/s44271-023-00003-2"},{"issue":"4","key":"2860_CR44","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1017\/pan.2022.20","volume":"31","author":"R Kubinec","year":"2023","unstructured":"Kubinec, R. (2023). Ordered beta regression: a parsimonious, well-fitting model for continuous data with lower and upper bounds. Political Analysis, 31(4), 519\u2013536. https:\/\/doi.org\/10.1017\/pan.2022.20","journal-title":"Political Analysis"},{"key":"2860_CR45","doi-asserted-by":"publisher","unstructured":"Kumle, L., & DejanDraschkow. (2020). Dejandraschkow\/mixedpower: the force awakens. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.3733023","DOI":"10.5281\/zenodo.3733023"},{"key":"2860_CR46","doi-asserted-by":"publisher","unstructured":"Liddell, T. M., & Kruschke, J. K. (2018). Analyzing ordinal data with metric models: what could possibly go wrong? Journal of Experimental Social Psychology, 79, 328\u2013348. https:\/\/doi.org\/10.1016\/j.jesp.2018.08.009","DOI":"10.1016\/j.jesp.2018.08.009"},{"issue":"2","key":"2860_CR47","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1037\/1082-989X.9.2.147","volume":"9","author":"SE Maxwell","year":"2004","unstructured":"Maxwell, S. E. (2004). The persistence of underpowered studies in psychological research: causes, consequences, and remedies. Psychological Methods, 9(2), 147\u2013163. https:\/\/doi.org\/10.1037\/1082-989X.9.2.147","journal-title":"Psychological Methods"},{"key":"2860_CR48","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1146\/annurev.psych.59.103006.093735","volume":"59","author":"SE Maxwell","year":"2008","unstructured":"Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008). Sample size planning for statistical power and accuracy in parameter estimation. Annual Review of Psychology, 59, 537\u2013563. https:\/\/doi.org\/10.1146\/annurev.psych.59.103006.093735","journal-title":"Annual Review of Psychology"},{"issue":"2","key":"2860_CR49","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1037\/h0031564","volume":"90","author":"DE Meyer","year":"1971","unstructured":"Meyer, D. E., & Schvaneveldt, R. W. (1971). Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations. Journal of Experimental Psychology, 90(2), 227\u2013234. https:\/\/doi.org\/10.1037\/h0031564","journal-title":"Journal of Experimental Psychology"},{"issue":"1","key":"2860_CR50","doi-asserted-by":"publisher","first-page":"124","DOI":"10.3758\/s13423-015-0859-7","volume":"23","author":"J Miller","year":"2016","unstructured":"Miller, J., & Ulrich, R. (2016). Interpreting confidence intervals: a comment on hoekstra, morey, rouder, and wagenmakers (2014). Psychonomic Bulletin & Review, 23(1), 124\u2013130. https:\/\/doi.org\/10.3758\/s13423-015-0859-7","journal-title":"Psychonomic Bulletin & Review"},{"key":"2860_CR51","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.11858","volume":"9","author":"M Montefinese","year":"2021","unstructured":"Montefinese, M., Ambrosini, E., & Angrilli, A. (2021). Online search trends and word-related emotional response during covid-19 lockdown in italy: a cross-sectional online study. PeerJ, 9, Article e11858. https:\/\/doi.org\/10.7717\/peerj.11858","journal-title":"PeerJ"},{"key":"2860_CR52","doi-asserted-by":"publisher","unstructured":"Montefinese, M., Vinson, D., Vigliocco, G., & Ambrosini, E. (2022). Italian age of acquisition norms for a large set of words (ItAoA). Open Science Framework. https:\/\/doi.org\/10.17605\/OSF.IO\/3TRG2","DOI":"10.17605\/OSF.IO\/3TRG2"},{"issue":"1","key":"2860_CR53","doi-asserted-by":"publisher","first-page":"131","DOI":"10.3758\/s13423-015-0955-8","volume":"23","author":"RD Morey","year":"2016","unstructured":"Morey, R. D., Hoekstra, R., Rouder, J. N., & Wagenmakers, E.-J. (2016). Continued misinterpretation of confidence intervals: response to miller and ulrich. Psychonomic Bulletin & Review, 23(1), 131\u2013140. https:\/\/doi.org\/10.3758\/s13423-015-0955-8","journal-title":"Psychonomic Bulletin & Review"},{"issue":"1","key":"2860_CR54","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1007\/BF01893607","volume":"27","author":"N Mukhopadhyay","year":"1980","unstructured":"Mukhopadhyay, N. (1980). A consistent and asymptotically efficient two-stage procedure to construct fixed width confidence intervals for the mean. Metrika, 27(1), 281\u2013284. https:\/\/doi.org\/10.1007\/BF01893607","journal-title":"Metrika"},{"issue":"3","key":"2860_CR55","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1027\/1864-9335\/a000192","volume":"45","author":"BA Nosek","year":"2014","unstructured":"Nosek, B. A., & Lakens, D. (2014). Registered reports: a method to increase the credibility of published results. Social Psychology, 45(3), 137\u2013141. https:\/\/doi.org\/10.1027\/1864-9335\/a000192","journal-title":"Social Psychology"},{"issue":"4","key":"2860_CR56","doi-asserted-by":"publisher","first-page":"1205","DOI":"10.3758\/s13428-015-0664-2","volume":"48","author":"MB Nuijten","year":"2016","unstructured":"Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016). The prevalence of statistical reporting errors in psychology (1985\u20132013). Behavior Research Methods, 48(4), 1205\u20131226. https:\/\/doi.org\/10.3758\/s13428-015-0664-2","journal-title":"Behavior Research Methods"},{"key":"2860_CR57","doi-asserted-by":"publisher","unstructured":"Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716\u2013aac4716. https:\/\/doi.org\/10.1126\/science.aac4716","DOI":"10.1126\/science.aac4716"},{"key":"2860_CR58","doi-asserted-by":"publisher","unstructured":"Peterson, J. C., Uddenberg, S., Griffiths, T. L., Todorov, A., & Suchow, J. W. (2022). Deep models of superficial face judgments. Proceedings of the National Academy of Sciences, 119(17). https:\/\/doi.org\/10.1073\/pnas.2115228119","DOI":"10.1073\/pnas.2115228119"},{"issue":"3","key":"2860_CR59","doi-asserted-by":"publisher","first-page":"1198","DOI":"10.3758\/s13428-017-0938-y","volume":"50","author":"L Pollock","year":"2018","unstructured":"Pollock, L. (2018). Statistical and methodological problems with concreteness and other semantic variables: a list memory experiment case study. Behavior Research Methods, 50(3), 1198\u20131216. https:\/\/doi.org\/10.3758\/s13428-017-0938-y","journal-title":"Behavior Research Methods"},{"key":"2860_CR60","doi-asserted-by":"publisher","unstructured":"Pownall, M., Pennington, C. R., Norris, E., Juanchich, M., Smailes, D., Russell, S., Gooch, D., Evans, T. R., Persson, S., Mak, M. H. C., Tzavella, L., Monk, R., Gough, T., Benwell, C. S. Y., Elsherif, M., Farran, E., Gallagher-Mitchell, T., Kendrick, L. T., Bahnmueller, J., ..., & Clark, K. (2023). Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation. Advances in Methods and Practices in Psychological Science, 6(4), 25152459231202724. https:\/\/doi.org\/10.1177\/25152459231202724","DOI":"10.1177\/25152459231202724"},{"issue":"4","key":"2860_CR61","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1177\/17456916211017098","volume":"16","author":"T Proulx","year":"2021","unstructured":"Proulx, T., & Morey, R. D. (2021). Beyond statistical ritual: theory in psychological science. Perspectives on Psychological Science, 16(4), 671\u2013681. https:\/\/doi.org\/10.1177\/17456916211017098","journal-title":"Perspectives on Psychological Science"},{"issue":"4","key":"2860_CR62","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1080\/00220970109599493","volume":"69","author":"DC Rheinheimer","year":"2001","unstructured":"Rheinheimer, D. C., & Penfield, D. A. (2001). The effects of type i error rate and power of the ancova f test and selected alternatives under nonnormality and variance heterogeneity. The Journal of Experimental Education, 69(4), 373\u2013391. https:\/\/doi.org\/10.1080\/00220970109599493","journal-title":"The Journal of Experimental Education"},{"issue":"4","key":"2860_CR63","doi-asserted-by":"publisher","first-page":"1294","DOI":"10.1037\/a0031214","volume":"39","author":"JP R\u00f6er","year":"2013","unstructured":"R\u00f6er, J. P., Bell, R., & Buchner, A. (2013). Is the survival-processing memory advantage due to richness of encoding? Journal of Experimental Psychology: Learning, Memory, and Cognition, 39(4), 1294\u20131302. https:\/\/doi.org\/10.1037\/a0031214","journal-title":"Journal of Experimental Psychology: Learning, Memory, and Cognition"},{"issue":"3","key":"2860_CR64","doi-asserted-by":"publisher","first-page":"638","DOI":"10.1037\/0033-2909.86.3.638","volume":"86","author":"R Rosenthal","year":"1979","unstructured":"Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638\u2013641. https:\/\/doi.org\/10.1037\/0033-2909.86.3.638","journal-title":"Psychological Bulletin"},{"issue":"1","key":"2860_CR65","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1177\/2515245917745058","volume":"1","author":"JN Rouder","year":"2018","unstructured":"Rouder, J. N., & Haaf, J. M. (2018). Power, dominance, and constraint: a note on the appeal of different design traditions. Advances in Methods and Practices in Psychological Science, 1(1), 19\u201326. https:\/\/doi.org\/10.1177\/2515245917745058","journal-title":"Advances in Methods and Practices in Psychological Science"},{"key":"2860_CR66","doi-asserted-by":"publisher","unstructured":"Rousselet, G., Pernet, D. C., & Wilcox, R. R. (2022). An introduction to the bootstrap: A versatile method to make inferences by using data-driven simulations. Meta-Psychology. https:\/\/doi.org\/10.31234\/osf.io\/h8ft7","DOI":"10.31234\/osf.io\/h8ft7"},{"key":"2860_CR67","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-1862-1","volume-title":"Sequential Analysis: Tests and Confidence Intervals","author":"D Siegmund","year":"1985","unstructured":"Siegmund, D. (1985). Sequential Analysis: Tests and Confidence Intervals. New York: Springer."},{"issue":"3","key":"2860_CR68","doi-asserted-by":"publisher","DOI":"10.1177\/2515245917747646","volume":"1","author":"R Silberzahn","year":"2018","unstructured":"Silberzahn, R., Uhlmann, E. L., Martin, D. P., Anselmi, P., Aust, F., Awtrey, E., Bahn\u00edk, \u0160, Bai, F., Bannard, C., Bonnier, E., et al. (2018). Many analysts, one data set: making transparent how variations in analytic choices affect results. Advances in Methods and Practices in Psychological Science, 1(3), Article 337356. https:\/\/doi.org\/10.1177\/2515245917747646","journal-title":"Advances in Methods and Practices in Psychological Science"},{"issue":"11","key":"2860_CR69","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.1177\/0956797611417632","volume":"22","author":"JP Simmons","year":"2011","unstructured":"Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359\u20131366. https:\/\/doi.org\/10.1177\/0956797611417632","journal-title":"Psychological Science"},{"key":"2860_CR70","doi-asserted-by":"publisher","unstructured":"Stewart, S., Rinke, E. M., McGarrigle, R., Lynott, D., Lunny, C., Lautarescu, A., Galizzi, M. M., Farran, E. K., & Crook, Z. (2020). Pre-registration and registered reports: A primer from UKRN. https:\/\/doi.org\/10.31219\/osf.io\/8v2n7","DOI":"10.31219\/osf.io\/8v2n7"},{"issue":"4","key":"2860_CR71","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1177\/1745691620966796","volume":"16","author":"A Szollosi","year":"2021","unstructured":"Szollosi, A., & Donkin, C. (2021). Arrested theory development: the misguided distinction between exploratory and confirmatory research. Perspectives on Psychological Science, 16(4), 717\u2013724. https:\/\/doi.org\/10.1177\/1745691620966796","journal-title":"Perspectives on Psychological Science"},{"issue":"5","key":"2860_CR72","doi-asserted-by":"publisher","first-page":"2175","DOI":"10.3758\/s13428-022-01814-7","volume":"55","author":"JE Taylor","year":"2022","unstructured":"Taylor, J. E., Rousselet, G. A., Scheepers, C., & Sereno, S. C. (2022). Rating norms should be calculated from cumulative link mixed effects models. Behavior Research Methods, 55(5), 2175\u20132196. https:\/\/doi.org\/10.3758\/s13428-022-01814-7","journal-title":"Behavior Research Methods"},{"key":"2860_CR73","doi-asserted-by":"publisher","unstructured":"Ulloa, J. L., Marchetti, C., Taffou, M., & George, N. (2014). Only your eyes tell me what you like: exploring the liking effect induced by other\u2019s gaze. Cognition and Emotion, 29(3), 460\u2013470. https:\/\/doi.org\/10.1080\/02699931.2014.919899","DOI":"10.1080\/02699931.2014.919899"},{"key":"2860_CR74","doi-asserted-by":"publisher","unstructured":"van den Akker, O. R., van Assen, M. A. L. M., Bakker, M., Elsherif, M., Wong, T. K., & Wicherts, J. M. (2023). Preregistration in practice: a comparison of preregistered and non-preregistered studies in psychology. Behavior Research Methods. https:\/\/doi.org\/10.3758\/s13428-023-02277-0","DOI":"10.3758\/s13428-023-02277-0"},{"key":"2860_CR75","doi-asserted-by":"publisher","unstructured":"van den Akker, O. R., Bakker, M., Assen, M. A. L. M. van, Pennington, C. R., Verweij, L., Elsherif, M., Claesen, A., Gaillard, S. D. M., Yeung, S. K., Frankenberger, J.-L., Krautter, K., Cockcroft, J. P., Kreuer, K. S., Evans, T. R., Heppel, F., Schoch, S. F., Korbmacher, M., Yamada, Y., Albayrak-Aydemir, N., ..., Wicherts, J. (2023). The effectiveness of preregistration in psychology: Assessing preregistration strictness and preregistration-study consistency. https:\/\/doi.org\/10.31222\/osf.io\/h8xjw","DOI":"10.31222\/osf.io\/h8xjw"},{"issue":"4","key":"2860_CR76","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1177\/1745691617751884","volume":"13","author":"S Vazire","year":"2018","unstructured":"Vazire, S. (2018). Implications of the credibility revolution for productivity, creativity, and progress. Perspectives on Psychological Science, 13(4), 411\u2013417. https:\/\/doi.org\/10.1177\/1745691617751884","journal-title":"Perspectives on Psychological Science"},{"key":"2860_CR77","doi-asserted-by":"crossref","unstructured":"Wald, A. (1992). Sequential tests of statistical hypotheses (S. Kotz & N. L. Johnson, Eds.; pp. 256\u2013298). Springer New York. http:\/\/link.springer.com\/10.1007\/978-1-4612-0919-5_18","DOI":"10.1007\/978-1-4612-0919-5_18"}],"container-title":["Behavior Research Methods"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-025-02860-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.3758\/s13428-025-02860-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-025-02860-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T19:30:31Z","timestamp":1772047831000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.3758\/s13428-025-02860-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,23]]},"references-count":77,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2026,2]]}},"alternative-id":["2860"],"URL":"https:\/\/doi.org\/10.3758\/s13428-025-02860-7","relation":{},"ISSN":["1554-3528"],"issn-type":[{"value":"1554-3528","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,23]]},"assertion":[{"value":"29 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 September 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 January 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The researchers declare no conflicts of interest. Erin Buchanan is a co-editor of Behavior Research Methods but had no involvement in the review process or the editorial decision for this manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of Interest"}},{"value":"Not applicable, simulation study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"Not applicable, simulation study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All authors approved the manuscript, no participant approval necessary.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"No materials were used.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Materials"}},{"value":"Manuscript repository with code and data:\n                      \n                      or\n                      \n                      Package repository with vignettes and data:","order":7,"name":"Ethics","group":{"name":"EthicsHeading","label":"Analysis Code"}},{"value":"We did not pre-register this study, as it was a simulation study.","order":8,"name":"Ethics","group":{"name":"EthicsHeading","label":"Pre-registration"}}],"article-number":"48"}}