{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T16:50:44Z","timestamp":1794329444820,"version":"4.9.0"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2025,9,18]],"date-time":"2025-09-18T00:00:00Z","timestamp":1758153600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,9,18]],"date-time":"2025-09-18T00:00:00Z","timestamp":1758153600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Ministry of Culture and Innovation of Hungary from the National Research, Development and Innovation Fund","award":["ADVANCED 150781"],"award-info":[{"award-number":["ADVANCED 150781"]}]},{"DOI":"10.13039\/501100011019","name":"Nemzeti Kutat\u00e1si Fejleszt\u00e9si \u00e9s Innov\u00e1ci\u00f3s Hivatal","doi-asserted-by":"publisher","award":["\u00daNKP-23-3-II"],"award-info":[{"award-number":["\u00daNKP-23-3-II"]}],"id":[{"id":"10.13039\/501100011019","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100009934","name":"E\u00f6tv\u00f6s Lor\u00e1nd University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100009934","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Behav Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Researcher degrees of freedom in data analysis present significant challenges in social sciences, where different analytical decisions can lead to varying conclusions. In this work, we propose an example of an exploratory multiverse simulation to empirically compare various decision pathways to identify an effect\u2019s sensitivity to different analytical choices. The approach is demonstrated on the congruency sequence effect (CSE), a well-studied phenomenon in cognitive control research. We reviewed existing literature to identify common non-theory-specific analytical decisions, such as outlier exclusion criteria and hypothesis testing methods, and incorporated these into our simulation framework. Using 20,000 simulated datasets, we compared the true positive rates (TPR) and false positive rates (FPR) across 50 different decision pathways, resulting in a total of 1 million analyses. Our results indicate substantial differences in power and type I error rates across the analytical pathways, with some posing a significant risk of producing high false positives. The findings underscore the importance of running extensive simulations to investigate different data handling and hypothesis testing approaches in certain research fields. This case study serves as an example for conducting similar simulation procedures in research fields characterized by high variability in analytical decisions when investigating an otherwise widely accepted effect.<\/jats:p>","DOI":"10.3758\/s13428-025-02807-y","type":"journal-article","created":{"date-parts":[[2025,9,18]],"date-time":"2025-09-18T18:13:59Z","timestamp":1758219239000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Multiverse simulation to explore the impact of analytical choices on type I and type II errors in a reaction time study"],"prefix":"10.3758","volume":"57","author":[{"given":"Miklos","family":"Bognar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marton A.","family":"Varga","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Don","family":"van Ravenzwaaij","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zoltan","family":"Kekecs","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James A.","family":"Grange","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mate","family":"Gyurkovics","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Balazs","family":"Aczel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,9,18]]},"reference":[{"key":"2807_CR1","doi-asserted-by":"publisher","first-page":"e72185","DOI":"10.7554\/eLife.72185","volume":"10","author":"B Aczel","year":"2021","unstructured":"Aczel, B., Szaszi, B., Nilsonne, G., van den Akker, O. R., Albers, C. J., van Assen, M. A., Bastiaansen, J. A., Benjamin, D., Boehm, U., Botvinik-Nezer, R., Bringmann, L. F., Busch, N. A., Caruyer, E., Cataldo, A. M., Cowan, N., Delios, A., van Dongen, N. N., Donkin, C., van Doorn, J. B., \u2026 Wagenmakers, E.-J. (2021). Consensus-based guidance for conducting and reporting multi-analyst studies. eLife, 10, e72185. https:\/\/doi.org\/10.7554\/eLife.72185","journal-title":"eLife"},{"issue":"1","key":"2807_CR2","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1016\/j.cognition.2008.12.009","volume":"111","author":"J Allan Cheyne","year":"2009","unstructured":"Allan Cheyne, J., Solman, G. J. F., Carriere, J. S. A., & Smilek, D. (2009). Anatomy of an error: A bidirectional state model of task engagement\/disengagement and attention-related errors. Cognition, 111(1), 98\u2013113. https:\/\/doi.org\/10.1016\/j.cognition.2008.12.009","journal-title":"Cognition"},{"issue":"3","key":"2807_CR3","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1080\/23743603.2019.1684822","volume":"3","author":"F Anvari","year":"2018","unstructured":"Anvari, F., & Lakens, D. (2018). The replicability crisis and public trust in psychological science. Comprehensive Results in Social Psychology, 3(3), 266\u2013286. https:\/\/doi.org\/10.1080\/23743603.2019.1684822","journal-title":"Comprehensive Results in Social Psychology"},{"issue":"3","key":"2807_CR4","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1016\/j.jml.2012.11.001","volume":"68","author":"DJ Barr","year":"2013","unstructured":"Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255\u2013278. https:\/\/doi.org\/10.1016\/j.jml.2012.11.001","journal-title":"Journal of Memory and Language"},{"key":"2807_CR5","doi-asserted-by":"publisher","unstructured":"Bastian, C. C. von, Blais, C., Brewer, G., Gyurkovics, M., Hedge, C., Ka\u0142ama\u0142a, P., Meier, M., Oberauer, K., Rey-Mermet, A., Rouder, J. N., Souza, A. S., Bartsch, L. M., Conway, A. R. A., Draheim, C., Engle, R. W., Friedman, N. P., Frischkorn, G. T., Gustavson, D. E., Koch, I., \u2026, & Wiemers, E. (2020). Advancing the understanding of individual differences in attentional control: Theoretical, methodological, and analytical considerations. OSF. https:\/\/doi.org\/10.31234\/osf.io\/x3b9k","DOI":"10.31234\/osf.io\/x3b9k"},{"key":"2807_CR6","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2021.675558","author":"A Berger","year":"2021","unstructured":"Berger, A., & Kiefer, M. (2021). Comparison of different response time outlier exclusion methods: A simulation study. Frontiers in Psychology. https:\/\/doi.org\/10.3389\/fpsyg.2021.675558","journal-title":"Frontiers in Psychology"},{"key":"2807_CR7","doi-asserted-by":"publisher","unstructured":"Boag, R., Innes, R., Stevenson, N., Bahg, G., Busemeyer, J., Cox, G., Donkin, C., Frank, M., Hawkins, G., Heathcote, A., Hedge, C., Lerche, V., Lilburn, S., Logan, G., Matzke, D., Miletic, S., Osth, A., Palmeri, T., Sederberg, P., \u2026, & Forstmann, B. (2024). An expert guide to planning experimental tasks for evidence accumulation modelling. OSF. https:\/\/doi.org\/10.31234\/osf.io\/snqgp","DOI":"10.31234\/osf.io\/snqgp"},{"issue":"4","key":"2807_CR8","doi-asserted-by":"publisher","first-page":"650","DOI":"10.1080\/02699931.2023.2191172","volume":"37","author":"M Bognar","year":"2023","unstructured":"Bognar, M., Gyurkovics, M., van Steenbergen, H., & Aczel, B. (2023). Phasic affective signals by themselves do not regulate cognitive control. Cognition and Emotion, 37(4), 650\u2013665. https:\/\/doi.org\/10.1080\/02699931.2023.2191172","journal-title":"Cognition and Emotion"},{"issue":"3","key":"2807_CR9","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1037\/0033-295X.108.3.624","volume":"108","author":"MM Botvinick","year":"2001","unstructured":"Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108(3), 624\u2013652. https:\/\/doi.org\/10.1037\/0033-295X.108.3.624","journal-title":"Psychological Review"},{"issue":"9","key":"2807_CR10","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1016\/j.tics.2019.07.002","volume":"23","author":"S Braem","year":"2019","unstructured":"Braem, S., Bugg, J. M., Schmidt, J. R., Crump, M. J. C., Weissman, D. H., Notebaert, W., & Egner, T. (2019). Measuring adaptive control in conflict tasks. Trends in Cognitive Sciences, 23(9), 769\u2013783. https:\/\/doi.org\/10.1016\/j.tics.2019.07.002","journal-title":"Trends in Cognitive Sciences"},{"issue":"3","key":"2807_CR11","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1016\/j.cortex.2012.12.016","volume":"49","author":"CD Chambers","year":"2013","unstructured":"Chambers, C. D. (2013). Registered reports: A new publishing initiative at Cortex. Cortex; a Journal Devoted to the Study of the Nervous System and Behavior, 49(3), 609\u2013610. https:\/\/doi.org\/10.1016\/j.cortex.2012.12.016","journal-title":"Cortex; a Journal Devoted to the Study of the Nervous System and Behavior"},{"key":"2807_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/9781118920497.ch1","volume-title":"The Wiley Handbook of Cognitive Control","author":"JD Cohen","year":"2017","unstructured":"Cohen, J. D. (2017). Cognitive Control. The Wiley Handbook of Cognitive Control (pp. 1\u201328). John Wiley & Sons Ltd. https:\/\/doi.org\/10.1002\/9781118920497.ch1"},{"issue":"3","key":"2807_CR13","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1037\/0033-295X.97.3.332","volume":"97","author":"JD Cohen","year":"1990","unstructured":"Cohen, J. D., Dunbar, K., & McClelland, J. L. (1990). On the control of automatic processes: A parallel distributed processing account of the Stroop effect. Psychological Review, 97(3), 332\u2013361. https:\/\/doi.org\/10.1037\/0033-295X.97.3.332","journal-title":"Psychological Review"},{"issue":"1","key":"2807_CR14","doi-asserted-by":"publisher","first-page":"251524592096511","DOI":"10.1177\/2515245920965119","volume":"4","author":"LM DeBruine","year":"2021","unstructured":"DeBruine, L. M., & Barr, D. J. (2021). Understanding mixed-effects models through data simulation. Advances in Methods and Practices in Psychological Science, 4(1), 2515245920965119. https:\/\/doi.org\/10.1177\/2515245920965119","journal-title":"Advances in Methods and Practices in Psychological Science"},{"issue":"1","key":"2807_CR15","doi-asserted-by":"publisher","first-page":"251524592095492","DOI":"10.1177\/2515245920954925","volume":"4","author":"M Del Giudice","year":"2021","unstructured":"Del Giudice, M., & Gangestad, S. W. (2021). A traveler\u2019s guide to the multiverse: Promises, pitfalls, and a framework for the evaluation of analytic decisions. Advances in Methods and Practices in Psychological Science, 4(1), 2515245920954925. https:\/\/doi.org\/10.1177\/2515245920954925","journal-title":"Advances in Methods and Practices in Psychological Science"},{"key":"2807_CR16","doi-asserted-by":"publisher","unstructured":"Dreisbach, G., & Fischer, R. (2012). The role of affect and reward in the conflict-triggered adjustment of cognitive control. Frontiers in Human Neuroscience, 6. https:\/\/doi.org\/10.3389\/fnhum.2012.00342","DOI":"10.3389\/fnhum.2012.00342"},{"key":"2807_CR17","doi-asserted-by":"publisher","unstructured":"Dutilh, G., Annis, J., Brown, S. D., Cassey, P., Evans, N. J., Grasman, R. P. P. P., Hawkins, G. E., Heathcote, A., Holmes, W. R., Krypotos, A.-M., Kupitz, C. N., Leite, F. P., Lerche, V., Lin, Y.-S., Logan, G. D., Palmeri, T. J., Starns, J. J., Trueblood, J. S., van Maanen, L., \u2026, & Donkin, C. (2019). The Quality of Response Time Data Inference: A Blinded, Collaborative Assessment of the Validity of Cognitive Models. Psychonomic Bulletin & Review, 26(4), 1051\u20131069. https:\/\/doi.org\/10.3758\/s13423-017-1417-2","DOI":"10.3758\/s13423-017-1417-2"},{"issue":"4","key":"2807_CR18","doi-asserted-by":"publisher","first-page":"380","DOI":"10.3758\/CABN.7.4.380","volume":"7","author":"T Egner","year":"2007","unstructured":"Egner, T. (2007). Congruency sequence effects and cognitive control. Cognitive, Affective, & Behavioral Neuroscience, 7(4), 380\u2013390. https:\/\/doi.org\/10.3758\/CABN.7.4.380","journal-title":"Cognitive, Affective, & Behavioral Neuroscience"},{"issue":"1","key":"2807_CR19","doi-asserted-by":"publisher","first-page":"143","DOI":"10.3758\/BF03203267","volume":"16","author":"BA Eriksen","year":"1974","unstructured":"Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon the identification of a target letter in a nonsearch task. Perception & Psychophysics, 16(1), 143\u2013149. https:\/\/doi.org\/10.3758\/BF03203267","journal-title":"Perception & Psychophysics"},{"issue":"2","key":"2807_CR20","doi-asserted-by":"publisher","first-page":"175","DOI":"10.3758\/BF03193146","volume":"39","author":"F Faul","year":"2007","unstructured":"Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175\u2013191. https:\/\/doi.org\/10.3758\/BF03193146","journal-title":"Behavior Research Methods"},{"key":"2807_CR21","unstructured":"Gelman, A., & Loken, E. (2013). The garden of forking paths: Why multiple comparisons can be a problem, even when there is no \u201cfishing expedition\u201d or \u201cp-hacking\u201d and the research hypothesis was posited ahead of time. Department of Statistics, Columbia University, 348(1-17), 3."},{"issue":"4","key":"2807_CR22","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1037\/0096-3445.121.4.480","volume":"121","author":"G Gratton","year":"1992","unstructured":"Gratton, G., Coles, M. G. H., & Donchin, E. (1992). Optimizing the use of information: Strategic control of activation of responses. Journal of Experimental Psychology: General, 121(4), 480\u2013506. https:\/\/doi.org\/10.1037\/0096-3445.121.4.480","journal-title":"Journal of Experimental Psychology: General"},{"issue":"4","key":"2807_CR23","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1111\/2041-210X.12504","volume":"7","author":"P Green","year":"2016","unstructured":"Green, P., & MacLeod, C. J. (2016). SIMR: An R package for power analysis of generalized linear mixed models by simulation. Methods in Ecology and Evolution, 7(4), 493\u2013498. https:\/\/doi.org\/10.1111\/2041-210X.12504","journal-title":"Methods in Ecology and Evolution"},{"issue":"8","key":"2807_CR24","doi-asserted-by":"publisher","first-page":"3777","DOI":"10.3758\/s13414-020-02021-2","volume":"82","author":"M Gyurkovics","year":"2020","unstructured":"Gyurkovics, M., Kovacs, M., Jaquiery, M., Palfi, B., Dechterenko, F., & Aczel, B. (2020). Registered replication report of Weissman, D. H., Jiang, J., & Egner, T. (2014). Determinants of congruency sequence effects without learning and memory confounds. Attention, Perception, & Psychophysics, 82(8), 3777\u20133787. https:\/\/doi.org\/10.3758\/s13414-020-02021-2","journal-title":"Attention, Perception, & Psychophysics"},{"issue":"1","key":"2807_CR25","doi-asserted-by":"publisher","first-page":"251524592110540","DOI":"10.1177\/25152459211054059","volume":"5","author":"M Kovacs","year":"2022","unstructured":"Kovacs, M., van Ravenzwaaij, D., Hoekstra, R., & Aczel, B. (2022). Samplesizeplanner: A tool to estimate and justify sample size for two-group studies. Advances in Methods and Practices in Psychological Science, 5(1), 25152459211054060. https:\/\/doi.org\/10.1177\/25152459211054059","journal-title":"Advances in Methods and Practices in Psychological Science"},{"issue":"4","key":"2807_CR26","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1016\/j.jesp.2013.03.013","volume":"49","author":"C Leys","year":"2013","unstructured":"Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013). Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology, 49(4), 764\u2013766. https:\/\/doi.org\/10.1016\/j.jesp.2013.03.013","journal-title":"Journal of Experimental Social Psychology"},{"key":"2807_CR27","doi-asserted-by":"publisher","unstructured":"Lo, S., & Andrews, S. (2015). To transform or not to transform: Using generalized linear mixed models to analyse reaction time data. Frontiers in Psychology, 6. https:\/\/doi.org\/10.3389\/fpsyg.2015.01171","DOI":"10.3389\/fpsyg.2015.01171"},{"issue":"3","key":"2807_CR28","doi-asserted-by":"publisher","first-page":"166","DOI":"10.3758\/BF03197535","volume":"7","author":"GD Logan","year":"1979","unstructured":"Logan, G. D., & Zbrodoff, N. J. (1979). When it helps to be misled: Facilitative effects of increasing the frequency of conflicting stimuli in a stroop-like task. Memory & Cognition, 7(3), 166\u2013174. https:\/\/doi.org\/10.3758\/BF03197535","journal-title":"Memory & Cognition"},{"issue":"5","key":"2807_CR29","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1038\/nn1051","volume":"6","author":"U Mayr","year":"2003","unstructured":"Mayr, U., Awh, E., & Laurey, P. (2003). Conflict adaptation effects in the absence of executive control. Nature Neuroscience, 6(5), 450\u2013452. https:\/\/doi.org\/10.1038\/nn1051","journal-title":"Nature Neuroscience"},{"issue":"4","key":"2807_CR30","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1080\/14640749108400962","volume":"43","author":"J Miller","year":"1991","unstructured":"Miller, J. (1991). Short report: Reaction time analysis with outlier exclusion: Bias varies with sample size. The Quarterly Journal of Experimental Psychology Section A, 43(4), 907\u2013912. https:\/\/doi.org\/10.1080\/14640749108400962","journal-title":"The Quarterly Journal of Experimental Psychology Section A"},{"issue":"3","key":"2807_CR31","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1027\/1864-9335\/a000192","volume":"45","author":"BA Nosek","year":"2014","unstructured":"Nosek, B. A., & Lakens, D. (2014). Registered reports. Social Psychology, 45(3), 137\u2013141. https:\/\/doi.org\/10.1027\/1864-9335\/a000192","journal-title":"Social Psychology"},{"issue":"10","key":"2807_CR32","doi-asserted-by":"publisher","first-page":"815","DOI":"10.1016\/j.tics.2019.07.009","volume":"23","author":"BA Nosek","year":"2019","unstructured":"Nosek, B. A., Beck, E. D., Campbell, L., Flake, J. K., Hardwicke, T. E., Mellor, D. T., van \u2019t Veer, A. E., & Vazire, S. (2019). Preregistration is hard, and worthwhile. Trends in Cognitive Sciences, 23(10), 815\u2013818. https:\/\/doi.org\/10.1016\/j.tics.2019.07.009","journal-title":"Trends in Cognitive Sciences"},{"issue":"12","key":"2807_CR33","doi-asserted-by":"publisher","first-page":"945","DOI":"10.1037\/h0037357","volume":"81","author":"RE Pastore","year":"1974","unstructured":"Pastore, R. E., & Scheirer, C. J. (1974). Signal detection theory: Considerations for general application. Psychological Bulletin, 81(12), 945\u2013958. https:\/\/doi.org\/10.1037\/h0037357","journal-title":"Psychological Bulletin"},{"key":"2807_CR34","volume-title":"Information Processing and Cognition: The Loyola Symposium","author":"MI Posner","year":"1975","unstructured":"Posner, M. I., & Snyder, C. R. R. (1975). Attention and Cognitive Control. In R. L. Solso (Ed.), Information Processing and Cognition: The Loyola Symposium. Lawrence Erlbaum."},{"issue":"2","key":"2807_CR35","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1037\/0033-295X.85.2.59","volume":"85","author":"R Ratcliff","year":"1978","unstructured":"Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85(2), 59\u2013108. https:\/\/doi.org\/10.1037\/0033-295X.85.2.59","journal-title":"Psychological Review"},{"issue":"3","key":"2807_CR36","doi-asserted-by":"publisher","first-page":"438","DOI":"10.3758\/BF03196302","volume":"9","author":"R Ratcliff","year":"2002","unstructured":"Ratcliff, R., & Tuerlinckx, F. (2002). Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability. Psychonomic Bulletin & Review, 9(3), 438\u2013481.","journal-title":"Psychonomic Bulletin & Review"},{"issue":"2","key":"2807_CR37","doi-asserted-by":"publisher","first-page":"e2377","DOI":"10.1002\/bdm.2377","volume":"37","author":"Y Roth","year":"2024","unstructured":"Roth, Y., & Yakobi, O. (2024). Attention! Do we really need attention checks? Journal of Behavioral Decision Making, 37(2), e2377. https:\/\/doi.org\/10.1002\/bdm.2377","journal-title":"Journal of Behavioral Decision Making"},{"key":"2807_CR38","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/S0166-4115(08)61218-2","volume-title":"Advances in Psychology","author":"JR Simon","year":"1990","unstructured":"Simon, J. R. (1990). The Effects of an Irrelevant Directional CUE on Human Information Processing. In R. W. Proctor & T. G. Reeve (Eds.), Advances in Psychology (vol. 65, pp. 31\u201386). North-Holland. https:\/\/doi.org\/10.1016\/S0166-4115(08)61218-2","edition":"vol. 65"},{"issue":"11","key":"2807_CR39","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.1177\/0956797611417632","volume":"22","author":"JP Simmons","year":"2011","unstructured":"Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359\u20131366. https:\/\/doi.org\/10.1177\/0956797611417632","journal-title":"Psychological Science"},{"key":"2807_CR40","unstructured":"Singmann, H., Brown, S., Gretton, M., Heathcote, A., Voss, A., Voss, J., & Terry, A. (2018). Package \u2018rtdists\u2019."},{"issue":"5","key":"2807_CR41","doi-asserted-by":"publisher","first-page":"702","DOI":"10.1177\/1745691616658637","volume":"11","author":"S Steegen","year":"2016","unstructured":"Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016). Increasing transparency through a multiverse analysis. Perspectives on Psychological Science, 11(5), 702\u2013712. https:\/\/doi.org\/10.1177\/1745691616658637","journal-title":"Perspectives on Psychological Science"},{"issue":"6","key":"2807_CR42","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1037\/h0054651","volume":"18","author":"JR Stroop","year":"1935","unstructured":"Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643\u2013662. https:\/\/doi.org\/10.1037\/h0054651","journal-title":"Journal of Experimental Psychology"},{"issue":"2","key":"2807_CR43","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1097\/00004424-197903000-00002","volume":"14","author":"JA Swets","year":"1979","unstructured":"Swets, J. A. (1979). ROC analysis applied to the evaluation of medical imaging techniques. Investigative Radiology, 14(2), 109.","journal-title":"Investigative Radiology"},{"issue":"1","key":"2807_CR44","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1037\/0096-3445.123.1.34","volume":"123","author":"R Ulrich","year":"1994","unstructured":"Ulrich, R., & Miller, J. (1994). Effects of truncation on reaction time analysis. Journal of Experimental Psychology: General, 123(1), 34\u201380. https:\/\/doi.org\/10.1037\/0096-3445.123.1.34","journal-title":"Journal of Experimental Psychology: General"},{"issue":"1","key":"2807_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s42113-021-00113-2","volume":"6","author":"J van Doorn","year":"2023","unstructured":"van Doorn, J., Aust, F., Haaf, J. M., Stefan, A. M., & Wagenmakers, E.-J. (2023). Bayes factors for mixed models. Computational Brain & Behavior, 6(1), 1\u201313. https:\/\/doi.org\/10.1007\/s42113-021-00113-2","journal-title":"Computational Brain & Behavior"},{"issue":"2","key":"2807_CR46","doi-asserted-by":"publisher","first-page":"547","DOI":"10.3758\/s13423-016-1081-y","volume":"24","author":"D van Ravenzwaaij","year":"2017","unstructured":"van Ravenzwaaij, D., Donkin, C., & Vandekerckhove, J. (2017). The EZ diffusion model provides a powerful test of simple empirical effects. Psychonomic Bulletin & Review, 24(2), 547\u2013556. https:\/\/doi.org\/10.3758\/s13423-016-1081-y","journal-title":"Psychonomic Bulletin & Review"},{"issue":"6","key":"2807_CR47","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1016\/j.tics.2009.02.007","volume":"13","author":"T Verguts","year":"2009","unstructured":"Verguts, T., & Notebaert, W. (2009). Adaptation by binding: A learning account of cognitive control. Trends in Cognitive Sciences, 13(6), 252\u2013257. https:\/\/doi.org\/10.1016\/j.tics.2009.02.007","journal-title":"Trends in Cognitive Sciences"},{"issue":"6","key":"2807_CR48","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1027\/1618-3169\/a000218","volume":"60","author":"A Voss","year":"2013","unstructured":"Voss, A., Nagler, M., & Lerche, V. (2013). Diffusion models in experimental psychology: A practical introduction. Experimental Psychology, 60(6), 385\u2013402. https:\/\/doi.org\/10.1027\/1618-3169\/a000218","journal-title":"Experimental Psychology"},{"issue":"1","key":"2807_CR49","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3758\/BF03194023","volume":"14","author":"E-J Wagenmakers","year":"2007","unstructured":"Wagenmakers, E.-J., Van Der Maas, H. L. J., & Grasman, R. P. P. P. (2007). An EZ-diffusion model for response time and accuracy. Psychonomic Bulletin & Review, 14(1), 3\u201322. https:\/\/doi.org\/10.3758\/BF03194023","journal-title":"Psychonomic Bulletin & Review"},{"issue":"5","key":"2807_CR50","doi-asserted-by":"publisher","first-page":"2022","DOI":"10.1037\/a0037454","volume":"40","author":"DH Weissman","year":"2014","unstructured":"Weissman, D. H., Jiang, J., & Egner, T. (2014). Determinants of congruency sequence effects without learning and memory confounds. Journal of Experimental Psychology: Human Perception and Performance, 40(5), 2022\u20132037. https:\/\/doi.org\/10.1037\/a0037454","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"}],"container-title":["Behavior Research Methods"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-025-02807-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.3758\/s13428-025-02807-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-025-02807-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T17:33:35Z","timestamp":1759858415000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.3758\/s13428-025-02807-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,18]]},"references-count":50,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["2807"],"URL":"https:\/\/doi.org\/10.3758\/s13428-025-02807-y","relation":{},"ISSN":["1554-3528"],"issn-type":[{"value":"1554-3528","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,18]]},"assertion":[{"value":"2 September 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 August 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 September 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"No conflicts of interest to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}],"article-number":"291"}}