{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T06:07:50Z","timestamp":1788847670803,"version":"build-2803163510"},"reference-count":31,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T00:00:00Z","timestamp":1788825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:p>Data-peeking, the practice of stopping data collection once significant results are obtained, poses a significant threat to the credibility of research by increasing the likelihood of observing and publishing false positive results. The effect of this practice on scientific reliability has traditionally been assessed through Monte-Carlo simulations, which suffer from some methodological issues (e.g., Monte\u2013Carlo standard error is often overestimated). This paper presents a computational model that, through a series of convolutions between normal and truncated normal distributions, estimates the increase in false-positive rates due to data-peeking practice, overcoming the issues of the simulation method. The performance of the computational model was compared against Monte-Carlo simulations under different conditions, including alpha levels (0.05, 0.025, 0.01, and 0.001), sample sizes (40, 80, 160, and 320), and numbers of interim analyses (1 to 10). The results confirmed the computational model's accuracy and reliability, showing that computational values fell within two standard deviations of the simulated means. In conclusion, the proposed model not only presents an faster and error-reducing approach to estimating the effects of data-peeking practice but also provides guidelines for the development of similar models to examine other forms of p-hacking, thereby improving the understanding and study of their effects.<\/jats:p>","DOI":"10.3389\/fpsyg.2026.1769309","type":"journal-article","created":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T05:35:34Z","timestamp":1788845734000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["New frontiers in the p-hacking practices: assessing the effect of data peeking practice on type-I error rate through computational modeling"],"prefix":"10.3389","volume":"17","author":[{"given":"Francesca","family":"Freuli","sequence":"first","affiliation":[{"name":"Department of Psychology and Cognitive Science, University of Trento","place":["Trento, Italy"]},{"name":"University Centre of Statistics in the Biomedical Sciences, Vita-Salute San Raffaele University","place":["Milan, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefano","family":"Noventa","sequence":"additional","affiliation":[{"name":"Department of General Psychology, University of Padua","place":["Padua, Italy"]},{"name":"IRCCS San Camillo Hospital","place":["Venice, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luigi","family":"Lombardi","sequence":"additional","affiliation":[{"name":"Department of Psychology and Cognitive Science, University of Trento","place":["Trento, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,8]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"235","DOI":"10.2307\/2343787","article-title":"Repeated significance tests on accumulating data","volume":"132","author":"Armitage","year":"1969","journal-title":"J. Roy. Statist. Soc. Ser. A"},{"key":"B2","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1177\/1745691612459060","article-title":"The rules of the game called psychological science","volume":"7","author":"Bakker","year":"2012","journal-title":"Perspect. Psychol. Sci"},{"key":"B3","doi-asserted-by":"publisher","first-page":"10769986251344939","DOI":"10.3102\/10769986251344939","article-title":"Optimizing the use of simulation methods in multilevel sample size calculations","volume":"51","author":"Browne","year":"2025","journal-title":"J. Educ. Behav. Statist"},{"key":"B4","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1038\/nrn3475","article-title":"Power failure: why small sample size undermines the reliability of neuroscience","volume":"14","author":"Button","year":"2013","journal-title":"Nat. Rev. Neurosci"},{"key":"B5","author":"Daniel","year":"","journal-title":"doParallel: Foreach parallel adaptor for the \u2018parallel' package"},{"key":"B6","author":"Daniel","year":"","journal-title":"Foreach: Provides foreach looping construct"},{"key":"B7","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1016\/j.jesp.2015.07.009","article-title":"Conceptualizing and evaluating the replication of research results","volume":"66","author":"Fabrigar","year":"2016","journal-title":"J. Exp. Soc. Psychol"},{"key":"B8","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1214\/23-STS904","article-title":"Replication success under questionable research practicesa simulation study","volume":"38","author":"Freuli","year":"2023","journal-title":"Stat. Sci"},{"key":"B9","doi-asserted-by":"publisher","first-page":"1000","DOI":"10.1080\/13854046.2016.1277557","article-title":"The statistical crisis in science: How is it relevant to clinical neuropsychology?","volume":"31","author":"Gelman","year":"2017","journal-title":"Clin. Neuropsychol"},{"key":"B10","doi-asserted-by":"publisher","first-page":"e1002106","DOI":"10.1371\/journal.pbio.1002106","article-title":"The extent and consequences of p-hacking in science","volume":"13","author":"Head","year":"2015","journal-title":"PLoS Biol"},{"key":"B11","doi-asserted-by":"crossref","DOI":"10.1002\/9780470316672","volume-title":"Multiple Comparison Procedures","author":"Hochberg","year":"1987"},{"key":"B12","unstructured":"A simple sequentially rejective multiple test procedure\n          \n          65\n          70\n          \n            \n              Holm\n              S.\n            \n          \n          Scand. J. Stat\n          6\n          1979"},{"key":"B13","doi-asserted-by":"publisher","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","article-title":"Why most published research findings are false","volume":"2","author":"Ioannidis","year":"2005","journal-title":"PLoS Med"},{"key":"B14","doi-asserted-by":"publisher","first-page":"640","DOI":"10.1097\/EDE.0b013e31818131e7","article-title":"Why most discovered true associations are inflated","volume":"19","author":"Ioannidis","year":"2008","journal-title":"Epidemiol"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1048","DOI":"10.1093\/jcr\/ucw085","article-title":"Single-paper meta-analysis: benefits for study summary, theory testing, and replicability","volume":"43","author":"McShane","year":"2017","journal-title":"J. Consum. Res"},{"key":"B16","doi-asserted-by":"publisher","first-page":"2074","DOI":"10.1002\/sim.8086","article-title":"Using simulation studies to evaluate statistical methods","volume":"38","author":"Morris","year":"2019","journal-title":"Stat. Med"},{"key":"B17","doi-asserted-by":"publisher","first-page":"25152459251348431","DOI":"10.1177\/25152459251348431","article-title":"Bestiary of questionable research practices in psychology","volume":"8","author":"Nagy","year":"2025","journal-title":"Adv. Methods Pract. Psychol. Sci"},{"key":"B18","doi-asserted-by":"publisher","first-page":"e1441","DOI":"10.1002\/widm.1441","article-title":"Over-optimism in benchmark studies and the multiplicity of design and analysis options when interpreting their results","volume":"12","author":"Nie\u00e1\u017el","year":"2022","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov"},{"key":"B19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/00031305.2025.2540002","article-title":"Handling missingness, failures, and non-convergence in simulation studies: a review of current practices and recommendations","volume":"80","author":"Pawel","year":"2025","journal-title":"Am. Statist"},{"key":"B20","doi-asserted-by":"publisher","first-page":"2200091","DOI":"10.1002\/bimj.202200091","article-title":"Pitfalls and potentials in simulation studies: Questionable research practices in comparative simulation studies allow for spurious claims of superiority of any method","volume":"66","author":"Pawel","year":"2024","journal-title":"Biometr. J"},{"key":"B21","volume-title":"R: a language and environment for statistical computing","year":"2021"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5334\/labphon.147","article-title":"Researcher degrees of freedom in phonetic research","volume":"10","author":"Roettger","year":"2019","journal-title":"Lab. Phonol"},{"key":"B23","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1146\/annurev.ps.46.020195.003021","article-title":"Multiple hypothesis testing","volume":"46","author":"Shaffer","year":"1995","journal-title":"Ann. Rev. Psychol"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1037\/met0000695.","article-title":"Simulation studies for methodological research in psychology: a standardized template for planning, preregistration, and reporting","author":"Siepe","year":"2024","journal-title":"Psychol. Methods"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.1177\/0956797611417632","article-title":"False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant","volume":"22","author":"Simmons","year":"2011","journal-title":"Psycholog. Sci"},{"key":"B26","doi-asserted-by":"publisher","first-page":"534","DOI":"10.1037\/a0033242","article-title":"P-curve: a key to the file-drawer","volume":"143","author":"Simonsohn","year":"2014","journal-title":"Journal of experimental psychology: General"},{"key":"B27","doi-asserted-by":"publisher","first-page":"220346","DOI":"10.1098\/rsos.220346","article-title":"Big little lies: a compendium and simulation of p-hacking strategies","volume":"10","author":"Stefan","year":"2023","journal-title":"Roy. Soc. Open Sci"},{"key":"B28","doi-asserted-by":"publisher","first-page":"24","DOI":"10.3758\/BF03192746","article-title":"SNOOP: a program for demonstrating the consequences of premature and repeated null hypothesis testing","volume":"38","author":"Strube","year":"2006","journal-title":"Behav. Res. Methods"},{"key":"B29","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1016\/j.jesp.2017.04.011","article-title":"Using independent covariates in experimental designs: quantifying the trade-off between power boost and type i error inflation","volume":"72","author":"Wang","year":"2017","journal-title":"J. Exp. Soc. Psychol"},{"key":"B30","doi-asserted-by":"publisher","first-page":"e0307999","DOI":"10.1371\/journal.pone.0307999","article-title":"Accumulating evidence across studies: Consistent methods protect against false findings produced by p-hacking","volume":"19","author":"Wegener","year":"2024","journal-title":"PLoS ONE"},{"key":"B31","doi-asserted-by":"publisher","first-page":"222767","DOI":"10.3389\/fpsyg.2016.01832","article-title":"Degrees of freedom in planning, running, analyzing, and reporting psychological studies: a checklist to avoid p-hacking","volume":"7","author":"Wicherts","year":"2016","journal-title":"Front. Psychol"}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1769309\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T05:35:36Z","timestamp":1788845736000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1769309\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,8]]},"references-count":31,"alternative-id":["10.3389\/fpsyg.2026.1769309"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2026.1769309","relation":{},"ISSN":["1664-1078"],"issn-type":[{"value":"1664-1078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,8]]},"article-number":"1769309"}}