{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T11:12:43Z","timestamp":1780571563293,"version":"3.54.1"},"reference-count":39,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2020,8,25]],"date-time":"2020-08-25T00:00:00Z","timestamp":1598313600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004189","name":"Max-Planck-Gesellschaft","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004189","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Human Brain Mapping"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    The problem of poor reproducibility of scientific findings has received much attention over recent years, in a variety of fields including psychology and neuroscience. The problem has been partly attributed to publication bias and unwanted practices such as\n                    <jats:italic>p<\/jats:italic>\n                    \u2010hacking. Low statistical power in individual studies is also understood to be an important factor. In a recent multisite collaborative study, we mapped brain anatomical left\u2013right asymmetries for regional measures of surface area and cortical thickness, in 99 MRI datasets from around the world, for a total of over 17,000 participants. In the present study, we revisited these hemispheric effects from the perspective of reproducibility. Within each dataset, we considered that an effect had been reproduced when it matched the meta\u2010analytic effect from the 98 other datasets, in terms of effect direction and significance threshold. In this sense, the results within each dataset were viewed as coming from separate studies in an \u201cideal publishing environment,\u201d that is, free from selective reporting and\n                    <jats:italic>p<\/jats:italic>\n                    hacking. We found an average reproducibility rate of 63.2% (\n                    <jats:italic>SD<\/jats:italic>\n                    \u00a0=\u00a022.9%, min\u00a0=\u00a022.2%, max\u00a0=\u00a097.0%). As expected, reproducibility was higher for larger effects and in larger datasets. Reproducibility was not obviously related to the age of participants, scanner field strength,\n                    <jats:italic>FreeSurfer<\/jats:italic>\n                    software version, cortical regional measurement reliability, or regional size. These findings constitute an empirical illustration of reproducibility in the absence of publication bias or\n                    <jats:italic>p<\/jats:italic>\n                    hacking, when assessing realistic biological effects in heterogeneous neuroscience data, and given typically\u2010used sample sizes.\n                  <\/jats:p>","DOI":"10.1002\/hbm.25154","type":"journal-article","created":{"date-parts":[[2020,8,25]],"date-time":"2020-08-25T23:28:07Z","timestamp":1598398087000},"page":"244-254","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Reproducibility in the absence of selective reporting: An\u00a0illustration from large\u2010scale brain asymmetry research"],"prefix":"10.1002","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0805-1350","authenticated-orcid":false,"given":"Xiang\u2010Zhen","family":"Kong","sequence":"first","affiliation":[{"name":"Language and Genetics Department Max Planck Institute for Psycholinguistics  Nijmegen The Netherlands"},{"name":"Department of Psychology and Behavioral Sciences Zhejiang University  Hangzhou China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"ENIGMA Laterality Working Group","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9098-890X","authenticated-orcid":false,"given":"Clyde","family":"Francks","sequence":"additional","affiliation":[{"name":"Language and Genetics Department Max Planck Institute for Psycholinguistics  Nijmegen The Netherlands"},{"name":"Donders Institute for Brain, Cognition and Behaviour Radboud University  Nijmegen The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2020,8,25]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aac4716"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/533452a"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1177\/1745691612459060"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-017-0189-z"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.3389\/fninf.2018.00102"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2314-9"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3475"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cortex.2019.11.006"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0270(02)00121-8"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2012.01.021"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2013.04.127"},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0038234"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2014.02.010"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.0020124"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1097\/EDE.0b013e31818131e7"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.22856"},{"key":"e_1_2_10_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797611430953"},{"key":"e_1_2_10_19_1","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.43464"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1525\/collabra.158"},{"key":"e_1_2_10_21_1","unstructured":"Klein R. Vianello M. Hasselman F. Adams B. Adams R.B. Alper S. \u2026 Nosek B.(2018). Many labs 2: Investigating variation in replicability across sample and setting.PsyArXiv."},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1027\/1864-9335\/a000178"},{"key":"e_1_2_10_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsych.2019.04.022"},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1718418115"},{"key":"e_1_2_10_25_1","doi-asserted-by":"crossref","unstructured":"Kong X.\u2010Z. Postema M. Guadalupe T. Kovel C.d. Boedhoe P.S. Hoogman M. \u2026 Francks C.(2019). Mapping brain asymmetry in health and disease through the ENIGMA consortium.Human Brain Mapping 1\u201315.http:\/\/dx.doi.org\/10.1002\/hbm.25033.","DOI":"10.31234\/osf.io\/ufwhp"},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-017-00908-7"},{"key":"e_1_2_10_27_1","first-page":"1","article-title":"Mapping brain asymmetry in health and disease through the ENIGMA consortium","volume":"2020","journal-title":"Human Brain Mapping"},{"key":"e_1_2_10_28_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aab2374"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.3389\/fninf.2016.00024"},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrn.2016.167"},{"key":"e_1_2_10_31_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-13005-8"},{"key":"e_1_2_10_32_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrd3439-c1"},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797611417632"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41398-020-0705-1"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11682-013-9269-5"},{"key":"e_1_2_10_36_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrn1009"},{"key":"e_1_2_10_37_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-017-0224-0"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2008.10.061"},{"key":"e_1_2_10_39_1","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.23519"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-019-0655-x"}],"container-title":["Human Brain Mapping"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/hbm.25154","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/hbm.25154","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/hbm.25154","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,28]],"date-time":"2023-08-28T06:10:35Z","timestamp":1693203035000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/hbm.25154"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,25]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["10.1002\/hbm.25154"],"URL":"https:\/\/doi.org\/10.1002\/hbm.25154","archive":["Portico"],"relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/866301","asserted-by":"object"}]},"ISSN":["1065-9471","1097-0193"],"issn-type":[{"value":"1065-9471","type":"print"},{"value":"1097-0193","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,25]]},"assertion":[{"value":"2020-04-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-08-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}