{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T06:02:54Z","timestamp":1789970574582,"version":"4.0.1"},"reference-count":104,"publisher":"Cambridge University Press (CUP)","license":[{"start":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T00:00:00Z","timestamp":1789948800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100005246","name":"Institute of Education Sciences","doi-asserted-by":"publisher","award":["R305D220026"],"award-info":[{"award-number":["R305D220026"]}],"id":[{"id":"10.13039\/100005246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Res. synth. methods"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Meta-analyses in social science fields face multiple methodological challenges arising from how primary research studies are designed and reported. One challenge is that many primary studies report multiple relevant effect size estimates, leading to a data structure with dependent observations. Another is selective reporting bias, which arises when the availability of study findings is influenced by the statistical significance of results. Although many selective reporting diagnostics and bias-correction methods have been proposed, few are suitable for meta-analyses involving dependent effect sizes. Among available methods, step-function selection models are conceptually appealing and have shown promise in previous simulations, but tend to understate uncertainty in parameter estimates if dependent effects are ignored. We study methods for estimating step-function models from data involving dependent effect sizes, focusing specifically on estimating parameters of the marginal distribution of effect sizes and accounting for dependence using cluster-robust variance estimation or bootstrap resampling. We describe two estimation strategies, demonstrate them by re-analyzing data from a previous synthesis on ego depletion effects, and evaluate their performance through an extensive simulation study under both univariate and multivariate selection processes. Simulation findings indicate that selection models provide low-bias estimates of average effect size and clustered bootstrap confidence intervals provide acceptable coverage levels for meta-analyses with at least 30 studies. Although unadjusted estimates are more efficient when selective reporting is absent or minimal, the proposed methods provide a robust and useful approach for evaluating the potential biases arising when selective reporting is present in meta-analyses with dependent effects.<\/jats:p>","DOI":"10.1017\/rsm.2026.10117","type":"journal-article","created":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T05:48:49Z","timestamp":1789969729000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":0,"title":["Estimation and inference for step-function selection models in meta-analyses with dependent effects"],"prefix":"10.1017","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0591-9465","authenticated-orcid":false,"given":"James E.","family":"Pustejovsky","sequence":"first","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martyna","family":"Citkowicz","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00490n048","id-type":"ROR","asserted-by":"publisher"}],"name":"American Institutes for Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Megha","family":"Joshi","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00490n048","id-type":"ROR","asserted-by":"publisher"}],"name":"American Institutes for Research"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"56","published-online":{"date-parts":[[2026,9,21]]},"reference":[{"key":"S1759287926101173_r64","doi-asserted-by":"publisher","DOI":"10.1007\/s10182-008-0060-7"},{"key":"S1759287926101173_r36","doi-asserted-by":"publisher","DOI":"10.3102\/00346543251389938"},{"key":"S1759287926101173_r61","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwt245"},{"key":"S1759287926101173_r67","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1063994971"},{"key":"S1759287926101173_r71","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.2020.1731599"},{"key":"S1759287926101173_r80","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-019-0787-z"},{"key":"S1759287926101173_r51","doi-asserted-by":"publisher","DOI":"10.31234\/osf.io\/rk4mn_v1"},{"key":"S1759287926101173_r81","doi-asserted-by":"publisher","DOI":"10.1098\/rsos.211499"},{"key":"S1759287926101173_r52","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-026-03023-y"},{"key":"S1759287926101173_r54","doi-asserted-by":"publisher","DOI":"10.1002\/sim.6481"},{"key":"S1759287926101173_r69","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2007.00593.x"},{"key":"S1759287926101173_r75","doi-asserted-by":"publisher","DOI":"10.1177\/1745691616652873"},{"key":"S1759287926101173_r93","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.2025.2540002"},{"key":"S1759287926101173_r95","doi-asserted-by":"publisher","DOI":"10.1111\/j.0006-341X.2000.00455.x"},{"key":"S1759287926101173_r99","first-page":"jrsm.1562","article-title":"Location-scale models for meta-analysis","author":"Viechtbauer","year":"2022","journal-title":"Res Synth Methods"},{"key":"S1759287926101173_r104","doi-asserted-by":"publisher","DOI":"10.1002\/bimj.202200222"},{"key":"S1759287926101173_r44","doi-asserted-by":"publisher","DOI":"10.1007\/s11121-021-01246-3"},{"key":"S1759287926101173_r83","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v036.i03"},{"key":"S1759287926101173_r85","unstructured":"[85] Joshi, M , Pustejovsky, JE . Simhelpers: helper functions for simulation studies. 2024. https:\/\/CRAN.R-project.org\/package=simhelpers."},{"key":"S1759287926101173_r4","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0066844"},{"key":"S1759287926101173_r10","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0215052"},{"key":"S1759287926101173_r65","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1464"},{"key":"S1759287926101173_r73","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000083"},{"key":"S1759287926101173_r7","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X13507104"},{"key":"S1759287926101173_r91","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1332"},{"key":"S1759287926101173_r6","doi-asserted-by":"publisher","DOI":"10.1001\/jama.291.20.2457"},{"key":"S1759287926101173_r12","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1703"},{"key":"S1759287926101173_r24","doi-asserted-by":"publisher","DOI":"10.1007\/BF02294384"},{"key":"S1759287926101173_r84","unstructured":"[84] Pustejovsky, JE . clubSandwich: cluster-robust (sandwich) variance estimators with small-sample corrections. 2024. https:\/\/CRAN.R-project.org\/package=clubSandwich."},{"key":"S1759287926101173_r26","doi-asserted-by":"publisher","DOI":"10.1080\/00223980.1963.9916596"},{"key":"S1759287926101173_r47","first-page":"1","article-title":"Detecting selection bias in meta-analyses with multiple outcomes: a simulation study","author":"Fern\u00e1ndez-Castilla","year":"2019","journal-title":"J Exp Educ"},{"key":"S1759287926101173_r31","doi-asserted-by":"publisher","DOI":"10.1177\/1745691616662243"},{"key":"S1759287926101173_r53","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/73.1.13"},{"key":"S1759287926101173_r20","doi-asserted-by":"publisher","DOI":"10.3102\/10769986009001061"},{"key":"S1759287926101173_r23","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177011364"},{"key":"S1759287926101173_r88","doi-asserted-by":"publisher","DOI":"10.21105\/joss.01686"},{"key":"S1759287926101173_r18","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1095"},{"key":"S1759287926101173_r27","doi-asserted-by":"publisher","DOI":"10.2466\/pr0.1964.15.2.570"},{"key":"S1759287926101173_r92","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X20912798"},{"key":"S1759287926101173_r42","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.1.3.227"},{"key":"S1759287926101173_r89","doi-asserted-by":"publisher","DOI":"10.7758\/9781610448864.14"},{"key":"S1759287926101173_r14","doi-asserted-by":"publisher","DOI":"10.1002\/0470870168.ch5"},{"key":"S1759287926101173_r68","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511802843"},{"key":"S1759287926101173_r96","doi-asserted-by":"publisher","DOI":"10.1177\/1745691614553988"},{"key":"S1759287926101173_r56","doi-asserted-by":"publisher","DOI":"10.1002\/0470870168.ch9"},{"key":"S1759287926101173_r5","doi-asserted-by":"publisher","DOI":"10.1191\/0962280205sm415oa"},{"key":"S1759287926101173_r103","article-title":"Meta-analyzing nonpreregistered and preregistered studies","volume":"17","author":"van Aert","year":"2025","journal-title":"Psychol Methods"},{"key":"S1759287926101173_r29","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1461"},{"key":"S1759287926101173_r38","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2022.105016"},{"key":"S1759287926101173_r72","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1987.10478410"},{"key":"S1759287926101173_r13","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1452"},{"key":"S1759287926101173_r1","doi-asserted-by":"publisher","DOI":"10.1002\/0470870168"},{"key":"S1759287926101173_r37","doi-asserted-by":"publisher","DOI":"10.1186\/s13750-023-00301-6"},{"key":"S1759287926101173_r79","doi-asserted-by":"publisher","DOI":"10.32614\/CRAN.package.metaselection"},{"key":"S1759287926101173_r90","unstructured":"[90] Fisher, Z , Tipton, E , Zhang, H. robumeta: robust variance meta-regression. 2024. https:\/\/CRAN.R-project.org\/package=robumeta."},{"key":"S1759287926101173_r17","first-page":"89","article-title":"A nonparametric \u201ctrim and fill\u201d method of accounting for publication bias in meta-analysis","volume":"95","author":"Duval","year":"2000","journal-title":"J Am Stat Assoc"},{"key":"S1759287926101173_r50","doi-asserted-by":"publisher","DOI":"10.31222\/osf.io\/jq52s"},{"key":"S1759287926101173_r60","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9574.00154"},{"key":"S1759287926101173_r40","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-012-0261-6"},{"key":"S1759287926101173_r34","doi-asserted-by":"publisher","DOI":"10.1017\/rsm.2025.10035"},{"key":"S1759287926101173_r87","unstructured":"[87] Hasselman, B. Nleqslv: solve systems of nonlinear equations. 2023. https:\/\/CRAN.R-project.org\/package=nleqslv."},{"key":"S1759287926101173_r41","article-title":"Multivariate meta-analysis: potential and promise","author":"Jackson","year":"2011","journal-title":"Stat Med"},{"key":"S1759287926101173_r78","unstructured":"[78] R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing; 2026. https:\/\/www.R-project.org\/."},{"key":"S1759287926101173_r97","doi-asserted-by":"publisher","DOI":"10.1037\/met0000025"},{"key":"S1759287926101173_r59","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.10.4.428"},{"key":"S1759287926101173_r19","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1352"},{"key":"S1759287926101173_r55","doi-asserted-by":"publisher","DOI":"10.1002\/sim.6350"},{"key":"S1759287926101173_r100","doi-asserted-by":"publisher","DOI":"10.1037\/met0000046"},{"key":"S1759287926101173_r74","doi-asserted-by":"publisher","DOI":"10.1037\/a0019486"},{"key":"S1759287926101173_r46","doi-asserted-by":"publisher","DOI":"10.1111\/rssc.12440"},{"key":"S1759287926101173_r8","doi-asserted-by":"publisher","DOI":"10.1038\/tp.2017.203"},{"key":"S1759287926101173_r43","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1040"},{"key":"S1759287926101173_r39","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.35"},{"key":"S1759287926101173_r94","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2000.10474226"},{"key":"S1759287926101173_r98","doi-asserted-by":"publisher","DOI":"10.1177\/1745691616650874"},{"key":"S1759287926101173_r82","doi-asserted-by":"publisher","DOI":"10.21231\/GNT1-HW21"},{"key":"S1759287926101173_r21","first-page":"109","article-title":"Selection models and the file drawer problem","volume":"3","author":"Iyengar","year":"1988","journal-title":"Stat Sci"},{"key":"S1759287926101173_r62","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-013-9328-2"},{"key":"S1759287926101173_r16","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.315.7109.629"},{"key":"S1759287926101173_r22","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177011363"},{"key":"S1759287926101173_r30","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1467"},{"key":"S1759287926101173_r76","doi-asserted-by":"publisher","DOI":"10.1177\/0956797621989733"},{"key":"S1759287926101173_r86","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v043.i09"},{"key":"S1759287926101173_r48","doi-asserted-by":"publisher","DOI":"10.1037\/met0000300"},{"key":"S1759287926101173_r3","first-page":"435","volume-title":"The Handbook of Research Synthesis and Meta-Analysis","author":"Sutton","year":"2009"},{"key":"S1759287926101173_r63","first-page":"221","volume-title":"Composite Likelihood Methods","author":"Lindsay","year":"1988"},{"key":"S1759287926101173_r101","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1594"},{"key":"S1759287926101173_r35","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1339"},{"key":"S1759287926101173_r2","doi-asserted-by":"publisher","DOI":"10.1037\/h0076157"},{"key":"S1759287926101173_r32","doi-asserted-by":"publisher","DOI":"10.1016\/B978-012691360-6\/50018-5"},{"key":"S1759287926101173_r102","doi-asserted-by":"publisher","DOI":"10.3102\/10769986021004299"},{"key":"S1759287926101173_r33","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.5"},{"key":"S1759287926101173_r66","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1475"},{"key":"S1759287926101173_r77","doi-asserted-by":"publisher","DOI":"10.1177\/1948550619887702"},{"key":"S1759287926101173_r25","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.41.11.1299"},{"key":"S1759287926101173_r58","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-9473(97)00039-X"},{"key":"S1759287926101173_r15","doi-asserted-by":"publisher","DOI":"10.2307\/2533446"},{"key":"S1759287926101173_r70","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-73186-5_11"},{"key":"S1759287926101173_r11","first-page":"376","article-title":"The chrysalis effect: how ugly initial results metamorphosize into beautiful articles","volume":"43","author":"O\u2019Boyle","year":"2017","journal-title":"J Manag"},{"key":"S1759287926101173_r57","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-015-0868-6"},{"key":"S1759287926101173_r45","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1554"},{"key":"S1759287926101173_r49","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.d4002"},{"key":"S1759287926101173_r9","doi-asserted-by":"publisher","DOI":"10.1177\/1948550615598377"},{"key":"S1759287926101173_r28","first-page":"115","article-title":"Correcting for bias in psychology: a comparison of meta-analytic methods","volume":"2","author":"Carter","year":"2019","journal-title":"Adv Methods Pract Psychol Sci"}],"container-title":["Research Synthesis Methods"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1759287926101173","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T05:48:54Z","timestamp":1789969734000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1759287926101173\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,21]]},"references-count":104,"alternative-id":["S1759287926101173"],"URL":"https:\/\/doi.org\/10.1017\/rsm.2026.10117","relation":{},"ISSN":["1759-2879","1759-2887"],"issn-type":[{"value":"1759-2879","type":"print"},{"value":"1759-2887","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,21]]},"assertion":[{"value":"\u00a9 The Author(s), 2026. Published by Cambridge University Press on behalf of The Society for Research Synthesis Methodology","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https:\/\/creativecommons.org\/licenses\/by\/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}]}}