{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T13:30:54Z","timestamp":1785504654961,"version":"3.56.0"},"reference-count":53,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T00:00:00Z","timestamp":1778716800000},"content-version":"am","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["2447088"],"award-info":[{"award-number":["2447088"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Multiple hypothesis testing (MHT) practices vary widely, without consensus on which are appropriate when. This article provides an economic foundation for these practices designed to capture leading examples, such as regulatory approval on the basis of clinical trials. MHT adjustments are appropriate in our framework to the extent that research costs are invariant to the number of hypotheses. Control of average size, as for example via a Bonferroni correction, emerges in the limit case where all costs are fixed; in the opposite limit, where costs vary in proportion to the hypothesis count, no correction is needed. We illustrate implications by calculating explicit critical values using data on actual costs in the drug approval process and in program evaluation research; these suggest that some MHT adjustment is warranted in these applications, but not as much as implied by standard practice.<\/jats:p>","DOI":"10.1093\/restud\/rdag026","type":"journal-article","created":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T11:56:50Z","timestamp":1778673410000},"source":"Crossref","is-referenced-by-count":3,"title":["A Model of Multiple Hypothesis Testing"],"prefix":"10.1093","author":[{"given":"Davide","family":"Viviano","sequence":"first","affiliation":[{"name":"Harvard University ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kaspar","family":"W\u00fcthrich","sequence":"additional","affiliation":[{"name":"University of Michigan ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Niehaus","sequence":"additional","affiliation":[{"name":"UC San Diego, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,5,14]]},"reference":[{"key":"2026051414155132400_rdag026-B1","doi-asserted-by":"crossref","first-page":"1481","DOI":"10.1198\/016214508000000841","article-title":"Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects","volume":"103","author":"Anderson","year":"2008","journal-title":"Journal of the American Statistical Association"},{"key":"2026051414155132400_rdag026-B2","doi-asserted-by":"crossref","first-page":"2117","DOI":"10.3982\/ECTA18155","article-title":"A Model of Scientific Communication","volume":"89","author":"Andrews","year":"2021","journal-title":"Econometrica: Journal of the Econometric Society"},{"key":"2026051414155132400_rdag026-B3","doi-asserted-by":"crossref","first-page":"133","DOI":"10.3982\/ECTA15732","article-title":"Policy Learning with Observational Data","volume":"89","author":"Athey","year":"2021","journal-title":"Econometrica: Journal of the Econometric Society"},{"key":"2026051414155132400_rdag026-B4","first-page":"141","volume-title":"Handbook of Field Experiments, Volume 1 of Handbook of Economic Field Experiments","author":"Banerjee","year":"2017"},{"key":"2026051414155132400_rdag026-B5","doi-asserted-by":"crossref","first-page":"1206","DOI":"10.1257\/aer.20171634","article-title":"A Theory of Experimenters: Robustness, Randomization, and Balance","volume":"110","author":"Banerjee","year":"2020","journal-title":"American Economic Review"},{"key":"2026051414155132400_rdag026-B6","doi-asserted-by":"publisher","author":"Bates","year":"2022","DOI":"10.48550\/arXiv.2205.06812"},{"key":"2026051414155132400_rdag026-B7","doi-asserted-by":"publisher","author":"Bates","year":"2023","DOI":"10.48550\/arXiv.2307.03748"},{"key":"2026051414155132400_rdag026-B8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/qje\/qjad031","article-title":"Predicting and Preventing Gun Violence: An Experimental Evaluation of READI Chicago","volume":"139","author":"Bhatt","year":"2024","journal-title":"The Quarterly Journal of Economics"},{"key":"2026051414155132400_rdag026-B9","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1257\/aer.102.4.1279","article-title":"Selective Trials: A Principal-Agent Approach to Randomized Controlled Experiments","volume":"102","author":"Chassang","year":"2012","journal-title":"American Economic Review"},{"key":"2026051414155132400_rdag026-B10","author":"Code of Federal Regulations","year":"2024"},{"key":"2026051414155132400_rdag026-B11","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1214\/ss\/1056397487","article-title":"Multiple Hypothesis Testing in Microarray Experiments","volume":"18","author":"Dudoit","year":"2003","journal-title":"Statistical Science"},{"key":"2026051414155132400_rdag026-B12","first-page":"1","article-title":"Microarrays, Empirical Bayes and the Two-Groups Model","volume":"23","author":"Efron","year":"2008","journal-title":"Statistical Science"},{"key":"2026051414155132400_rdag026-B13","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1214\/07-AOAS141","article-title":"Simultaneous Inference: When Should Hypothesis Testing Problems be Combined?","volume":"2","author":"Efron","year":"2008","journal-title":"Annals of Applied Statistics"},{"key":"2026051414155132400_rdag026-B14","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1080\/10543409108835012","article-title":"The Use of One-Sided Tests in Drug Trials: An FDA Advisory Committee Member\u2019s Perspective","volume":"1","author":"Fisher","year":"1991","journal-title":"Journal of Biopharmaceutical Statistics"},{"key":"2026051414155132400_rdag026-B15","author":"Food and Drug Administration","year":"2022"},{"key":"2026051414155132400_rdag026-B16","first-page":"1","article-title":"Which Findings Should Be Published?","volume":"14","author":"Frankel","year":"2022","journal-title":"American Economic Journal: Microeconomics"},{"key":"2026051414155132400_rdag026-B17","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/0304-4068(89)90018-9","article-title":"Maxmin Expected Utility With Non-Unique Prior","volume":"18","author":"Gilboa","year":"1989","journal-title":"Journal of Mathematical Economics"},{"key":"2026051414155132400_rdag026-B18","doi-asserted-by":"crossref","first-page":"11","DOI":"10.2165\/00019053-200220003-00002","article-title":"Returns on Research and Development for 1990s New Drug Introductions","volume":"20","author":"Grabowski","year":"2002","journal-title":"PharmacoEconomics"},{"key":"2026051414155132400_rdag026-B19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3982\/ECTA19304","article-title":"Invidious comparisons: Ranking and selection as compound decisions","volume":"91","author":"Gu","year":"2020","journal-title":"Econometrica: Journal of the Econometric Society"},{"key":"2026051414155132400_rdag026-B20","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1257\/aer.20171919","article-title":"Research and the Approval Process: The Organization of Persuasion","volume":"109","author":"Henry","year":"2019","journal-title":"American Economic Review"},{"key":"2026051414155132400_rdag026-B21","doi-asserted-by":"crossref","first-page":"1683","DOI":"10.3982\/ECTA6630","article-title":"Asymptotics for Statistical Treatment Rules","volume":"77","author":"Hirano","year":"2009","journal-title":"Econometrica: Journal of the Econometric Society"},{"key":"2026051414155132400_rdag026-B22","first-page":"283","volume-title":"Handbook of Econometrics, Volume 7A, Handbook of Econometrics","author":"Hirano","year":"2020"},{"key":"2026051414155132400_rdag026-B23","first-page":"65","article-title":"A Simple Sequentially Rejective Multiple Test Procedure","volume":"6","author":"Holm","year":"1979","journal-title":"Scandinavian Journal of Statistics"},{"key":"2026051414155132400_rdag026-B24","author":"Kasy","year":"2023"},{"key":"2026051414155132400_rdag026-B25","doi-asserted-by":"crossref","first-page":"591","DOI":"10.3982\/ECTA13288","article-title":"Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice","volume":"86","author":"Kitagawa","year":"2018","journal-title":"Econometrica: Journal of the Econometric Society"},{"key":"2026051414155132400_rdag026-B26","doi-asserted-by":"crossref","first-page":"1963","DOI":"10.1093\/qje\/qjac024","article-title":"Systemic Discrimination Among Large US Employers","volume":"137","author":"Kline","year":"2022","journal-title":"The Quarterly Journal of Economics"},{"key":"2026051414155132400_rdag026-B27","author":"Kline","year":"2024"},{"key":"2026051414155132400_rdag026-B28","volume-title":"Testing Statistical Hypotheses","author":"Lehmann","year":"2005"},{"key":"2026051414155132400_rdag026-B29","doi-asserted-by":"crossref","first-page":"1084","DOI":"10.1214\/009053605000000066","article-title":"On Optimality of Stepdown and Stepup Multiple Test Procedures","volume":"33","author":"Lehmann","year":"2005","journal-title":"Annals of Statistics"},{"key":"2026051414155132400_rdag026-B30","doi-asserted-by":"crossref","first-page":"1903","DOI":"10.1002\/(SICI)1097-0258(19990815)18:15<1903::AID-SIM188>3.0.CO;2-F","article-title":"Statistical Principles for Clinical Trials (ICH E9): An Introductory Note on an International Guideline","volume":"18","author":"Lewis","year":"1999","journal-title":"Statistics in Medicine"},{"key":"2026051414155132400_rdag026-B31","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1007\/s10683-018-09597-5","article-title":"Multiple Hypothesis Testing in Experimental Economics","volume":"22","author":"List","year":"2019","journal-title":"Experimental Economics"},{"key":"2026051414155132400_rdag026-B32","doi-asserted-by":"crossref","first-page":"1221","DOI":"10.1111\/j.1468-0262.2004.00530.x","article-title":"Statistical Treatment Rules for Heterogeneous Populations","volume":"72","author":"Manski","year":"2004","journal-title":"Econometrica: Journal of the Econometric Society"},{"key":"2026051414155132400_rdag026-B33","author":"McCloskey","year":"2022"},{"key":"2026051414155132400_rdag026-B34","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1257\/jep.35.3.193","article-title":"Evidence on Research Transparency in Economics","volume":"35","author":"Miguel","year":"2021","journal-title":"Journal of Economic Perspectives"},{"key":"2026051414155132400_rdag026-B35","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1162\/rest_a_01317","article-title":"Factorial Designs, Model Selection, and (Incorrect) Inference in Randomized Experiments","volume":"107","author":"Muralidharan","year":"2025","journal-title":"The Review of Economics and Statistics"},{"key":"2026051414155132400_rdag026-B36","author":"NIH National Library of Medicine","year":".."},{"key":"2026051414155132400_rdag026-B37","doi-asserted-by":"crossref","first-page":"2917","DOI":"10.1002\/sim.1296","article-title":"Subgroup Analysis, Covariate Adjustment and Baseline Comparisons in Clinical Trial Reporting: Current Practice and Problems","volume":"21","author":"Pocock","year":"2002","journal-title":"Statistics in Medicine"},{"key":"2026051414155132400_rdag026-B38","author":"Robbins","year":"1951"},{"key":"2026051414155132400_rdag026-B39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2202\/1557-4679.1300","article-title":"Consonance and the Closure Method in Multiple Testing","volume":"7","author":"Romano","year":"2011","journal-title":"The International Journal of Biostatistics"},{"key":"2026051414155132400_rdag026-B40","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1146\/annurev.economics.102308.124342","article-title":"Hypothesis Testing in Econometrics","volume":"2","author":"Romano","year":"2010","journal-title":"Annual Review of Economics"},{"key":"2026051414155132400_rdag026-B41","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1177\/1740774515625964","article-title":"Key Cost Drivers of Pharmaceutical Clinical Trials in the United States","volume":"13","author":"Sertkaya","year":"2016","journal-title":"Clinical Trials"},{"key":"2026051414155132400_rdag026-B42","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1214\/aoms\/1177698122","article-title":"On Multivariate Normal Probabilities of Rectangles: Their Dependence on Correlations","volume":"39","author":"\u0160id\u00e1k","year":"1968","journal-title":"The Annals of Mathematical Statistics"},{"key":"2026051414155132400_rdag026-B43","author":"Spiess","year":"2018"},{"key":"2026051414155132400_rdag026-B44","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1214\/aoms\/1177692621","article-title":"On the Optimality of Some Multiple Comparison Procedures","volume":"43","author":"Spjotvoll","year":"1972","journal-title":"The Annals of Mathematical Statistics"},{"key":"2026051414155132400_rdag026-B45","doi-asserted-by":"crossref","first-page":"2013","DOI":"10.1214\/aos\/1074290335","article-title":"The Positive False Discovery Rate: A Bayesian Interpretation and the q-Value","volume":"31","author":"Storey","year":"2003","journal-title":"Annals of Statistics"},{"key":"2026051414155132400_rdag026-B46","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.jeconom.2011.06.013","article-title":"Statistical Treatment Choice Based on Asymmetric Minimax Regret Criteria","volume":"166","author":"Tetenov","year":"2012","journal-title":"Journal of Econometrics"},{"key":"2026051414155132400_rdag026-B47","author":"Tetenov","year":"2016"},{"key":"2026051414155132400_rdag026-B48","author":"U.S. Food and Drug Administration","year":".."},{"key":"2026051414155132400_rdag026-B49","author":"U.S. Food and Drug Administration","year":".."},{"key":"2026051414155132400_rdag026-B50","doi-asserted-by":"publisher","author":"Viviano","year":"2025","DOI":"10.48550\/arXiv.2104.13367"},{"key":"2026051414155132400_rdag026-B51","volume-title":"Statistical Decision Functions","author":"Wald","year":"1950"},{"key":"2026051414155132400_rdag026-B52","author":"Williams","year":"2021"},{"key":"2026051414155132400_rdag026-B53","doi-asserted-by":"crossref","first-page":"2018","DOI":"10.1086\/720072","article-title":"Designing Incentives for Heterogeneous Researchers","volume":"130","author":"Yoder","year":"2022","journal-title":"Journal of Political Economy"}],"container-title":["Review of Economic Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/restud\/advance-article-pdf\/doi\/10.1093\/restud\/rdag026\/68288288\/rdag026.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/restud\/advance-article-pdf\/doi\/10.1093\/restud\/rdag026\/68288288\/rdag026.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T18:16:06Z","timestamp":1778782566000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/restud\/advance-article\/doi\/10.1093\/restud\/rdag026\/8678404"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,14]]},"references-count":53,"URL":"https:\/\/doi.org\/10.1093\/restud\/rdag026","relation":{},"ISSN":["0034-6527","1467-937X"],"issn-type":[{"value":"0034-6527","type":"print"},{"value":"1467-937X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,14]]},"article-number":"rdag026"}}