{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T07:32:38Z","timestamp":1785569558651,"version":"3.56.0"},"reference-count":36,"publisher":"Wiley","issue":"6","license":[{"start":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T00:00:00Z","timestamp":1685059200000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T00:00:00Z","timestamp":1685059200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["SES\u20101530661"],"award-info":[{"award-number":["SES\u20101530661"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000155","name":"Social Sciences and Humanities Research Council of Canada","doi-asserted-by":"publisher","award":["CGS\u2010767\u20102022\u20102529"],"award-info":[{"award-number":["CGS\u2010767\u20102022\u20102529"]}],"id":[{"id":"10.13039\/501100000155","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J of Applied Econometrics"],"published-print":{"date-parts":[[2023,9]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>This paper provides a framework for testing multiple null hypotheses simultaneously using experimental data in which simple random sampling is used to assign treatment status to units. Using general results from the multiple testing literature, we develop under weak assumptions a procedure that (i) asymptotically controls the familywise error rate\u2014the probability of one or more false rejections\u2014and (ii) is asymptotically balanced in that the marginal probability of rejecting any true null hypothesis is approximately equal in large samples. Our procedure improves upon classical methods by incorporating information about the joint dependence structure of the test statistics when determining which null hypotheses to reject, leading to gains in power. An important point of departure from prior work is that we exploit observed, baseline covariates to obtain further gains in power. The precise way in which we incorporate these covariates is based on recent results from the statistics literature in order to ensure that inferences are typically more powerful in large samples.<\/jats:p>","DOI":"10.1002\/jae.2985","type":"journal-article","created":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T12:14:39Z","timestamp":1685103279000},"page":"920-939","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Multiple testing with covariate adjustment in experimental economics"],"prefix":"10.1002","volume":"38","author":[{"given":"John A.","family":"List","sequence":"first","affiliation":[{"name":"Department of Economics University of Chicago and NBER  Chicago Illinois USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Azeem M.","family":"Shaikh","sequence":"additional","affiliation":[{"name":"Department of Economics University of Chicago  Chicago Illinois USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atom","family":"Vayalinkal","sequence":"additional","affiliation":[{"name":"Department of Economics University of Toronto  Toronto Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2023,5,26]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0749-3797(02)00655-4"},{"key":"e_1_2_8_3_1","first-page":"1","article-title":"Inference in experiments with matched pairs","volume":"2021","author":"Bai Y.","year":"2021","journal-title":"Journal of the American Statistical Association"},{"key":"e_1_2_8_4_1","doi-asserted-by":"crossref","unstructured":"Bazylik S. Mogstad M. Romano J. P. Shaikh A. &Wilhelm D.(2021).Finite\u2010 and large\u2010sample inference for ranks using multinomial data with an application to ranking political parties. National Bureau of Economic Research Working Paper.","DOI":"10.3386\/w29519"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1990.10476215"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1177\/0193841X13513025"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeconom.2012.01.001"},{"key":"e_1_2_8_8_1","unstructured":"Bonferroni C. E.(1935).Il calcolo delle assicurazioni su gruppi di teste. Rome: Tipografia del Senato."},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2017.1375934"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.3982\/QE1150"},{"key":"e_1_2_8_11_1","doi-asserted-by":"crossref","unstructured":"Butera L. Grossman P. J. Houser D. List J. A. &Villeval M. C.(2020).A new mechanism to alleviate the crises of confidence in science\u2014With an application to the public goods game. (ID 3598721).Rochester NY: Social Science Research Network.","DOI":"10.3386\/w26801"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1516179112"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.3982\/QE8"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1257\/aer.103.6.2052"},{"key":"e_1_2_8_15_1","doi-asserted-by":"crossref","unstructured":"Heckman J. J. Pinto R. &Shaikh A.(2020).Inference with imperfect randomization: The case of the Perry Preschool Program. (ID 3656356).Rochester NY: Social Science Research Network.","DOI":"10.2139\/ssrn.3656356"},{"issue":"2","key":"e_1_2_8_16_1","first-page":"65","article-title":"A simple sequentially rejective multiple test procedure","volume":"6","author":"Holm S.","year":"1979","journal-title":"Scandinavian Journal of Statistics"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1257\/aer.97.5.1774"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/jae.2327"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOAS583"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10683-018-09597-5"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeconom.2018.04.007"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1257\/aer.104.1.277"},{"key":"e_1_2_8_23_1","doi-asserted-by":"crossref","unstructured":"Mogstad M. Romano J. Shaikh A. &Wilhelm D.(2022).Inference for ranks with applications to mobility across neighborhoods and academic achievement across countries. The Review of Economic Studies forthcoming.","DOI":"10.1093\/restud\/rdad006"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1257\/pandp.20221064"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/07474938.2020.1824732"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1214\/009053606000000461"},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOS1051"},{"issue":"3","key":"e_1_2_8_28_1","first-page":"417","article-title":"Control of the false discovery rate under dependence using the bootstrap and subsampling","volume":"17","author":"Romano J. P.","year":"2008","journal-title":"TEST. An Official Journal of the Spanish Society of Statistics and Operations Research"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0266466608080171"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.economics.102308.124342"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1057\/978-1-349-95121-5_2914-1"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0262.2005.00615.x"},{"key":"e_1_2_8_33_1","doi-asserted-by":"publisher","DOI":"10.1214\/09-AOS734"},{"key":"e_1_2_8_34_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.3113"},{"key":"e_1_2_8_35_1","unstructured":"Viviano D. Wuthrich K. &Niehaus P.(2022).(When) should you adjust inferences for multiple hypothesis testing?Papers 2104.13367."},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.1198\/000313001753272466"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2022.2049278"}],"container-title":["Journal of Applied Econometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jae.2985","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jae.2985","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,4]],"date-time":"2024-01-04T09:44:55Z","timestamp":1704361495000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jae.2985"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,26]]},"references-count":36,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,9]]}},"alternative-id":["10.1002\/jae.2985"],"URL":"https:\/\/doi.org\/10.1002\/jae.2985","archive":["Portico"],"relation":{},"ISSN":["0883-7252","1099-1255"],"issn-type":[{"value":"0883-7252","type":"print"},{"value":"1099-1255","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,26]]},"assertion":[{"value":"2021-05-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}