{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T10:55:44Z","timestamp":1773831344558,"version":"3.50.1"},"reference-count":33,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2018,5,8]],"date-time":"2018-05-08T00:00:00Z","timestamp":1525737600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"},{"start":{"date-parts":[[2018,5,8]],"date-time":"2018-05-08T00:00:00Z","timestamp":1525737600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,12,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n               <jats:p>Effect modification means the magnitude or stability of a treatment effect varies as a function of an observed covariate. Generally, larger and more stable treatment effects are insensitive to larger biases from unmeasured covariates, so a causal conclusion may be considerably firmer if this pattern is noted if it occurs. We propose a new strategy, called the submax-method, that combines exploratory, and confirmatory efforts to determine whether there is stronger evidence of causality\u2014that is, greater insensitivity to unmeasured confounding\u2014in some subgroups of individuals. It uses the joint distribution of test statistics that split the data in various ways based on certain observed covariates. For L binary covariates, the method splits the population L times into two subpopulations, perhaps first men and women, perhaps then smokers and nonsmokers, computing a test statistic from each subpopulation, and appends the test statistic for the whole population, making test statistics in total. Although L binary covariates define interaction groups, only tests are performed, and at least of these tests use at least half of the data. The submax-method achieves the highest design sensitivity and the highest Bahadur efficiency of its component tests. Moreover, the form of the test is sufficiently tractable that its large sample power may be studied analytically. The simulation suggests that the submax method exhibits superior performance, in comparison with an approach using CART, when there is effect modification of moderate size. Using data from the NHANES I epidemiologic follow-up survey, an observational study of the effects of physical activity on survival is used to illustrate the method. The method is implemented in the package which contains the NHANES example. An online Appendix provides simulation results and further analysis of the example.<\/jats:p>","DOI":"10.1111\/biom.12884","type":"journal-article","created":{"date-parts":[[2018,5,8]],"date-time":"2018-05-08T19:05:27Z","timestamp":1525806327000},"page":"1161-1170","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["A Powerful Approach to the Study of Moderate Effect Modification in Observational Studies"],"prefix":"10.1093","volume":"74","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5823-4331","authenticated-orcid":false,"given":"Kwonsang","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Biostatistics, Harvard School of Public Health , Boston, Massachusetts 02115 , U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4928-2646","authenticated-orcid":false,"given":"Dylan S.","family":"Small","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of Pennsylvania , Philadelphia, Pennsylvania 19104 , U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0872-1403","authenticated-orcid":false,"given":"Paul R.","family":"Rosenbaum","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of Pennsylvania , Philadelphia, Pennsylvania 19104 , U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2018,5,8]]},"reference":[{"key":"2024011509372937700_biom12884-bib-0001","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1007\/978-3-642-52307-6_8","volume-title":"Multiple Hypothesenpr\u00fcfung","author":"Bergmann","year":"1988"},{"key":"2024011509372937700_biom12884-bib-0002","first-page":"158","article-title":"Relatively optimal combinations of test statistics","volume":"5","author":"Berk","year":"1978","journal-title":"Scandinavian Journal of Statistics"},{"key":"2024011509372937700_biom12884-bib-0003","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1006\/pmed.1994.1051","article-title":"Health behaviors and survival among middle aged and older men and women in the NHANES I epidemiologic follow-up study","volume":"23","author":"Davis","year":"1994","journal-title":"Preventive Medicine"},{"key":"2024011509372937700_biom12884-bib-0004","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1111\/j.1541-0420.2008.01111.x","article-title":"On estimation of the survivor average causal effect in observational studies when important confounders are missing due to death","volume":"65","author":"Egleston","year":"2009","journal-title":"Biometrics"},{"key":"2024011509372937700_biom12884-bib-0005","doi-asserted-by":"crossref","first-page":"1820","DOI":"10.1080\/01621459.2015.1120675","article-title":"Sensitivity analysis for multiple comparisons in matched observational studies through quadratically constrained linear programming","volume":"111","author":"Fogarty","year":"2016","journal-title":"Journal of the American Statistical Association"},{"key":"2024011509372937700_biom12884-bib-0006","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1111\/1467-9868.00249","article-title":"Asymptotic separability in sensitivity analysis","volume":"62","author":"Gastwirth","year":"2000","journal-title":"Journal of the Royal Statistical Society, Series B"},{"key":"2024011509372937700_biom12884-bib-0007","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-01689-9","volume-title":"Computation of Multivariate Normal and t Probabilities","author":"Genz","year":"2009"},{"key":"2024011509372937700_biom12884-bib-0008","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1111\/1541-0420.00063","article-title":"Sensitivity analysis for the assessment of the causal vaccine effects on viral load in HIV vaccine trials","volume":"59","author":"Gilbert","year":"2003","journal-title":"Biometrics"},{"key":"2024011509372937700_biom12884-bib-0009","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1515\/1544-6115.1554","article-title":"The inheritance procedure","volume":"11","author":"Goeman","year":"2012","journal-title":"Statistical Applications in Genetics and Molecular Biology"},{"key":"2024011509372937700_biom12884-bib-0010","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1198\/106186006X137047","article-title":"Optimal full matching and related designs via network flows","volume":"15","author":"Hansen","year":"2012","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"2024011509372937700_biom12884-bib-0011","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1080\/01621459.1994.10476453","article-title":"On the relationship between stepwise decision procedures and confidence sets","volume":"89","author":"Hayter","year":"1994","journal-title":"Journal of the American Statistical Association"},{"key":"2024011509372937700_biom12884-bib-0012","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1214\/09-AOAS315","article-title":"The sensitivity of linear regression coefficients\u2019 confidence limits to the omission of a confounder","volume":"4","author":"Hosman","year":"2010","journal-title":"Annals of Applied Statistics"},{"key":"2024011509372937700_biom12884-bib-0013","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1080\/01621459.2012.742018","article-title":"Effect modification and design sensitivity in observational studies","volume":"108","author":"Hsu","year":"2013","journal-title":"Journal of the American Statistical Association"},{"key":"2024011509372937700_biom12884-bib-0014","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1093\/biomet\/asv034","article-title":"Strong control of the familywise error rate in observational studies that discover effect modification by exploratory methods","volume":"102","author":"Hsu","year":"2015","journal-title":"Biometrika"},{"key":"2024011509372937700_biom12884-bib-0015","volume-title":"Nonparametrics","author":"Lehmann","year":"1975"},{"key":"2024011509372937700_biom12884-bib-0016","volume-title":"Testing Statistical Hypotheses","author":"Lehmann","year":"2005"},{"key":"2024011509372937700_biom12884-bib-0017","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1007\/s11121-012-0339-5","article-title":"Sensitivity analysis for unobserved confounding in nonexperimental prevention research","volume":"14","author":"Liu","year":"2013","journal-title":"Prevention Science"},{"key":"2024011509372937700_biom12884-bib-0018","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1093\/biomet\/63.3.655","article-title":"On closed testing procedures with special reference to ordered analysis of variance","volume":"63","author":"Marcus","year":"1976","journal-title":"Biometrika"},{"key":"2024011509372937700_biom12884-bib-0019","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1093\/biomet\/66.1.163","article-title":"Exact robust confidence intervals for location","volume":"66","author":"Maritz","year":"1979","journal-title":"Biometrika"},{"key":"2024011509372937700_biom12884-bib-0020","doi-asserted-by":"crossref","first-page":"169","DOI":"10.2307\/2531957","article-title":"A paired Prentice-Wilcoxon test for censored paired data","volume":"43","author":"O'Brien","year":"1987","journal-title":"Biometrics"},{"key":"2024011509372937700_biom12884-bib-0021","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3692-2","volume-title":"Observational Studies","author":"Rosenbaum","year":"2002"},{"key":"2024011509372937700_biom12884-bib-0022","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1093\/biomet\/91.1.153","article-title":"Design sensitivity in observational studies","volume":"91","author":"Rosenbaum","year":"2004","journal-title":"Biometrika"},{"key":"2024011509372937700_biom12884-bib-0023","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1111\/j.1541-0420.2006.00717.x","article-title":"Sensitivity analysis for m-estimates, tests and confidence intervals in matched observational studies","volume":"63","author":"Rosenbaum","year":"2007","journal-title":"Biometrics"},{"key":"2024011509372937700_biom12884-bib-0024","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1198\/jasa.2009.0016","article-title":"Sensitivity analysis for equivalence and difference in an observational study of neonatal intensive care units","volume":"104","author":"Rosenbaum","year":"2009","journal-title":"Journal of the American Statistical Association"},{"key":"2024011509372937700_biom12884-bib-0025","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4419-1213-8","volume-title":"Design of Observational Studies","author":"Rosenbaum","year":"2010"},{"key":"2024011509372937700_biom12884-bib-0026","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1093\/biomet\/ass032","article-title":"Testing one hypothesis twice in observational studies","volume":"99","author":"Rosenbaum","year":"2012","journal-title":"Biometrika"},{"key":"2024011509372937700_biom12884-bib-0027","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1080\/01621459.2014.960968","article-title":"Bahadur efficiency of sensitivity analyses in observational studies","volume":"110","author":"Rosenbaum","year":"2015","journal-title":"Journal of the American Statistical Association"},{"key":"2024011509372937700_biom12884-bib-0028","doi-asserted-by":"crossref","DOI":"10.4159\/9780674982697","volume-title":"Observation and Experiment","author":"Rosenbaum","year":"2017"},{"key":"2024011509372937700_biom12884-bib-0029","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1080\/01621459.1986.10478341","article-title":"Modified sequentially rejective multiple test procedures","volume":"81","author":"Shaffer","year":"1986","journal-title":"Journal of the American Statistical Association"},{"key":"2024011509372937700_biom12884-bib-0030","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1097\/EDE.0b013e3182782468","article-title":"Should epidemiologists be more sensitive to design sensitivity?","volume":"24","author":"Stuart","year":"2013","journal-title":"Epidemiology"},{"key":"2024011509372937700_biom12884-bib-0031","article-title":"Estimation and inference of heterogeneous treatment effects using random forests","author":"Wager","year":"2017","journal-title":"Journal of the American Statistical Association"},{"key":"2024011509372937700_biom12884-bib-0032","article-title":"Selective inference for effect modification via the lasso","author":"Zhao","year":"2017","journal-title":"arXiv:1705.08020"},{"key":"2024011509372937700_biom12884-bib-0033","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1097\/EDE.0b013e318277367e","article-title":"Effect of the 2010 Chilean earthquake on posttraumatic stress","volume":"24","author":"Zubizarreta","year":"2013","journal-title":"Epidemiology"}],"container-title":["Biometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fbiom.12884","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/biom.12884","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/biom.12884","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/biometrics\/article-pdf\/74\/4\/1161\/55806081\/biometrics_74_4_1161.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biometrics\/article-pdf\/74\/4\/1161\/55806081\/biometrics_74_4_1161.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,26]],"date-time":"2024-01-26T18:06:45Z","timestamp":1706292405000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biometrics\/article\/74\/4\/1161-1170\/7537566"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,8]]},"references-count":33,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2018,5,8]]},"published-print":{"date-parts":[[2018,12,1]]}},"URL":"https:\/\/doi.org\/10.1111\/biom.12884","relation":{},"ISSN":["0006-341X","1541-0420"],"issn-type":[{"value":"0006-341X","type":"print"},{"value":"1541-0420","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,12]]},"published":{"date-parts":[[2018,5,8]]},"assertion":[{"value":"2017-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-05-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}