{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T13:11:21Z","timestamp":1792069881194,"version":"4.4.0"},"reference-count":48,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2019,12,17]],"date-time":"2019-12-17T00:00:00Z","timestamp":1576540800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,2,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:p>We extend the omitted variable bias framework with a suite of tools for sensitivity analysis in regression models that does not require assumptions on the functional form of the treatment assignment mechanism nor on the distribution of the unobserved confounders, naturally handles multiple confounders, possibly acting non-linearly, exploits expert knowledge to bound sensitivity parameters and can be easily computed by using only standard regression results. In particular, we introduce two novel sensitivity measures suited for routine reporting. The robustness value describes the minimum strength of association that unobserved confounding would need to have, both with the treatment and with the outcome, to change the research conclusions. The partial R2 of the treatment with the outcome shows how strongly confounders explaining all the residual outcome variation would have to be associated with the treatment to eliminate the estimated effect. Next, we offer graphical tools for elaborating on problematic confounders, examining the sensitivity of point estimates and t-values, as well as \u2018extreme scenarios\u2019. Finally, we describe problems with a common \u2018benchmarking\u2019 practice and introduce a novel procedure to bound the strength of confounders formally on the basis of a comparison with observed covariates. We apply these methods to a running example that estimates the effect of exposure to violence on attitudes toward peace.<\/jats:p>","DOI":"10.1111\/rssb.12348","type":"journal-article","created":{"date-parts":[[2019,12,17]],"date-time":"2019-12-17T09:45:37Z","timestamp":1576575937000},"page":"39-67","source":"Crossref","is-referenced-by-count":1038,"title":["Making Sense of Sensitivity: Extending Omitted Variable Bias"],"prefix":"10.1093","volume":"82","author":[{"given":"Carlos","family":"Cinelli","sequence":"first","affiliation":[{"name":"University of California , Los Angeles , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chad","family":"Hazlett","sequence":"additional","affiliation":[{"name":"University of California , Los Angeles , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2019,12,17]]},"reference":[{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"791","DOI":"10.3368\/jhr.XL.4.791","article-title":"An evaluation of instrumental variable strategies for estimating the effects of catholic schooling","volume":"40","author":"Altonji","year":"2005","journal-title":"J. Hum. Resour."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctvcm4j72","volume-title":"Mostly Harmless Econometrics: an Empiricist\u2019s Companion","author":"Angrist","year":"2008"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","DOI":"10.3386\/w23144","volume-title":"Undergraduate econometrics instruction: through our classes, darkly. Technical Report.","author":"Angrist","year":"2017"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1093\/pan\/mpt006","article-title":"A selection bias approach to sensitivity analysis for causal effects","volume":"22","author":"Blackwell","year":"2013","journal-title":"Polit. Anal."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1002\/sim.1657","article-title":"Sensitivity analyses for unmeasured confounding assuming a marginal structural model for repeated measures","volume":"23","author":"Brumback","year":"2004","journal-title":"Statist. Med."},{"key":"2023022408362725100_","first-page":"395","article-title":"Assessing sensitivity to unmeasured confounding using a simulated potential confounder","volume":"9","author":"Carnegie","year":"2016","journal-title":"J. Res. Educ. Effect."},{"key":"2023022408362725100_","volume-title":"treatsens: a package to assess sensitivity of causal analyses to unmeasured confounding","author":"Carnegie","year":"2016"},{"key":"2023022408362725100_","volume-title":"sensemakr: sensitivity analysis tools for OLS","author":"Cinelli","year":"2019"},{"key":"2023022408362725100_","first-page":"1252","article-title":"Sensitivity analysis of linear structural causal models","volume":"97","author":"Cinelli","year":"2019","journal-title":"Proc. Mach. Learn. Res."},{"key":"2023022408362725100_","first-page":"173","article-title":"Smoking and lung cancer: recent evidence and a discussion of some questions","volume":"22","author":"Cornfield","year":"1959","journal-title":"J. Natn. Cancer Inst."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1515\/jci-2013-0021","article-title":"To adjust or not to adjust?: Sensitivity analysis of M-bias and butterfly-bias","volume":"3","author":"Ding","year":"2015","journal-title":"J. Causl Inf."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"3453","DOI":"10.1002\/sim.6973","article-title":"A flexible, interpretable framework for assessing sensitivity to unmeasured confounding","volume":"35","author":"Dorie","year":"2016","journal-title":"Statist. Med."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139084444","volume-title":"Natural Experiments in the Social Sciences: a Design-based Approach","author":"Dunning","year":"2012"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","DOI":"10.5040\/9781350219489","volume-title":"Darfur: a New History of a Long War","author":"Flint","year":"2008"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1177\/0049124100029002001","article-title":"Impact of a confounding variable on a regression coefficient","volume":"29","author":"Frank","year":"2000","journal-title":"Sociol. Meth. Res."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"437","DOI":"10.3102\/0162373713493129","article-title":"What would it take to change an inference?: Using Rubin\u2019s causal model to interpret the robustness of causal inferences","volume":"35","author":"Frank","year":"2013","journal-title":"Educ. Evaln Poly Anal."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1111\/j.1467-9531.2007.00186.x","article-title":"Indices of robustness for sample representation","volume":"37","author":"Frank","year":"2007","journal-title":"Sociol. Methodol."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"3","DOI":"10.3102\/0162373707313781","article-title":"Does NBPTS certification affect the number of colleagues a teacher helps with instructional matters?","volume":"30","author":"Frank","year":"2008","journal-title":"Educ. Evaln Poly Anal."},{"key":"2023022408362725100_","article-title":"Flexible sensitivity analysis for observational studies without observable implications","author":"Franks","year":"2019","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"387","DOI":"10.2307\/1907330","article-title":"Partial time regressions as compared with individual trends","volume":"1","author":"Frisch","year":"1933","journal-title":"Econometrica"},{"key":"2023022408362725100_","article-title":"Angry or weary?: The effect of personal violence on attitudes towards peace in Darfur","author":"Hazlett","year":"2019","journal-title":"J. Conflct Resoln"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"32","DOI":"10.3102\/1076998617749561","article-title":"Weighting-based sensitivity analysis in causal mediation studies","volume":"43","author":"Hong","year":"2018","journal-title":"J. Educ. Behav. Statist."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1214\/09-AOAS315","article-title":"The sensitivity of linear regression coefficients\u2019 confidence limits to the omission of a confounder","volume":"4","author":"Hosman","year":"2010","journal-title":"Ann. Appl. Statist."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1214\/10-STS321","article-title":"Identification, inference and sensitivity analysis for causal mediation effects","volume":"25","author":"Imai","year":"2010","journal-title":"Statist. Sci."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1257\/000282803321946921","article-title":"Sensitivity to exogeneity assumptions in program evaluation","volume":"93","author":"Imbens","year":"2003","journal-title":"Am. Econ. Rev."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal Inference in Statistics, Social, and Biomedical Sciences","author":"Imbens","year":"2015"},{"key":"2023022408362725100_","volume-title":"Gendered language. Policy Research Working Paper.","author":"Jakiela","year":"2018"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1080\/00031305.1989.10475596","article-title":"Concepts of relative importance in recent scientific literature","volume":"43","author":"Kruskal","year":"1989","journal-title":"Am. Statistn"},{"key":"2023022408362725100_","first-page":"31","article-title":"Let\u2019s take the con out of econometrics","volume":"73","author":"Leamer","year":"1983","journal-title":"Am. Econ. Rev."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.jeconom.2015.10.013","article-title":"S-values: conventional context-minimal measures of the sturdiness of regression coefficients","volume":"193","author":"Leamer","year":"2016","journal-title":"J. Econmetr."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1080\/01621459.1963.10480682","article-title":"Seasonal adjustment of economic time series and multiple regression analysis","volume":"58","author":"Lovell","year":"1963","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"88","DOI":"10.3200\/JECE.39.1.88-91","article-title":"A simple proof of the FWL theorem","volume":"39","author":"Lovell","year":"2008","journal-title":"J. Econ. Educ."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1093\/pan\/mpw015","article-title":"Bias amplification and bias unmasking","volume":"24","author":"Middleton","year":"2016","journal-title":"Polit. Anal."},{"key":"2023022408362725100_","volume-title":"Unobservable selection and coefficient stability: theory and evidence. Working Paper.","author":"Oster","year":"2014"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1080\/07350015.2016.1227711","article-title":"Unobservable selection and coefficient stability: theory and evidence","volume":"37","author":"Oster","year":"2019","journal-title":"J. Bus. Econ. Statist."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511803161","volume-title":"Causality","author":"Pearl","year":"2009"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"1223","DOI":"10.1093\/aje\/kwr352","article-title":"Invited commentary: understanding bias amplification","volume":"174","author":"Pearl","year":"2011","journal-title":"Am. J. Epidem."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1023\/A:1005285815569","article-title":"Association, causation, and marginal structural models","volume":"121","author":"Robins","year":"1999","journal-title":"Synthese"},{"key":"2023022408362725100_","first-page":"656","article-title":"The consequences of adjustment for a concomitant variable that has been affected by the treatment","volume":"147","author":"Rosenbaum","year":"1984","journal-title":"J. R. Statist. Soc."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-1-4757-3692-2","volume-title":"Observational Studies","author":"Rosenbaum","year":"2002"},{"key":"2023022408362725100_","first-page":"1809","volume-title":"Encyclopedia of Statistics in Behavioral Science","author":"Rosenbaum","year":"2005"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4419-1213-8","volume-title":"Design of Observational Studies","author":"Rosenbaum","year":"2010"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","DOI":"10.4159\/9780674982697","volume-title":"Observation and Experiment: an Introduction to Causal Inference","author":"Rosenbaum","year":"2017"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1093\/biomet\/70.1.41","article-title":"The central role of the propensity score in observational studies for causal effects","volume":"70","author":"Rosenbaum","year":"1983","journal-title":"Biometrika"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1111\/j.2517-6161.1983.tb01242.x","article-title":"Assessing sensitivity to an unobserved binary covariate in an observational study with binary outcome","volume":"45","author":"Rosenbaum","year":"1983","journal-title":"J. R. Statist. Soc."},{"issue":"no. 2","key":"2023022408362725100_","article-title":"The mechanics of omitted variable bias: bias amplification and cancellation of offsetting biases","volume":"4","author":"Steiner","year":"2016","journal-title":"J. Causl Inf."},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1097\/EDE.0b013e3181f74493","article-title":"Bias formulas for sensitivity analysis of unmeasured confounding for general outcomes, treatments, and confounders","volume":"22","author":"Vanderweele","year":"2011","journal-title":"Epidemiology"},{"key":"2023022408362725100_","doi-asserted-by":"crossref","first-page":"268","DOI":"10.7326\/M16-2607","article-title":"Sensitivity analysis in observational research: introducing the E-value","volume":"167","author":"VanderWeele","year":"2017","journal-title":"Ann. Intern. Med."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12348","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/1\/39\/49320681\/jrsssb_82_1_39.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/1\/39\/49320681\/jrsssb_82_1_39.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,28]],"date-time":"2024-07-28T15:29:20Z","timestamp":1722180560000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/82\/1\/39\/7056023"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,17]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,12,17]]},"published-print":{"date-parts":[[2020,2,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12348","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,2]]},"published":{"date-parts":[[2019,12,17]]}}}