{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T07:23:16Z","timestamp":1791444196618,"version":"4.3.3"},"reference-count":78,"publisher":"The Econometric Society","issue":"1","license":[{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["QE"],"abstract":"<jats:p>\n                    Given a set of baseline assumptions, a breakdown frontier is the boundary between the set of assumptions which lead to a specific conclusion and those which do not. In a potential outcomes model with a binary treatment, we consider two conclusions: First, that ATE is at least a specific value (e.g., nonnegative) and second that the proportion of units who benefit from treatment is at least a specific value (e.g., at least 50%). For these conclusions, we derive the breakdown frontier for two kinds of assumptions: one which indexes relaxations of the baseline random assignment of treatment assumption, and one which indexes relaxations of the baseline rank invariance assumption. These classes of assumptions nest both the point identifying assumptions of random assignment and rank invariance and the opposite end of no constraints on treatment selection or the dependence structure between potential outcomes. This frontier provides a quantitative measure of the robustness of conclusions to relaxations of the baseline point identifying assumptions. We derive\n                    <a:math xmlns:a=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" display=\"inline\">\n                      <a:msqrt>\n                        <a:mi>N<\/a:mi>\n                      <\/a:msqrt>\n                    <\/a:math>\n                    \u2010consistent sample analog estimators for these frontiers. We then provide two asymptotically valid bootstrap procedures for constructing lower uniform confidence bands for the breakdown frontier. As a measure of robustness, estimated breakdown frontiers and their corresponding confidence bands can be presented alongside traditional point estimates and confidence intervals obtained under point identifying assumptions. We illustrate this approach in an empirical application to the effect of child soldiering on wages. We find that sufficiently weak conclusions are robust to simultaneous failures of rank invariance and random assignment, while some stronger conclusions are fairly robust to failures of rank invariance but not necessarily to relaxations of random assignment.\n                  <\/jats:p>","DOI":"10.3982\/qe1288","type":"journal-article","created":{"date-parts":[[2020,1,27]],"date-time":"2020-01-27T07:51:29Z","timestamp":1580111489000},"page":"41-111","source":"Crossref","is-referenced-by-count":43,"title":["Inference on breakdown frontiers"],"prefix":"10.3982","volume":"11","author":[{"given":"Matthew A.","family":"Masten","sequence":"first","affiliation":[{"name":"Department of Economics, Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandre","family":"Poirier","sequence":"additional","affiliation":[{"name":"Department of Economics, Georgetown University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2359","published-online":{"date-parts":[[2020]]},"reference":[{"key":"quan200069-bib-0001","doi-asserted-by":"crossref","first-page":"5145","DOI":"10.1016\/S1573-4412(07)06072-2","volume":"6","author":"Abbring","year":"2007","journal-title":"Handbook of Econometrics"},{"key":"quan200069-bib-0002","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1086\/426036","volume":"113","author":"Altonji","year":"2005","journal-title":"Journal of Political Economy"},{"key":"quan200069-bib-0003","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1257\/aer.98.2.345","volume":"98","author":"Altonji","year":"2008","journal-title":"American Economic Review P&P"},{"key":"quan200069-bib-0004","unstructured":"Angrist, J. D. (1990), \u201cLifetime earnings and the Vietnam era draft lottery: Evidence from social security administrative records.\u201d The American Economic Review, 313\u2013336."},{"key":"quan200069-bib-0005","unstructured":"Annan, J., C. Blattman, and R. Horton (2006), \u201cThe State of Youth and Youth Protection in Northern Uganda.\u201d Final Report for UNICEF Uganda."},{"key":"quan200069-bib-0006","doi-asserted-by":"crossref","unstructured":"Bedoya, G., L. Bittarello, J. Davis, and N. Mittag (2017), \u201cDistributional impact analysis: Toolkit and illustrations of impacts beyond the average treatment effect.\u201d Policy Research Working Paper No. 8139, World Bank.","DOI":"10.1596\/1813-9450-8139"},{"key":"quan200069-bib-0007","volume-title":"Mathematical Statistics: Basic Ideas and Selected Topics","volume":"2","author":"Bickel","year":"2015"},{"key":"quan200069-bib-0008","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1162\/REST_a_00036","volume":"92","author":"Blattman","year":"2010","journal-title":"The Review of Economics and Statistics"},{"key":"quan200069-bib-0009","volume-title":"Algorithms for Minimization Without Derivatives","author":"Brent","year":"1973"},{"key":"quan200069-bib-0010","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1017\/9781108227223.009","volume-title":"Advances in Economics and Econometrics: Eleventh World Congress","volume":"2","author":"Canay","year":"2017"},{"key":"quan200069-bib-0011","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/0167-9473(92)00066-Z","volume":"17","author":"Cao","year":"1994","journal-title":"Computational Statistics & Data Analysis"},{"key":"quan200069-bib-0012","first-page":"57","volume":"4","author":"Card","year":"2012","journal-title":"American Economic Journal: Applied Economics"},{"key":"quan200069-bib-0013","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.3982\/ECTA7880","volume":"78","author":"Chernozhukov","year":"2010","journal-title":"Econometrica"},{"key":"quan200069-bib-0014","doi-asserted-by":"crossref","first-page":"959","DOI":"10.3982\/ECTA12223","volume":"85","author":"Chesher","year":"2017","journal-title":"Econometrica"},{"key":"quan200069-bib-0015","first-page":"173","volume":"22","author":"Cornfield","year":"1959","journal-title":"Journal of the National Cancer Institute"},{"key":"quan200069-bib-0016","doi-asserted-by":"crossref","unstructured":"De Angelis, D. and G. A. Young (1992), \u201cSmoothing the bootstrap.\u201d International Statistical Review, 45\u201356.","DOI":"10.2307\/1403500"},{"key":"quan200069-bib-0017","unstructured":"Donoho, D. L. and P. J. Huber (1983), \u201cThe notion of breakdown point.\u201d A Festschrift for Erich L. Lehmann, 157\u2013184."},{"key":"quan200069-bib-0018","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1007\/BF01197342","volume":"95","author":"D\u00fcmbgen","year":"1993","journal-title":"Probability Theory and Related Fields"},{"key":"quan200069-bib-0019","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.jeconom.2016.10.005","volume":"197","author":"Fan","year":"2017","journal-title":"Journal of Econometrics"},{"key":"quan200069-bib-0020","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1108\/S0731-9053(2009)0000025004","volume-title":"Nonparametric Econometric Methods: Advances in Econometrics","volume":"25","author":"Fan","year":"2009"},{"key":"quan200069-bib-0021","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1017\/S0266466609990168","volume":"26","author":"Fan","year":"2010","journal-title":"Econometric Theory"},{"key":"quan200069-bib-0022","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1146\/annurev-economics-080213-041221","volume":"6","author":"Fan","year":"2014","journal-title":"Annual Review of Economics"},{"key":"quan200069-bib-0023","unstructured":"Fang, Z. and A. Santos (2015), \u201cInference on directionally differentiable functions.\u201d Working paper."},{"key":"quan200069-bib-0024","first-page":"377","volume":"86","author":"Fang","year":"2019","journal-title":"The Review of Economic Studies"},{"key":"quan200069-bib-0025","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.jeconom.2018.01.006","volume":"204","author":"Freyberger","year":"2018","journal-title":"Journal of Econometrics"},{"key":"quan200069-bib-0026","unstructured":"Gechter, M. (2016), \u201cGeneralizing the results from social experiments: Theory and evidence from Mexico and India.\u201d Working paper."},{"key":"quan200069-bib-0027","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.jeconom.2011.06.007","volume":"166","author":"Gundersen","year":"2012","journal-title":"Journal of Econometrics"},{"key":"quan200069-bib-0028","unstructured":"Hampel, F. R. (1968), Contributions to the Theory of Robust Estimation. PhD Dissertation, University of California, Berkeley."},{"key":"quan200069-bib-0029","doi-asserted-by":"crossref","unstructured":"Hampel, F. R. (1971), \u201cA general qualitative definition of robustness.\u201d The Annals of Mathematical Statistics, 1887\u20131896.","DOI":"10.1214\/aoms\/1177693054"},{"key":"quan200069-bib-0030","volume-title":"Robust Statistics: The Approach Based on Influence Functions","author":"Hampel","year":"1986"},{"key":"quan200069-bib-0031","unstructured":"Hansen, B. E. (2004), \u201cBandwidth selection for nonparametric distribution estimation.\u201d Working paper."},{"key":"quan200069-bib-0032","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1080\/07350015.2015.1073595","volume":"35","author":"Hansen","year":"2017","journal-title":"Journal of Business & Economic Statistics"},{"key":"quan200069-bib-0033","doi-asserted-by":"crossref","first-page":"487","DOI":"10.2307\/2971729","volume":"64","author":"Heckman","year":"1997","journal-title":"The Review of Economic Studies"},{"key":"quan200069-bib-0034","series-title":"Econometric Society Monographs","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1017\/9781108227223.010","volume-title":"Advances in Economics and Econometrics: Eleventh World Congress","volume":"2","author":"Ho","year":"2017"},{"key":"quan200069-bib-0035","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/j.jeconom.2018.06.007","volume":"206","author":"Hong","year":"2018","journal-title":"Journal of Econometrics"},{"key":"quan200069-bib-0036","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/j.jeconom.2011.12.001","volume":"168","author":"Horowitz","year":"2012","journal-title":"Journal of Econometrics"},{"key":"quan200069-bib-0037","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.jeconom.2017.06.019","volume":"201","author":"Horowitz","year":"2017","journal-title":"Journal of Econometrics"},{"key":"quan200069-bib-0038","doi-asserted-by":"crossref","first-page":"281","DOI":"10.2307\/2951627","volume":"63","author":"Horowitz","year":"1995","journal-title":"Econometrica"},{"key":"quan200069-bib-0039","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1214\/aoms\/1177703732","volume":"35","author":"Huber","year":"1964","journal-title":"The Annals of Mathematical Statistics"},{"key":"quan200069-bib-0040","doi-asserted-by":"crossref","DOI":"10.1002\/9780470434697","volume-title":"Robust Statistics","author":"Huber","year":"2009"},{"key":"quan200069-bib-0041","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1257\/000282803321946921","volume":"93","author":"Imbens","year":"2003","journal-title":"American Economic Review P&P"},{"key":"quan200069-bib-0042","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal Inference for Statistics, Social, and Biomedical Sciences","author":"Imbens","year":"2015"},{"key":"quan200069-bib-0043","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.jeconom.2015.12.017","volume":"192","author":"Kaido","year":"2016","journal-title":"Journal of Econometrics"},{"key":"quan200069-bib-0044","doi-asserted-by":"crossref","first-page":"231","DOI":"10.3982\/QE176","volume":"4","author":"Kline","year":"2013","journal-title":"Quantitative Economics"},{"key":"quan200069-bib-0045","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-74978-5","volume-title":"Introduction to Empirical Processes and Semiparametric Inference","author":"Kosorok","year":"2008"},{"key":"quan200069-bib-0046","doi-asserted-by":"crossref","first-page":"958","DOI":"10.1080\/01621459.2012.682828","volume":"107","author":"Kreider","year":"2012","journal-title":"Journal of the American Statistical Association"},{"key":"quan200069-bib-0047","doi-asserted-by":"crossref","first-page":"1106","DOI":"10.1002\/soej.12078","volume":"82","author":"Kreider","year":"2016","journal-title":"Southern Economic Journal"},{"key":"quan200069-bib-0048","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1016\/j.jeconom.2019.02.007","volume":"211","author":"Lee","year":"2019","journal-title":"Journal of Econometrics"},{"key":"quan200069-bib-0049","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1007\/BF02481146","volume":"42","author":"L\u00e9ger","year":"1990","journal-title":"Annals of the Institute of Statistical Mathematics"},{"key":"quan200069-bib-0050","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1198\/073500107000000250","volume":"26","author":"Li","year":"2008","journal-title":"Journal of Business & Economic Statistics"},{"key":"quan200069-bib-0051","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1137\/1126086","volume":"26","author":"Makarov","year":"1982","journal-title":"Theory of Probability & Its Applications"},{"key":"quan200069-bib-0052","volume-title":"Identification for Prediction and Decision","author":"Manski","year":"2007"},{"key":"quan200069-bib-0053","doi-asserted-by":"crossref","first-page":"F412","DOI":"10.1111\/ecoj.12068","volume":"123","author":"Manski","year":"2013","journal-title":"The Economic Journal"},{"key":"quan200069-bib-0054","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1162\/REST_a_00689","volume":"100","author":"Manski","year":"2018","journal-title":"The Review of Economics and Statistics"},{"key":"quan200069-bib-0055","first-page":"249","volume-title":"Exploring the Limits of Bootstrap","author":"Marron","year":"1992"},{"key":"quan200069-bib-0056","doi-asserted-by":"crossref","unstructured":"Masten, M. A, and A. Poirier (2020), \u201cSupplement to \u2018Inference on breakdown frontiers\u2019.\u201d Quantitative Economics Supplemental Material, 11, https:\/\/doi.org\/10.3982\/QE1288.","DOI":"10.3982\/QE1288"},{"key":"quan200069-bib-0057","doi-asserted-by":"crossref","unstructured":"Masten, M. A. and A. Poirier (2016), \u201cPartial independence in nonseparable models.\u201d cemmap Working Paper, CWP26\/16.","DOI":"10.2139\/ssrn.2797364"},{"key":"quan200069-bib-0058","doi-asserted-by":"crossref","first-page":"317","DOI":"10.3982\/ECTA14481","volume":"86","author":"Masten","year":"2018","journal-title":"Econometrica"},{"key":"quan200069-bib-0059","unstructured":"Masten, M. A. and A. Poirier (2018b), \u201cInterpreting quantile independence.\u201d Working paper."},{"key":"quan200069-bib-0060","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1111\/1468-0262.00452","volume":"71","author":"Matzkin","year":"2003","journal-title":"Econometrica"},{"key":"quan200069-bib-0061","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.jhealeco.2018.06.011","volume":"61","author":"Mullahy","year":"2018","journal-title":"Journal of Health Economics"},{"key":"quan200069-bib-0062","volume-title":"An Introduction to Copulas","author":"Nelsen","year":"2006","edition":"second edition"},{"key":"quan200069-bib-0063","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1080\/07350015.2016.1227711","volume":"37","author":"Oster","year":"2019","journal-title":"Journal of Business & Economic Statistics"},{"key":"quan200069-bib-0064","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1111\/1467-9868.00099","volume":"59","author":"Polansky","year":"1997","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"quan200069-bib-0065","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1023\/A:1005285815569","volume":"121","author":"Robins","year":"1999","journal-title":"Synthese"},{"key":"quan200069-bib-0066","first-page":"1","volume-title":"Statistical Models in Epidemiology, the Environment, and Clinical Trials","author":"Robins","year":"2000"},{"key":"quan200069-bib-0067","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-2443-1","volume-title":"Observational Studies","author":"Rosenbaum","year":"1995"},{"key":"quan200069-bib-0068","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3692-2","volume-title":"Observational Studies","author":"Rosenbaum","year":"2002","edition":"second edition"},{"key":"quan200069-bib-0069","doi-asserted-by":"crossref","unstructured":"Rosenbaum, P. R. and D. B. Rubin (1983), \u201cAssessing sensitivity to an unobserved binary covariate in an observational study with binary outcome.\u201d Journal of the Royal Statistical Society, Series B, 212\u2013218.","DOI":"10.1111\/j.2517-6161.1983.tb01242.x"},{"key":"quan200069-bib-0070","doi-asserted-by":"crossref","first-page":"1321","DOI":"10.1080\/01621459.1998.10473795","volume":"93","author":"Rotnitzky","year":"1998","journal-title":"Journal of the American Statistical Association"},{"key":"quan200069-bib-0071","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1007\/BF00940933","volume":"66","author":"Shapiro","year":"1990","journal-title":"Journal of Optimization Theory and Applications"},{"key":"quan200069-bib-0072","first-page":"229","volume":"8","author":"Sklar","year":"1959","journal-title":"Publications de l'Institut de statistique de l'Universit\u00e9 de Paris"},{"key":"quan200069-bib-0073","unstructured":"Stoye, J. (2005), Essays on Partial Identification and Statistical Decisions. PhD Dissertation, Northwestern University."},{"key":"quan200069-bib-0074","doi-asserted-by":"crossref","first-page":"323","DOI":"10.3982\/QE24","volume":"1","author":"Stoye","year":"2010","journal-title":"Quantitative Economics"},{"key":"quan200069-bib-0075","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1093\/biomet\/76.4.705","volume":"76","author":"Taylor","year":"1989","journal-title":"Biometrika"},{"key":"quan200069-bib-0076","doi-asserted-by":"crossref","first-page":"105","DOI":"10.3982\/QE634","volume":"10","author":"Torgovitsky","year":"2019","journal-title":"Quantitative Economics"},{"key":"quan200069-bib-0077","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-2545-2","volume-title":"Weak Convergence and Empirical Processes: With Applications to Statistics","author":"Vaart","year":"1996"},{"key":"quan200069-bib-0078","volume-title":"Asymptotic Statistics","author":"Vaart","year":"2000"}],"container-title":["Quantitative Economics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.3982\/QE1288","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,1,27]],"date-time":"2020-01-27T07:52:53Z","timestamp":1580111573000},"score":1,"resource":{"primary":{"URL":"http:\/\/qeconomics.org\/ojs\/index.php\/qe\/article\/view\/QE1288"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"references-count":78,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020]]}},"alternative-id":["10.3982\/QE1288"],"URL":"https:\/\/doi.org\/10.3982\/qe1288","relation":{},"ISSN":["1759-7323"],"issn-type":[{"value":"1759-7323","type":"print"}],"subject":[],"published":{"date-parts":[[2020]]}}}