{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T17:30:02Z","timestamp":1787592602214,"version":"build-2736575974"},"reference-count":144,"publisher":"Annual Reviews","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Annu. Rev. Econ."],"published-print":{"date-parts":[[2019,8,2]]},"abstract":"<jats:p>We discuss the relevance of the recent machine learning (ML) literature for economics and econometrics. First we discuss the differences in goals, methods, and settings between the ML literature and the traditional econometrics and statistics literatures. Then we discuss some specific methods from the ML literature that we view as important for empirical researchers in economics. These include supervised learning methods for regression and classification, unsupervised learning methods, and matrix completion methods. Finally, we highlight newly developed methods at the intersection of ML and econometrics that typically perform better than either off-the-shelf ML or more traditional econometric methods when applied to particular classes of problems, including causal inference for average treatment effects, optimal policy estimation, and estimation of the counterfactual effect of price changes in consumer choice models.<\/jats:p>","DOI":"10.1146\/annurev-economics-080217-053433","type":"journal-article","created":{"date-parts":[[2019,6,10]],"date-time":"2019-06-10T15:03:41Z","timestamp":1560179021000},"page":"685-725","source":"Crossref","is-referenced-by-count":896,"title":["Machine Learning Methods That Economists Should Know About"],"prefix":"10.1146","volume":"11","author":[{"given":"Susan","family":"Athey","sequence":"first","affiliation":[{"name":"Graduate School of Business, Stanford University, Stanford, California 94305, USA;,"},{"name":"Stanford Institute for Economic Policy Research, Stanford University, Stanford, California 94305, USA"},{"name":"National Bureau of Economic Research, Cambridge, Massachusetts 02138, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guido W.","family":"Imbens","sequence":"additional","affiliation":[{"name":"Graduate School of Business, Stanford University, Stanford, California 94305, USA;,"},{"name":"Stanford Institute for Economic Policy Research, Stanford University, Stanford, California 94305, USA"},{"name":"National Bureau of Economic Research, Cambridge, Massachusetts 02138, USA"},{"name":"Department of Economics, Stanford University, Stanford, California 94305, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"22","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-economics-080217-053402"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1198\/jasa.2009.ap08746"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1111\/ajps.12116"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1198\/jbes.2009.07333"},{"key":"B5","volume-title":"Introduction to Machine Learning","author":"Alpaydin E","year":"2009"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvcm4j72"},{"key":"B7","unstructured":"Arjovsky M, Bottou L. 2017. Towards principled methods for training generative adversarial networks. arXiv:1701.04862 [stat.ML]"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00106"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1126\/science.aal4321"},{"key":"B10","volume-title":"The Economics of Artificial Intelligence: An Agenda","author":"Athey S","year":"2019"},{"key":"B11","doi-asserted-by":"crossref","unstructured":"Athey S, Bayati M, Doudchenko N, Imbens G, Khosravi K. 2017a. Matrix completion methods for causal panel data models. arXiv:1710.10251 [math.ST]","DOI":"10.3386\/w25132"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.3386\/w25675"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1257\/pandp.20181031"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1510489113"},{"key":"B15","unstructured":"Athey S, Imbens G, Wager S. 2016a. Efficient inference of average treatment effects in high dimensions via approximate residual balancing. arXiv:1604.07125 [math.ST]"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1016\/bs.hefe.2016.10.003"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1257\/jep.31.2.3"},{"key":"B18","volume-title":"The impact of aggregators on internet news consumption","author":"Athey S","year":"2017"},{"key":"B19","doi-asserted-by":"crossref","unstructured":"Athey S, Tibshirani J, Wager S. 2016b. Generalized random forests. arXiv:1610.01271 [stat.ME]","DOI":"10.32614\/CRAN.package.grf"},{"key":"B20","unstructured":"Athey S, Wager S. 2017. Efficient policy learning. arXiv:1702.02896 [math.ST]"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1111\/1468-0262.00392"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1111\/1468-0262.00273"},{"key":"B23","unstructured":"Bai J, Ng S. 2017. Principal components and regularized estimation of factor models. arXiv:1708.08137 [stat.ME]"},{"key":"B24","first-page":"380","volume-title":"Proceedings of the 34th International Conference on Machine Learning","author":"Bamler R","year":"2017"},{"key":"B25","doi-asserted-by":"crossref","unstructured":"Barkan O. 2016. Bayesian neural word embedding. arXiv:1603.06571 [math.ST]","DOI":"10.1609\/aaai.v31i1.10987"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.2661896"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1145\/1345448.1345465"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1257\/jep.28.2.29"},{"key":"B29","first-page":"1137","volume":"3","author":"Bengio Y","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-33486-6_6"},{"key":"B31","volume-title":"Proceedings of KDD Cup and Workshop 2007","author":"Bennett J","year":"2007"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1214\/15-AOS1388"},{"key":"B33","volume-title":"Efficient and Adaptive Estimation for Semiparametric Models","author":"Bickel P","year":"1998"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1017\/CCOL0521344301.003"},{"key":"B35","first-page":"101","volume-title":"Text Mining: Classification, Clustering, and Applications","author":"Blei DM","year":"2009"},{"key":"B36","first-page":"9","volume-title":"On-Line Learning in Neural Networks","author":"Bottou L","year":"1998"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35289-8_25"},{"key":"B38","volume-title":"Better subset selection using the non-negative garotte","author":"Breiman L","year":"1993"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1007\/BF00058655"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1009213726"},{"key":"B42","volume-title":"Classification and Regression Trees","author":"Breiman L","year":"1984"},{"key":"B43","volume-title":"The Hundred-Page Machine Learning Book","author":"Burkov A","year":"2019"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1214\/009053606000001523"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1007\/s10208-009-9045-5"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-4076(99)00039-1"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1016\/S1573-4412(07)06076-X"},{"key":"B48","volume-title":"Double machine learning for treatment and causal parameters","author":"Chernozhukov V","year":"2016"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1111\/ectj.12097"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1257\/aer.p20171038"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.3386\/w24678"},{"key":"B52","unstructured":"Chernozhukov V, Escanciano JC, Ichimura H, Newey WK. 2016b. Locally robust semiparametric estimation. arXiv:1608.00033 [math.ST]"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1920\/wp.cem.2018.1518"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1214\/09-AOAS285"},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45014-9_1"},{"key":"B57","unstructured":"Dimakopoulou M, Athey S, Imbens G. 2017. Estimation considerations in contextual bandits. arXiv:1711.07077 [stat.ML]"},{"key":"B58","doi-asserted-by":"crossref","unstructured":"Dimakopoulou M, Zhou Z, Athey S, Imbens G. 2018. Balanced linear contextual bandits. arXiv:1812.06227 [cs.LG]","DOI":"10.1609\/aaai.v33i01.33013445"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.3386\/w22791"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.1214\/14-STS500"},{"key":"B61","first-page":"1097","volume-title":"Proceedings of the 28th International Conference on Machine Learning","author":"Dudik M","year":"2011"},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781316576533"},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.1214\/009053604000000067"},{"key":"B64","unstructured":"Farrell MH, Liang T, Misra S. 2018. Deep neural networks for estimation and inference: application to causal effects and other semiparametric estimands. arXiv:1809.09953 [econ.EM]"},{"key":"B65","first-page":"1","volume-title":"Studies in Linguistic Analysis (Special Volume of the Philological Society)","author":"Firth JR","year":"1957"},{"key":"B66","unstructured":"Friedberg R, Tibshirani J, Athey S, Wager S. 2018. Local linear forests. arXiv:1807.11408 [stat.ML]"},{"key":"B67","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-9473(01)00065-2"},{"key":"B68","doi-asserted-by":"publisher","DOI":"10.3386\/w23276"},{"key":"B69","first-page":"2672","volume-title":"Advances in Neural Information Processing Systems","volume":"27","author":"Goodfellow I","year":"2014"},{"key":"B70","volume-title":"Proceedings of the 31st Conference on Uncertainty in Artificial Intelligence, Amsterdam, Neth., July 12\u201316","author":"Gopalan P","year":"2015"},{"key":"B71","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfs036"},{"key":"B72","volume-title":"Econometric Analysis","author":"Greene WH","year":"2000"},{"key":"B73","doi-asserted-by":"publisher","DOI":"10.1080\/00437956.1954.11659520"},{"key":"B74","unstructured":"Hartford J, Lewis G, Taddy M. 2016. Counterfactual prediction with deep instrumental variables networks. arXiv:1612.09596 [stat.AP]"},{"key":"B75","doi-asserted-by":"publisher","DOI":"10.2307\/2346830"},{"key":"B76","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7"},{"key":"B77","unstructured":"Hastie T, Tibshirani R, Tibshirani RJ. 2017. Extended comparisons of best subset selection, forward stepwise selection, and the lasso. arXiv:1707.08692 [stat.ME]"},{"key":"B78","doi-asserted-by":"publisher","DOI":"10.1201\/b18401"},{"key":"B79","doi-asserted-by":"publisher","DOI":"10.1198\/jcgs.2010.08162"},{"key":"B80","doi-asserted-by":"publisher","DOI":"10.3982\/ECTA6630"},{"key":"B81","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1970.10488634"},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1986.10478354"},{"key":"B83","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(89)90020-8"},{"key":"B84","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOAS593"},{"key":"B85","doi-asserted-by":"publisher","DOI":"10.1257\/jel.47.1.5"},{"key":"B86","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeconom.2007.05.001"},{"key":"B87","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139025751"},{"key":"B88","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.2443455"},{"key":"B89","first-page":"652","volume-title":"Proceedings of the 33rd International Conference on Machine Learning","author":"Jiang N","year":"2016"},{"key":"B90","unstructured":"Kallus N. 2017. Balanced policy evaluation and learning. arXiv:1705.07384 [stat.ML]"},{"key":"B91","first-page":"54","volume-title":"The Oxford Handbook of Panel Data","author":"Keane MP","year":"2013"},{"key":"B92","volume-title":"Who should be treated? Empirical welfare maximization methods for treatment choice","author":"Kitagawa T","year":"2015"},{"key":"B93","doi-asserted-by":"publisher","DOI":"10.1002\/9781119439868"},{"key":"B94","first-page":"1097","volume-title":"Advances in Neural Information Processing Systems","volume":"25","author":"Krizhevsky A","year":"2012"},{"key":"B95","unstructured":"K\u00fcnzel S, Sekhon J, Bickel P, Yu B. 2017. Meta-learners for estimating heterogeneous treatment effects using machine learning. arXiv:1706.03461 [math.ST]"},{"key":"B96","doi-asserted-by":"publisher","DOI":"10.1016\/0196-8858(85)90002-8"},{"key":"B97","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539"},{"key":"B98","first-page":"2177","volume-title":"Advances in Neural Information Processing Systems","volume":"27","author":"Levy O","year":"2014"},{"key":"B99","first-page":"929","volume-title":"Proceedings of the 24th International Conference on the World Wide Web","author":"Li L","year":"2014"},{"key":"B100","first-page":"297","volume-title":"Proceedings of 4th ACM International Conference on Web Search and Data Mining","author":"Li L","year":"2012"},{"key":"B101","doi-asserted-by":"crossref","first-page":"2523","DOI":"10.1016\/S1573-4412(05)80011-X","volume-title":"Handbook of Econometrics","volume":"4","author":"Matzkin RL","year":"1994"},{"key":"B102","doi-asserted-by":"publisher","DOI":"10.1016\/S1573-4412(07)06073-4"},{"key":"B103","first-page":"2287","volume":"11","author":"Mazumder R","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"B104","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2006.12.019"},{"key":"B105","unstructured":"Mikolov T, Chen K, Corrado GS, Dean J. 2013a. Efficient estimation of word representations in vector space. arXiv:1301.3781 [cs.CL]"},{"key":"B106","first-page":"3111","volume-title":"Advances in Neural Information Processing Systems","volume":"26","author":"Mikolov T","year":"2013"},{"key":"B107","first-page":"746","volume-title":"Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Mikolov T","year":"2013"},{"key":"B108","doi-asserted-by":"publisher","DOI":"10.1201\/9781420035933"},{"key":"B109","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273577"},{"key":"B110","first-page":"2265","volume-title":"Advances in Neural Information Processing Systems","volume":"26","author":"Mnih A","year":"2013"},{"key":"B111","first-page":"419","volume-title":"Proceedings of the 29th International Conference on Machine Learning","author":"Mnih A","year":"2012"},{"key":"B112","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1983.10477920"},{"key":"B113","doi-asserted-by":"publisher","DOI":"10.1257\/jep.31.2.87"},{"key":"B114","doi-asserted-by":"crossref","unstructured":"Nie X, Wager S. 2019. Quasi-oracle estimation of heterogeneous treatment effects. arXiv:1712.04912 [stat.ML]","DOI":"10.1093\/biomet\/asaa076"},{"key":"B115","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"B116","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1995.10476494"},{"key":"B117","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/70.1.41"},{"key":"B118","unstructured":"Ruiz FJ, Athey S, Blei DM. 2017. SHOPPER: a probabilistic model of consumer choice with substitutes and complements. arXiv:1711.03560 [stat.ML]"},{"key":"B119","doi-asserted-by":"publisher","DOI":"10.1038\/323533a0"},{"key":"B120","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/8291.001.0001","volume-title":"Boosting: Foundations and Algorithms","author":"Schapire RE","year":"2012"},{"key":"B121","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/4175.001.0001","volume-title":"Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond","author":"Scholkopf B","year":"2001"},{"key":"B122","doi-asserted-by":"publisher","DOI":"10.1002\/asmb.874"},{"key":"B123","unstructured":"Semenova V, Goldman M, Chernozhukov V, Taddy M. 2018. Orthogonal ML for demand estimation: high dimensional causal inference in dynamic panels. arXiv:1712.09988 [stat.ML]"},{"key":"B124","first-page":"2217","volume-title":"Advances in Neural Information Processing Systems","volume":"23","author":"Strehl A","year":"2010"},{"key":"B125","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton RS","year":"1998"},{"key":"B126","first-page":"1731","volume":"16","author":"Swaminathan A","year":"2015","journal-title":"J. Mach. Learn. Res."},{"key":"B127","first-page":"2139","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Thomas P","year":"2016"},{"key":"B128","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/25.3-4.285"},{"key":"B129","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"Tibshirani R","year":"1996","journal-title":"J. R. Stat. Soc. B"},{"key":"B130","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1987.10478466"},{"key":"B131","doi-asserted-by":"publisher","DOI":"10.2202\/1557-4679.1043"},{"key":"B132","volume-title":"Asymptotic Statistics","author":"Van der Vaart AW","year":"2000"},{"key":"B133","volume-title":"The Nature of Statistical Learning Theory","author":"Vapnik V","year":"2013"},{"key":"B134","doi-asserted-by":"publisher","DOI":"10.1257\/jep.28.2.3"},{"key":"B135","unstructured":"Vilnis L, McCallum A. 2015. Word representations via Gaussian embedding. arXiv:1412.6623 [cs.CL]"},{"key":"B136","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2017.1319839"},{"key":"B137","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052568"},{"key":"B138","volume-title":"Artificial Neural Networks: Approximation and Learning Theory","author":"White H","year":"1992"},{"key":"B139","volume-title":"Econometric Analysis of Cross Section and Panel Data","author":"Wooldridge JM","year":"2010"},{"key":"B140","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-007-0114-2"},{"key":"B141","doi-asserted-by":"publisher","DOI":"10.1198\/106186008X319331"},{"key":"B142","unstructured":"Zhou Z, Athey S, Wager S. 2018. Offline multi-action policy learning: generalization and optimization. arXiv:1810.04778 [stat.ML]"},{"key":"B143","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00503.x"},{"key":"B144","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2015.1023805"}],"container-title":["Annual Review of Economics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.annualreviews.org\/doi\/pdf\/10.1146\/annurev-economics-080217-053433","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T09:35:36Z","timestamp":1721381736000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.annualreviews.org\/doi\/10.1146\/annurev-economics-080217-053433"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,2]]},"references-count":144,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,8,2]]}},"alternative-id":["10.1146\/annurev-economics-080217-053433"],"URL":"https:\/\/doi.org\/10.1146\/annurev-economics-080217-053433","relation":{},"ISSN":["1941-1383","1941-1391"],"issn-type":[{"value":"1941-1383","type":"print"},{"value":"1941-1391","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,2]]}}}