{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T01:36:43Z","timestamp":1790991403355,"version":"4.1.0"},"reference-count":63,"publisher":"The Econometric Society","issue":"4","license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["QE"],"abstract":"<jats:p>In panel experiments, we randomly assign units to different interventions, measuring their outcomes, and repeating the procedure in several periods. Using the potential outcomes framework, we define finite population dynamic causal effects that capture the relative effectiveness of alternative treatment paths. For a rich class of dynamic causal effects, we provide a nonparametric estimator that is unbiased over the randomization distribution and derive its finite population limiting distribution as either the sample size or the duration of the experiment increases. We develop two methods for inference: a conservative test for weak null hypotheses and an exact randomization test for sharp null hypotheses. We further analyze the finite population probability limit of linear fixed effects estimators. These commonly\u2010used estimators do not recover a causally interpretable estimand if there are dynamic causal effects and serial correlation in the assignments, highlighting the value of our proposed estimator.<\/jats:p>","DOI":"10.3982\/qe1744","type":"journal-article","created":{"date-parts":[[2021,10,29]],"date-time":"2021-10-29T09:08:16Z","timestamp":1635498496000},"page":"1171-1196","source":"Crossref","is-referenced-by-count":47,"title":["Panel experiments and dynamic causal effects: A finite population perspective"],"prefix":"10.3982","volume":"12","author":[{"given":"Iavor","family":"Bojinov","sequence":"first","affiliation":[{"name":"Technology and Operations Management Unit, Harvard Business School"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashesh","family":"Rambachan","sequence":"additional","affiliation":[{"name":"Department of Economics, Harvard University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neil","family":"Shephard","sequence":"additional","affiliation":[{"name":"Department of Economics, Department of Statistics, Harvard University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2359","published-online":{"date-parts":[[2021]]},"reference":[{"key":"quan200173-bib-0001","doi-asserted-by":"crossref","unstructured":"Abadie, A., S. C. Athey, G. W. Imbens, and J. Wooldridge (2017), \u201cWhen should you adjust standard errors for clustering?\u201d NBER Working Paper No. 24003.","DOI":"10.3386\/w24003"},{"issue":"1","key":"quan200173-bib-0002","doi-asserted-by":"crossref","first-page":"265","DOI":"10.3982\/ECTA12675","volume":"88","author":"Abadie","year":"2020","journal-title":"Econometrica"},{"key":"quan200173-bib-0003","unstructured":"Abraham, S. and L. Sun (2020), \u201cEstimating dynamic treatment effects in event studies with heterogeneous treatment effects.\u201d arXiv preprint. Available at arXiv:1804.05785."},{"key":"quan200173-bib-0004","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.jet.2004.09.002","volume":"127","author":"Andreoni","year":"2006","journal-title":"Journal of Economic Theory"},{"key":"quan200173-bib-0005","doi-asserted-by":"crossref","first-page":"693","DOI":"10.3982\/ECTA13795","volume":"85","author":"Arellano","year":"2017","journal-title":"Econometrica"},{"key":"quan200173-bib-0006","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1146\/annurev-economics-111809-125139","volume":"3","author":"Arellano","year":"2012","journal-title":"Annual Review of Economics"},{"issue":"3","key":"quan200173-bib-0007","doi-asserted-by":"crossref","first-page":"C61","DOI":"10.1111\/ectj.12062","volume":"19","author":"Arellano","year":"2016","journal-title":"The Econometrics Journal"},{"key":"quan200173-bib-0008","unstructured":"Arkhangelsky, D. and G. Imbens (2019), \u201cDouble-robust identification for causal panel data models.\u201d arXiv preprint. Available at arXiv:1909.09412."},{"issue":"4","key":"quan200173-bib-0009","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1214\/16-AOAS1005","volume":"11","author":"Aronow","year":"2017","journal-title":"The Annals of Applied Statistics"},{"key":"quan200173-bib-0010","doi-asserted-by":"crossref","unstructured":"Athey, S., M. Bayati, N. Doudchenko, G. Imbens, and K. Koshravi (2018), \u201cMatrix completion methods for causal panel data models.\u201d arXiv preprint. Available at arXiv:1710.10251.","DOI":"10.3386\/w25132"},{"key":"quan200173-bib-0011","doi-asserted-by":"crossref","unstructured":"Athey, S. and G. Imbens (2018), \u201cDesign-based analysis in difference-in-differences settings with staggered adoption.\u201d arXiv preprint. Available at arXiv:1808.05293.","DOI":"10.3386\/w24963"},{"key":"quan200173-bib-0012","doi-asserted-by":"crossref","unstructured":"Bellemare, C., L. Bissonnette, and S. Kroger (2014), \u201cStatistical power of within and between-subjects designs in economic experiments.\u201d IZA Working Paper No. 8583.","DOI":"10.2139\/ssrn.3149007"},{"key":"quan200173-bib-0013","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/s40881-016-0028-4","volume":"2","author":"Bellemare","year":"2016","journal-title":"Journal of the Economic Science Association"},{"key":"quan200173-bib-0014","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1086\/259291","volume":"75","author":"Ben-Porath","year":"1967","journal-title":"Journal of Political Economy"},{"key":"quan200173-bib-0015","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1017\/S0003055418000357","volume":"112","author":"Blackwell","year":"2018","journal-title":"American Political Science Review"},{"key":"quan200173-bib-0016","doi-asserted-by":"crossref","unstructured":"Bojinov, I., A. Rambachan, and N. Shephard (2021), \u201cSupplement to \u2018Panel experiments and dynamic causal effects: A finite population perspective\u2019.\u201d Quantitative Economics Supplemental Material, 12, https:\/\/doi.org\/10.3982\/QE1744.","DOI":"10.3982\/QE1744"},{"issue":"2","key":"quan200173-bib-0017","first-page":"48","volume":"98","author":"Bojinov","year":"2020","journal-title":"Harvard Business Review"},{"issue":"528","key":"quan200173-bib-0018","doi-asserted-by":"crossref","first-page":"1665","DOI":"10.1080\/01621459.2018.1527225","volume":"114","author":"Bojinov","year":"2019","journal-title":"Journal of the American Statistical Association"},{"key":"quan200173-bib-0019","doi-asserted-by":"crossref","unstructured":"Bojinov, I., D. Simchi-Levi, and J. Zhao (2020), \u201cDesign and analysis of switchback experiments.\u201d arXiv preprint. Available at arXiv:2009.00148.","DOI":"10.2139\/ssrn.3684168"},{"key":"quan200173-bib-0020","doi-asserted-by":"crossref","first-page":"1112","DOI":"10.1080\/01621459.2017.1305274","volume":"113","author":"Boruvka","year":"2018","journal-title":"Journal of the American Statistical Association"},{"key":"quan200173-bib-0021","doi-asserted-by":"crossref","unstructured":"Boryusak, K. and X. Jaravel (2017), \u201cRevisiting event study designs, with an application to the estimation of the marginal propensity to consume.\u201d Available at https:\/\/ssrn.com\/abstract=2826228.","DOI":"10.2139\/ssrn.2826228"},{"key":"quan200173-bib-0022","doi-asserted-by":"crossref","first-page":"1353","DOI":"10.1111\/j.1467-937X.2010.00612.x","volume":"77","author":"Browning","year":"2010","journal-title":"Review of Economic Studies"},{"issue":"1","key":"quan200173-bib-0023","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jebo.2011.08.009","volume":"81","author":"Charness","year":"2012","journal-title":"Journal of Economic and Business Organization"},{"key":"quan200173-bib-0024","unstructured":"Chin, A. (2018), \u201cCentral limit theorems via Stein's method for randomized experiments under interference.\u201d arXiv preprint. Available at arXiv:1804.03105."},{"key":"quan200173-bib-0025","volume-title":"Planning of Experiments","author":"Cox","year":"1958"},{"key":"quan200173-bib-0026","first-page":"697","volume-title":"Handbook of the Economics of Education","volume":"1","author":"Cunha","year":"2006"},{"issue":"3","key":"quan200173-bib-0027","doi-asserted-by":"crossref","first-page":"883","DOI":"10.3982\/ECTA6551","volume":"78","author":"Cunha","year":"2010","journal-title":"Econometrica"},{"issue":"2","key":"quan200173-bib-0028","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1002\/soej.12392","volume":"86","author":"Czibor","year":"2019","journal-title":"Southern Economic Journal"},{"issue":"9","key":"quan200173-bib-0029","doi-asserted-by":"crossref","first-page":"2964","DOI":"10.1257\/aer.20181169","volume":"110","author":"Chaisemartin","year":"2020","journal-title":"American Economic Review"},{"issue":"2","key":"quan200173-bib-0030","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.aam.2006.12.003","volume":"40","author":"Freedman","year":"2008","journal-title":"Advances in Applied Mathematics"},{"key":"quan200173-bib-0031","doi-asserted-by":"crossref","unstructured":"Goodman-Bacon, A. (2018), \u201cDifference-in-differences with variation in treatment timing.\u201d NBER Working Paper No. 25018.","DOI":"10.3386\/w25018"},{"key":"quan200173-bib-0032","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/1913285","volume":"45","author":"Griliches","year":"1977","journal-title":"Econometrica"},{"issue":"15","key":"quan200173-bib-0033","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.2014602118","volume":"118","author":"Hadad","year":"2021","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"quan200173-bib-0034","author":"Han","year":"2019","journal-title":"Journal of Econometrics"},{"key":"quan200173-bib-0035","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/j.jeconom.2015.12.001","volume":"191","author":"Heckman","year":"2016","journal-title":"Journal of Econometrics"},{"key":"quan200173-bib-0036","doi-asserted-by":"crossref","first-page":"945","DOI":"10.1080\/01621459.1986.10478354","volume":"81","author":"Holland","year":"1986","journal-title":"Journal of the American Statistical Association"},{"key":"quan200173-bib-0037","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1080\/01621459.1952.10483446","volume":"47","author":"Horvitz","year":"1952","journal-title":"Journal of the American Statistical Association"},{"key":"quan200173-bib-0038","unstructured":"Hull, P. (2018), \u201cEstimating treatment effects in mover designs.\u201d arXiv preprint. Available at arXiv:1804.06721."},{"key":"quan200173-bib-0039","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1111\/ajps.12417","volume":"63","author":"Imai","year":"2019","journal-title":"American Journal of Political Science"},{"key":"quan200173-bib-0040","author":"Imai","year":"2020","journal-title":"Political Analysis"},{"key":"quan200173-bib-0041","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal Inference for Statistics, Social and Biomedical Sciences: An Introduction","author":"Imbens","year":"2015"},{"key":"quan200173-bib-0042","unstructured":"Kastelman, D. and R. Ramesh (2018), \u201cSwitchback tests and randomized experimentation under network effects at DoorDash.\u201d https:\/\/medium.com\/@DoorDash\/switchback-tests-and-randomized-experimentation-under-network-effects-at-doordash-f1d938ab7c2a."},{"key":"quan200173-bib-0043","first-page":"946","volume":"50","author":"Kempthorne","year":"1955","journal-title":"Journal of the American Statistical Association"},{"key":"quan200173-bib-0044","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/0304-4076(95)01753-4","volume":"74","author":"Koop","year":"1996","journal-title":"Journal of Econometrics"},{"issue":"1","key":"quan200173-bib-0045","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/0196-8858(85)90002-8","volume":"6","author":"Lai","year":"1985","journal-title":"Advances in Applied Mathematics"},{"key":"quan200173-bib-0046","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1145\/1772690.1772758","author":"Li","year":"2010","journal-title":"Proceedings of the 19th International Conference on World Wide Web"},{"key":"quan200173-bib-0047","first-page":"539","author":"Li","year":"2016","journal-title":"Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval"},{"issue":"520","key":"quan200173-bib-0048","doi-asserted-by":"crossref","first-page":"1759","DOI":"10.1080\/01621459.2017.1295865","volume":"112","author":"Li","year":"2017","journal-title":"Journal of the American Statistical Association"},{"issue":"2","key":"quan200173-bib-0049","doi-asserted-by":"crossref","first-page":"161","DOI":"10.2217\/pme.11.7","volume":"8","author":"Lillie","year":"2011","journal-title":"Personalized Medicine"},{"key":"quan200173-bib-0050","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1111\/1467-9868.00389","volume":"65","author":"Murphy","year":"2003","journal-title":"Journal of the Royal Statisticsl Society B"},{"key":"quan200173-bib-0051","doi-asserted-by":"crossref","first-page":"1410","DOI":"10.1198\/016214501753382327","volume":"96","author":"Murphy","year":"2001","journal-title":"Journal of the American Statistical Association"},{"key":"quan200173-bib-0052","first-page":"465","volume":"5","author":"Neyman","year":"1923","journal-title":"Statistical Science"},{"key":"quan200173-bib-0053","unstructured":"Rambachan, A. and N. Shephard (2020), \u201cEconometric analysis of potential outcomes time series: Instruments, shocks, linearity and the causal response function.\u201d arXiv preprint. Available at arXiv:1903.01637."},{"issue":"5","key":"quan200173-bib-0054","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1090\/S0002-9904-1952-09620-8","volume":"58","author":"Robbins","year":"1952","journal-title":"Bulletin of the American Mathematical Society"},{"key":"quan200173-bib-0055","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1016\/0270-0255(86)90088-6","volume":"7","author":"Robins","year":"1986","journal-title":"Mathematical Modelling"},{"key":"quan200173-bib-0056","doi-asserted-by":"crossref","first-page":"2379","DOI":"10.1080\/03610929408831393","volume":"23","author":"Robins","year":"1994","journal-title":"Communications in Statistics\u2014Theory and Methods"},{"key":"quan200173-bib-0057","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1080\/01621459.1999.10474168","volume":"94","author":"Robins","year":"1999","journal-title":"Journal of the American Statistical Association"},{"key":"quan200173-bib-0058","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1037\/h0037350","volume":"66","author":"Rubin","year":"1974","journal-title":"Journal of Educational Psychology"},{"key":"quan200173-bib-0059","unstructured":"S\u00e4vje, F., P. M. Aronow, and M. G. Hudgens (2019), \u201cAverage treatment effects in the presence of unknown interference.\u201d arXiv preprint. Available at arXiv:1711.06399."},{"key":"quan200173-bib-0060","unstructured":"Sneider, C. and Y. Tang (2018), \u201cExperiment rigor for switchback experiment analysis.\u201d https:\/\/doordash.engineering\/2019\/02\/20\/experiment-rigor-for-switchback-experiment-analysis\/."},{"key":"quan200173-bib-0061","unstructured":"van der Laan Mark, J. (2008), \u201cThe construction and analysis of adaptive group sequential designs.\u201d Available at https:\/\/biostats.bepress.com\/ucbbiostat\/paper232\/."},{"key":"quan200173-bib-0062","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1162\/0034653053970320","volume":"87","author":"Wooldridge","year":"2005","journal-title":"Review of Economics and Statistics"},{"key":"quan200173-bib-0063","unstructured":"Zhang, K. W., L. Janson, and S. A. Murphy (2020), \u201cInference for batched bandits.\u201d arXiv preprint. Available at arXiv:2002.03217."}],"container-title":["Quantitative Economics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.3982\/QE1744","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,29]],"date-time":"2021-10-29T09:10:28Z","timestamp":1635498628000},"score":1,"resource":{"primary":{"URL":"http:\/\/qeconomics.org\/ojs\/index.php\/qe\/article\/view\/QE1744"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":63,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021]]}},"alternative-id":["10.3982\/QE1744"],"URL":"https:\/\/doi.org\/10.3982\/qe1744","relation":{},"ISSN":["1759-7323"],"issn-type":[{"value":"1759-7323","type":"print"}],"subject":[],"published":{"date-parts":[[2021]]}}}