
How should researchers design experiments to detect treatment effects with panel data? In this paper, we derive analytical expressions for the variance of panel estimators under non-i.i.d. error structures, which inform power calculations in panel data settings. Using Monte Carlo simulation, we demonstrate that, with correlated errors, traditional methods for experimental design result in experiments that are incorrectly powered with proper inference. Failing to account for serial correlation yields overpowered experiments in short panels and underpowered experiments in long panels. Using both data from a randomized experiment in China and a high-frequency dataset of U.S. electricity consumption, we show that these results hold in real-world settings. Our theoretical results enable us to achieve correctly powered experiments in both simulated and real data. This paper provides researchers with the tools to design well-powered experiments in panel data settings.
MetaArXiv|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences|Economics, Economics, BITSS|Social and Behavioral Sciences|Economics|Econometrics, Social and Behavioral Sciences, FOS: Economics and business, MetaArXiv|Social and Behavioral Sciences|Economics, BITSS|Social and Behavioral Sciences|Economics, MetaArXiv|Social and Behavioral Sciences|Economics|Econometrics, BITSS|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences|Economics|Econometrics, Econometrics
MetaArXiv|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences|Economics, Economics, BITSS|Social and Behavioral Sciences|Economics|Econometrics, Social and Behavioral Sciences, FOS: Economics and business, MetaArXiv|Social and Behavioral Sciences|Economics, BITSS|Social and Behavioral Sciences|Economics, MetaArXiv|Social and Behavioral Sciences|Economics|Econometrics, BITSS|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences|Economics|Econometrics, Econometrics
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 36 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
