Should We Adjust for the Test for Pre-trends in Difference-in-Difference Designs?

04/04/2018
by   Jonathan Roth, et al.
0

The common practice in difference-in-difference (DiD) designs is to check for parallel trends prior to treatment assignment, yet typical estimation and inference does not account for the fact that this test has occurred. I analyze the properties of the traditional DiD estimator conditional on having passed (i.e. not rejected) the test for parallel pre-trends. When the DiD design is valid and the test for pre-trends confirms it, the typical DiD estimator is unbiased, but traditional standard errors are overly conservative. Additionally, there exists an alternative unbiased estimator that is more efficient than the traditional DiD estimator under parallel trends. However, when in population there is a non-zero pre-trend but we fail to reject the hypothesis of parallel pre-trends, the DiD estimator is generally biased relative to the population DiD coefficient. Moreover, if the trend is monotone, then under reasonable assumptions the bias from conditioning exacerbates the bias relative to the true treatment effect. I propose new estimation and inference procedures that account for the test for parallel trends, and compare their performance to that of the traditional estimator in a Monte Carlo simulation.

READ FULL TEXT
research
04/04/2018

Should We Condition on the Test for Pre-trends in Difference-in-Difference Designs?

The common practice in difference-in-difference (DiD) designs is to chec...
research
05/17/2022

Benefits and costs of matching prior to a Difference in Differences analysis when parallel trends does not hold

The Difference in Difference (DiD) estimator is a popular estimator buil...
research
08/30/2021

Eliminating Systematic Bias from Difference-in-Differences Design: A Permutational Detrending Strategy

Since the initial work by Ashenfelter and Card in 1985, the use of diffe...
research
01/30/2021

Using Multiple Pre-treatment Periods to Improve Difference-in-Differences and Staggered Adoption Design

While difference-in-differences (DID) was originally developed with one ...
research
01/18/2020

Insight into bias in time-stratified case-crossover studies

The use of case-crossover designs has become widespread in epidemiologic...
research
01/04/2022

What's Trending in Difference-in-Differences? A Synthesis of the Recent Econometrics Literature

This paper synthesizes recent advances in the econometrics of difference...

Please sign up or login with your details

Forgot password? Click here to reset