Policy evaluation in COVID-19: A graphical guide to common design issues

09/03/2020
by   Noah A Haber, et al.
0

Policy responses to COVID-19, particularly those related to non-pharmaceutical interventions, are unprecedented in scale and scope. Researchers and policymakers are striving to understand the impact of these policies on a variety of outcomes. Policy impact evaluations always require a complex combination of circumstance, study design, data, statistics, and analysis. Beyond the issues that are faced for any policy, evaluation of COVID-19 policies is complicated by additional challenges related to infectious disease dynamics and lags, lack of direct observation of key outcomes, and a multiplicity of interventions occurring on an accelerated time scale. In this paper, we (1) introduce the basic suite of policy impact evaluation designs for observational data, including cross-sectional analyses, pre/post, interrupted time-series, and difference-in-differences analysis, (2) demonstrate key ways in which the requirements and assumptions underlying these designs are often violated in the context of COVID-19, and (3) provide decision-makers and reviewers a conceptual and graphical guide to identifying these key violations. The overall goal of this paper is to help policy-makers, journal editors, journalists, researchers, and other research consumers understand and weigh the strengths and limitations of evidence that is essential to decision-making.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/06/2022

Compartmental Models for COVID-19 and Control via Policy Interventions

We demonstrate an approach to replicate and forecast the spread of the S...
research
06/25/2022

Feedback Dynamics of the Low-Income Rental Housing Market: Exploring Policy Responses to COVID-19

The COVID-19 recession threatens mass housing insecurity that undermines...
research
05/17/2020

Enhancing Covid-19 Decision-Making by Creating an Assurance Case for Simulation Models

Simulation models have been informing the COVID-19 policy-making process...
research
04/07/2020

Scenario analysis of non-pharmaceutical interventions on global COVID-19 transmissions

This paper introduces a dynamic panel SIR (DP-SIR) model to investigate ...
research
05/29/2021

Assessing the Causal Impact of COVID-19 Related Policies on Outbreak Dynamics: A Case Study in the US

To mitigate the spread of COVID-19 pandemic, decision-makers and public ...
research
11/11/2020

A trial emulation approach for policy evaluations with group-level longitudinal data

To limit the spread of the novel coronavirus, governments across the wor...
research
01/10/2022

Understanding COVID-19 Effects on Mobility: A Community-Engaged Approach

Given aggregated mobile device data, the goal is to understand the impac...

Please sign up or login with your details

Forgot password? Click here to reset