Backtesting the predictability of COVID-19

07/22/2020
by   Dmitry Gordeev, et al.
0

The advent of the COVID-19 pandemic has instigated unprecedented changes in many countries around the globe, putting a significant burden on the health sectors, affecting the macro economic conditions, and altering social interactions amongst the population. In response, the academic community has produced multiple forecasting models, approaches and algorithms to best predict the different indicators of COVID-19, such as the number of confirmed infected cases. Yet, researchers had little to no historical information about the pandemic at their disposal in order to inform their forecasting methods. Our work studies the predictive performance of models at various stages of the pandemic to better understand their fundamental uncertainty and the impact of data availability on such forecasts. We use historical data of COVID-19 infections from 253 regions from the period of 22nd January 2020 until 22nd June 2020 to predict, through a rolling window backtesting framework, the cumulative number of infected cases for the next 7 and 28 days. We implement three simple models to track the root mean squared logarithmic error in this 6-month span, a baseline model that always predicts the last known value of the cumulative confirmed cases, a power growth model and an epidemiological model called SEIRD. Prediction errors are substantially higher in early stages of the pandemic, resulting from limited data. Throughout the course of the pandemic, errors regress slowly, but steadily. The more confirmed cases a country exhibits at any point in time, the lower the error in forecasting future confirmed cases. We emphasize the significance of having a rigorous backtesting framework to accurately assess the predictive power of such models at any point in time during the outbreak which in turn can be used to assign the right level of certainty to these forecasts and facilitate better planning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2020

Time Series Analysis and Forecasting of COVID-19 Cases Using LSTM and ARIMA Models

Coronavirus disease 2019 (COVID-19) is a global public health crisis tha...
research
04/08/2022

Temporal and spatial evolution of power-law in the numbers of COVID-19 pandemic

This work systematically conducts a data analysis based on the numbers o...
research
08/08/2020

Statistical Analytics and Regional Representation Learning for COVID-19 Pandemic Understanding

The rapid spread of the novel coronavirus (COVID-19) has severely impact...
research
02/20/2023

Estimating the severity of COVID-19 Omicron Variant in USA, India, Brazil, France, Germany and UK

This work evaluates the severity of COVID-19 Omicron variant in terms of...
research
03/27/2023

Modeling Population Movements under Uncertainty at the Border in Humanitarian Crises: A Situational Analysis Tool

Humanitarian agencies must be prepared to mobilize quickly in response t...
research
01/11/2021

Predictive Analysis of Chikungunya

Chikungunya is an emerging threat for health security all over the world...
research
10/07/2021

Impact of COVID-19 Policies and Misinformation on Social Unrest

The novel coronavirus disease (COVID-19) pandemic has impacted every cor...

Please sign up or login with your details

Forgot password? Click here to reset