Estimating the Uncertainty of Neural Network Forecasts for Influenza Prevalence Using Web Search Activity

05/26/2021
by   Michael Morris, et al.
14

Influenza is an infectious disease with the potential to become a pandemic, and hence, forecasting its prevalence is an important undertaking for planning an effective response. Research has found that web search activity can be used to improve influenza models. Neural networks (NN) can provide state-of-the-art forecasting accuracy but do not commonly incorporate uncertainty in their estimates, something essential for using them effectively during decision making. In this paper, we demonstrate how Bayesian Neural Networks (BNNs) can be used to both provide a forecast and a corresponding uncertainty without significant loss in forecasting accuracy compared to traditional NNs. Our method accounts for two sources of uncertainty: data and model uncertainty, arising due to measurement noise and model specification, respectively. Experiments are conducted using 14 years of data for England, assessing the model's accuracy over the last 4 flu seasons in this dataset. We evaluate the performance of different models including competitive baselines with conventional metrics as well as error functions that incorporate uncertainty estimates. Our empirical analysis indicates that considering both sources of uncertainty simultaneously is superior to considering either one separately. We also show that a BNN with recurrent layers that models both sources of uncertainty yields superior accuracy for these metrics for forecasting horizons greater than 7 days.

READ FULL TEXT
research
11/08/2021

Assessing the Uncertainty of Epidemiological Forecasts with Normalised Estimation Error Squared

Estimates from infectious disease models have constituted a significant ...
research
11/29/2021

Evaluation of Machine Learning Techniques for Forecast Uncertainty Quantification

Producing an accurate weather forecast and a reliable quantification of ...
research
06/06/2020

The Zoltar forecast archive: a tool to facilitate standardization and storage of interdisciplinary prediction research

Forecasting has emerged as an important component of informed, data-driv...
research
05/04/2022

Uncertainty estimation of pedestrian future trajectory using Bayesian approximation

Past research on pedestrian trajectory forecasting mainly focused on det...
research
03/20/2019

Performance Measurement for Deep Bayesian Neural Network

Deep Bayesian neural network has aroused a great attention in recent yea...
research
06/07/2021

When in Doubt: Neural Non-Parametric Uncertainty Quantification for Epidemic Forecasting

Accurate and trustworthy epidemic forecasting is an important problem th...
research
03/27/2023

Modeling Population Movements under Uncertainty at the Border in Humanitarian Crises: A Situational Analysis Tool

Humanitarian agencies must be prepared to mobilize quickly in response t...

Please sign up or login with your details

Forgot password? Click here to reset