Extreme events evaluation using CRPS distributions

05/10/2019
by   Maxime Taillardat, et al.
0

Verification of ensemble forecasts for extreme events remains a challenging question. The general public as well as the media naturely pay particular attention on extreme events and conclude about the global predictive performance of ensembles, which are often unskillful when they are needed. Ashing classical verification tools to focus on such events can lead to unexpected behaviors. To square up these effects, thresholded and weighted scoring rules have been developed. Most of them use derivations of the Continuous Ranked Probability Score (CRPS). However, some properties of the CRPS for extreme events generate undesirable effects on the quality of verification. Using theoretical arguments and simulation examples, we illustrate some pitfalls of conventional verification tools and propose a different direction to assess ensemble forecasts using extreme value theory, considering proper scores as random variables.

READ FULL TEXT
research
02/25/2022

Evaluating forecasts for high-impact events using transformed kernel scores

It is informative to evaluate a forecaster's ability to predict outcomes...
research
06/26/2023

Locally tail-scale invariant scoring rules for evaluation of extreme value forecasts

Statistical analysis of extremes can be used to predict the probability ...
research
09/11/2022

Weighted verification tools to evaluate univariate and multivariate forecasts for high-impact weather events

To mitigate the impacts associated with adverse weather conditions, mete...
research
11/03/2019

A simple study of the correlation effects in the superposition of waves of electric fields: the emergence of extreme events

In this paper, we study the effects of correlated random phases in the i...
research
06/28/2021

More on verification of probability forecasts for football outcomes: score decompositions, reliability, and discrimination analyses

Forecast of football outcomes in terms of Home Win, Draw and Away Win re...
research
02/01/2021

Evaluation of point forecasts for extreme events using consistent scoring functions

We present a method for comparing point forecasts in a region of interes...
research
07/19/2020

Integration of max-stable processes and Bayesian model averaging to predict extreme climatic events in multi-model ensembles

Projections of changes in extreme climate are sometimes predicted by usi...

Please sign up or login with your details

Forgot password? Click here to reset