Using scoring functions to evaluate point process forecasts

03/22/2021
by   Jonas Brehmer, et al.
0

Point process models are widely used tools to issue forecasts or assess risks. In order to check which models are useful in practice, they are examined by a variety of statistical methods. We transfer the concept of consistent scoring functions, which are principled statistical tools to compare forecasts, to the point process setting. The results provide a novel approach for the comparative assessment of forecasts and models and encompass some existing testing procedures.

READ FULL TEXT
research
03/27/2015

Of Quantiles and Expectiles: Consistent Scoring Functions, Choquet Representations, and Forecast Rankings

In the practice of point prediction, it is desirable that forecasters re...
research
11/27/2017

Order-Sensitivity and Equivariance of Scoring Functions

The relative performance of competing point forecasts is usually measure...
research
02/01/2021

Evaluation of point forecasts for extreme events using consistent scoring functions

We present a method for comparing point forecasts in a region of interes...
research
11/11/2021

Proper Scoring Rules, Gradients, Divergences, and Entropies for Paths and Time Series

Many forecasts consist not of point predictions but concern the evolutio...
research
07/31/2020

On Single Point Forecasts for Fat-Tailed Variables

We discuss common errors and fallacies when using naive "evidence based"...
research
02/25/2022

Model Comparison and Calibration Assessment: User Guide for Consistent Scoring Functions in Machine Learning and Actuarial Practice

One of the main tasks of actuaries and data scientists is to build good ...
research
07/22/2018

Long-Term Forecasts of Military Technologies for a 20-30 Year Horizon: An Empirical Assessment of Accuracy

During the 1990s, while exploring the impact of the collapse of the Sovi...

Please sign up or login with your details

Forgot password? Click here to reset