On Testing Equal Conditional Predictive Ability Under Measurement Error

06/21/2021
by   Yannick Hoga, et al.
0

Loss functions are widely used to compare several competing forecasts. However, forecast comparisons are often based on mismeasured proxy variables for the true target. We introduce the concept of exact robustness to measurement error for loss functions and fully characterize this class of loss functions as the Bregman class. For such exactly robust loss functions, forecast loss differences are on average unaffected by the use of proxy variables and, thus, inference on conditional predictive ability can be carried out as usual. Moreover, we show that more precise proxies give predictive ability tests higher power in discriminating between competing forecasts. Simulations illustrate the different behavior of exactly robust and non-robust loss functions. An empirical application to US GDP growth rates demonstrates that it is easier to discriminate between forecasts issued at different horizons if a better proxy for GDP growth is used.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/06/2021

Using Proxies to Improve Forecast Evaluation

Comparative evaluation of forecasts of statistical functionals relies on...
research
12/15/2019

Integral Mixabilty: a Tool for Efficient Online Aggregation of Functional and Probabilistic Forecasts

In this paper we extend the setting of the online prediction with expert...
research
05/03/2023

A Curriculum View of Robust Loss Functions

Robust loss functions are designed to combat the adverse impacts of labe...
research
11/24/2022

How to predict and optimise with asymmetric error metrics

In this paper, we examine the concept of the predict and optimise proble...
research
08/13/2019

Forecast Encompassing Tests for the Expected Shortfall

In this paper, we introduce new forecast encompassing tests for the risk...
research
08/17/2022

Characterizing M-estimators

We characterize the full classes of M-estimators for semiparametric mode...
research
07/11/2020

Scoring Interval Forecasts: Equal-Tailed, Shortest, and Modal Interval

We consider different types of predictive intervals and ask whether they...

Please sign up or login with your details

Forgot password? Click here to reset