Forecast Hedging and Calibration

10/13/2022
by   Dean P. Foster, et al.
0

Calibration means that forecasts and average realized frequencies are close. We develop the concept of forecast hedging, which consists of choosing the forecasts so as to guarantee that the expected track record can only improve. This yields all the calibration results by the same simple basic argument while differentiating between them by the forecast-hedging tools used: deterministic and fixed point based versus stochastic and minimax based. Additional contributions are an improved definition of continuous calibration, ensuing game dynamics that yield Nash equilibria in the long run, and a new calibrated forecasting procedure for binary events that is simpler than all known such procedures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/13/2022

Smooth Calibration, Leaky Forecasts, Finite Recall, and Nash Dynamics

We propose to smooth out the calibration score, which measures how good ...
research
09/11/2022

"Calibeating": Beating Forecasters at Their Own Game

In order to identify expertise, forecasters should not be tested by thei...
research
04/27/2022

Faster online calibration without randomization: interval forecasts and the power of two choices

We study the problem of making calibrated probabilistic forecasts for a ...
research
09/13/2022

Calibrated Forecasts: The Minimax Proof

A formal write-up of the simple proof (1995) of the existence of calibra...
research
11/29/2022

Score-based calibration testing for multivariate forecast distributions

Multivariate distributional forecasts have become widespread in recent y...
research
05/14/2021

Threshold Martingales and the Evolution of Forecasts

This paper introduces a martingale that characterizes two properties of ...
research
06/30/2023

U-Calibration: Forecasting for an Unknown Agent

We consider the problem of evaluating forecasts of binary events whose p...

Please sign up or login with your details

Forgot password? Click here to reset