Smooth Calibration, Leaky Forecasts, Finite Recall, and Nash Dynamics

10/13/2022
by   Dean P. Foster, et al.
0

We propose to smooth out the calibration score, which measures how good a forecaster is, by combining nearby forecasts. While regular calibration can be guaranteed only by randomized forecasting procedures, we show that smooth calibration can be guaranteed by deterministic procedures. As a consequence, it does not matter if the forecasts are leaked, i.e., made known in advance: smooth calibration can nevertheless be guaranteed (while regular calibration cannot). Moreover, our procedure has finite recall, is stationary, and all forecasts lie on a finite grid. To construct the procedure, we deal also with the related setups of online linear regression and weak calibration. Finally, we show that smooth calibration yields uncoupled finite-memory dynamics in n-person games "smooth calibrated learning" in which the players play approximate Nash equilibria in almost all periods (by contrast, calibrated learning, which uses regular calibration, yields only that the time-averages of play are approximate correlated equilibria).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/13/2022

Forecast Hedging and Calibration

Calibration means that forecasts and average realized frequencies are cl...
research
09/13/2022

Calibrated Forecasts: The Minimax Proof

A formal write-up of the simple proof (1995) of the existence of calibra...
research
06/30/2023

U-Calibration: Forecasting for an Unknown Agent

We consider the problem of evaluating forecasts of binary events whose p...
research
09/11/2022

"Calibeating": Beating Forecasters at Their Own Game

In order to identify expertise, forecasters should not be tested by thei...
research
02/20/2012

(weak) Calibration is Computationally Hard

We show that the existence of a computationally efficient calibration al...
research
06/05/2023

Calibrated Stackelberg Games: Learning Optimal Commitments Against Calibrated Agents

In this paper, we introduce a generalization of the standard Stackelberg...
research
10/22/2014

Log-Optimal Portfolio Selection Using the Blackwell Approachability Theorem

We present a method for constructing the log-optimal portfolio using the...

Please sign up or login with your details

Forgot password? Click here to reset