Model selection with Gini indices under auto-calibration

07/28/2022
by   Mario V. Wüthrich, et al.
0

The Gini index does not give a strictly consistent scoring rule in general. Therefore, maximizing the Gini index may lead to wrong decisions. The main issue is that the Gini index is a rank-based score that is not calibration-sensitive. We show that the Gini index allows for strictly consistent scoring if we restrict to the class of auto-calibrated regression models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/06/2023

Isotonic Recalibration under a Low Signal-to-Noise Ratio

Insurance pricing systems should fulfill the auto-calibration property t...
research
03/01/2022

Sensitivity Measures Based on Scoring Functions

We propose a holistic framework for constructing sensitivity measures fo...
research
06/30/2023

U-Calibration: Forecasting for an Unknown Agent

We consider the problem of evaluating forecasts of binary events whose p...
research
02/12/2019

Elicitability of Range Value at Risk

The predictive performance of point forecasts for a statistical function...
research
02/25/2020

Binary Scoring Rules that Incentivize Precision

All proper scoring rules incentivize an expert to predict accurately (re...
research
02/25/2022

Model Comparison and Calibration Assessment: User Guide for Consistent Scoring Functions in Machine Learning and Actuarial Practice

One of the main tasks of actuaries and data scientists is to build good ...

Please sign up or login with your details

Forgot password? Click here to reset