A safe Hosmer-Lemeshow test

03/01/2022
by   Timo Dimitriadis, et al.
0

This technical report proposes an alternative to the Hosmer-Lemeshow (HL) test for evaluating the calibration of probability forecasts for binary events. The approach is based on e-values, a new tool for hypothesis testing. An e-value is a random variable with expected value less or equal to 1 under a null hypothesis. Large e-values give evidence against the null hypothesis, and the multiplicative inverse of an e-value is a p-value. In a simulation study, the proposed e-values detect even slight miscalibration for larger sample sizes, but with a reduced power compared to the original HL test.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/24/2021

Sequentially valid tests for forecast calibration

Forecasting and forecast evaluation are inherently sequential tasks. Pre...
research
08/29/2020

Technical Issues in the Interpretation of S-values and Their Relation to Other Information Measures

An extended technical discussion of S-values and unconditional informati...
research
07/13/2021

MinP Score Tests with an Inequality Constrained Parameter Space

Score tests have the advantage of requiring estimation alone of the mode...
research
07/05/2023

Federated Epidemic Surveillance

The surveillance of a pandemic is a challenging task, especially when cr...
research
01/06/2023

Divergence vs. Decision P-values: A Distinction Worth Making in Theory and Keeping in Practice

There are two distinct definitions of 'P-value' for evaluating a propose...
research
06/18/2019

Safe Testing

We present a new theory of hypothesis testing. The main concept is the S...
research
01/29/2018

Test Martingales for bounded random variables

Test martingales have been proposed as a more intuitive approach to hypo...

Please sign up or login with your details

Forgot password? Click here to reset