Loss minimization yields multicalibration for large neural networks

04/19/2023
by   Jarosław Błasiok, et al.
0

Multicalibration is a notion of fairness that aims to provide accurate predictions across a large set of groups. Multicalibration is known to be a different goal than loss minimization, even for simple predictors such as linear functions. In this note, we show that for (almost all) large neural network sizes, optimally minimizing squared error leads to multicalibration. Our results are about representational aspects of neural networks, and not about algorithmic or sample complexity considerations. Previous such results were known only for predictors that were nearly Bayes-optimal and were therefore representation independent. We emphasize that our results do not apply to specific algorithms for optimizing neural networks, such as SGD, and they should not be interpreted as "fairness comes for free from optimizing neural networks".

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/25/2023

Initialization-Dependent Sample Complexity of Linear Predictors and Neural Networks

We provide several new results on the sample complexity of vector-valued...
research
09/11/2021

Omnipredictors

Loss minimization is a dominant paradigm in machine learning, where a pr...
research
12/30/2020

Provably Training Neural Network Classifiers under Fairness Constraints

Training a classifier under fairness constraints has gotten increasing a...
research
06/01/2023

Unfair Utilities and First Steps Towards Improving Them

Many fairness criteria constrain the policy or choice of predictors. In ...
research
03/02/2022

Low-Degree Multicalibration

Introduced as a notion of algorithmic fairness, multicalibration has pro...
research
11/22/2019

Neural Networks Learning and Memorization with (almost) no Over-Parameterization

Many results in recent years established polynomial time learnability of...
research
10/02/2020

Polyphonic Piano Transcription Using Autoregressive Multi-State Note Model

Recent advances in polyphonic piano transcription have been made primari...

Please sign up or login with your details

Forgot password? Click here to reset