Balancing Fairness and Robustness via Partial Invariance

12/17/2021
by   Moulik Choraria, et al.
0

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the data generating distributions remain constant across the environments or alternately, the data "overlaps" across environments to find meaningful invariant features. Consequently, when the "overlap" assumption does not hold, the set of truly invariant features may not be sufficient for optimal prediction performance. Such cases arise naturally in networked settings and hierarchical data-generating models, wherein the IRM performance becomes suboptimal. To mitigate this failure case, we argue for a partial invariance framework. The key idea is to introduce flexibility into the IRM framework by partitioning the environments based on hierarchical differences, while enforcing invariance locally within the partitions. We motivate this framework in classification settings with causal distribution shifts across environments. Our results show the capability of the partial invariant risk minimization to alleviate the trade-off between fairness and risk in certain settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/28/2023

Learning Optimal Features via Partial Invariance

Learning models that are robust to test-time distribution shifts is a ke...
research
05/04/2021

Robust Reconfigurable Intelligent Surfaces via Invariant Risk and Causal Representations

In this paper, the problem of robust reconfigurable intelligent surface ...
research
05/29/2022

The Missing Invariance Principle Found – the Reciprocal Twin of Invariant Risk Minimization

Machine learning models often generalize poorly to out-of-distribution (...
research
02/02/2022

Invariant Ancestry Search

Recently, methods have been proposed that exploit the invariance of pred...
research
11/14/2021

Invariant Risk Minimisation for Cross-Organism Inference: Substituting Mouse Data for Human Data in Human Risk Factor Discovery

Human medical data can be challenging to obtain due to data privacy conc...
research
11/12/2020

Fairness and Robustness in Invariant Learning: A Case Study in Toxicity Classification

Robustness is of central importance in machine learning and has given ri...
research
06/29/2022

Lower Bounds on the Error Probability for Invariant Causal Prediction

It is common practice to collect observations of feature and response pa...

Please sign up or login with your details

Forgot password? Click here to reset