DeepAI AI Chat
Log In Sign Up

An Empirical Study of Invariant Risk Minimization

04/10/2020
by   Yo Joong Choe, et al.
Kakao Corp.
0

Invariant risk minimization (IRM; Arjovsky et al., 2019) is a recently proposed framework designed for learning predictors that are invariant to spurious correlations across different training environments. Because IRM does not assume that the test data is identically distributed as the training data, it can allow models to learn invariances that generalize well on unseen and out-of-distribution (OOD) samples. Yet, despite this theoretical justification, IRM has not been extensively tested across various settings. In an attempt to gain a better understanding of IRM, we empirically investigate several research questions using IRMv1, which is the first practical algorithm proposed in (Arjovsky et al., 2019) to approximately solve IRM. By extending the ColoredMNIST experiment from (Arjovsky et al., 2019) in multiple ways, we find that IRMv1 (i) performs better as the spurious correlation varies more widely between training environments, (ii) learns an approximately invariant predictor when the underlying relationship is approximately invariant, and (iii) can be extended to multiple environments, multiple outcomes, and different modalities (i.e., text). We hope that this work will shed light on the characteristics of IRM and help with applying IRM to real-world OOD generalization tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/11/2020

Invariant Risk Minimization Games

The standard risk minimization paradigm of machine learning is brittle w...
10/12/2020

The Risks of Invariant Risk Minimization

Invariant Causal Prediction (Peters et al., 2016) is a technique for out...
01/30/2022

Provable Domain Generalization via Invariant-Feature Subspace Recovery

Domain generalization asks for models trained on a set of training envir...
06/18/2021

Iterative Feature Matching: Toward Provable Domain Generalization with Logarithmic Environments

Domain generalization aims at performing well on unseen test environment...
06/06/2021

A call for better unit testing for invariant risk minimisation

In this paper we present a controlled study on the linearized IRM framew...
01/16/2021

Out-of-distribution Prediction with Invariant Risk Minimization: The Limitation and An Effective Fix

This work considers the out-of-distribution (OOD) prediction problem whe...
06/06/2020

Domain Extrapolation via Regret Minimization

Many real prediction tasks such as molecular property prediction require...

Code Repositories

irm-empirical-study

An Empirical Study of Invariant Risk Minimization


view repo