An Invariant Matching Property for Distribution Generalization under Intervened Response

05/18/2022
by   Kang Du, et al.
0

The task of distribution generalization concerns making reliable prediction of a response in unseen environments. The structural causal models are shown to be useful to model distribution changes through intervention. Motivated by the fundamental invariance principle, it is often assumed that the conditional distribution of the response given its predictors remains the same across environments. However, this assumption might be violated in practical settings when the response is intervened. In this work, we investigate a class of model with an intervened response. We identify a novel form of invariance by incorporating the estimates of certain features as additional predictors. Effectively, we show this invariance is equivalent to having a deterministic linear matching that makes the generalization possible. We provide an explicit characterization of the linear matching and present our simulation results under various intervention settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/22/2022

Learning Invariant Representations under General Interventions on the Response

It has become increasingly common nowadays to collect observations of fe...
research
11/05/2019

Stabilizing Variable Selection and Regression

We consider regression in which one predicts a response Y with a set of ...
research
01/14/2023

Generalized Invariant Matching Property via LASSO

Learning under distribution shifts is a challenging task. One principled...
research
05/29/2022

The Missing Invariance Principle Found – the Reciprocal Twin of Invariant Risk Minimization

Machine learning models often generalize poorly to out-of-distribution (...
research
06/09/2023

Adaptive Contextual Perception: How to Generalize to New Backgrounds and Ambiguous Objects

Biological vision systems make adaptive use of context to recognize obje...
research
11/28/2019

A Generalization Theory based on Independent and Task-Identically Distributed Assumption

Existing generalization theories analyze the generalization performance ...
research
06/11/2021

Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization

The invariance principle from causality is at the heart of notable appro...

Please sign up or login with your details

Forgot password? Click here to reset