Selecting Treatment Effects Models for Domain Adaptation Using Causal Knowledge

02/11/2021
by   Trent Kyono, et al.
4

Selecting causal inference models for estimating individualized treatment effects (ITE) from observational data presents a unique challenge since the counterfactual outcomes are never observed. The problem is challenged further in the unsupervised domain adaptation (UDA) setting where we only have access to labeled samples in the source domain, but desire selecting a model that achieves good performance on a target domain for which only unlabeled samples are available. Existing techniques for UDA model selection are designed for the predictive setting. These methods examine discriminative density ratios between the input covariates in the source and target domain and do not factor in the model's predictions in the target domain. Because of this, two models with identical performance on the source domain would receive the same risk score by existing methods, but in reality, have significantly different performance in the test domain. We leverage the invariance of causal structures across domains to propose a novel model selection metric specifically designed for ITE methods under the UDA setting. In particular, we propose selecting models whose predictions of interventions' effects satisfy known causal structures in the target domain. Experimentally, our method selects ITE models that are more robust to covariate shifts on several healthcare datasets, including estimating the effect of ventilation in COVID-19 patients from different geographic locations.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

page 21

07/01/2020

Sequential Unsupervised Domain Adaptation through Prototypical Distributions

We develop an algorithm for unsupervised domain adaptation (UDA) of a cl...
01/18/2021

Model Compression for Domain Adaptation through Causal Effect Estimation

Recent improvements in the predictive quality of natural language proces...
11/12/2020

Learning causal representations for robust domain adaptation

Domain adaptation solves the learning problem in a target domain by leve...
09/26/2013

Causal Transportability of Experiments on Controllable Subsets of Variables: z-Transportability

We introduce z-transportability, the problem of estimating the causal ef...
11/20/2017

Parameter Reference Loss for Unsupervised Domain Adaptation

The success of deep learning in computer vision is mainly attributed to ...
02/24/2021

Semiparametric counterfactual density estimation

Causal effects are often characterized with averages, which can give an ...
02/27/2021

Scalable Causal Transfer Learning

One of the most important problems in transfer learning is the task of d...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.