Semi-Supervised Learning, Causality and the Conditional Cluster Assumption

05/28/2019
by   Julius von Kügelgen, et al.
7

While the success of semi-supervised learning (SSL) is still not fully understood, Schölkopf et al. (2012) have established a link to the principle of independent causal mechanisms. They conclude that SSL should be impossible when predicting a target variable from its causes, but possible when predicting it from its effects. Since both these cases are somewhat restrictive, we extend their work by considering classification using cause and effect features at the same time, such as predicting a disease from both risk factors and symptoms. While standard SSL exploits information contained in the marginal distribution of the inputs (to improve our estimate of the conditional distribution of target given inputs), we argue that in our more general setting we can use information in the conditional of effect features given causal features. We explore how this insight generalizes the previous understanding, and how it relates to and can be exploited for SSL.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/19/2023

On Identifiability of Conditional Causal Effects

We address the problem of identifiability of an arbitrary conditional ca...
research
02/11/2014

Justifying Information-Geometric Causal Inference

Information Geometric Causal Inference (IGCI) is a new approach to disti...
research
05/10/2022

On Causality in Domain Adaptation and Semi-Supervised Learning: an Information-Theoretic Analysis

The establishment of the link between causality and unsupervised domain ...
research
06/27/2012

On Causal and Anticausal Learning

We consider the problem of function estimation in the case where an unde...
research
04/03/2017

Local nearest neighbour classification with applications to semi-supervised learning

We derive a new asymptotic expansion for the global excess risk of a loc...
research
10/14/2020

Learning Robust Models Using The Principle of Independent Causal Mechanisms

Standard supervised learning breaks down under data distribution shift. ...
research
10/29/2019

Feature relevance quantification in explainable AI: A causality problem

We discuss promising recent contributions on quantifying feature relevan...

Please sign up or login with your details

Forgot password? Click here to reset