DeepAI AI Chat
Log In Sign Up

Independent mechanism analysis, a new concept?

by   Luigi Gresele, et al.

Independent component analysis provides a principled framework for unsupervised representation learning, with solid theory on the identifiability of the latent code that generated the data, given only observations of mixtures thereof. Unfortunately, when the mixing is nonlinear, the model is provably nonidentifiable, since statistical independence alone does not sufficiently constrain the problem. Identifiability can be recovered in settings where additional, typically observed variables are included in the generative process. We investigate an alternative path and consider instead including assumptions reflecting the principle of independent causal mechanisms exploited in the field of causality. Specifically, our approach is motivated by thinking of each source as independently influencing the mixing process. This gives rise to a framework which we term independent mechanism analysis. We provide theoretical and empirical evidence that our approach circumvents a number of nonidentifiability issues arising in nonlinear blind source separation.


page 8

page 36


Probing the Robustness of Independent Mechanism Analysis for Representation Learning

One aim of representation learning is to recover the original latent cod...

Discovering Latent Causal Variables via Mechanism Sparsity: A New Principle for Nonlinear ICA

It can be argued that finding an interpretable low-dimensional represent...

Nonlinear Independent Component Analysis for Continuous-Time Signals

We study the classical problem of recovering a multidimensional source p...

The Incomplete Rosetta Stone Problem: Identifiability Results for Multi-View Nonlinear ICA

We consider the problem of recovering a common latent source with indepe...

A Geometric Blind Source Separation Method Based on Facet Component Analysis

Given a set of mixtures, blind source separation attempts to retrieve th...

Provable Subspace Identification Under Post-Nonlinear Mixtures

Unsupervised mixture learning (UML) aims at identifying linearly or nonl...