Differentiable and Transportable Structure Learning

06/13/2022
by   Jeroen Berrevoets, et al.
2

We are interested in unsupervised structure learning with a particular focus on directed acyclic graphical (DAG) models. Compute required to infer these structures is typically super-exponential in the amount of variables, as inference requires a sweep of a combinatorially large space of potential structures. That is, until recent advances allowed to search this space using a differentiable metric, drastically reducing search time. While this technique – named NOTEARS – is widely considered a seminal work in DAG-discovery, it concedes an important property in favour of differentiability: transportability. In our paper we introduce D-Struct which recovers transportability in the found structures through a novel architecture and loss function, while remaining completely differentiable. As D-Struct remains differentiable, one can easily adopt our method in differentiable architectures as was previously done with NOTEARS. In our experiments we empirically validate D-Struct with respect to edge accuracy and the structural Hamming distance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/15/2022

Large-Scale Differentiable Causal Discovery of Factor Graphs

A common theme in causal inference is learning causal relationships betw...
research
04/13/2022

De-IReps: Searching for improved Re-parameterizing Architecture based on Differentiable Evolution Strategy

In recent years, neural architecture search (NAS) has shown great compet...
research
01/11/2021

Unchain the Search Space with Hierarchical Differentiable Architecture Search

Differentiable architecture search (DAS) has made great progress in sear...
research
09/23/2019

Scheduled Differentiable Architecture Search for Visual Recognition

Convolutional Neural Networks (CNN) have been regarded as a capable clas...
research
10/14/2020

Differentiable Causal Discovery Under Unmeasured Confounding

The data drawn from biological, economic, and social systems are often c...
research
09/08/2020

AutoKWS: Keyword Spotting with Differentiable Architecture Search

Smart audio devices are gated by an always-on lightweight keyword spotti...
research
11/22/2019

Differentiable Algorithm for Marginalising Changepoints

We present an algorithm for marginalising changepoints in time-series mo...

Please sign up or login with your details

Forgot password? Click here to reset