Detecting Hierarchical Changes in Latent Variable Models

by   Shintaro Fukushima, et al.

This paper addresses the issue of detecting hierarchical changes in latent variable models (HCDL) from data streams. There are three different levels of changes for latent variable models: 1) the first level is the change in data distribution for fixed latent variables, 2) the second one is that in the distribution over latent variables, and 3) the third one is that in the number of latent variables. It is important to detect these changes because we can analyze the causes of changes by identifying which level a change comes from (change interpretability). This paper proposes an information-theoretic framework for detecting changes of the three levels in a hierarchical way. The key idea to realize it is to employ the MDL (minimum description length) change statistics for measuring the degree of change, in combination with DNML (decomposed normalized maximum likelihood) code-length calculation. We give a theoretical basis for making reliable alarms for changes. Focusing on stochastic block models, we employ synthetic and benchmark datasets to empirically demonstrate the effectiveness of our framework in terms of change interpretability as well as change detection.



page 8

page 10


Variational Autoencoders and Nonlinear ICA: A Unifying Framework

The framework of variational autoencoders allows us to efficiently learn...

Change Sign Detection with Differential MDL Change Statistics and its Applications to COVID-19 Pandemic Analysis

We are concerned with the issue of detecting changes and their signs fro...

Change-Point Detection on Hierarchical Circadian Models

This paper addresses the problem of change-point detection on sequences ...

Leveraging the Exact Likelihood of Deep Latent Variables Models

Deep latent variable models combine the approximation abilities of deep ...

Computation for Latent Variable Model Estimation: A Unified Stochastic Proximal Framework

Latent variable models have been playing a central role in psychometrics...

Descriptive Dimensionality and Its Characterization of MDL-based Learning and Change Detection

This paper introduces a new notion of dimensionality of probabilistic mo...

We Are Not Your Real Parents: Telling Causal from Confounded using MDL

Given data over variables (X_1,...,X_m, Y) we consider the problem of fi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.