Dirichlet process mixture models for non-stationary data streams

10/13/2022
by   Ioar Casado, et al.
0

In recent years, we have seen a handful of work on inference algorithms over non-stationary data streams. Given their flexibility, Bayesian non-parametric models are a good candidate for these scenarios. However, reliable streaming inference under the concept drift phenomenon is still an open problem for these models. In this work, we propose a variational inference algorithm for Dirichlet process mixture models. Our proposal deals with the concept drift by including an exponential forgetting over the prior global parameters. Our algorithm allows to adapt the learned model to the concept drifts automatically. We perform experiments in both synthetic and real data, showing that the proposed model is competitive with the state-of-the-art algorithms in the density estimation problem, and it outperforms them in the clustering problem.

READ FULL TEXT
research
05/02/2022

Streaming Inference for Infinite Non-Stationary Clustering

Learning from a continuous stream of non-stationary data in an unsupervi...
research
12/01/2014

Streaming Variational Inference for Bayesian Nonparametric Mixture Models

In theory, Bayesian nonparametric (BNP) models are well suited to stream...
research
02/27/2022

Sampling in Dirichlet Process Mixture Models for Clustering Streaming Data

Practical tools for clustering streaming data must be fast enough to han...
research
02/08/2022

Variance matrix priors for Dirichlet process mixture models with Gaussian kernels

The Dirichlet Process Mixture Model (DPMM) is a Bayesian non-parametric ...
research
05/22/2022

A Dirichlet Process Mixture of Robust Task Models for Scalable Lifelong Reinforcement Learning

While reinforcement learning (RL) algorithms are achieving state-of-the-...
research
07/26/2012

Achieving Approximate Soft Clustering in Data Streams

In recent years, data streaming has gained prominence due to advances in...
research
05/09/2012

Bisimulation-based Approximate Lifted Inference

There has been a great deal of recent interest in methods for performing...

Please sign up or login with your details

Forgot password? Click here to reset