Stein Variational Online Changepoint Detection with Applications to Hawkes Processes and Neural Networks

01/23/2019
by   Gianluca Detommaso, et al.
0

Bayesian online changepoint detection (BOCPD) (Adams & MacKay, 2007) offers a rigorous and viable way to identity changepoints in complex systems. In this work, we introduce a Stein variational online changepoint detection (SVOCD) method to provide a computationally tractable generalization of BOCPD beyond the exponential family of probability distributions. We integrate the recently developed Stein variational Newton (SVN) method (Detommaso et al., 2018) and BOCPD to offer a full online Bayesian treatment for a large number of situations with significant importance in practice. We apply the resulting method to two challenging and novel applications: Hawkes processes and long short-term memory (LSTM) neural networks. In both cases, we successfully demonstrate the efficacy of our method on real data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/20/2020

Detecting the Insider Threat with Long Short Term Memory (LSTM) Neural Networks

Information systems enable many organizational processes in every indust...
research
05/16/2020

Automatic Dialogic Instruction Detection for K-12 Online One-on-one Classes

Online one-on-one class is created for highly interactive and immersive ...
research
02/21/2023

Memory-augmented Online Video Anomaly Detection

The ability to understand the surrounding scene is of paramount importan...
research
12/23/2017

An Approximate Bayesian Long Short-Term Memory Algorithm for Outlier Detection

Long Short-Term Memory networks trained with gradient descent and back-p...
research
01/31/2020

Compensation of Fiber Nonlinearities in Digital Coherent Systems Leveraging Long Short-Term Memory Neural Networks

We introduce for the first time the utilization of Long short-term memor...
research
12/09/2017

Word Sense Disambiguation with LSTM: Do We Really Need 100 Billion Words?

Recently, Yuan et al. (2016) have shown the effectiveness of using Long ...

Please sign up or login with your details

Forgot password? Click here to reset