Deep density ratio estimation for change point detection

05/23/2019
by   Haidar Khan, et al.
0

In this work, we propose new objective functions to train deep neural network based density ratio estimators and apply it to a change point detection problem. Existing methods use linear combinations of kernels to approximate the density ratio function by solving a convex constrained minimization problem. Approximating the density ratio function using a deep neural network requires defining a suitable objective function to optimize. We formulate and compare objective functions that can be minimized using gradient descent and show that the network can effectively learn to approximate the density ratio function. Using our deep density ratio estimation objective function results in better performance on a seizure detection task than other (kernel and neural network based) density ratio estimation methods and other window-based change point detection algorithms. We also show that the method can still support other neural network architectures, such as convolutional networks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

01/17/2020

Generalization of Change-Point Detection in Time Series Data Based on Direct Density Ratio Estimation

The goal of the change-point detection is to discover changes of time se...
08/05/2019

Change-point detection in dynamic networks via graphon estimation

We propose a general approach for change-point detection in dynamic netw...
01/11/2019

Change Point Detection for Compositional Multivariate Data

Change point detection algorithms have numerous applications in fields o...
10/06/2018

Testing exchangeability with martingale for change-point detection

This work studies the exchangeability test for a random sequence through...
04/06/2016

Information Utilization Ratio in Heuristic Optimization Algorithms

Heuristic algorithms are able to optimize objective functions efficientl...
06/28/2021

The Deep Neural Network based Photometry Framework for Wide Field Small Aperture Telescopes

Wide field small aperture telescopes (WFSATs) are mainly used to obtain ...
08/02/2019

TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systems

A trojan backdoor is a hidden pattern typically implanted in a deep neur...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.