Deep density ratio estimation for change point detection

by   Haidar Khan, et al.

In this work, we propose new objective functions to train deep neural network based density ratio estimators and apply it to a change point detection problem. Existing methods use linear combinations of kernels to approximate the density ratio function by solving a convex constrained minimization problem. Approximating the density ratio function using a deep neural network requires defining a suitable objective function to optimize. We formulate and compare objective functions that can be minimized using gradient descent and show that the network can effectively learn to approximate the density ratio function. Using our deep density ratio estimation objective function results in better performance on a seizure detection task than other (kernel and neural network based) density ratio estimation methods and other window-based change point detection algorithms. We also show that the method can still support other neural network architectures, such as convolutional networks.



There are no comments yet.


page 2


Generalization of Change-Point Detection in Time Series Data Based on Direct Density Ratio Estimation

The goal of the change-point detection is to discover changes of time se...

Change-point detection in dynamic networks via graphon estimation

We propose a general approach for change-point detection in dynamic netw...

Change Point Detection for Compositional Multivariate Data

Change point detection algorithms have numerous applications in fields o...

Testing exchangeability with martingale for change-point detection

This work studies the exchangeability test for a random sequence through...

Information Utilization Ratio in Heuristic Optimization Algorithms

Heuristic algorithms are able to optimize objective functions efficientl...

The Deep Neural Network based Photometry Framework for Wide Field Small Aperture Telescopes

Wide field small aperture telescopes (WFSATs) are mainly used to obtain ...

TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systems

A trojan backdoor is a hidden pattern typically implanted in a deep neur...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.