Outlier Detection using Generative Models with Theoretical Performance Guarantees

10/26/2018
by   Jirong Yi, et al.
12

This paper considers the problem of recovering signals from compressed measurements contaminated with sparse outliers, which has arisen in many applications. In this paper, we propose a generative model neural network approach for reconstructing the ground truth signals under sparse outliers. We propose an iterative alternating direction method of multipliers (ADMM) algorithm for solving the outlier detection problem via ℓ_1 norm minimization, and a gradient descent algorithm for solving the outlier detection problem via squared ℓ_1 norm minimization. We establish the recovery guarantees for reconstruction of signals using generative models in the presence of outliers, and give an upper bound on the number of outliers allowed for recovery. Our results are applicable to both the linear generator neural network and the nonlinear generator neural network with an arbitrary number of layers. We conduct extensive experiments using variational auto-encoder and deep convolutional generative adversarial networks, and the experimental results show that the signals can be successfully reconstructed under outliers using our approach. Our approach outperforms the traditional Lasso and ℓ_2 minimization approach.

READ FULL TEXT

page 30

page 32

page 33

page 34

page 38

research
07/27/2021

Unsupervised Outlier Detection using Memory and Contrastive Learning

Outlier detection is one of the most important processes taken to create...
research
09/28/2018

Generative Adversarial Active Learning for Unsupervised Outlier Detection

Outlier detection is an important topic in machine learning and has been...
research
03/20/2017

Efficient variational Bayesian neural network ensembles for outlier detection

In this work we perform outlier detection using ensembles of neural netw...
research
10/12/2019

A Computational Theory of Robust Localization Verifiability in the Presence of Pure Outlier Measurements

The problem of localizing a set of nodes from relative pairwise measurem...
research
10/25/2020

Further Analysis of Outlier Detection with Deep Generative Models

The recent, counter-intuitive discovery that deep generative models (DGM...
research
05/22/2019

Outlier Robust Extreme Learning Machine for Multi-Target Regression

The popularity of algorithms based on Extreme Learning Machine (ELM), wh...
research
07/07/2019

Fast and Provable ADMM for Learning with Generative Priors

In this work, we propose a (linearized) Alternating Direction Method-of-...

Please sign up or login with your details

Forgot password? Click here to reset