Robust training on approximated minimal-entropy set

10/21/2016
by   Tianpei Xie, et al.
0

In this paper, we propose a general framework to learn a robust large-margin binary classifier when corrupt measurements, called anomalies, caused by sensor failure might be present in the training set. The goal is to minimize the generalization error of the classifier on non-corrupted measurements while controlling the false alarm rate associated with anomalous samples. By incorporating a non-parametric regularizer based on an empirical entropy estimator, we propose a Geometric-Entropy-Minimization regularized Maximum Entropy Discrimination (GEM-MED) method to learn to classify and detect anomalies in a joint manner. We demonstrate using simulated data and a real multimodal data set. Our GEM-MED method can yield improved performance over previous robust classification methods in terms of both classification accuracy and anomaly detection rate.

READ FULL TEXT
research
02/16/2017

Latent Laplacian Maximum Entropy Discrimination for Detection of High-Utility Anomalies

Data-driven anomaly detection methods suffer from the drawback of detect...
research
03/07/2018

Sequential Maximum Margin Classifiers for Partially Labeled Data

In many real-world applications, data is not collected as one batch, but...
research
09/30/2014

Data Imputation through the Identification of Local Anomalies

We introduce a comprehensive and statistical framework in a model free s...
research
08/27/2017

Anomaly Detection in Wireless Sensor Networks

Wireless sensor networks usually comprise a large number of sensors moni...
research
01/02/2019

Anomaly Detection in Networks with Application to Financial Transaction Networks

This paper is motivated by the task of detecting anomalies in networks o...
research
08/05/2023

Anomaly Detection in Global Financial Markets with Graph Neural Networks and Nonextensive Entropy

Anomaly detection is a challenging task, particularly in systems with ma...
research
09/27/2021

Distributionally Robust Multiclass Classification and Applications in Deep CNN Image Classifiers

We develop a Distributionally Robust Optimization (DRO) formulation for ...

Please sign up or login with your details

Forgot password? Click here to reset