Anomaly detection with semi-supervised classification based on risk estimators

09/01/2023
by   Le Thi Khanh Hien, et al.
0

A significant limitation of one-class classification anomaly detection methods is their reliance on the assumption that unlabeled training data only contains normal instances. To overcome this impractical assumption, we propose two novel classification-based anomaly detection methods. Firstly, we introduce a semi-supervised shallow anomaly detection method based on an unbiased risk estimator. Secondly, we present a semi-supervised deep anomaly detection method utilizing a nonnegative (biased) risk estimator. We establish estimation error bounds and excess risk bounds for both risk minimizers. Additionally, we propose techniques to select appropriate regularization parameters that ensure the nonnegativity of the empirical risk in the shallow model under specific loss functions. Our extensive experiments provide strong evidence of the effectiveness of the risk-based anomaly detection methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/09/2023

AGAD: Adversarial Generative Anomaly Detection

Anomaly detection suffered from the lack of anomalies due to the diversi...
research
12/14/2011

Semi-Supervised Anomaly Detection - Towards Model-Independent Searches of New Physics

Most classification algorithms used in high energy physics fall under th...
research
11/02/2021

A Critical Study on the Recent Deep Learning Based Semi-Supervised Video Anomaly Detection Methods

Video anomaly detection is one of the hot research topics in computer vi...
research
08/24/2019

A framework for anomaly detection using language modeling, and its applications to finance

In the finance sector, studies focused on anomaly detection are often as...
research
08/24/2023

Try with Simpler – An Evaluation of Improved Principal Component Analysis in Log-based Anomaly Detection

The rapid growth of deep learning (DL) has spurred interest in enhancing...
research
11/01/2022

Semi-Supervised Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detection

In the era of big astronomical surveys, our ability to leverage artifici...
research
07/23/2019

A Neural Network Based On-device Learning Anomaly Detector for Edge Devices

Semi-supervised anomaly detection is referred as an approach to identify...

Please sign up or login with your details

Forgot password? Click here to reset