Towards Fair Deep Anomaly Detection

12/29/2020
by   Hongjing Zhang, et al.
64

Anomaly detection aims to find instances that are considered unusual and is a fundamental problem of data science. Recently, deep anomaly detection methods were shown to achieve superior results particularly in complex data such as images. Our work focuses on deep one-class classification for anomaly detection which learns a mapping only from the normal samples. However, the non-linear transformation performed by deep learning can potentially find patterns associated with social bias. The challenge with adding fairness to deep anomaly detection is to ensure both making fair and correct anomaly predictions simultaneously. In this paper, we propose a new architecture for the fair anomaly detection approach (Deep Fair SVDD) and train it using an adversarial network to de-correlate the relationships between the sensitive attributes and the learned representations. This differs from how fairness is typically added namely as a regularizer or a constraint. Further, we propose two effective fairness measures and empirically demonstrate that existing deep anomaly detection methods are unfair. We show that our proposed approach can remove the unfairness largely with minimal loss on the anomaly detection performance. Lastly, we conduct an in-depth analysis to show the strength and limitations of our proposed model, including parameter analysis, feature visualization, and run-time analysis.

READ FULL TEXT

page 2

page 7

page 8

research
03/04/2023

Achieving Counterfactual Fairness for Anomaly Detection

Ensuring fairness in anomaly detection models has received much attentio...
research
07/07/2022

Red PANDA: Disambiguating Anomaly Detection by Removing Nuisance Factors

Anomaly detection methods strive to discover patterns that differ from t...
research
08/26/2023

Bias in Unsupervised Anomaly Detection in Brain MRI

Unsupervised anomaly detection methods offer a promising and flexible al...
research
01/29/2021

The Deep Radial Basis Function Data Descriptor (D-RBFDD) Network: A One-Class Neural Network for Anomaly Detection

Anomaly detection is a challenging problem in machine learning, and is e...
research
09/22/2022

Oracle Analysis of Representations for Deep Open Set Detection

The problem of detecting a novel class at run time is known as Open Set ...
research
05/05/2020

Classification-Based Anomaly Detection for General Data

Anomaly detection, finding patterns that substantially deviate from thos...
research
12/10/2019

Minority report detection in refugee-authored community-driven journalism using RBMs

Our work seeks to gather and distribute sensitive information from refug...

Please sign up or login with your details

Forgot password? Click here to reset