Active Learning-based Isolation Forest (ALIF): Enhancing Anomaly Detection in Decision Support Systems

07/08/2022
by   Elisa Marcelli, et al.
0

The detection of anomalous behaviours is an emerging need in many applications, particularly in contexts where security and reliability are critical aspects. While the definition of anomaly strictly depends on the domain framework, it is often impractical or too time consuming to obtain a fully labelled dataset. The use of unsupervised models to overcome the lack of labels often fails to catch domain specific anomalies as they rely on general definitions of outlier. This paper suggests a new active learning based approach, ALIF, to solve this problem by reducing the number of required labels and tuning the detector towards the definition of anomaly provided by the user. The proposed approach is particularly appealing in the presence of a Decision Support System (DSS), a case that is increasingly popular in real-world scenarios. While it is common that DSS embedded with anomaly detection capabilities rely on unsupervised models, they don't have a way to improve their performance: ALIF is able to enhance the capabilities of DSS by exploiting the user feedback during common operations. ALIF is a lightweight modification of the popular Isolation Forest that proved superior performances with respect to other state-of-art algorithms in a multitude of real anomaly detection datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/25/2022

Little Help Makes a Big Difference: Leveraging Active Learning to Improve Unsupervised Time Series Anomaly Detection

Key Performance Indicators (KPI), which are essentially time series data...
research
09/29/2019

Active Anomaly Detection for time-domain discoveries

We present the first application of adaptive machine learning to the ide...
research
11/30/2021

TiWS-iForest: Isolation Forest in Weakly Supervised and Tiny ML scenarios

Unsupervised anomaly detection tackles the problem of finding anomalies ...
research
07/21/2020

Interpretable Anomaly Detection with DIFFI: Depth-based Feature Importance for the Isolation Forest

Anomaly Detection is one of the most important tasks in unsupervised lea...
research
09/17/2018

Active Anomaly Detection via Ensembles

In critical applications of anomaly detection including computer securit...
research
01/07/2023

How to Allocate your Label Budget? Choosing between Active Learning and Learning to Reject in Anomaly Detection

Anomaly detection attempts at finding examples that deviate from the exp...
research
02/04/2023

Unsupervised Ensemble Methods for Anomaly Detection in PLC-based Process Control

Programmable logic controller (PLC) based industrial control systems (IC...

Please sign up or login with your details

Forgot password? Click here to reset