Active Anomaly Detection for time-domain discoveries

09/29/2019
by   Emille E. O. Ishida, et al.
0

We present the first application of adaptive machine learning to the identification of anomalies in a data set of non-periodic astronomical light curves. The method follows an active learning strategy where highly informative objects are selected to be labelled. This new information is subsequently used to improve the machine learning model, allowing its accuracy to evolve with the addition of every new classification. For the case of anomaly detection, the algorithm aims to maximize the number of real anomalies presented to the expert by slightly modifying the decision boundary of a traditional isolation forest in each iteration. As a proof of concept, we apply the Active Anomaly Discovery (AAD) algorithm to light curves from the Open Supernova Catalog and compare its results to those of a static Isolation Forest (IF). For both methods, we visually inspected objects within 2 was able to identify 80 evidence that AAD algorithms can play a central role in the search for new physics in the era of large scale sky surveys.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/08/2022

Active Learning-based Isolation Forest (ALIF): Enhancing Anomaly Detection in Decision Support Systems

The detection of anomalous behaviours is an emerging need in many applic...
research
04/09/2020

A Mathematical Assessment of the Isolation Tree Method for Data Anomaly Detection in Big Data

We present the mathematical analysis of the Isolation Random Forest Meth...
research
04/09/2020

A Mathematical Assessment of the Isolation Tree Method for Data Anomaly Detection

We present the mathematical analysis of the Isolation Random Forest Meth...
research
10/29/2021

Real-time detection of anomalies in large-scale transient surveys

New time-domain surveys, such as the Rubin Observatory Legacy Survey of ...
research
12/15/2021

Real-time Detection of Anomalies in Multivariate Time Series of Astronomical Data

Astronomical transients are stellar objects that become temporarily brig...
research
10/28/2022

Learning to Detect Interesting Anomalies

Anomaly detection algorithms are typically applied to static, unchanging...
research
04/09/2019

Functional Isolation Forest

For the purpose of monitoring the behavior of complex infrastructures (e...

Please sign up or login with your details

Forgot password? Click here to reset