Fast kernel methods for Data Quality Monitoring as a goodness-of-fit test

03/09/2023
by   Gaia Grosso, et al.
0

We here propose a machine learning approach for monitoring particle detectors in real-time. The goal is to assess the compatibility of incoming experimental data with a reference dataset, characterising the data behaviour under normal circumstances, via a likelihood-ratio hypothesis test. The model is based on a modern implementation of kernel methods, nonparametric algorithms that can learn any continuous function given enough data. The resulting approach is efficient and agnostic to the type of anomaly that may be present in the data. Our study demonstrates the effectiveness of this strategy on multivariate data from drift tube chamber muon detectors.

READ FULL TEXT
research
04/05/2022

Learning new physics efficiently with nonparametric methods

We present a machine learning approach for model-independent new physics...
research
12/07/2020

Efficient Nonlinear RX Anomaly Detectors

Current anomaly detection algorithms are typically challenged by either ...
research
11/11/2022

A monitoring framework for deployed machine learning models with supply chain examples

Actively monitoring machine learning models during production operations...
research
10/08/2016

A nonparametric sequential test for online randomized experiments

We propose a nonparametric sequential test that aims to address two prac...
research
04/10/2018

Loss Rank Mining: A General Hard Example Mining Method for Real-time Detectors

Modern object detectors usually suffer from low accuracy issues, as fore...
research
04/17/2023

Computational Performance Aware Benchmarking of Unsupervised Concept Drift Detection

For many AI systems, concept drift detection is crucial to ensure the sy...
research
10/14/2020

Scalable changepoint and anomaly detection in cross-correlated data with an application to condition monitoring

Motivated by a condition monitoring application arising from subsea engi...

Please sign up or login with your details

Forgot password? Click here to reset