Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter

08/31/2023
by   Abhirami Harilal, et al.
0

The online Data Quality Monitoring system (DQM) of the CMS electromagnetic calorimeter (ECAL) is a crucial operational tool that allows ECAL experts to quickly identify, localize, and diagnose a broad range of detector issues that would otherwise hinder physics-quality data taking. Although the existing ECAL DQM system has been continuously updated to respond to new problems, it remains one step behind newer and unforeseen issues. Using unsupervised deep learning, a real-time autoencoder-based anomaly detection system is developed that is able to detect ECAL anomalies unseen in past data. After accounting for spatial variations in the response of the ECAL and the temporal evolution of anomalies, the new system is able to efficiently detect anomalies while maintaining an estimated false discovery rate between 10^-2 to 10^-4, beating existing benchmarks by about two orders of magnitude. The real-world performance of the system is validated using anomalies found in 2018 and 2022 LHC collision data. Additionally, first results from deploying the autoencoder-based system in the CMS online DQM workflow for the ECAL barrel during Run 3 of the LHC are presented, showing its promising performance in detecting obscure issues that could have been missed in the existing DQM system.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

research
09/18/2023

Autoencoder-based Anomaly Detection System for Online Data Quality Monitoring of the CMS Electromagnetic Calorimeter

The CMS detector is a general-purpose apparatus that detects high-energy...
research
02/07/2020

Anomaly Detection using Deep Autoencoders for in-situ Wastewater Systems Monitoring Data

Due to the growing amount of data from in-situ sensors in wastewater sys...
research
04/04/2019

Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detection

Deep autoencoder has been extensively used for anomaly detection. Traini...
research
10/09/2020

Algorithmic Frameworks for the Detection of High Density Anomalies

This study explores the concept of high-density anomalies. As opposed to...
research
03/19/2022

Machine Learning-based Anomaly Detection in Optical Fiber Monitoring

Secure and reliable data communication in optical networks is critical f...
research
03/28/2023

Hard Nominal Example-aware Template Mutual Matching for Industrial Anomaly Detection

Anomaly detectors are widely used in industrial production to detect and...
research
07/27/2018

Detector monitoring with artificial neural networks at the CMS experiment at the CERN Large Hadron Collider

Reliable data quality monitoring is a key asset in delivering collision ...

Please sign up or login with your details

Forgot password? Click here to reset