Anomaly Detection in Multivariate Non-stationary Time Series for Automatic DBMS Diagnosis

08/08/2017

∙

Anomaly detection in database management systems (DBMSs) is difficult because of increasing number of statistics (stat) and event metrics in big data system. In this paper, I propose an automatic DBMS diagnosis system that detects anomaly periods with abnormal DB stat metrics and finds causal events in the periods. Reconstruction error from deep autoencoder and statistical process control approach are applied to detect time period with anomalies. Related events are found using time series similarity measures between events and abnormal stat metrics. After training deep autoencoder with DBMS metric data, efficacy of anomaly detection is investigated from other DBMSs containing anomalies. Experiment results show effectiveness of proposed model, especially, batch temporal normalization layer. Proposed model is used for publishing automatic DBMS diagnosis reports in order to determine DBMS configuration and SQL tuning.

READ FULL TEXT

Anomaly Detection in Multivariate Non-stationary Time Series for Automatic DBMS Diagnosis

Anomaly Detection using Deep Autoencoders for in-situ Wastewater Systems Monitoring Data

An Attention Free Conditional Autoencoder For Anomaly Detection in Cryptocurrencies

Anomaly Detection on Seasonal Metrics via Robust Time Series Decomposition

SAQL: A Stream-based Query System for Real-Time Abnormal System Behavior Detection

Detecting systematic anomalies affecting systems when inputs are stationary time series

MA-VAE: Multi-head Attention-based Variational Autoencoder Approach for Anomaly Detection in Multivariate Time-series Applied to Automotive Endurance Powertrain Testing

Anomaly Detection for Aggregated Data Using Multi-Graph Autoencoder

Anomaly Detection in Multivariate Non-stationary Time Series for Automatic DBMS Diagnosis

Related Research

Anomaly Detection using Deep Autoencoders for in-situ Wastewater Systems Monitoring Data

An Attention Free Conditional Autoencoder For Anomaly Detection in Cryptocurrencies

Anomaly Detection on Seasonal Metrics via Robust Time Series Decomposition

SAQL: A Stream-based Query System for Real-Time Abnormal System Behavior Detection

Detecting systematic anomalies affecting systems when inputs are stationary time series

MA-VAE: Multi-head Attention-based Variational Autoencoder Approach for Anomaly Detection in Multivariate Time-series Applied to Automotive Endurance Powertrain Testing

Anomaly Detection for Aggregated Data Using Multi-Graph Autoencoder