Real-time Drift Detection on Time-series Data

10/12/2021
by   Nandini Ramanan, et al.
0

Practical machine learning applications involving time series data, such as firewall log analysis to proactively detect anomalous behavior, are concerned with real time analysis of streaming data. Consequently, we need to update the ML models as the statistical characteristics of such data may shift frequently with time. One alternative explored in the literature is to retrain models with updated data whenever the models accuracy is observed to degrade. However, these methods rely on near real time availability of ground truth, which is rarely fulfilled. Further, in applications with seasonal data, temporal concept drift is confounded by seasonal variation. In this work, we propose an approach called Unsupervised Temporal Drift Detector or UTDD to flexibly account for seasonal variation, efficiently detect temporal concept drift in time series data in the absence of ground truth, and subsequently adapt our ML models to concept drift for better generalization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/30/2020

ConceptExplorer: Visual Analysis of Concept Driftsin Multi-source Time-series Data

Time-series data is widely studied in various scenarios, like weather fo...
research
04/04/2023

Handling Concept Drift in Global Time Series Forecasting

Machine learning (ML) based time series forecasting models often require...
research
03/16/2020

Drift-Adjusted And Arbitrated Ensemble Framework For Time Series Forecasting

Time Series Forecasting is at the core of many practical applications su...
research
02/21/2021

Anomaly Detection in Audio with Concept Drift using Adaptive Huffman Coding

In this work, we propose a framework to apply Huffman coding for anomaly...
research
07/24/2022

CODiT: Conformal Out-of-Distribution Detection in Time-Series Data

Machine learning models are prone to making incorrect predictions on inp...
research
03/27/2020

New Perspectives on the Use of Online Learning for Congestion Level Prediction over Traffic Data

This work focuses on classification over time series data. When a time s...
research
09/21/2021

Online Multi-horizon Transaction Metric Estimation with Multi-modal Learning in Payment Networks

Predicting metrics associated with entities' transnational behavior with...

Please sign up or login with your details

Forgot password? Click here to reset