Weakly Supervised Temporal Anomaly Segmentation with Dynamic Time Warping

08/15/2021
by   Dongha Lee, et al.
0

Most recent studies on detecting and localizing temporal anomalies have mainly employed deep neural networks to learn the normal patterns of temporal data in an unsupervised manner. Unlike them, the goal of our work is to fully utilize instance-level (or weak) anomaly labels, which only indicate whether any anomalous events occurred or not in each instance of temporal data. In this paper, we present WETAS, a novel framework that effectively identifies anomalous temporal segments (i.e., consecutive time points) in an input instance. WETAS learns discriminative features from the instance-level labels so that it infers the sequential order of normal and anomalous segments within each instance, which can be used as a rough segmentation mask. Based on the dynamic time warping (DTW) alignment between the input instance and its segmentation mask, WETAS obtains the result of temporal segmentation, and simultaneously, it further enhances itself by using the mask as additional supervision. Our experiments show that WETAS considerably outperforms other baselines in terms of the localization of temporal anomalies, and also it provides more informative results than point-level detection methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/12/2018

Real-world Anomaly Detection in Surveillance Videos

Surveillance videos are able to capture a variety of realistic anomalies...
research
08/20/2020

Localizing Anomalies from Weakly-Labeled Videos

Video anomaly detection under video-level labels is currently a challeng...
research
04/30/2021

Cleaning Label Noise with Clusters for Minimally Supervised Anomaly Detection

Learning to detect real-world anomalous events using video-level annotat...
research
12/15/2022

Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework with Spatio-Temporal Collaboration

Instance segmentation in videos, which aims to segment and track multipl...
research
11/24/2020

CLAWS: Clustering Assisted Weakly Supervised Learning with Normalcy Suppression for Anomalous Event Detection

Learning to detect real-world anomalous events through video-level label...
research
08/10/2022

Consistency-based Self-supervised Learning for Temporal Anomaly Localization

This work tackles Weakly Supervised Anomaly detection, in which a predic...
research
03/03/2022

Constrained unsupervised anomaly segmentation

Current unsupervised anomaly localization approaches rely on generative ...

Please sign up or login with your details

Forgot password? Click here to reset