Contracting Skeletal Kinematic Embeddings for Anomaly Detection

01/23/2023
by   Alessandro Flaborea, et al.
0

Detecting the anomaly of human behavior is paramount to timely recognizing endangering situations, such as street fights or elderly falls. However, anomaly detection is complex, since anomalous events are rare and because it is an open set recognition task, i.e., what is anomalous at inference has not been observed at training. We propose COSKAD, a novel model which encodes skeletal human motion by an efficient graph convolutional network and learns to COntract SKeletal kinematic embeddings onto a latent hypersphere of minimum volume for Anomaly Detection. We propose and analyze three latent space designs for COSKAD: the commonly-adopted Euclidean, and the new spherical-radial and hyperbolic volumes. All three variants outperform the state-of-the-art, including video-based techniques, on the ShangaiTechCampus, the Avenue, and on the most recent UBnormal dataset, for which we contribute novel skeleton annotations and the selection of human-related videos. The source code and dataset will be released upon acceptance.

READ FULL TEXT
research
05/23/2023

A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipation

Semi-supervised video anomaly detection (VAD) is a critical task in the ...
research
03/09/2023

Understanding the Challenges and Opportunities of Pose-based Anomaly Detection

Pose-based anomaly detection is a video-analysis technique for detecting...
research
03/25/2022

Clustering Aided Weakly Supervised Training to Detect Anomalous Events in Surveillance Videos

Formulating learning systems for the detection of real-world anomalous e...
research
07/24/2019

Motion-Aware Feature for Improved Video Anomaly Detection

Motivated by our observation that motion information is the key to good ...
research
11/16/2022

Are we certain it's anomalous?

The progress in modelling time series and, more generally, sequences of ...
research
07/14/2023

Multimodal Motion Conditioned Diffusion Model for Skeleton-based Video Anomaly Detection

Anomalies are rare and anomaly detection is often therefore framed as On...
research
02/15/2019

Street Scene: A new dataset and evaluation protocol for video anomaly detection

Progress in video anomaly detection research is currently slowed by smal...

Please sign up or login with your details

Forgot password? Click here to reset