Unsupervised Abnormality Detection Using Heterogeneous Autonomous Systems

Anomaly detection in a surveillance scenario is an emerging and challenging field of research. For autonomous vehicles like drones or cars, it is immensely important to distinguish between normal and abnormal states in real-time to avoid/detect potential threats. But the nature and degree of abnormality may vary depending upon the actual environment and adversary. As a result, it is impractical to model all cases a priori and use supervised methods to classify. Also, an autonomous vehicle provides various data types like images and other analog or digital sensor data. In this paper, a heterogeneous system is proposed which estimates the degree of abnormality of an environment using drone-feed, analyzing real-time image and IMU sensor data in an unsupervised manner. Here, we have demonstrated AngleNet (a novel CNN architecture) to estimate the angle between a normal image and another image under consideration, which provides us with a measure of anomaly. Moreover, the IMU data are used in clustering models to predict abnormality. Finally, the results from these two algorithms are ensembled to estimate the final abnormality. The proposed method performs satisfactorily on the IEEE SP Cup-2020 dataset with an accuracy of 99.92 in-house dataset to validate its robustness.


page 1

page 3

page 4

page 5


Anomaly Detection in Unsupervised Surveillance Setting Using Ensemble of Multimodal Data with Adversarial Defense

Autonomous aerial surveillance using drone feed is an interesting and ch...

UAV-AdNet: Unsupervised Anomaly Detection using Deep Neural Networks for Aerial Surveillance

Anomaly detection is a key goal of autonomous surveillance systems that ...

Anomaly Detection using Deep Reconstruction and Forecasting for Autonomous Systems

We propose self-supervised deep algorithms to detect anomalies in hetero...

Measuring Novelty in Autonomous Vehicles Motion Using Local Outlier Factor Algorithm

Under unexpected conditions or scenarios, autonomous vehicles (AV) are m...

Generative Damage Learning for Concrete Aging Detection using Auto-flight Images

In order to health monitoring the state of large scale infrastructures, ...

On-board Deep-learning-based Unmanned Aerial Vehicle Fault Cause Detection and Identification

With the increase in use of Unmanned Aerial Vehicles (UAVs)/drones, it i...

DIT4BEARs Smart Roads Internship

The research internship at UiT - The Arctic University of Norway was off...

Please sign up or login with your details

Forgot password? Click here to reset