Deep Structured Cross-Modal Anomaly Detection

08/11/2019
by   Yuening Li, et al.
8

Anomaly detection is a fundamental problem in data mining field with many real-world applications. A vast majority of existing anomaly detection methods predominately focused on data collected from a single source. In real-world applications, instances often have multiple types of features, such as images (ID photos, finger prints) and texts (bank transaction histories, user online social media posts), resulting in the so-called multi-modal data. In this paper, we focus on identifying anomalies whose patterns are disparate across different modalities, i.e., cross-modal anomalies. Some of the data instances within a multi-modal context are often not anomalous when they are viewed separately in each individual modality, but contains inconsistent patterns when multiple sources are jointly considered. The existence of multi-modal data in many real-world scenarios brings both opportunities and challenges to the canonical task of anomaly detection. On the one hand, in multi-modal data, information of different modalities may complement each other in improving the detection performance. On the other hand, complicated distributions across different modalities call for a principled framework to characterize their inherent and complex correlations, which is often difficult to capture with conventional linear models. To this end, we propose a novel deep structured anomaly detection framework to identify the cross-modal anomalies embedded in the data. Experiments on real-world datasets demonstrate the effectiveness of the proposed framework comparing with the state-of-the-art.

READ FULL TEXT

page 1

page 6

page 7

research
07/02/2018

Cyclostationary Statistical Models and Algorithms for Anomaly Detection Using Multi-Modal Data

A framework is proposed to detect anomalies in multi-modal data. A deep ...
research
08/11/2019

SpecAE: Spectral AutoEncoder for Anomaly Detection in Attributed Networks

Anomaly detection aims to distinguish observations that are rare and dif...
research
03/25/2022

Multi-modal Misinformation Detection: Approaches, Challenges and Opportunities

As social media platforms are evolving from text-based forums into multi...
research
06/03/2023

Inconsistent Matters: A Knowledge-guided Dual-consistency Network for Multi-modal Rumor Detection

Rumor spreaders are increasingly utilizing multimedia content to attract...
research
06/22/2022

Heterogeneous Anomaly Detection for Software Systems via Attentive Multi-modal Learning

Prompt and accurate detection of system anomalies is essential to ensure...
research
10/04/2022

Multiple Instance Learning for Detecting Anomalies over Sequential Real-World Datasets

Detecting anomalies over real-world datasets remains a challenging task....
research
07/27/2019

Many could be better than all: A novel instance-oriented algorithm for Multi-modal Multi-label problem

With the emergence of diverse data collection techniques, objects in rea...

Please sign up or login with your details

Forgot password? Click here to reset