A Survey on Multimodal Disinformation Detection

03/13/2021
by   Firoj Alam, et al.
0

Recent years have witnessed the proliferation of fake news, propaganda, misinformation, and disinformation online. While initially this was mostly about textual content, over time images and videos gained popularity, as they are much easier to consume, attract much more attention, and spread further than simple text. As a result, researchers started targeting different modalities and combinations thereof. As different modalities are studied in different research communities, with insufficient interaction, here we offer a survey that explores the state-of-the-art on multimodal disinformation detection covering various combinations of modalities: text, images, audio, video, network structure, and temporal information. Moreover, while some studies focused on factuality, others investigated how harmful the content is. While these two components in the definition of disinformation – (i) factuality and (ii) harmfulness, are equally important, they are typically studied in isolation. Thus, we argue for the need to tackle disinformation detection by taking into account multiple modalities as well as both factuality and harmfulness, in the same framework. Finally, we discuss current challenges and future research directions.

READ FULL TEXT
research
11/23/2021

A Review of Web Infodemic Analysis and Detection Trends across Multi-modalities using Deep Neural Networks

Fake news and misinformation are a matter of concern for people around t...
research
05/22/2023

Multimodal Automated Fact-Checking: A Survey

Misinformation, i.e. factually incorrect information, is often conveyed ...
research
03/16/2021

A Survey on Predicting the Factuality and the Bias of News Media

The present level of proliferation of fake, biased, and propagandistic c...
research
11/20/2022

FakeSV: A Multimodal Benchmark with Rich Social Context for Fake News Detection on Short Video Platforms

Short video platforms have become an important channel for news sharing,...
research
02/07/2023

Combating Online Misinformation Videos: Characterization, Detection, and Future Directions

With information consumption via online video streaming becoming increas...
research
08/27/2023

AIGC for Various Data Modalities: A Survey

AI-generated content (AIGC) methods aim to produce text, images, videos,...
research
06/08/2022

Words are all you need? Capturing human sensory similarity with textual descriptors

Recent advances in multimodal training use textual descriptions to signi...

Please sign up or login with your details

Forgot password? Click here to reset