ETMA: Efficient Transformer Based Multilevel Attention framework for Multimodal Fake News Detection

by   Ashima Yadav, et al.

In this new digital era, social media has created a severe impact on the lives of people. In recent times, fake news content on social media has become one of the major challenging problems for society. The dissemination of fabricated and false news articles includes multimodal data in the form of text and images. The previous methods have mainly focused on unimodal analysis. Moreover, for multimodal analysis, researchers fail to keep the unique characteristics corresponding to each modality. This paper aims to overcome these limitations by proposing an Efficient Transformer based Multilevel Attention (ETMA) framework for multimodal fake news detection, which comprises the following components: visual attention-based encoder, textual attention-based encoder, and joint attention-based learning. Each component utilizes the different forms of attention mechanism and uniquely deals with multimodal data to detect fraudulent content. The efficacy of the proposed network is validated by conducting several experiments on four real-world fake news datasets: Twitter, Jruvika Fake News Dataset, Pontes Fake News Dataset, and Risdal Fake News Dataset using multiple evaluation metrics. The results show that the proposed method outperforms the baseline methods on all four datasets. Further, the computation time of the model is also lower than the state-of-the-art methods.


page 2

page 6

page 14

page 17


Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection

Fake news detection is an important task for increasing the credibility ...

On the Role of Images for Analyzing Claims in Social Media

Fake news is a severe problem in social media. In this paper, we present...

GAME-ON: Graph Attention Network based Multimodal Fusion for Fake News Detection

Social media in present times has a significant and growing influence. F...

SEMI-FND: Stacked Ensemble Based Multimodal Inference For Faster Fake News Detection

Fake News Detection (FND) is an essential field in natural language proc...

Multimodal Fake News Detection

Over the last years, there has been an unprecedented proliferation of fa...

Improving Generalization for Multimodal Fake News Detection

The increasing proliferation of misinformation and its alarming impact h...

The Surprising Performance of Simple Baselines for Misinformation Detection

As social media becomes increasingly prominent in our day to day lives, ...

Please sign up or login with your details

Forgot password? Click here to reset