DeepAI AI Chat
Log In Sign Up

A Modality-level Explainable Framework for Misinformation Checking in Social Networks

by   Vítor Lourenço, et al.
Universidade Federal Fluminense

The widespread of false information is a rising concern worldwide with critical social impact, inspiring the emergence of fact-checking organizations to mitigate misinformation dissemination. However, human-driven verification leads to a time-consuming task and a bottleneck to have checked trustworthy information at the same pace they emerge. Since misinformation relates not only to the content itself but also to other social features, this paper addresses automatic misinformation checking in social networks from a multimodal perspective. Moreover, as simply naming a piece of news as incorrect may not convince the citizen and, even worse, strengthen confirmation bias, the proposal is a modality-level explainable-prone misinformation classifier framework. Our framework comprises a misinformation classifier assisted by explainable methods to generate modality-oriented explainable inferences. Preliminary findings show that the misinformation classifier does benefit from multimodal information encoding and the modality-oriented explainable mechanism increases both inferences' interpretability and completeness.


Explainable Fact-checking through Question Answering

Misleading or false information has been creating chaos in some places a...

That is a Known Lie: Detecting Previously Fact-Checked Claims

The recent proliferation of "fake news" has triggered a number of respon...

QuTI! Quantifying Text-Image Consistency in Multimodal Documents

The World Wide Web and social media platforms have become popular source...

MONITOR: A Multimodal Fusion Framework to Assess Message Veracity in Social Networks

Users of social networks tend to post and share content with little rest...

Balanced Audiovisual Dataset for Imbalance Analysis

The imbalance problem is widespread in the field of machine learning, wh...

Multimodal Shannon Game with Images

The Shannon game has long been used as a thought experiment in linguisti...