Interpretable Rumor Detection in Microblogs by Attending to User Interactions

01/29/2020
by   Ling Min Serena Khoo, et al.
0

We address rumor detection by learning to differentiate between the community's response to real and fake claims in microblogs. Existing state-of-the-art models are based on tree models that model conversational trees. However, in social media, a user posting a reply might be replying to the entire thread rather than to a specific user. We propose a post-level attention model (PLAN) to model long distance interactions between tweets with the multi-head attention mechanism in a transformer network. We investigated variants of this model: (1) a structure aware self-attention model (StA-PLAN) that incorporates tree structure information in the transformer network, and (2) a hierarchical token and post-level attention model (StA-HiTPLAN) that learns a sentence representation with token-level self-attention. To the best of our knowledge, we are the first to evaluate our models on two rumor detection data sets: the PHEME data set as well as the Twitter15 and Twitter16 data sets. We show that our best models outperform current state-of-the-art models for both data sets. Moreover, the attention mechanism allows us to explain rumor detection predictions at both token-level and post-level.

READ FULL TEXT
research
05/02/2020

Synthesizer: Rethinking Self-Attention in Transformer Models

The dot product self-attention is known to be central and indispensable ...
research
09/19/2021

Unified and Multilingual Author Profiling for Detecting Haters

This paper presents a unified user profiling framework to identify hate ...
research
03/08/2022

Measuring the Mixing of Contextual Information in the Transformer

The Transformer architecture aggregates input information through the se...
research
07/02/2022

An End-to-End Set Transformer for User-Level Classification of Depression and Gambling Disorder

This work proposes a transformer architecture for user-level classificat...
research
04/27/2023

Rumor Detection with Hierarchical Representation on Bipartite Adhoc Event Trees

The rapid growth of social media has caused tremendous effects on inform...
research
03/07/2021

Orthogonal Attention: A Cloze-Style Approach to Negation Scope Resolution

Negation Scope Resolution is an extensively researched problem, which is...
research
05/12/2021

Looking at CTR Prediction Again: Is Attention All You Need?

Click-through rate (CTR) prediction is a critical problem in web search,...

Please sign up or login with your details

Forgot password? Click here to reset