TweepFake: about Detecting Deepfake Tweets

07/31/2020
by   Tiziano Fagni, et al.
0

The threat of deepfakes, synthetic, or manipulated media, is becoming increasingly alarming, especially for social media platforms that have already been accused of manipulating public opinion. Even the cheapest text generation techniques (e.g. the search-and-replace method) can deceive humans, as the Net Neutrality scandal proved in 2017. Meanwhile, more powerful generative models have been released, from RNN-based methods to the GPT-2 language model. State-of-the-art language models, transformer-based in particular, can generate synthetic text in response to the model being primed with arbitrary input. Thus, Therefore, it is crucial to develop tools that help to detect media authenticity. To help the research in this field, we collected a dataset of real Deepfake tweets. It is real in the sense that each deepfake tweet was actually posted on Twitter. We collected tweets from a total of 23 bots, imitating 17 human accounts. The bots are based on various generation techniques, i.e., Markov Chains, RNN, RNN+Markov, LSTM, GPT-2. We also randomly selected tweets from the humans imitated by the bots to have an overall balanced dataset of 25,836 tweets (half human and half bots generated). The dataset is publicly available on Kaggle. In order to create a solid baseline for detection techniques on the proposed dataset we tested 13 detection methods based on various state-of-the-art approaches. The detection results reported as a baseline using 13 detection methods, confirm that the newest and more sophisticated generative methods based on transformer architecture (e.g., GPT-2) can produce high-quality short texts, difficult to detect.

READ FULL TEXT

page 8

page 12

page 18

page 19

research
01/22/2021

BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets

During the last two decades, we have progressively turned to the Interne...
research
04/09/2021

WLV-RIT at SemEval-2021 Task 5: A Neural Transformer Framework for Detecting Toxic Spans

In recent years, the widespread use of social media has led to an increa...
research
11/29/2022

How Many Tweets DoWe Need?: Efficient Mining of Short-Term Polarized Topics on Twitter: A Case Study From Japan

In recent years, social media has been criticized for yielding polarizat...
research
01/13/2018

Detecting Offensive Language in Tweets Using Deep Learning

This paper addresses the important problem of discerning hateful content...
research
10/13/2022

Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methods

Advances in natural language generation (NLG) have resulted in machine g...
research
05/30/2018

An English-Hindi Code-Mixed Corpus: Stance Annotation and Baseline System

Social media has become one of the main channels for peo- ple to communi...
research
05/30/2022

Rites de Passage: Elucidating Displacement to Emplacement of Refugees on Twitter

Social media deliberations allow to explore refugee-related is-sues. AI-...

Please sign up or login with your details

Forgot password? Click here to reset