Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English

01/07/2021
by   Xiangyang Li, et al.
0

In this paper, we describe our system for the AAAI 2021 shared task of COVID-19 Fake News Detection in English, where we achieved the 3rd position with the weighted F1 score of 0.9859 on the test set. Specifically, we proposed an ensemble method of different pre-trained language models such as BERT, Roberta, Ernie, etc. with various training strategies including warm-up,learning rate schedule and k-fold cross-validation. We also conduct an extensive analysis of the samples that are not correctly classified. The code is available at:https://github.com/archersama/3rd-solution-COVID19-Fake-News-Detection-in-English.

READ FULL TEXT
research
01/01/2021

Transformer based Automatic COVID-19 Fake News Detection System

Recent rapid technological advancements in online social networks such a...
research
01/11/2021

Identification of COVID-19 related Fake News via Neural Stacking

Identification of Fake News plays a prominent role in the ongoing pandem...
research
07/17/2019

Fake News Detection as Natural Language Inference

This report describes the entry by the Intelligent Knowledge Management ...
research
10/13/2021

Fake News Detection in Spanish Using Deep Learning Techniques

This paper addresses the problem of fake news detection in Spanish using...
research
01/13/2021

LaDiff ULMFiT: A Layer Differentiated training approach for ULMFiT

In our paper, we present Deep Learning models with a layer differentiate...
research
01/12/2021

Fake News Detection System using XLNet model with Topic Distributions: CONSTRAINT@AAAI2021 Shared Task

With the ease of access to information, and its rapid dissemination over...

Please sign up or login with your details

Forgot password? Click here to reset