Dartmouth CS at WNUT-2020 Task 2: Informative COVID-19 Tweet Classification Using BERT

12/07/2020
by   Dylan Whang, et al.
0

We describe the systems developed for the WNUT-2020 shared task 2, identification of informative COVID-19 English Tweets. BERT is a highly performant model for Natural Language Processing tasks. We increased BERT's performance in this classification task by fine-tuning BERT and concatenating its embeddings with Tweet-specific features and training a Support Vector Machine (SVM) for classification (henceforth called BERT+). We compared its performance to a suite of machine learning models. We used a Twitter specific data cleaning pipeline and word-level TF-IDF to extract features for the non-BERT models. BERT+ was the top performing model with an F1-score of 0.8713.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/07/2020

UIT-HSE at WNUT-2020 Task 2: Exploiting CT-BERT for Identifying COVID-19 Information on the Twitter Social Network

Recently, COVID-19 has affected a variety of real-life aspects of the wo...
research
10/28/2022

Feature Engineering vs BERT on Twitter Data

In this paper, we compare the performances of traditional machine learni...
research
09/18/2019

Enriching BERT with Knowledge Graph Embeddings for Document Classification

In this paper, we focus on the classification of books using short descr...
research
05/15/2020

COVID-Twitter-BERT: A Natural Language Processing Model to Analyse COVID-19 Content on Twitter

In this work, we release COVID-Twitter-BERT (CT-BERT), a transformer-bas...
research
09/07/2021

Naturalness Evaluation of Natural Language Generation in Task-oriented Dialogues using BERT

This paper presents an automatic method to evaluate the naturalness of n...
research
02/20/2023

Boosting classification reliability of NLP transformer models in the long run

Transformer-based machine learning models have become an essential tool ...
research
06/20/2020

Sarcasm Detection in Tweets with BERT and GloVe Embeddings

Sarcasm is a form of communication in whichthe person states opposite of...

Please sign up or login with your details

Forgot password? Click here to reset