BERT based Transformers lead the way in Extraction of Health Information from Social Media

by   Sidharth R, et al.

This paper describes our submissions for the Social Media Mining for Health (SMM4H)2021 shared tasks. We participated in 2 tasks:(1) Classification, extraction and normalization of adverse drug effect (ADE) mentions in English tweets (Task-1) and (2) Classification of COVID-19 tweets containing symptoms(Task-6). Our approach for the first task uses the language representation model RoBERTa with a binary classification head. For the second task, we use BERTweet, based on RoBERTa. Fine-tuning is performed on the pre-trained models for both tasks. The models are placed on top of a custom domain-specific processing pipeline. Our system ranked first among all the submissions for subtask-1(a) with an F1-score of 61 system obtained an F1-score of 50 score averaged across all submissions. The BERTweet model achieved an F1 score of 94


Want to Identify, Extract and Normalize Adverse Drug Reactions in Tweets? Use RoBERTa

This paper presents our approach for task 2 and task 3 of Social Media M...

Task Adaptive Pretraining of Transformers for Hostility Detection

Identifying adverse and hostile content on the web and more particularly...

Fine-tuning of Pre-trained Transformers for Hate, Offensive, and Profane Content Detection in English and Marathi

This paper describes neural models developed for the Hate Speech and Off...

UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using BERT and SVMs

This paper describes the UM-IU@LING's system for the SemEval 2019 Task 6...

Automatic Extraction of Medication Names in Tweets as Named Entity Recognition

Social media posts contain potentially valuable information about medica...

Fine-Tuning Transformers for Identifying Self-Reporting Potential Cases and Symptoms of COVID-19 in Tweets

We describe our straight-forward approach for Tasks 5 and 6 of 2021 Soci...

Detecting Adverse Drug Reactions from Twitter through Domain-Specific Preprocessing and BERT Ensembling

The automation of adverse drug reaction (ADR) detection in social media ...

Please sign up or login with your details

Forgot password? Click here to reset