View Distillation with Unlabeled Data for Extracting Adverse Drug Effects from User-Generated Data

by   Payam Karisani, et al.

We present an algorithm based on multi-layer transformers for identifying Adverse Drug Reactions (ADR) in social media data. Our model relies on the properties of the problem and the characteristics of contextual word embeddings to extract two views from documents. Then a classifier is trained on each view to label a set of unlabeled documents to be used as an initializer for a new classifier in the other view. Finally, the initialized classifier in each view is further trained using the initial training examples. We evaluated our model in the largest publicly available ADR dataset. The experiments testify that our model significantly outperforms the transformer-based models pretrained on domain-specific data.


page 1

page 2

page 3

page 4


Extracting adverse drug reactions and their context using sequence labelling ensembles in TAC2017

Adverse drug reactions (ADRs) are unwanted or harmful effects experience...

Detecting Adverse Drug Reactions from Twitter through Domain-Specific Preprocessing and BERT Ensembling

The automation of adverse drug reaction (ADR) detection in social media ...

Cross-lingual Approaches for the Detection of Adverse Drug Reactions in German from a Patient's Perspective

In this work, we present the first corpus for German Adverse Drug Reacti...

NRC-Canada at SMM4H Shared Task: Classifying Tweets Mentioning Adverse Drug Reactions and Medication Intake

Our team, NRC-Canada, participated in two shared tasks at the AMIA-2017 ...

NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations

Adverse Drug Event (ADE) extraction models can rapidly examine large col...

Attention-Gated Graph Convolutions for Extracting Drug Interaction Information from Drug Labels

Preventable adverse events as a result of medical errors present a growi...

Attention-Gated Graph Convolution for Extracting Drugs and Their Interactions from Drug Labels

Preventable adverse events as a result of medical errors present a growi...