Concept Extraction to Identify Adverse Drug Reactions in Medical Forums: A Comparison of Algorithms

04/27/2015
by   Alejandro Metke-Jimenez, et al.
0

Social media is becoming an increasingly important source of information to complement traditional pharmacovigilance methods. In order to identify signals of potential adverse drug reactions, it is necessary to first identify medical concepts in the social media text. Most of the existing studies use dictionary-based methods which are not evaluated independently from the overall signal detection task. We compare different approaches to automatically identify and normalise medical concepts in consumer reviews in medical forums. Specifically, we implement several dictionary-based methods popular in the relevant literature, as well as a method we suggest based on a state-of-the-art machine learning method for entity recognition. MetaMap, a popular biomedical concept extraction tool, is used as a baseline. Our evaluations were performed in a controlled setting on a common corpus which is a collection of medical forum posts annotated with concepts and linked to controlled vocabularies such as MedDRA and SNOMED CT. To our knowledge, our study is the first to systematically examine the effect of popular concept extraction methods in the area of signal detection for adverse reactions. We show that the choice of algorithm or controlled vocabulary has a significant impact on concept extraction, which will impact the overall signal detection process. We also show that our proposed machine learning approach significantly outperforms all the other methods in identification of both adverse reactions and drugs, even when trained with a relatively small set of annotated text.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/25/2023

Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection

Adverse drug events (ADEs) are an important aspect of drug safety. Vario...
research
05/19/2021

Improving Adverse Drug Event Extraction with SpanBERT on Different Text Typologies

In recent years, Internet users are reporting Adverse Drug Events (ADE) ...
research
09/05/2023

Incorporating Dictionaries into a Neural Network Architecture to Extract COVID-19 Medical Concepts From Social Media

We investigate the potential benefit of incorporating dictionary informa...
research
05/23/2020

From Witch's Shot to Music Making Bones – Resources for Medical Laymen to Technical Language and Vice Versa

Many people share information in social media or forums, like food they ...
research
09/17/2020

PhenoTagger: A Hybrid Method for Phenotype Concept Recognition using Human Phenotype Ontology

Automatic phenotype concept recognition from unstructured text remains a...
research
08/07/2020

Retrofitting Vector Representations of Adverse Event Reporting Data to Structured Knowledge to Improve Pharmacovigilance Signal Detection

Adverse drug events (ADE) are prevalent and costly. Clinical trials are ...
research
08/15/2023

DS4DH at #SMM4H 2023: Zero-Shot Adverse Drug Events Normalization using Sentence Transformers and Reciprocal-Rank Fusion

This paper outlines the performance evaluation of a system for adverse d...

Please sign up or login with your details

Forgot password? Click here to reset