Enhancing PIO Element Detection in Medical Text Using Contextualized Embedding

06/26/2019
by   Hichem Mezaoui, et al.
0

In this paper, we investigate a new approach to Population, Intervention and Outcome (PIO) element detection, a common task in Evidence Based Medicine (EBM). The purpose of this study is two-fold: to build a training dataset for PIO element detection with minimum redundancy and ambiguity and to investigate possible options in utilizing state of the art embedding methods for the task of PIO element detection. For the former purpose, we build a new and improved dataset by investigating the shortcomings of previously released datasets. For the latter purpose, we leverage the state of the art text embedding, Bidirectional Encoder Representations from Transformers (BERT), and build a multi-label classifier. We show that choosing a domain specific pre-trained embedding further optimizes the performance of the classifier. Furthermore, we show that the model could be enhanced by using ensemble methods and boosting techniques provided that features are adequately chosen.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/13/2020

BoostingBERT:Integrating Multi-Class Boosting into BERT for NLP Tasks

As a pre-trained Transformer model, BERT (Bidirectional Encoder Represen...
research
10/30/2018

Advancing PICO Element Detection in Medical Text via Deep Neural Networks

In evidence-based medicine (EBM), structured medical questions are alway...
research
08/06/2021

Offensive Language and Hate Speech Detection with Deep Learning and Transfer Learning

Toxic online speech has become a crucial problem nowadays due to an expo...
research
01/12/2021

Neural Contract Element Extraction Revisited

We investigate contract element extraction. We show that LSTM-based enco...
research
03/17/2020

Author2Vec: A Framework for Generating User Embedding

Online forums and social media platforms provide noisy but valuable data...

Please sign up or login with your details

Forgot password? Click here to reset