An Empirical Study of UMLS Concept Extraction from Clinical Notes using Boolean Combination Ensembles

08/04/2021
by   Greg M. Silverman, et al.
0

Our objective in this study is to investigate the behavior of Boolean operators on combining annotation output from multiple Natural Language Processing (NLP) systems across multiple corpora and to assess how filtering by aggregation of Unified Medical Language System (UMLS) Metathesaurus concepts affects system performance for Named Entity Recognition (NER) of UMLS concepts. We used three corpora annotated for UMLS concepts: 2010 i2b2 VA challenge set (31,161 annotations), Multi-source Integrated Platform for Answering Clinical Questions (MiPACQ) corpus (17,457 annotations including UMLS concept unique identifiers), and Fairview Health Services corpus (44,530 annotations). Our results showed that for UMLS concept matching, Boolean ensembling of the MiPACQ corpus trended towards higher performance over individual systems. Use of an approximate grid-search can help optimize the precision-recall tradeoff and can provide a set of heuristics for choosing an optimal set of ensembles.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

page 12

05/27/2020

Establishing a New State-of-the-Art for French Named Entity Recognition

The French TreeBank developed at the University Paris 7 is the main sour...
12/12/2019

Extracting clinical concepts from user queries

Clinical concept extraction often begins with clinical Named Entity Reco...
06/07/2018

Embedding Transfer for Low-Resource Medical Named Entity Recognition: A Case Study on Patient Mobility

Functioning is gaining recognition as an important indicator of global h...
05/22/2020

Concept Annotation for Intelligent Textbooks

With the increased popularity of electronic textbooks, there is a growin...
01/01/2021

De-identifying Hospital Discharge Summaries: An End-to-End Framework using Ensemble of De-Identifiers

Objective:Electronic Medical Records (EMRs) contain clinical narrative t...
05/22/2020

Knowledge Annotation for Intelligent Textbooks

With the increased popularity of electronic textbooks, there is a growin...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.