Improving Clinical Document Understanding on COVID-19 Research with Spark NLP

12/07/2020
by   Veysel Kocaman, et al.
0

Following the global COVID-19 pandemic, the number of scientific papers studying the virus has grown massively, leading to increased interest in automated literate review. We present a clinical text mining system that improves on previous efforts in three ways. First, it can recognize over 100 different entity types including social determinants of health, anatomy, risk factors, and adverse events in addition to other commonly used clinical and biomedical entities. Second, the text processing pipeline includes assertion status detection, to distinguish between clinical facts that are present, absent, conditional, or about someone other than the patient. Third, the deep learning models used are more accurate than previously available, leveraging an integrated pipeline of state-of-the-art pretrained named entity recognition models, and improving on the previous best performing benchmarks for assertion status detection. We illustrate extracting trends and insights, e.g. most frequent disorders and symptoms, and most common vital signs and EKG findings, from the COVID-19 Open Research Dataset (CORD-19). The system is built using the Spark NLP library which natively supports scaling to use distributed clusters, leveraging GPUs, configurable and reusable NLP pipelines, healthcare specific embeddings, and the ability to train models to support new entity types or human languages with no code changes.

READ FULL TEXT

page 2

page 3

research
07/02/2022

A Biomedical Pipeline to Detect Clinical and Non-Clinical Named Entities

There are a few challenges related to the task of biomedical named entit...
research
11/12/2020

Biomedical Named Entity Recognition at Scale

Named entity recognition (NER) is a widely applicable natural language p...
research
07/29/2020

Biomedical and Clinical English Model Packages in the Stanza Python NLP Library

We introduce biomedical and clinical English model packages for the Stan...
research
12/25/2021

Deeper Clinical Document Understanding Using Relation Extraction

The surging amount of biomedical literature digital clinical records...
research
01/05/2022

Mining Adverse Drug Reactions from Unstructured Mediums at Scale

Adverse drug reactions / events (ADR/ADE) have a major impact on patient...
research
06/22/2022

Evaluation of Embedding Models for Automatic Extraction and Classification of Acknowledged Entities in Scientific Documents

Acknowledgments in scientific papers may give an insight into aspects of...

Please sign up or login with your details

Forgot password? Click here to reset