A self-attention based deep learning method for lesion attribute detection from CT reports

04/30/2019
by   Yifan Peng, et al.
0

In radiology, radiologists not only detect lesions from the medical image, but also describe them with various attributes such as their type, location, size, shape, and intensity. While these lesion attributes are rich and useful in many downstream clinical applications, how to extract them from the radiology reports is less studied. This paper outlines a novel deep learning method to automatically extract attributes of lesions of interest from the clinical text. Different from classical CNN models, we integrated the multi-head self-attention mechanism to handle the long-distance information in the sentence, and to jointly correlate different portions of sentence representation subspaces in parallel. Evaluation on an in-house corpus demonstrates that our method can achieve high performance with 0.848 in precision, 0.788 in recall, and 0.815 in F-score. The new method and constructed corpus will enable us to build automatic systems with a higher-level understanding of the radiological world.

READ FULL TEXT
research
05/15/2021

Can self-training identify suspicious ugly duckling lesions?

One commonly used clinical approach towards detecting melanomas recognis...
research
04/09/2019

Holistic and Comprehensive Annotation of Clinically Significant Findings on Diverse CT Images: Learning from Radiology Reports and Label Ontology

In radiologists' routine work, one major task is to read a medical image...
research
10/05/2019

A Deep Learning System That Generates Quantitative CT Reports for Diagnosing Pulmonary Tuberculosis

We developed a deep learning model-based system to automatically generat...
research
03/14/2022

DKMA-ULD: Domain Knowledge augmented Multi-head Attention based Robust Universal Lesion Detection

Incorporating data-specific domain knowledge in deep networks explicitly...
research
03/04/2019

Fine-grained lesion annotation in CT images with knowledge mined from radiology reports

In radiologists' routine work, one major task is to read a medical image...
research
08/21/2021

Multimodal Breast Lesion Classification Using Cross-Attention Deep Networks

Accurate breast lesion risk estimation can significantly reduce unnecess...

Please sign up or login with your details

Forgot password? Click here to reset