MVP-Net: Multi-view FPN with Position-aware Attention for Deep Universal Lesion Detection

09/10/2019
by   Zihao Li, et al.
4

Universal lesion detection (ULD) on computed tomography (CT) images is an important but underdeveloped problem. Recently, deep learning-based approaches have been proposed for ULD, aiming to learn representative features from annotated CT data. However, the hunger for data of deep learning models and the scarcity of medical annotation hinders these approaches to advance further. In this paper, we propose to incorporate domain knowledge in clinical practice into the model design of universal lesion detectors. Specifically, as radiologists tend to inspect multiple windows for an accurate diagnosis, we explicitly model this process and propose a multi-view feature pyramid network (FPN), where multi-view features are extracted from images rendered with varied window widths and window levels; to effectively combine this multi-view information, we further propose a position-aware attention module. With the proposed model design, the data-hunger problem is relieved as the learning task is made easier with the correctly induced clinical practice prior. We show promising results with the proposed model, achieving an absolute gain of 5.65% (in the sensitivity of FPs@4.0) over the previous state-of-the-art on the NIH DeepLesion dataset.

READ FULL TEXT

page 2

page 3

page 8

research
03/14/2022

DKMA-ULD: Domain Knowledge augmented Multi-head Attention based Robust Universal Lesion Detection

Incorporating data-specific domain knowledge in deep networks explicitly...
research
06/26/2023

Multi-View Attention Learning for Residual Disease Prediction of Ovarian Cancer

In the treatment of ovarian cancer, precise residual disease prediction ...
research
07/20/2019

Direct Quantification for Coronary Artery Stenosis Using Multiview Learning

The quantification of the coronary artery stenosis is of significant cli...
research
12/02/2021

Robust End-to-End Focal Liver Lesion Detection using Unregistered Multiphase Computed Tomography Images

The computer-aided diagnosis of focal liver lesions (FLLs) can help impr...
research
07/19/2021

RECIST-Net: Lesion detection via grouping keypoints on RECIST-based annotation

Universal lesion detection in computed tomography (CT) images is an impo...
research
11/21/2021

Domain Generalization for Mammography Detection via Multi-style and Multi-view Contrastive Learning

Lesion detection is a fundamental problem in the computer-aided diagnosi...
research
10/03/2022

Multi-view information fusion using multi-view variational autoencoders to predict proximal femoral strength

Background and aim: Hip fracture can be devastating. The proximal femora...

Please sign up or login with your details

Forgot password? Click here to reset