Deep Lesion Tracker: Monitoring Lesions in 4D Longitudinal Imaging Studies

by   Jinzheng Cai, et al.

Monitoring treatment response in longitudinal studies plays an important role in clinical practice. Accurately identifying lesions across serial imaging follow-up is the core to the monitoring procedure. Typically this incorporates both image and anatomical considerations. However, matching lesions manually is labor-intensive and time-consuming. In this work, we present deep lesion tracker (DLT), a deep learning approach that uses both appearance- and anatomical-based signals. To incorporate anatomical constraints, we propose an anatomical signal encoder, which prevents lesions being matched with visually similar but spurious regions. In addition, we present a new formulation for Siamese networks that avoids the heavy computational loads of 3D cross-correlation. To present our network with greater varieties of images, we also propose a self-supervised learning (SSL) strategy to train trackers with unpaired images, overcoming barriers to data collection. To train and evaluate our tracker, we introduce and release the first lesion tracking benchmark, consisting of 3891 lesion pairs from the public DeepLesion database. The proposed method, DLT, locates lesion centers with a mean error distance of 7 mm. This is 5 times faster on whole CT volumes. We demonstrate even greater improvements over detector or similarity-learning alternatives. DLT also generalizes well on an external clinical test set of 100 longitudinal studies, achieving 88 Finally, we plug DLT into an automatic tumor monitoring workflow where it leads to an accuracy of 85 0.46


page 1

page 4

page 7

page 13

page 14

page 15

page 16

page 17


Transformer Lesion Tracker

Evaluating lesion progression and treatment response via longitudinal le...

Self-supervised Lesion Change Detection and Localisation in Longitudinal Multiple Sclerosis Brain Imaging

Longitudinal imaging forms an essential component in the management and ...

Deep Volumetric Universal Lesion Detection using Light-Weight Pseudo 3D Convolution and Surface Point Regression

Identifying, measuring and reporting lesions accurately and comprehensiv...

Detection and Longitudinal Tracking of Pigmented Skin Lesions in 3D Total-Body Skin Textured Meshes

We present an automated approach to detect and longitudinally track skin...

End-to-End Discriminative Deep Network for Liver Lesion Classification

Colorectal liver metastasis is one of most aggressive liver malignancies...

Harvesting, Detecting, and Characterizing Liver Lesions from Large-scale Multi-phase CT Data via Deep Dynamic Texture Learning

Effective and non-invasive radiological imaging based tumor/lesion chara...

Code Repositories