DeepAI
Log In Sign Up

Transformer Lesion Tracker

06/13/2022
by   Wen Tang, et al.
0

Evaluating lesion progression and treatment response via longitudinal lesion tracking plays a critical role in clinical practice. Automated approaches for this task are motivated by prohibitive labor costs and time consumption when lesion matching is done manually. Previous methods typically lack the integration of local and global information. In this work, we propose a transformer-based approach, termed Transformer Lesion Tracker (TLT). Specifically, we design a Cross Attention-based Transformer (CAT) to capture and combine both global and local information to enhance feature extraction. We also develop a Registration-based Anatomical Attention Module (RAAM) to introduce anatomical information to CAT so that it can focus on useful feature knowledge. A Sparse Selection Strategy (SSS) is presented for selecting features and reducing memory footprint in Transformer training. In addition, we use a global regression to further improve model performance. We conduct experiments on a public dataset to show the superiority of our method and find that our model performance has improved the average Euclidean center error by at least 14.3 available at https://github.com/TangWen920812/TLT.

READ FULL TEXT
12/09/2020

Deep Lesion Tracker: Monitoring Lesions in 4D Longitudinal Imaging Studies

Monitoring treatment response in longitudinal studies plays an important...
03/29/2021

Transformer Tracking

Correlation acts as a critical role in the tracking field, especially in...
12/02/2021

SwinTrack: A Simple and Strong Baseline for Transformer Tracking

Transformer has recently demonstrated clear potential in improving visua...
03/25/2022

High-Performance Transformer Tracking

Correlation has a critical role in the tracking field, especially in rec...
01/12/2023

Lesion-aware Dynamic Kernel for Polyp Segmentation

Automatic and accurate polyp segmentation plays an essential role in ear...
01/26/2022

RTNet: Relation Transformer Network for Diabetic Retinopathy Multi-lesion Segmentation

Automatic diabetic retinopathy (DR) lesions segmentation makes great sen...