What does AI see? Deep segmentation networks discover biomarkers for lung cancer survival

03/26/2019
by   Stephen Baek, et al.
14

Non-small-cell lung cancer (NSCLC) represents approximately 80-85 cancer diagnoses and is the leading cause of cancer-related death worldwide. Recent studies indicate that image-based radiomics features from positron emission tomography-computed tomography (PET/CT) images have predictive power on NSCLC outcomes. To this end, easily calculated functional features such as the maximum and the mean of standard uptake value (SUV) and total lesion glycolysis (TLG) are most commonly used for NSCLC prognostication, but their prognostic value remains controversial. Meanwhile, convolutional neural networks (CNN) are rapidly emerging as a new premise for cancer image analysis, with significantly enhanced predictive power compared to other hand-crafted radiomics features. Here we show that CNN trained to perform the tumor segmentation task, with no other information than physician contours, identify a rich set of survival-related image features with remarkable prognostic value. In a retrospective study on 96 NSCLC patients before stereotactic-body radiotherapy (SBRT), we found that the CNN segmentation algorithm (U-Net) trained for tumor segmentation in PET/CT images, contained features having strong correlation with 2- and 5-year overall and disease-specific survivals. The U-net algorithm has not seen any other clinical information (e.g. survival, age, smoking history) than the images and the corresponding tumor contours provided by physicians. Furthermore, through visualization of the U-Net, we also found convincing evidence that the regions of progression appear to match with the regions where the U-Net features identified patterns that predicted higher likelihood of death. We anticipate our findings will be a starting point for more sophisticated non-intrusive patient specific cancer prognosis determination.

READ FULL TEXT

page 1

page 2

page 5

page 6

research
07/29/2020

Multimodal Spatial Attention Module for Targeting Multimodal PET-CT Lung Tumor Segmentation

Multimodal positron emission tomography-computed tomography (PET-CT) is ...
research
12/07/2020

Predicting survival outcomes using topological features of tumor pathology images

Tumor shape and size have been used as important markers for cancer diag...
research
06/18/2018

Assessing robustness of radiomic features by image perturbation

Image features need to be robust against differences in positioning, acq...
research
02/13/2023

Detection and Segmentation of Pancreas using Morphological Snakes and Deep Convolutional Neural Networks

Pancreatic cancer is one of the deadliest types of cancer, with 25 diagn...

Please sign up or login with your details

Forgot password? Click here to reset