Multi-Task Multi-Scale Learning For Outcome Prediction in 3D PET Images

by   Amine Amyar, et al.

Background and Objectives: Predicting patient response to treatment and survival in oncology is a prominent way towards precision medicine. To that end, radiomics was proposed as a field of study where images are used instead of invasive methods. The first step in radiomic analysis is the segmentation of the lesion. However, this task is time consuming and can be physician subjective. Automated tools based on supervised deep learning have made great progress to assist physicians. However, they are data hungry, and annotated data remains a major issue in the medical field where only a small subset of annotated images is available. Methods: In this work, we propose a multi-task learning framework to predict patient's survival and response. We show that the encoder can leverage multiple tasks to extract meaningful and powerful features that improve radiomics performance. We show also that subsidiary tasks serve as an inductive bias so that the model can better generalize. Results: Our model was tested and validated for treatment response and survival in lung and esophageal cancers, with an area under the ROC curve of 77 respectively, outperforming single task learning methods. Conclusions: We show that, by using a multi-task learning approach, we can boost the performance of radiomic analysis by extracting rich information of intratumoral and peritumoral regions.


page 2

page 3

page 4

page 6

page 9

page 11


Deep Learning for Patient-Specific Kidney Graft Survival Analysis

An accurate model of patient-specific kidney graft survival distribution...

Label-Efficient Multi-Task Segmentation using Contrastive Learning

Obtaining annotations for 3D medical images is expensive and time-consum...

Radiomics-enhanced Deep Multi-task Learning for Outcome Prediction in Head and Neck Cancer

Outcome prediction is crucial for head and neck cancer patients as it ca...

OmiEmbed: reconstruct comprehensive phenotypic information from multi-omics data using multi-task deep learning

High-dimensional omics data contains intrinsic biomedical information th...

Advance Prediction of Ventricular Tachyarrhythmias using Patient Metadata and Multi-Task Networks

We describe a novel neural network architecture for the prediction of ve...

SurvTRACE: Transformers for Survival Analysis with Competing Events

In medicine, survival analysis studies the time duration to events of in...

Predicting Adverse Neonatal Outcomes for Preterm Neonates with Multi-Task Learning

Diagnosis of adverse neonatal outcomes is crucial for preterm survival s...

Please sign up or login with your details

Forgot password? Click here to reset