Radiomics-enhanced Deep Multi-task Learning for Outcome Prediction in Head and Neck Cancer

11/10/2022
by   Mingyuan Meng, et al.
0

Outcome prediction is crucial for head and neck cancer patients as it can provide prognostic information for early treatment planning. Radiomics methods have been widely used for outcome prediction from medical images. However, these methods are limited by their reliance on intractable manual segmentation of tumor regions. Recently, deep learning methods have been proposed to perform end-to-end outcome prediction so as to remove the reliance on manual segmentation. Unfortunately, without segmentation masks, these methods will take the whole image as input, such that makes them difficult to focus on tumor regions and potentially unable to fully leverage the prognostic information within the tumor regions. In this study, we propose a radiomics-enhanced deep multi-task framework for outcome prediction from PET/CT images, in the context of HEad and neCK TumOR segmentation and outcome prediction challenge (HECKTOR 2022). In our framework, our novelty is to incorporate radiomics as an enhancement to our recently proposed Deep Multi-task Survival model (DeepMTS). The DeepMTS jointly learns to predict the survival risk scores of patients and the segmentation masks of tumor regions. Radiomics features are extracted from the predicted tumor regions and combined with the predicted survival risk scores for final outcome prediction, through which the prognostic information in tumor regions can be further leveraged. Our method achieved a C-index of 0.681 on the testing set, placing the 2nd on the leaderboard with only 0.00068 lower in C-index than the 1st place.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/17/2023

DeepMSS: Deep Multi-Modality Segmentation-to-Survival Learning for Survival Outcome Prediction from PET/CT Images

Survival prediction is a major concern for cancer management. Deep survi...
research
07/07/2023

Merging-Diverging Hybrid Transformer Networks for Survival Prediction in Head and Neck Cancer

Survival prediction is crucial for cancer patients as it provides early ...
research
08/01/2023

Improved Prognostic Prediction of Pancreatic Cancer Using Multi-Phase CT by Integrating Neural Distance and Texture-Aware Transformer

Pancreatic ductal adenocarcinoma (PDAC) is a highly lethal cancer in whi...
research
09/12/2022

TMSS: An End-to-End Transformer-based Multimodal Network for Segmentation and Survival Prediction

When oncologists estimate cancer patient survival, they rely on multimod...
research
04/17/2023

Towards Tumour Graph Learning for Survival Prediction in Head Neck Cancer Patients

With nearly one million new cases diagnosed worldwide in 2020, head & ne...
research
03/01/2022

Multi-Task Multi-Scale Learning For Outcome Prediction in 3D PET Images

Background and Objectives: Predicting patient response to treatment and ...
research
10/29/2022

Multi-Scale Fusion Methodologies for Head and Neck Tumor Segmentation

Head and Neck (H&N) organ-at-risk (OAR) and tumor segmentations are esse...

Please sign up or login with your details

Forgot password? Click here to reset