Weighted Concordance Index Loss-based Multimodal Survival Modeling for Radiation Encephalopathy Assessment in Nasopharyngeal Carcinoma Radiotherapy

06/23/2022
by   Jiansheng Fang, et al.
5

Radiation encephalopathy (REP) is the most common complication for nasopharyngeal carcinoma (NPC) radiotherapy. It is highly desirable to assist clinicians in optimizing the NPC radiotherapy regimen to reduce radiotherapy-induced temporal lobe injury (RTLI) according to the probability of REP onset. To the best of our knowledge, it is the first exploration of predicting radiotherapy-induced REP by jointly exploiting image and non-image data in NPC radiotherapy regimen. We cast REP prediction as a survival analysis task and evaluate the predictive accuracy in terms of the concordance index (CI). We design a deep multimodal survival network (MSN) with two feature extractors to learn discriminative features from multimodal data. One feature extractor imposes feature selection on non-image data, and the other learns visual features from images. Because the priorly balanced CI (BCI) loss function directly maximizing the CI is sensitive to uneven sampling per batch. Hence, we propose a novel weighted CI (WCI) loss function to leverage all REP samples effectively by assigning their different weights with a dual average operation. We further introduce a temperature hyper-parameter for our WCI to sharpen the risk difference of sample pairs to help model convergence. We extensively evaluate our WCI on a private dataset to demonstrate its favourability against its counterparts. The experimental results also show multimodal data of NPC radiotherapy can bring more gains for REP risk prediction.

READ FULL TEXT

page 3

page 4

research
08/29/2018

Image-based Survival Analysis for Lung Cancer Patients using CNNs

Traditional survival models such as the Cox proportional hazards model a...
research
07/22/2023

Pathology-and-genomics Multimodal Transformer for Survival Outcome Prediction

Survival outcome assessment is challenging and inherently associated wit...
research
06/12/2021

DeepMMSA: A Novel Multimodal Deep Learning Method for Non-small Cell Lung Cancer Survival Analysis

Lung cancer is the leading cause of cancer death worldwide. The critical...
research
08/21/2023

Deep Metric Loss for Multimodal Learning

Multimodal learning often outperforms its unimodal counterparts by explo...
research
02/05/2015

A mixture Cox-Logistic model for feature selection from survival and classification data

This paper presents an original approach for jointly fitting survival ti...
research
10/08/2018

Deep learning cardiac motion analysis for human survival prediction

Motion analysis is used in computer vision to understand the behaviour o...

Please sign up or login with your details

Forgot password? Click here to reset