Spatio-spectral deep learning methods for in-vivo hyperspectral laryngeal cancer detection

04/21/2020
by   Marcel Bengs, et al.
0

Early detection of head and neck tumors is crucial for patient survival. Often, diagnoses are made based on endoscopic examination of the larynx followed by biopsy and histological analysis, leading to a high inter-observer variability due to subjective assessment. In this regard, early non-invasive diagnostics independent of the clinician would be a valuable tool. A recent study has shown that hyperspectral imaging (HSI) can be used for non-invasive detection of head and neck tumors, as precancerous or cancerous lesions show specific spectral signatures that distinguish them from healthy tissue. However, HSI data processing is challenging due to high spectral variations, various image interferences, and the high dimensionality of the data. Therefore, performance of automatic HSI analysis has been limited and so far, mostly ex-vivo studies have been presented with deep learning. In this work, we analyze deep learning techniques for in-vivo hyperspectral laryngeal cancer detection. For this purpose we design and evaluate convolutional neural networks (CNNs) with 2D spatial or 3D spatio-spectral convolutions combined with a state-of-the-art Densenet architecture. For evaluation, we use an in-vivo data set with HSI of the oral cavity or oropharynx. Overall, we present multiple deep learning techniques for in-vivo laryngeal cancer detection based on HSI and we show that jointly learning from the spatial and spectral domain improves classification accuracy notably. Our 3D spatio-spectral Densenet achieves an average accuracy of 81

READ FULL TEXT
research
07/02/2020

Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification

Early detection of cancerous tissue is crucial for long-term patient sur...
research
12/01/2016

BASS Net: Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification

Deep learning based landcover classification algorithms have recently be...
research
12/25/2022

Deep Cost-sensitive Learning for Wheat Frost Detection

Frost damage is one of the main factors leading to wheat yield reduction...
research
04/26/2023

Deep Learning Techniques for Hyperspectral Image Analysis in Agriculture: A Review

In the recent years, hyperspectral imaging (HSI) has gained considerably...
research
02/10/2019

Towards Automatic Lesion Classification in the Upper Aerodigestive Tract Using OCT and Deep Transfer Learning Methods

Early detection of cancer is crucial for treatment and overall patient s...
research
06/03/2015

Hyperspectral Image Classification and Clutter Detection via Multiple Structural Embeddings and Dimension Reductions

We present a new and effective approach for Hyperspectral Image (HSI) cl...
research
07/25/2017

Patch-based Carcinoma Detection on Confocal Laser Endomicroscopy Images - A Cross-Site Robustness Assessment

Deep learning technologies such as convolutional neural networks (CNN) p...

Please sign up or login with your details

Forgot password? Click here to reset