Estimation of Tissue Oxygen Saturation from RGB Images based on Pixel-level Image Translation

04/19/2018

∙

Intra-operative measurement of tissue oxygen saturation (StO2) has been widely explored by pulse oximetry or hyperspectral imaging (HSI) to assess the function and viability of tissue. In this paper we propose a pixel- level image-to-image translation approach based on conditional Generative Adversarial Networks (cGAN) to estimate tissue oxygen saturation (StO2) directly from RGB images. The real-time performance and non-reliance on additional hardware, enable a seamless integration of the proposed method into surgical and diagnostic workflows with standard endoscope systems. For validation, RGB images and StO2 ground truth were simulated and estimated from HSI images collected by a liquid crystal tuneable filter (LCTF) endoscope for three tissue types (porcine bowel, lamb uterus and rabbit uterus). The result show that the proposed method can achieve visually identical images with comparable accuracy.

READ FULL TEXT

Estimation of Tissue Oxygen Saturation from RGB Images based on Pixel-level Image Translation

Estimation of Tissue Oxygen Saturation from RGB images and Sparse Hyperspectral Signals based on Conditional Generative Adversarial Network

Restoration of marker occluded hematoxylin and eosin stained whole slide histology images using generative adversarial networks

GAN-based Virtual Re-Staining: A Promising Solution for Whole Slide Image Analysis

ComplexWoundDB: A Database for Automatic Complex Wound Tissue Categorization

Recovering Dense Tissue Multispectral Signal from in vivo RGB Images

Computational Histological Staining and Destaining of Prostate Core Biopsy RGB Images with Generative Adversarial Neural Networks

Deep Learning-based Frozen Section to FFPE Translation

Estimation of Tissue Oxygen Saturation from RGB Images based on Pixel-level Image Translation

Related Research

Estimation of Tissue Oxygen Saturation from RGB images and Sparse Hyperspectral Signals based on Conditional Generative Adversarial Network

Restoration of marker occluded hematoxylin and eosin stained whole slide histology images using generative adversarial networks

GAN-based Virtual Re-Staining: A Promising Solution for Whole Slide Image Analysis

ComplexWoundDB: A Database for Automatic Complex Wound Tissue Categorization

Recovering Dense Tissue Multispectral Signal from in vivo RGB Images

Computational Histological Staining and Destaining of Prostate Core Biopsy RGB Images with Generative Adversarial Neural Networks

Deep Learning-based Frozen Section to FFPE Translation