Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning

07/01/2020
by   Mason T. Chen, et al.
0

Spatial frequency domain imaging (SFDI) is a powerful technique for mapping tissue oxygen saturation over a wide field of view. However, current SFDI methods either require a sequence of several images with different illumination patterns or, in the case of single snapshot optical properties (SSOP), introduce artifacts and sacrifice accuracy. To avoid this tradeoff, we introduce OxyGAN: a data-driven, content-aware method to estimate tissue oxygenation directly from single structured light images using end-to-end generative adversarial networks. Conventional SFDI is used to obtain ground truth tissue oxygenation maps for ex vivo human esophagi, in vivo hands and feet, and an in vivo pig colon sample under 659 nm and 851 nm sinusoidal illumination. We benchmark OxyGAN by comparing to SSOP and to a two-step hybrid technique that uses a previously-developed deep learning model to predict optical properties followed by a physical model to calculate tissue oxygenation. When tested on human feet, a cross-validated OxyGAN maps tissue oxygenation with an accuracy of 96.5 included in the training set, such as human hands and pig colon, OxyGAN achieves a 93.0 average, OxyGAN outperforms SSOP and a hybrid model in estimating tissue oxygenation by 24.9 inference so that oxygenation maps are computed  10 times faster than previous work, enabling video-rate, 25Hz imaging. Due to its rapid acquisition and processing speed, OxyGAN has the potential to enable real-time, high-fidelity tissue oxygenation mapping that may be useful for many clinical applications.

READ FULL TEXT

page 5

page 8

page 10

page 11

research
06/12/2019

GANPOP: Generative Adversarial Network Prediction of Optical Properties from Single Snapshot Wide-field Images

We present a deep learning framework for wide-field, content-aware estim...
research
06/01/2023

Label- and slide-free tissue histology using 3D epi-mode quantitative phase imaging and virtual H E staining

Histological staining of tissue biopsies, especially hematoxylin and eos...
research
05/01/2019

Estimation of Tissue Oxygen Saturation from RGB images and Sparse Hyperspectral Signals based on Conditional Generative Adversarial Network

Purpose: Intra-operative measurement of tissue oxygen saturation (StO2) ...
research
07/23/2018

Deep Learning from Label Proportions for Emphysema Quantification

We propose an end-to-end deep learning method that learns to estimate em...
research
02/01/2019

SCATGAN for Reconstruction of Ultrasound Scatterers Using Generative Adversarial Networks

Computational simulation of ultrasound (US) echography is essential for ...
research
06/15/2016

Probe-based Rapid Hybrid Hyperspectral and Tissue Surface Imaging Aided by Fully Convolutional Networks

Tissue surface shape and reflectance spectra provide rich intra-operativ...
research
06/22/2017

Fast Estimation of Haemoglobin Concentration in Tissue Via Wavelet Decomposition

Tissue oxygenation and perfusion can be an indicator for organ viability...

Please sign up or login with your details

Forgot password? Click here to reset