Can Deep Learning Relax Endomicroscopy Hardware Miniaturization Requirements?

06/21/2018
by   Saeed Izadi, et al.
0

Confocal laser endomicroscopy (CLE) is a novel imaging modality that provides in vivo histological cross-sections of examined tissue. Recently, attempts have been made to develop miniaturized in vivo imaging devices, specifically confocal laser microscopes, for both clinical and research applications. However, current implementations of miniature CLE components, such as confocal lenses, compromise image resolution, signal-to-noise ratio, or both, which negatively impacts the utility of in vivo imaging. In this work, we demonstrate that software-based techniques can be used to recover lost information due to endomicroscopy hardware miniaturization and reconstruct images of higher resolution. Particularly, a densely connected convolutional neural network is used to reconstruct a high-resolution CLE image from a low-resolution input. In the proposed network, each layer is directly connected to all subsequent layers, which results in an effective combination of low-level and high-level features and efficient information flow throughout the network. To train and evaluate our network, we use a dataset of 181 high-resolution CLE images. Both quantitative and qualitative results indicate superiority of the proposed network compared to traditional interpolation techniques and competing learning-based methods. This work demonstrates that software-based super-resolution is a viable approach to compensate for loss of resolution due to endoscopic hardware miniaturization.

READ FULL TEXT

page 6

page 7

research
02/17/2021

SRDTI: Deep learning-based super-resolution for diffusion tensor MRI

High-resolution diffusion tensor imaging (DTI) is beneficial for probing...
research
10/22/2019

Deep learning enabled laser speckle wavemeter with a high dynamic range

The speckle pattern produced when a laser is scattered by a disordered m...
research
09/28/2020

High-throughput molecular imaging via deep learning enabled Raman spectroscopy

Raman spectroscopy enables non-destructive, label-free imaging with unpr...
research
06/24/2022

Segmentation-free PVC for Cardiac SPECT using a Densely-connected Multi-dimensional Dynamic Network

In nuclear imaging, limited resolution causes partial volume effects (PV...
research
04/27/2020

LSHR-Net: a hardware-friendly solution for high-resolution computational imaging using a mixed-weights neural network

Recent work showed neural-network-based approaches to reconstructing ima...
research
02/27/2015

Puzzle Imaging: Using Large-scale Dimensionality Reduction Algorithms for Localization

Current high-resolution imaging techniques require an intact sample that...
research
10/26/2021

Real-time division-of-focal-plane polarization imaging system with progressive networks

Division-of-focal-plane (DoFP) polarization imaging technical recently h...

Please sign up or login with your details

Forgot password? Click here to reset