From Hours to Seconds: Towards 100x Faster Quantitative Phase Imaging via Differentiable Microscopy

05/23/2022
by   Udith Haputhanthri, et al.
25

With applications ranging from metabolomics to histopathology, quantitative phase microscopy (QPM) is a powerful label-free imaging modality. Despite significant advances in fast multiplexed imaging sensors and deep-learning-based inverse solvers, the throughput of QPM is currently limited by the speed of electronic hardware. Complementarily, to improve throughput further, here we propose to acquire images in a compressed form such that more information can be transferred beyond the existing electronic hardware bottleneck. To this end, we present a learnable optical compression-decompression framework that learns content-specific features. The proposed differentiable optical-electronic quantitative phase microscopy (∂μ) first uses learnable optical feature extractors as image compressors. The intensity representation produced by these networks is then captured by the imaging sensor. Finally, a reconstruction network running on electronic hardware decompresses the QPM images. The proposed system achieves compression of × 64 while maintaining the SSIM of ∼ 0.90 and PSNR of ∼ 30 dB. The promising results demonstrated by our experiments open up a new pathway for achieving end-to-end optimized (i.e., optics and electronic) compact QPM systems that provide unprecedented throughput improvements.

READ FULL TEXT

page 1

page 2

page 3

page 6

page 8

page 9

page 10

page 11

research
01/22/2022

Diffractive all-optical computing for quantitative phase imaging

Quantitative phase imaging (QPI) is a label-free computational imaging t...
research
03/28/2022

Differentiable Microscopy Designs an All Optical Quantitative Phase Microscope

Ever since the first microscope by Zacharias Janssen in the late 16th ce...
research
03/28/2022

Differentiable Microscopy for Content and Task Aware Compressive Fluorescence Imaging

The trade-off between throughput and image quality is an inherent challe...
research
09/26/2020

Quantifying the effect of image compression on supervised learning applications in optical microscopy

The impressive growth of data throughput in optical microscopy has trigg...
research
08/05/2023

Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network

As a label-free imaging technique, quantitative phase imaging (QPI) prov...
research
12/07/2020

High resolution functional imaging through Lorentz transmission electron microscopy and differentiable programming

Lorentz transmission electron microscopy is a unique characterization te...
research
02/04/2023

Human-Imperceptible Identification with Learnable Lensless Imaging

Lensless imaging protects visual privacy by capturing heavily blurred im...

Please sign up or login with your details

Forgot password? Click here to reset