Deep-learned orthogonal basis patterns for fast, noise-robust single-pixel imaging

05/18/2022
by   Ritz Ann Aguilar, et al.
0

Single-pixel imaging (SPI) is a novel, unconventional method that goes beyond the notion of traditional cameras but can be computationally expensive and slow for real-time applications. Deep learning has been proposed as an alternative approach for solving the SPI reconstruction problem, but a detailed analysis of its performance and generated basis patterns when used for SPI is limited. We present a modified deep convolutional autoencoder network (DCAN) for SPI on 64x64 pixel images with up to 6.25 orthogonality regularizers during training. Training a DCAN with these regularizers allows it to learn multiple measurement bases that have combinations of binary or non-binary, and orthogonal or non-orthogonal patterns. We compare the reconstruction quality, orthogonality of the patterns, and robustness to noise of the resulting DCAN models to traditional SPI reconstruction algorithms (such as Total Variation minimization and Fourier Transform). Our DCAN models can be trained to be robust to noise while still having fast enough reconstruction times ( 3 ms per frame) to be viable for real-time imaging.

READ FULL TEXT

page 5

page 7

research
10/19/2017

Computational ghost imaging using deep learning

Computational ghost imaging (CGI) is a single-pixel imaging technique th...
research
12/09/2016

Fast Fourier single-pixel imaging using binary illumination

Fourier single-pixel imaging (FSI) has proven capable of reconstructing ...
research
06/14/2016

Efficient adaptation of complex-valued noiselet sensing matrices for compressed single-pixel imaging

Minimal mutual coherence of discrete noiselets and Haar wavelets makes t...
research
03/09/2022

Single-pixel imaging based on weight sort of the Hadamard basis

Single-pixel imaging (SPI) is very popular in subsampling applications, ...
research
06/15/2016

High-speed real-time single-pixel microscopy based on Fourier sampling

Single-pixel cameras based on the concepts of compressed sensing (CS) le...
research
01/24/2023

Learned Interferometric Imaging for the SPIDER Instrument

The Segmented Planar Imaging Detector for Electro-Optical Reconnaissance...
research
11/20/2022

Joint Embedding Predictive Architectures Focus on Slow Features

Many common methods for learning a world model for pixel-based environme...

Please sign up or login with your details

Forgot password? Click here to reset