Noise-Adaptive Intelligent Programmable Meta-Imager

08/22/2022
by   Chenqi Qian, et al.
0

We present an intelligent programmable computational meta-imager that tailors its sequence of coherent scene illuminations not only to a specific information-extraction task (e.g., object recognition) but also adapts to different types and levels of noise. We systematically study how the learned illumination patterns depend on the noise, and we discover that trends in intensity and overlap of the learned illumination patterns can be understood intuitively. We conduct our analysis based on an analytical coupled-dipole forward model of a microwave dynamic metasurface antenna (DMA); we formulate a differentiable end-to-end information-flow pipeline comprising the programmable physical measurement process including noise as well as the subsequent digital processing layers. This pipeline allows us to jointly inverse-design the programmable physical weights (DMA configurations that determine the coherent scene illuminations) and the trainable digital weights. Our noise-adaptive intelligent meta-imager outperforms the conventional use of pseudo-random illumination patterns most clearly under conditions that make the extraction of sufficient task-relevant information challenging: latency constraints (limiting the number of allowed measurements) and strong noise. Programmable microwave meta-imagers in indoor surveillance and earth observation will be confronted with these conditions.

READ FULL TEXT

page 7

page 15

page 18

research
10/26/2021

Intelligent Meta-Imagers: From Compressed to Learned Sensing

Computational meta-imagers synergize metamaterial hardware with advanced...
research
04/09/2020

Physics-enhanced machine learning for virtual fluorescence microscopy

This paper introduces a supervised deep-learning network that jointly op...
research
09/21/2023

Self-Calibrating, Fully Differentiable NLOS Inverse Rendering

Existing time-resolved non-line-of-sight (NLOS) imaging methods reconstr...
research
08/18/2021

A Simple Framework for 3D Lensless Imaging with Programmable Masks

Lensless cameras provide a framework to build thin imaging systems by re...
research
05/03/2019

Programmable Logic Arrays

Programmable logic arrays (PLAs) are traditional digital electronic devi...
research
03/18/2019

Direct Object Recognition Without Line-of-Sight Using Optical Coherence

Visual object recognition under situations in which the direct line-of-s...

Please sign up or login with your details

Forgot password? Click here to reset