To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objects

05/26/2022
by   Bijie Bai, et al.
0

Privacy protection is a growing concern in the digital era, with machine vision techniques widely used throughout public and private settings. Existing methods address this growing problem by, e.g., encrypting camera images or obscuring/blurring the imaged information through digital algorithms. Here, we demonstrate a camera design that performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects. This diffractive camera consists of transmissive surfaces structured using deep learning to perform selective imaging of target classes of objects positioned at its input field-of-view. After their fabrication, the thin diffractive layers collectively perform optical mode filtering to accurately form images of the objects that belong to a target data class or group of classes, while instantaneously erasing objects of the other data classes at the output field-of-view. Using the same framework, we also demonstrate the design of class-specific permutation cameras, where the objects of a target data class are pixel-wise permuted for all-optical class-specific encryption, while the other objects are irreversibly erased from the output image. The success of class-specific diffractive cameras was experimentally demonstrated using terahertz (THz) waves and 3D-printed diffractive layers that selectively imaged only one class of the MNIST handwritten digit dataset, all-optically erasing the other handwritten digits. This diffractive camera design can be scaled to different parts of the electromagnetic spectrum, including, e.g., the visible and infrared wavelengths, to provide transformative opportunities for privacy-preserving digital cameras and task-specific data-efficient imaging.

READ FULL TEXT

page 24

page 25

page 26

page 27

page 28

page 30

page 31

research
12/25/2022

Data class-specific all-optical transformations and encryption

Diffractive optical networks provide rich opportunities for visual compu...
research
05/15/2020

Machine Vision using Diffractive Spectral Encoding

Machine vision systems mostly rely on lens-based optical imaging archite...
research
04/21/2022

Physics vs. Learned Priors: Rethinking Camera and Algorithm Design for Task-Specific Imaging

Cameras were originally designed using physics-based heuristics to captu...
research
08/11/2020

Key-Nets: Optical Transformation Convolutional Networks for Privacy Preserving Vision Sensors

Modern cameras are not designed with computer vision or machine learning...
research
10/04/2021

Deep Learning Approach Protecting Privacy in Camera-Based Critical Applications

Many critical applications rely on cameras to capture video footage for ...
research
12/10/2022

Snapshot Multispectral Imaging Using a Diffractive Optical Network

Multispectral imaging has been used for numerous applications in e.g., e...
research
12/05/2022

Unidirectional Imaging using Deep Learning-Designed Materials

A unidirectional imager would only permit image formation along one dire...

Please sign up or login with your details

Forgot password? Click here to reset