Learning Privacy-Preserving Optics for Human Pose Estimation

10/09/2021
by   Carlos Hinojosa, et al.
0

The widespread use of always-connected digital cameras in our everyday life has led to increasing concerns about the users' privacy and security. How to develop privacy-preserving computer vision systems? In particular, we want to prevent the camera from obtaining detailed visual data that may contain private information. However, we also want the camera to capture useful information to perform computer vision tasks. Inspired by the trend of jointly designing optics and algorithms, we tackle the problem of privacy-preserving human pose estimation by optimizing an optical encoder (hardware-level protection) with a software decoder (convolutional neural network) in an end-to-end framework. We introduce a visual privacy protection layer in our optical encoder that, parametrized appropriately, enables the optimization of the camera lens's point spread function (PSF). We validate our approach with extensive simulations and a prototype camera. We show that our privacy-preserving deep optics approach successfully degrades or inhibits private attributes while maintaining important features to perform human pose estimation.

READ FULL TEXT

page 1

page 3

page 7

page 8

research
07/16/2020

Human Pose Estimation on Privacy-Preserving Low-Resolution Depth Images

Human pose estimation (HPE) is a key building block for developing AI-ba...
research
11/14/2020

Privacy-Preserving Pose Estimation for Human-Robot Interaction

Pose estimation is an important technique for nonverbal human-robot inte...
research
08/04/2022

Privacy-Preserving Action Recognition via Motion Difference Quantization

The widespread use of smart computer vision systems in our personal spac...
research
06/03/2022

Learning rich optical embeddings for privacy-preserving lensless image classification

By replacing the lens with a thin optical element, lensless imaging enab...
research
02/14/2018

Learning Privacy Preserving Encodings through Adversarial Training

We present a framework to learn privacy-preserving encodings of images (...
research
11/30/2021

In-Bed Human Pose Estimation from Unseen and Privacy-Preserving Image Domains

Medical applications have benefited from the rapid advancement in comput...
research
12/31/2022

DensePose From WiFi

Advances in computer vision and machine learning techniques have led to ...

Please sign up or login with your details

Forgot password? Click here to reset