Privacy-Preserving Video Conferencing via Thermal-Generative Images

03/15/2023
by   Sheng-Yang Chiu, et al.
0

Due to the COVID-19 epidemic, video conferencing has evolved as a new paradigm of communication and teamwork. However, private and personal information can be easily leaked through cameras during video conferencing. This includes leakage of a person's appearance as well as the contents in the background. This paper proposes a novel way of using online low-resolution thermal images as conditions to guide the synthesis of RGB images, bringing a promising solution for real-time video conferencing when privacy leakage is a concern. SPADE-SR (Spatially-Adaptive De-normalization with Self Resampling), a variant of SPADE, is adopted to incorporate the spatial property of a thermal heatmap and the non-thermal property of a normal, privacy-free pre-recorded RGB image provided in a form of latent code. We create a PAIR-LRT-Human (LRT = Low-Resolution Thermal) dataset to validate our claims. The result enables a convenient way of video conferencing where users no longer need to groom themselves and tidy up backgrounds for a short meeting. Additionally, it allows a user to switch to a different appearance and background during a conference.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
04/12/2022

Glass Segmentation with RGB-Thermal Image Pairs

This paper proposes a new glass segmentation method utilizing paired RGB...
research
12/16/2022

Person Detection Using an Ultra Low-resolution Thermal Imager on a Low-cost MCU

Detecting persons in images or video with neural networks is a well-stud...
research
04/04/2023

A real-time algorithm for human action recognition in RGB and thermal video

Monitoring the movement and actions of humans in video in real-time is a...
research
04/12/2020

Low-Resolution Overhead Thermal Tripwire for Occupancy Estimation

Smart buildings use occupancy sensing for various tasks ranging from ene...
research
10/15/2021

Occupancy Estimation from Thermal Images

We propose a non-intrusive, and privacy-preserving occupancy estimation ...
research
04/24/2020

Low-latency hand gesture recognition with a low resolution thermal imager

Using hand gestures to answer a call or to control the radio while drivi...
research
05/28/2021

Using Convolutional Neural Networks for Relative Pose Estimation of a Non-Cooperative Spacecraft with Thermal Infrared Imagery

Recent interest in on-orbit servicing and Active Debris Removal (ADR) mi...

Please sign up or login with your details

Forgot password? Click here to reset