Temporally coherent video anonymization through GAN inpainting

06/04/2021
by   Thangapavithraa Balaji, et al.
5

This work tackles the problem of temporally coherent face anonymization in natural video streams.We propose JaGAN, a two-stage system starting with detecting and masking out faces with black image patches in all individual frames of the video. The second stage leverages a privacy-preserving Video Generative Adversarial Network designed to inpaint the missing image patches with artificially generated faces. Our initial experiments reveal that image based generative models are not capable of inpainting patches showing temporal coherent appearance across neighboring video frames. To address this issue we introduce a newly curated video collection, which is made publicly available for the research community along with this paper. We also introduce the Identity Invariance Score IdI as a means to quantify temporal coherency between neighboring frames.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

research
05/30/2019

Align-and-Attend Network for Globally and Locally Coherent Video Inpainting

We propose a novel feed-forward network for video inpainting. We use a s...
research
09/02/2021

Deep Face Video Inpainting via UV Mapping

This paper addresses the problem of face video inpainting. Existing vide...
research
05/30/2023

Context-Preserving Two-Stage Video Domain Translation for Portrait Stylization

Portrait stylization, which translates a real human face image into an a...
research
08/30/2019

Copy-and-Paste Networks for Deep Video Inpainting

We present a novel deep learning based algorithm for video inpainting. V...
research
03/04/2021

Multi-Stage Raw Video Denoising with Adversarial Loss and Gradient Mask

In this paper, we propose a learning-based approach for denoising raw vi...
research
07/02/2019

Learnable Gated Temporal Shift Module for Deep Video Inpainting

How to efficiently utilize temporal information to recover videos in a c...
research
04/21/2019

Automatic Temporally Coherent Video Colorization

Greyscale image colorization for applications in image restoration has s...

Please sign up or login with your details

Forgot password? Click here to reset