AnonySIGN: Novel Human Appearance Synthesis for Sign Language Video Anonymisation

07/22/2021
by   Ben Saunders, et al.
12

The visual anonymisation of sign language data is an essential task to address privacy concerns raised by large-scale dataset collection. Previous anonymisation techniques have either significantly affected sign comprehension or required manual, labour-intensive work. In this paper, we formally introduce the task of Sign Language Video Anonymisation (SLVA) as an automatic method to anonymise the visual appearance of a sign language video whilst retaining the meaning of the original sign language sequence. To tackle SLVA, we propose AnonySign, a novel automatic approach for visual anonymisation of sign language data. We first extract pose information from the source video to remove the original signer appearance. We next generate a photo-realistic sign language video of a novel appearance from the pose sequence, using image-to-image translation methods in a conditional variational autoencoder framework. An approximate posterior style distribution is learnt, which can be sampled from to synthesise novel human appearances. In addition, we propose a novel style loss that ensures style consistency in the anonymised sign language videos. We evaluate AnonySign for the SLVA task with extensive quantitative and qualitative experiments highlighting both realism and anonymity of our novel human appearance synthesis. In addition, we formalise an anonymity perceptual study as an evaluation criteria for the SLVA task and showcase that video anonymisation using AnonySign retains the original sign language content.

READ FULL TEXT

page 1

page 4

page 6

page 7

research
11/19/2020

Everybody Sign Now: Translating Spoken Language to Photo Realistic Sign Language Video

To be truly understandable and accepted by Deaf communities, an automati...
research
03/29/2022

Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production

Sign languages are visual languages, with vocabularies as rich as their ...
research
09/01/2022

Topic Detection in Continuous Sign Language Videos

Significant progress has been made recently on challenging tasks in auto...
research
07/08/2022

Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation

Sign language is the window for people differently-abled to express thei...
research
01/27/2023

Semantic Network Model for Sign Language Comprehension

In this study, the authors propose a computational cognitive model for s...
research
05/06/2021

Pose-Guided Sign Language Video GAN with Dynamic Lambda

We propose a novel approach for the synthesis of sign language videos us...
research
07/12/2023

Enhancing Portuguese Sign Language Animation with Dynamic Timing and Mouthing

Current signing avatars are often described as unnatural as they cannot ...

Please sign up or login with your details

Forgot password? Click here to reset