Beyond Neural-on-Neural Approaches to Speaker Gender Protection

06/30/2023
by   Loes van Bemmel, et al.
0

Recent research has proposed approaches that modify speech to defend against gender inference attacks. The goal of these protection algorithms is to control the availability of information about a speaker's gender, a privacy-sensitive attribute. Currently, the common practice for developing and testing gender protection algorithms is "neural-on-neural", i.e., perturbations are generated and tested with a neural network. In this paper, we propose to go beyond this practice to strengthen the study of gender protection. First, we demonstrate the importance of testing gender inference attacks that are based on speech features historically developed by speech scientists, alongside the conventionally used neural classifiers. Next, we argue that researchers should use speech features to gain insight into how protective modifications change the speech signal. Finally, we point out that gender-protection algorithms should be compared with novel "vocal adversaries", human-executed voice adaptations, in order to improve interpretability and enable before-the-mic protection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2022

Generating gender-ambiguous voices for privacy-preserving speech recognition

Our voice encodes a uniquely identifiable pattern which can be used to i...
research
08/27/2023

Fairness and Privacy in Voice Biometrics:A Study of Gender Influences Using wav2vec 2.0

This study investigates the impact of gender information on utility, pri...
research
03/09/2022

Speaker Identification Experiments Under Gender De-Identification

The present work is based on the COST Action IC1206 for De-identificatio...
research
03/29/2022

NeuraGen-A Low-Resource Neural Network based approach for Gender Classification

Human voice is the source of several important information. This is in t...
research
04/22/2021

Protecting gender and identity with disentangled speech representations

Besides its linguistic content, our speech is rich in biometric informat...
research
05/09/2023

VSMask: Defending Against Voice Synthesis Attack via Real-Time Predictive Perturbation

Deep learning based voice synthesis technology generates artificial huma...
research
03/08/2022

Digital Speech Algorithms for Speaker De-Identification

The present work is based on the COST Action IC1206 for De-identificatio...

Please sign up or login with your details

Forgot password? Click here to reset