Representation Learning for Audio Privacy Preservation using Source Separation and Robust Adversarial Learning

08/09/2023
by   Diep Luong, et al.
0

Privacy preservation has long been a concern in smart acoustic monitoring systems, where speech can be passively recorded along with a target signal in the system's operating environment. In this study, we propose the integration of two commonly used approaches in privacy preservation: source separation and adversarial representation learning. The proposed system learns the latent representation of audio recordings such that it prevents differentiating between speech and non-speech recordings. Initially, the source separation network filters out some of the privacy-sensitive data, and during the adversarial learning process, the system will learn privacy-preserving representation on the filtered signal. We demonstrate the effectiveness of our proposed method by comparing our method against systems without source separation, without adversarial learning, and without both. Overall, our results suggest that the proposed system can significantly improve speech privacy preservation compared to that of using source separation or adversarial learning solely while maintaining good performance in the acoustic monitoring task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2023

Adversarial Representation Learning for Robust Privacy Preservation in Audio

Sound event detection systems are widely used in various applications su...
research
04/09/2021

Joint Online Multichannel Acoustic Echo Cancellation, Speech Dereverberation and Source Separation

This paper presents a joint source separation algorithm that simultaneou...
research
11/11/2017

Unsupervised Audio Source Separation via Spectrum Energy Preserved Wasserstein Learning

Separating audio mixtures into individual tracks has been a long standin...
research
05/23/2019

CASS: Cross Adversarial Source Separation via Autoencoder

This paper introduces a cross adversarial source separation (CASS) frame...
research
10/13/2021

Deep Metric Learning with Locality Sensitive Angular Loss for Self-Correcting Source Separation of Neural Spiking Signals

Neurophysiological time series, such as electromyographic signal and int...
research
12/15/2019

Breaking Speech Recognizers to Imagine Lyrics

We introduce a new method for generating text, and in particular song ly...
research
07/20/2022

Spatial Aware Multi-Task Learning Based Speech Separation

During the Covid, online meetings have become an indispensable part of o...

Please sign up or login with your details

Forgot password? Click here to reset