Attributable-Watermarking of Speech Generative Models

02/17/2022
by   Yongbaek Cho, et al.
0

Generative models are now capable of synthesizing images, speeches, and videos that are hardly distinguishable from authentic contents. Such capabilities cause concerns such as malicious impersonation and IP theft. This paper investigates a solution for model attribution, i.e., the classification of synthetic contents by their source models via watermarks embedded in the contents. Building on past success of model attribution in the image domain, we discuss algorithmic improvements for generating user-end speech models that empirically achieve high attribution accuracy, while maintaining high generation quality. We show the trade off between attributability and generation quality under a variety of attacks on generated speech signals attempting to remove the watermarks, and the feasibility of learning robust watermarks against these attacks.

READ FULL TEXT
research
10/27/2020

Decentralized Attribution of Generative Models

There have been growing concerns regarding the fabrication of contents t...
research
04/17/2023

Attributing Image Generative Models using Latent Fingerprints

Generative models have enabled the creation of contents that are indisti...
research
06/07/2023

WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models

The rapid advancement of generative models, facilitating the creation of...
research
06/04/2022

Learning Robust Representations Of Generative Models Using Set-Based Artificial Fingerprints

With recent progress in deep generative models, the problem of identifyi...
research
10/14/2022

Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario

Speech synthesis methods can create realistic-sounding speech, which may...
research
04/10/2023

EKILA: Synthetic Media Provenance and Attribution for Generative Art

We present EKILA; a decentralized framework that enables creatives to re...
research
03/18/2022

Transferable Class-Modelling for Decentralized Source Attribution of GAN-Generated Images

GAN-generated deepfakes as a genre of digital images are gaining ground ...

Please sign up or login with your details

Forgot password? Click here to reset