Attributing Image Generative Models using Latent Fingerprints

04/17/2023
by   Guangyu Nie, et al.
5

Generative models have enabled the creation of contents that are indistinguishable from those taken from the nature. Open-source development of such models raised concerns about the risks in their misuse for malicious purposes. One potential risk mitigation strategy is to attribute generative models via fingerprinting. Current fingerprinting methods exhibit significant tradeoff between robust attribution accuracy and generation quality, and also lack designing principles to improve this tradeoff. This paper investigates the use of latent semantic dimensions as fingerprints, from where we can analyze the effects of design variables, including the choice of fingerprinting dimensions, strength, and capacity, on the accuracy-quality tradeoff. Compared with previous SOTA, our method requires minimum computation and is more applicable to large-scale models. We use StyleGAN2 and the latent diffusion model to demonstrate the efficacy of our method.

READ FULL TEXT

page 2

page 5

page 8

page 14

page 15

research
02/17/2022

Attributable-Watermarking of Speech Generative Models

Generative models are now capable of synthesizing images, speeches, and ...
research
10/27/2020

Decentralized Attribution of Generative Models

There have been growing concerns regarding the fabrication of contents t...
research
07/31/2023

On the Trustworthiness Landscape of State-of-the-art Generative Models: A Comprehensive Survey

Diffusion models and large language models have emerged as leading-edge ...
research
06/07/2023

WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models

The rapid advancement of generative models, facilitating the creation of...
research
06/04/2022

Learning Robust Representations Of Generative Models Using Set-Based Artificial Fingerprints

With recent progress in deep generative models, the problem of identifyi...
research
07/08/2023

Typology of Risks of Generative Text-to-Image Models

This paper investigates the direct risks and harms associated with moder...
research
02/02/2022

GANSlider: How Users Control Generative Models for Images using Multiple Sliders with and without Feedforward Information

We investigate how multiple sliders with and without feedforward visuali...

Please sign up or login with your details

Forgot password? Click here to reset