Unified Concept Editing in Diffusion Models

08/25/2023
by   Rohit Gandikota, et al.
0

Text-to-image models suffer from various safety issues that may limit their suitability for deployment. Previous methods have separately addressed individual issues of bias, copyright, and offensive content in text-to-image models. However, in the real world, all of these issues appear simultaneously in the same model. We present a method that tackles all issues with a single approach. Our method, Unified Concept Editing (UCE), edits the model without training using a closed-form solution, and scales seamlessly to concurrent edits on text-conditional diffusion models. We demonstrate scalable simultaneous debiasing, style erasure, and content moderation by editing text-to-image projections, and we present extensive experiments demonstrating improved efficacy and scalability over prior work. Our code is available at https://unified.baulab.info

READ FULL TEXT

page 1

page 6

page 7

page 14

page 15

page 16

page 18

page 19

research
12/08/2022

SINE: SINgle Image Editing with Text-to-Image Diffusion Models

Recent works on diffusion models have demonstrated a strong capability f...
research
09/19/2023

Forgedit: Text Guided Image Editing via Learning and Forgetting

Text guided image editing on real images given only the image and the ta...
research
06/28/2023

PFB-Diff: Progressive Feature Blending Diffusion for Text-driven Image Editing

Diffusion models have showcased their remarkable capability to synthesiz...
research
06/01/2023

Differential Diffusion: Giving Each Pixel Its Strength

Text-based image editing has advanced significantly in recent years. Wit...
research
12/05/2022

Exploring Stroke-Level Modifications for Scene Text Editing

Scene text editing (STE) aims to replace text with the desired one while...
research
06/02/2022

DE-Net: Dynamic Text-guided Image Editing Adversarial Networks

Text-guided image editing models have shown remarkable results. However,...
research
03/17/2023

A Recipe for Watermarking Diffusion Models

Recently, diffusion models (DMs) have demonstrated their advantageous po...

Please sign up or login with your details

Forgot password? Click here to reset