ELODIN: Naming Concepts in Embedding Spaces

03/07/2023
by   Rodrigo Mello, et al.
0

Despite recent advancements, the field of text-to-image synthesis still suffers from lack of fine-grained control. Using only text, it remains challenging to deal with issues such as concept coherence and concept contamination. We propose a method to enhance control by generating specific concepts that can be reused throughout multiple images, effectively expanding natural language with new words that can be combined much like a painter's palette. Unlike previous contributions, our method does not copy visuals from input data and can generate concepts through text alone. We perform a set of comparisons that finds our method to be a significant improvement over text-only prompts.

READ FULL TEXT

page 1

page 2

page 3

page 7

page 8

research
08/02/2022

An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion

Text-to-image models offer unprecedented freedom to guide creation throu...
research
05/29/2023

Concept Decomposition for Visual Exploration and Inspiration

A creative idea is often born from transforming, combining, and modifyin...
research
02/23/2023

Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models

Text-to-image personalization aims to teach a pre-trained diffusion mode...
research
02/10/2017

Learning Concept Embeddings for Efficient Bag-of-Concepts Densification

Explicit concept space models have proven efficacy for text representati...
research
03/02/2018

Representing Verbs as Argument Concepts

Verbs play an important role in the understanding of natural language te...
research
05/25/2023

Break-A-Scene: Extracting Multiple Concepts from a Single Image

Text-to-image model personalization aims to introduce a user-provided co...
research
05/02/2023

Key-Locked Rank One Editing for Text-to-Image Personalization

Text-to-image models (T2I) offer a new level of flexibility by allowing ...

Please sign up or login with your details

Forgot password? Click here to reset