Image-Based CLIP-Guided Essence Transfer

10/24/2021
by   Hila Chefer, et al.
3

The conceptual blending of two signals is a semantic task that may underline both creativity and intelligence. We propose to perform such blending in a way that incorporates two latent spaces: that of the generator network and that of the semantic network. For the first network, we employ the powerful StyleGAN generator, and for the second, the powerful image-language matching network of CLIP. The new method creates a blending operator that is optimized to be simultaneously additive in both latent spaces. Our results demonstrate that this leads to blending that is much more natural than what can be obtained in each space separately.

READ FULL TEXT

page 2

page 4

research
08/07/2022

Hierarchical Semantic Regularization of Latent Spaces in StyleGANs

Progress in GANs has enabled the generation of high-resolution photoreal...
research
08/10/2021

An Image-based Generator Architecture for Synthetic Image Refinement

Proposed are alternative generator architectures for Boundary Equilibriu...
research
04/04/2017

Geracao Automatica de Paineis de Controle para Analise de Mobilidade Urbana Utilizando Redes Complexas

In this paper we describe an automatic generator to support the data sci...
research
02/22/2023

Gradient Adjusting Networks for Domain Inversion

StyleGAN2 was demonstrated to be a powerful image generation engine that...
research
12/13/2022

HS-Diffusion: Learning a Semantic-Guided Diffusion Model for Head Swapping

Image-based head swapping task aims to stitch a source head to another s...
research
08/21/2022

Semantic-enhanced Image Clustering

Image clustering is an important, and open challenge task in computer vi...

Please sign up or login with your details

Forgot password? Click here to reset