MUSE: Illustrating Textual Attributes by Portrait Generation

11/09/2020
by   Xiaodan Hu, et al.
0

We propose a novel approach, MUSE, to illustrate textual attributes visually via portrait generation. MUSE takes a set of attributes written in text, in addition to facial features extracted from a photo of the subject as input. We propose 11 attribute types to represent inspirations from a subject's profile, emotion, story, and environment. We propose a novel stacked neural network architecture by extending an image-to-image generative model to accept textual attributes. Experiments show that our approach significantly outperforms several state-of-the-art methods without using textual attributes, with Inception Score score increased by 6 score decreased by 11 reconstruction metric to evaluate whether the generated portraits preserve the subject's attributes. Experiments show that our approach can accurately illustrate 78 a more creative and expressive way.

READ FULL TEXT

page 1

page 5

page 6

research
08/10/2020

Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approach

Manipulating visual attributes of images through human-written text is a...
research
05/18/2021

rx-anon – A Novel Approach on the De-Identification of Heterogeneous Data based on a Modified Mondrian Algorithm

Traditional approaches for data anonymization consider relational data a...
research
07/31/2018

Deep Sketch-Photo Face Recognition Assisted by Facial Attributes

In this paper, we present a deep coupled framework to address the proble...
research
07/13/2017

Learning Photography Aesthetics with Deep CNNs

Automatic photo aesthetic assessment is a challenging artificial intelli...
research
03/23/2023

DreamBooth3D: Subject-Driven Text-to-3D Generation

We present DreamBooth3D, an approach to personalize text-to-3D generativ...
research
10/07/2021

Flow Plugin Network for conditional generation

Generative models have gained many researchers' attention in the last ye...
research
09/27/2016

House price estimation from visual and textual features

Most existing automatic house price estimation systems rely only on some...

Please sign up or login with your details

Forgot password? Click here to reset