A Creative Industry Image Generation Dataset Based on Captions

11/16/2022
by   Xiang Yuejia, et al.
0

Most image generation methods are difficult to precisely control the properties of the generated images, such as structure, scale, shape, etc., which limits its large-scale application in creative industries such as conceptual design and graphic design, and so on. Using the prompt and the sketch is a practical solution for controllability. Existing datasets lack either prompt or sketch and are not designed for the creative industry. Here is the main contribution of our work. a) This is the first dataset that covers the 4 most important areas of creative industry domains and is labeled with prompt and sketch. b) We provide multiple reference images in the test set and fine-grained scores for each reference which are useful for measurement. c) We apply two state-of-the-art models to our dataset and then find some shortcomings, such as the prompt is more highly valued than the sketch.

READ FULL TEXT
research
10/27/2022

Towards Practicality of Sketch-Based Visual Understanding

Sketches have been used to conceptualise and depict visual objects from ...
research
03/20/2023

Picture that Sketch: Photorealistic Image Generation from Abstract Sketches

Given an abstract, deformed, ordinary sketch from untrained amateurs lik...
research
07/17/2022

Effect of Instance Normalization on Fine-Grained Control for Sketch-Based Face Image Generation

Sketching is an intuitive and effective way for content creation. While ...
research
05/04/2017

Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks

Recently, realistic image generation using deep neural networks has beco...
research
11/24/2017

Sketch-to-Image Generation Using Deep Contextual Completion

When the input to pix2pix translation is a badly drawn sketch, the outpu...
research
03/17/2022

CoGS: Controllable Generation and Search from Sketch and Style

We present CoGS, a novel method for the style-conditioned, sketch-driven...
research
02/26/2022

Edge Augmentation for Large-Scale Sketch Recognition without Sketches

This work addresses scaling up the sketch classification task into a lar...

Please sign up or login with your details

Forgot password? Click here to reset