MIGS: Meta Image Generation from Scene Graphs

10/22/2021
by   Azade Farshad, et al.
6

Generation of images from scene graphs is a promising direction towards explicit scene generation and manipulation. However, the images generated from the scene graphs lack quality, which in part comes due to high difficulty and diversity in the data. We propose MIGS (Meta Image Generation from Scene Graphs), a meta-learning based approach for few-shot image generation from graphs that enables adapting the model to different scenes and increases the image quality by training on diverse sets of tasks. By sampling the data in a task-driven fashion, we train the generator using meta-learning on different sets of tasks that are categorized based on the scene attributes. Our results show that using this meta-learning approach for the generation of images from scene graphs achieves state-of-the-art performance in terms of image quality and capturing the semantic relationships in the scene. Project Website: https://migs2021.github.io/

READ FULL TEXT

page 1

page 4

page 6

page 7

page 10

research
04/07/2020

Semantic Image Manipulation Using Scene Graphs

Image manipulation can be considered a special case of image generation ...
research
03/05/2020

Image Generation from Freehand Scene Sketches

We introduce the first method for automatic image generation from scene-...
research
12/05/2019

MetalGAN: Multi-Domain Label-Less Image Synthesis Using cGANs and Meta-Learning

Image synthesis is currently one of the most addressed image processing ...
research
04/25/2019

Meta-Sim: Learning to Generate Synthetic Datasets

Training models to high-end performance requires availability of large l...
research
08/20/2020

Meta-Sim2: Unsupervised Learning of Scene Structure for Synthetic Data Generation

Procedural models are being widely used to synthesize scenes for graphic...
research
03/08/2023

Transformer-based Image Generation from Scene Graphs

Graph-structured scene descriptions can be efficiently used in generativ...
research
03/24/2022

Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors

Recent text-to-image generation methods provide a simple yet exciting co...

Please sign up or login with your details

Forgot password? Click here to reset