Image Synthesis under Limited Data: A Survey and Taxonomy

07/31/2023
by   Mengping Yang, et al.
0

Deep generative models, which target reproducing the given data distribution to produce novel samples, have made unprecedented advancements in recent years. Their technical breakthroughs have enabled unparalleled quality in the synthesis of visual content. However, one critical prerequisite for their tremendous success is the availability of a sufficient number of training samples, which requires massive computation resources. When trained on limited data, generative models tend to suffer from severe performance deterioration due to overfitting and memorization. Accordingly, researchers have devoted considerable attention to develop novel models that are capable of generating plausible and diverse images from limited training data recently. Despite numerous efforts to enhance training stability and synthesis quality in the limited data scenarios, there is a lack of a systematic survey that provides 1) a clear problem definition, critical challenges, and taxonomy of various tasks; 2) an in-depth analysis on the pros, cons, and remain limitations of existing literature; as well as 3) a thorough discussion on the potential applications and future directions in the field of image synthesis under limited data. In order to fill this gap and provide a informative introduction to researchers who are new to this topic, this survey offers a comprehensive review and a novel taxonomy on the development of image synthesis under limited data. In particular, it covers the problem definition, requirements, main solutions, popular benchmarks, and remain challenges in a comprehensive and all-around manner.

READ FULL TEXT

page 4

page 5

page 17

page 19

research
07/12/2021

Active Divergence with Generative Deep Learning – A Survey and Taxonomy

Generative deep learning systems offer powerful tools for artefact gener...
research
10/27/2022

Deep Generative Models on 3D Representations: A Survey

Generative models, as an important family of statistical modeling, targe...
research
10/21/2019

A Survey and Taxonomy of Adversarial Neural Networks for Text-to-Image Synthesis

Text-to-image synthesis refers to computational methods which translate ...
research
10/12/2022

3D Brain and Heart Volume Generative Models: A Survey

Generative models such as generative adversarial networks and autoencode...
research
10/25/2022

A Survey on 3D-aware Image Synthesis

Recent years have seen remarkable progress in deep learning powered visu...
research
05/21/2022

Deep Learning for Omnidirectional Vision: A Survey and New Perspectives

Omnidirectional image (ODI) data is captured with a 360x180 field-of-vie...
research
03/27/2022

An Empirical Study and Comparison of Recent Few-Shot Object Detection Algorithms

The generic object detection (GOD) task has been successfully tackled by...

Please sign up or login with your details

Forgot password? Click here to reset