WaveGAN: Frequency-aware GAN for High-Fidelity Few-shot Image Generation

07/15/2022
by   Mengping Yang, et al.
2

Existing few-shot image generation approaches typically employ fusion-based strategies, either on the image or the feature level, to produce new images. However, previous approaches struggle to synthesize high-frequency signals with fine details, deteriorating the synthesis quality. To address this, we propose WaveGAN, a frequency-aware model for few-shot image generation. Concretely, we disentangle encoded features into multiple frequency components and perform low-frequency skip connections to preserve outline and structural information. Then we alleviate the generator's struggles of synthesizing fine details by employing high-frequency skip connections, thus providing informative frequency information to the generator. Moreover, we utilize a frequency L1-loss on the generated and real images to further impede frequency information loss. Extensive experiments demonstrate the effectiveness and advancement of our method on three datasets. Noticeably, we achieve new state-of-the-art with FID 42.17, LPIPS 0.3868, FID 30.35, LPIPS 0.5076, and FID 4.96, LPIPS 0.3822 respectively on Flower, Animal Faces, and VGGFace. GitHub: https://github.com/kobeshegu/ECCV2022_WaveGAN

READ FULL TEXT

page 2

page 11

page 12

page 19

research
08/30/2023

Improving Few-shot Image Generation by Structural Discrimination and Textural Modulation

Few-shot image generation, which aims to produce plausible and diverse i...
research
03/15/2023

Harnessing Low-Frequency Neural Fields for Few-Shot View Synthesis

Neural Radiance Fields (NeRF) have led to breakthroughs in the novel vie...
research
03/29/2021

High-Fidelity and Arbitrary Face Editing

Cycle consistency is widely used for face editing. However, we observe t...
research
10/11/2022

FreGAN: Exploiting Frequency Components for Training GANs under Limited Data

Training GANs under limited data often leads to discriminator overfittin...
research
07/27/2023

EqGAN: Feature Equalization Fusion for Few-shot Image Generation

Due to the absence of fine structure and texture information, existing f...
research
03/04/2023

Few-Shot Defect Image Generation via Defect-Aware Feature Manipulation

The performances of defect inspection have been severely hindered by ins...
research
02/08/2022

Residual Aligned: Gradient Optimization for Non-Negative Image Synthesis

In this work, we address an important problem of optical see through (OS...

Please sign up or login with your details

Forgot password? Click here to reset