pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis

12/02/2020
by   Eric R. Chan, et al.
14

We have witnessed rapid progress on 3D-aware image synthesis, leveraging recent advances in generative visual models and neural rendering. Existing approaches however fall short in two ways: first, they may lack an underlying 3D representation or rely on view-inconsistent rendering, hence synthesizing images that are not multi-view consistent; second, they often depend upon representation network architectures that are not expressive enough, and their results thus lack in image quality. We propose a novel generative model, named Periodic Implicit Generative Adversarial Networks (π-GAN or pi-GAN), for high-quality 3D-aware image synthesis. π-GAN leverages neural representations with periodic activation functions and volumetric rendering to represent scenes as view-consistent 3D representations with fine detail. The proposed approach obtains state-of-the-art results for 3D-aware image synthesis with multiple real and synthetic datasets.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

page 13

page 14

page 15

research
04/13/2022

Multi-View Consistent Generative Adversarial Networks for 3D-aware Image Synthesis

3D-aware image synthesis aims to generate images of objects from multipl...
research
12/20/2021

3D-aware Image Synthesis via Learning Structural and Textural Representations

Making generative models 3D-aware bridges the 2D image space and the 3D ...
research
11/21/2022

Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars

3D-aware generative adversarial networks (GANs) synthesize high-fidelity...
research
01/13/2022

VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting

We propose VoLux-GAN, a generative framework to synthesize 3D-aware face...
research
04/04/2022

Exemplar-bsaed Pattern Synthesis with Implicit Periodic Field Network

Synthesis of ergodic, stationary visual patterns is widely applicable in...
research
01/27/2023

HyperNeRFGAN: Hypernetwork approach to 3D NeRF GAN

Recently, generative models for 3D objects are gaining much popularity i...
research
03/22/2023

NeRF-GAN Distillation for Memory-Efficient 3D-Aware Generation with Convolutions

Pose-conditioned convolutional generative models struggle with high-qual...

Please sign up or login with your details

Forgot password? Click here to reset