Class-Continuous Conditional Generative Neural Radiance Field

01/03/2023
by   Jiwook Kim, et al.
0

The 3D-aware image synthesis focuses on conserving spatial consistency besides generating high-resolution images with fine details. Recently, Neural Radiance Field (NeRF) has been introduced for synthesizing novel views with low computational cost and superior performance. While several works investigate a generative NeRF and show remarkable achievement, they cannot handle conditional and continuous feature manipulation in the generation procedure. In this work, we introduce a novel model, called Class-Continuous Conditional Generative NeRF (C^3G-NeRF), which can synthesize conditionally manipulated photorealistic 3D-consistent images by projecting conditional features to the generator and the discriminator. The proposed C^3G-NeRF is evaluated with three image datasets, AFHQ, CelebA, and Cars. As a result, our model shows strong 3D-consistency with fine details and smooth interpolation in conditional feature manipulation. For instance, C^3G-NeRF exhibits a Fréchet Inception Distance (FID) of 7.64 in 3D-aware face image synthesis with a 128^2 resolution. Additionally, we provide FIDs of generated 3D-aware images of each class of the datasets as it is possible to synthesize class-conditional images with C^3G-NeRF.

READ FULL TEXT

page 6

page 7

page 14

page 16

page 17

page 18

page 19

page 20

research
10/18/2021

StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis

We propose StyleNeRF, a 3D-aware generative model for photo-realistic hi...
research
11/30/2017

High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs

We present a new method for synthesizing high-resolution photo-realistic...
research
08/13/2020

DF-GAN: Deep Fusion Generative Adversarial Networks for Text-to-Image Synthesis

Synthesizing high-resolution realistic images from text descriptions is ...
research
11/25/2022

Learning Detailed Radiance Manifolds for High-Fidelity and 3D-Consistent Portrait Synthesis from Monocular Image

A key challenge for novel view synthesis of monocular portrait images is...
research
06/01/2022

PAGER: Progressive Attribute-Guided Extendable Robust Image Generation

This work presents a generative modeling approach based on successive su...
research
06/16/2021

Cascading Modular Network (CAM-Net) for Multimodal Image Synthesis

Deep generative models such as GANs have driven impressive advances in c...
research
05/27/2021

Deconditional Downscaling with Gaussian Processes

Refining low-resolution (LR) spatial fields with high-resolution (HR) in...

Please sign up or login with your details

Forgot password? Click here to reset