StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generation

12/21/2021
by   Roy Or-El, et al.
0

We introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF. Our method is trained on single-view RGB data only, and stands on the shoulders of StyleGAN2 for image generation, while solving two main challenges in 3D-aware GANs: 1) high-resolution, view-consistent generation of the RGB images, and 2) detailed 3D shape. We achieve this by merging a SDF-based 3D representation with a style-based 2D generator. Our 3D implicit network renders low-resolution feature maps, from which the style-based network generates view-consistent, 1024x1024 images. Notably, our SDF-based 3D modeling defines detailed 3D surfaces, leading to consistent volume rendering. Our method shows higher quality results compared to state of the art in terms of visual and geometric quality.

READ FULL TEXT

page 1

page 6

page 8

page 13

page 14

page 15

page 16

page 17

research
12/15/2021

Efficient Geometry-aware 3D Generative Adversarial Networks

Unsupervised generation of high-quality multi-view-consistent images and...
research
10/18/2021

StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis

We propose StyleNeRF, a 3D-aware generative model for photo-realistic hi...
research
04/25/2019

High-Resolution Network for Photorealistic Style Transfer

Photorealistic style transfer aims to transfer the style of one image to...
research
07/03/2023

MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion

This paper introduces MVDiffusion, a simple yet effective multi-view ima...
research
01/24/2017

Learning an attention model in an artificial visual system

The Human visual perception of the world is of a large fixed image that ...
research
06/21/2022

EpiGRAF: Rethinking training of 3D GANs

A very recent trend in generative modeling is building 3D-aware generato...
research
08/16/2023

OmniZoomer: Learning to Move and Zoom in on Sphere at High-Resolution

Omnidirectional images (ODIs) have become increasingly popular, as their...

Please sign up or login with your details

Forgot password? Click here to reset