SNeRF: Stylized Neural Implicit Representations for 3D Scenes

07/05/2022
by   Thu Nguyen-Phuoc, et al.
1

This paper presents a stylized novel view synthesis method. Applying state-of-the-art stylization methods to novel views frame by frame often causes jittering artifacts due to the lack of cross-view consistency. Therefore, this paper investigates 3D scene stylization that provides a strong inductive bias for consistent novel view synthesis. Specifically, we adopt the emerging neural radiance fields (NeRF) as our choice of 3D scene representation for their capability to render high-quality novel views for a variety of scenes. However, as rendering a novel view from a NeRF requires a large number of samples, training a stylized NeRF requires a large amount of GPU memory that goes beyond an off-the-shelf GPU capacity. We introduce a new training method to address this problem by alternating the NeRF and stylization optimization steps. Such a method enables us to make full use of our hardware memory capacity to both generate images at higher resolution and adopt more expressive image style transfer methods. Our experiments show that our method produces stylized NeRFs for a wide range of content, including indoor, outdoor and dynamic scenes, and synthesizes high-quality novel views with cross-view consistency.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

page 9

research
08/24/2023

NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes

Recent implicit neural representations have shown great results for nove...
research
09/14/2023

CoRF : Colorizing Radiance Fields using Knowledge Distillation

Neural radiance field (NeRF) based methods enable high-quality novel-vie...
research
03/23/2023

Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylization

Recent advances in 3D scene representation and novel view synthesis have...
research
01/13/2023

Laser: Latent Set Representations for 3D Generative Modeling

NeRF provides unparalleled fidelity of novel view synthesis: rendering a...
research
03/13/2023

NeRFLiX: High-Quality Neural View Synthesis by Learning a Degradation-Driven Inter-viewpoint MiXer

Neural radiance fields (NeRF) show great success in novel view synthesis...
research
03/29/2023

Instant Neural Radiance Fields Stylization

We present Instant Neural Radiance Fields Stylization, a novel approach ...
research
05/24/2022

StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning

3D scene stylization aims at generating stylized images of the scene fro...

Please sign up or login with your details

Forgot password? Click here to reset