NeRF-Editing: Geometry Editing of Neural Radiance Fields

05/10/2022
by   Yu-Jie Yuan, et al.
0

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the scene. While existing works have proposed some approaches to modify the radiance field according to the user's constraints, the modification is limited to color editing or object translation and rotation. In this paper, we propose a method that allows users to perform controllable shape deformation on the implicit representation of the scene, and synthesizes the novel view images of the edited scene without re-training the network. Specifically, we establish a correspondence between the extracted explicit mesh representation and the implicit neural representation of the target scene. Users can first utilize well-developed mesh-based deformation methods to deform the mesh representation of the scene. Our method then utilizes user edits from the mesh representation to bend the camera rays by introducing a tetrahedra mesh as a proxy, obtaining the rendering results of the edited scene. Extensive experiments demonstrate that our framework can achieve ideal editing results not only on synthetic data, but also on real scenes captured by users.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

page 9

page 10

page 11

research
07/25/2022

NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing

Very recently neural implicit rendering techniques have been rapidly evo...
research
07/25/2022

Deforming Radiance Fields with Cages

Recent advances in radiance fields enable photorealistic rendering of st...
research
10/15/2022

SPIDR: SDF-based Neural Point Fields for Illumination and Deformation

Neural radiance fields (NeRFs) have recently emerged as a promising appr...
research
03/21/2023

Interactive Geometry Editing of Neural Radiance Fields

In this paper, we propose a method that enables the interactive geometry...
research
08/01/2022

VolTeMorph: Realtime, Controllable and Generalisable Animation of Volumetric Representations

The recent increase in popularity of volumetric representations for scen...
research
04/24/2023

Neural Implicit Shape Editing using Boundary Sensitivity

Neural fields are receiving increased attention as a geometric represent...
research
05/13/2021

Editing Conditional Radiance Fields

A neural radiance field (NeRF) is a scene model supporting high-quality ...

Please sign up or login with your details

Forgot password? Click here to reset