EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points

12/07/2022
by   Chengwei Zheng, et al.
0

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields that enable end-users to easily edit dynamic scenes and even support topological changes. Input with an image sequence from a single camera, our network is trained fully automatically and models topologically varying dynamics using our picked-out surface key points. Then end-users can edit the scene by easily dragging the key points to desired new positions. To achieve this, we propose a scene analysis method to detect and initialize key points by considering the dynamics in the scene, and a weighted key points strategy to model topologically varying dynamics by joint key points and weights optimization. Our method supports intuitive multi-dimensional (up to 3D) editing and can generate novel scenes that are unseen in the input sequence. Experiments demonstrate that our method achieves high-quality editing on various dynamic scenes and outperforms the state-of-the-art. We will release our code and captured data.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

research
07/24/2023

Dyn-E: Local Appearance Editing of Dynamic Neural Radiance Fields

Recently, the editing of neural radiance fields (NeRFs) has gained consi...
research
03/22/2023

Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions

We propose a method for editing NeRF scenes with text-instructions. Give...
research
05/22/2023

Registering Neural Radiance Fields as 3D Density Images

No significant work has been done to directly merge two partially overla...
research
11/30/2021

NeRFReN: Neural Radiance Fields with Reflections

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis ...
research
02/27/2023

BaLi-RF: Bandlimited Radiance Fields for Dynamic Scene Modeling

Reasoning the 3D structure of a non-rigid dynamic scene from a single mo...
research
01/19/2023

RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D Scenes

Radiance fields have gradually become a main representation of media. Al...
research
05/31/2022

Decomposing NeRF for Editing via Feature Field Distillation

Emerging neural radiance fields (NeRF) are a promising scene representat...

Please sign up or login with your details

Forgot password? Click here to reset