Dyn-E: Local Appearance Editing of Dynamic Neural Radiance Fields

07/24/2023
by   Shangzhan Zhang, et al.
0

Recently, the editing of neural radiance fields (NeRFs) has gained considerable attention, but most prior works focus on static scenes while research on the appearance editing of dynamic scenes is relatively lacking. In this paper, we propose a novel framework to edit the local appearance of dynamic NeRFs by manipulating pixels in a single frame of training video. Specifically, to locally edit the appearance of dynamic NeRFs while preserving unedited regions, we introduce a local surface representation of the edited region, which can be inserted into and rendered along with the original NeRF and warped to arbitrary other frames through a learned invertible motion representation network. By employing our method, users without professional expertise can easily add desired content to the appearance of a dynamic scene. We extensively evaluate our approach on various scenes and show that our approach achieves spatially and temporally consistent editing results. Notably, our approach is versatile and applicable to different variants of dynamic NeRF representations.

READ FULL TEXT

page 1

page 4

page 6

page 8

page 10

page 11

research
12/07/2022

EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view ...
research
12/21/2022

PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fields

Recent advances in neural radiance fields have enabled the high-fidelity...
research
09/02/2023

MagicProp: Diffusion-based Video Editing via Motion-aware Appearance Propagation

This paper addresses the issue of modifying the visual appearance of vid...
research
07/27/2023

Seal-3D: Interactive Pixel-Level Editing for Neural Radiance Fields

With the popularity of implicit neural representations, or neural radian...
research
05/13/2021

Editing Conditional Radiance Fields

A neural radiance field (NeRF) is a scene model supporting high-quality ...
research
12/05/2016

ROAM: a Rich Object Appearance Model with Application to Rotoscoping

Rotoscoping, the detailed delineation of scene elements through a video ...
research
06/27/2018

Watch to Edit: Video Retargeting using Gaze

We present a novel approach to optimally retarget videos for varied disp...

Please sign up or login with your details

Forgot password? Click here to reset