Deforming Radiance Fields with Cages

07/25/2022
by   Tianhan Xu, et al.
1

Recent advances in radiance fields enable photorealistic rendering of static or dynamic 3D scenes, but still do not support explicit deformation that is used for scene manipulation or animation. In this paper, we propose a method that enables a new type of deformation of the radiance field: free-form radiance field deformation. We use a triangular mesh that encloses the foreground object called cage as an interface, and by manipulating the cage vertices, our approach enables the free-form deformation of the radiance field. The core of our approach is cage-based deformation which is commonly used in mesh deformation. We propose a novel formulation to extend it to the radiance field, which maps the position and the view direction of the sampling points from the deformed space to the canonical space, thus enabling the rendering of the deformed scene. The deformation results of the synthetic datasets and the real-world datasets demonstrate the effectiveness of our approach.

READ FULL TEXT

page 3

page 12

page 13

page 14

research
05/10/2022

NeRF-Editing: Geometry Editing of Neural Radiance Fields

Implicit neural rendering, especially Neural Radiance Field (NeRF), has ...
research
08/05/2023

SwinGar: Spectrum-Inspired Neural Dynamic Deformation for Free-Swinging Garments

Our work presents a novel spectrum-inspired learning-based approach for ...
research
01/13/2021

Singularity-free Aerial Deformation by Two-dimensional Multilinked Aerial Robot with 1-DoF Vectorable Propeller

Two-dimensional multilinked structures can benefit aerial robots in both...
research
07/21/2023

FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fields

As recent advances in Neural Radiance Fields (NeRF) have enabled high-fi...
research
05/24/2020

Haptic Rendering of Thin, Deformable Objects with Spatially Varying Stiffness

In the real world, we often come across soft objects having spatially va...
research
08/14/2014

Regularized Harmonic Surface Deformation

Harmonic surface deformation is a well-known geometric modeling method t...
research
03/19/2018

Alive Caricature from 2D to 3D

Caricature is an art form that expresses subjects in abstract, simple an...

Please sign up or login with your details

Forgot password? Click here to reset