Robust Dynamic Radiance Fields

01/05/2023
by   Yu-Lun Liu, et al.
0

Dynamic radiance field reconstruction methods aim to model the time-varying structure and appearance of a dynamic scene. Existing methods, however, assume that accurate camera poses can be reliably estimated by Structure from Motion (SfM) algorithms. These methods, thus, are unreliable as SfM algorithms often fail or produce erroneous poses on challenging videos with highly dynamic objects, poorly textured surfaces, and rotating camera motion. We address this robustness issue by jointly estimating the static and dynamic radiance fields along with the camera parameters (poses and focal length). We demonstrate the robustness of our approach via extensive quantitative and qualitative experiments. Our results show favorable performance over the state-of-the-art dynamic view synthesis methods.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

research
03/24/2023

Progressively Optimized Local Radiance Fields for Robust View Synthesis

We present an algorithm for reconstructing the radiance field of a large...
research
09/21/2022

PREF: Predictability Regularized Neural Motion Fields

Knowing the 3D motions in a dynamic scene is essential to many vision ap...
research
09/16/2023

DynaMoN: Motion-Aware Fast And Robust Camera Localization for Dynamic NeRF

Dynamic reconstruction with neural radiance fields (NeRF) requires accur...
research
02/14/2021

NeRF–: Neural Radiance Fields Without Known Camera Parameters

This paper tackles the problem of novel view synthesis (NVS) from 2D ima...
research
09/07/2017

Monocular Navigation in Large Scale Dynamic Environments

We present a processing technique for a robust reconstruction of motion ...
research
02/28/2017

Parallel Structure from Motion from Local Increment to Global Averaging

In this paper, we tackle the accurate and consistent Structure from Moti...
research
02/27/2023

BaLi-RF: Bandlimited Radiance Fields for Dynamic Scene Modeling

Reasoning the 3D structure of a non-rigid dynamic scene from a single mo...

Please sign up or login with your details

Forgot password? Click here to reset