NARF22: Neural Articulated Radiance Fields for Configuration-Aware Rendering

10/03/2022
by   Stanley Lewis, et al.
0

Articulated objects pose a unique challenge for robotic perception and manipulation. Their increased number of degrees-of-freedom makes tasks such as localization computationally difficult, while also making the process of real-world dataset collection unscalable. With the aim of addressing these scalability issues, we propose Neural Articulated Radiance Fields (NARF22), a pipeline which uses a fully-differentiable, configuration-parameterized Neural Radiance Field (NeRF) as a means of providing high quality renderings of articulated objects. NARF22 requires no explicit knowledge of the object structure at inference time. We propose a two-stage parts-based training mechanism which allows the object rendering models to generalize well across the configuration space even if the underlying training data has as few as one configuration represented. We demonstrate the efficacy of NARF22 by training configurable renderers on a real-world articulated tool dataset collected via a Fetch mobile manipulation robot. We show the applicability of the model to gradient-based inference methods through a configuration estimation and 6 degree-of-freedom pose refinement task. The project webpage is available at: https://progress.eecs.umich.edu/projects/narf/.

READ FULL TEXT

page 1

page 3

page 6

page 7

research
11/16/2021

IKEA Object State Dataset: A 6DoF object pose estimation dataset and benchmark for multi-state assembly objects

Utilizing 6DoF(Degrees of Freedom) pose information of an object and its...
research
03/02/2022

Manipulation of unknown objects via contact configuration regulation

We present an approach to robotic manipulation of unknown objects throug...
research
02/17/2022

AKB-48: A Real-World Articulated Object Knowledge Base

Human life is populated with articulated objects. A comprehensive unders...
research
07/17/2020

Geometric Correspondence Fields: Learned Differentiable Rendering for 3D Pose Refinement in the Wild

We present a novel 3D pose refinement approach based on differentiable r...
research
11/24/2022

ScanNeRF: a Scalable Benchmark for Neural Radiance Fields

In this paper, we propose the first-ever real benchmark thought for eval...
research
02/07/2023

Local Neural Descriptor Fields: Locally Conditioned Object Representations for Manipulation

A robot operating in a household environment will see a wide range of un...
research
04/08/2023

NeBLa: Neural Beer-Lambert for 3D Reconstruction of Oral Structures from Panoramic Radiographs

Panoramic radiography (panoramic X-ray, PX) is a widely used imaging mod...

Please sign up or login with your details

Forgot password? Click here to reset