Reconstructing Hand-Held Objects from Monocular Video

11/30/2022
by   Di Huang, et al.
0

This paper presents an approach that reconstructs a hand-held object from a monocular video. In contrast to many recent methods that directly predict object geometry by a trained network, the proposed approach does not require any learned prior about the object and is able to recover more accurate and detailed object geometry. The key idea is that the hand motion naturally provides multiple views of the object and the motion can be reliably estimated by a hand pose tracker. Then, the object geometry can be recovered by solving a multi-view reconstruction problem. We devise an implicit neural representation-based method to solve the reconstruction problem and address the issues of imprecise hand pose estimation, relative hand-object motion, and insufficient geometry optimization for small objects. We also provide a newly collected dataset with 3D ground truth to validate the proposed approach.

READ FULL TEXT

page 1

page 3

page 7

page 10

page 12

page 13

page 14

page 15

research
05/31/2023

Learning Explicit Contact for Implicit Reconstruction of Hand-held Objects from Monocular Images

Reconstructing hand-held objects from monocular RGB images is an appeali...
research
08/16/2019

Hyperparameter-Free Losses for Model-Based Monocular Reconstruction

This work proposes novel hyperparameter-free losses for single view 3D r...
research
08/16/2021

Towards unconstrained joint hand-object reconstruction from RGB videos

Our work aims to obtain 3D reconstruction of hands and manipulated objec...
research
12/19/2022

HARP: Personalized Hand Reconstruction from a Monocular RGB Video

We present HARP (HAnd Reconstruction and Personalization), a personalize...
research
09/19/2023

SHOWMe: Benchmarking Object-agnostic Hand-Object 3D Reconstruction

Recent hand-object interaction datasets show limited real object variabi...
research
06/06/2023

Towards Scalable Multi-View Reconstruction of Geometry and Materials

In this paper, we propose a novel method for joint recovery of camera po...
research
04/24/2023

gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstruction

Signed distance functions (SDFs) is an attractive framework that has rec...

Please sign up or login with your details

Forgot password? Click here to reset