Category-Level Metric Scale Object Shape and Pose Estimation

09/01/2021
by   Taeyeop Lee, et al.
2

Advances in deep learning recognition have led to accurate object detection with 2D images. However, these 2D perception methods are insufficient for complete 3D world information. Concurrently, advanced 3D shape estimation approaches focus on the shape itself, without considering metric scale. These methods cannot determine the accurate location and orientation of objects. To tackle this problem, we propose a framework that jointly estimates a metric scale shape and pose from a single RGB image. Our framework has two branches: the Metric Scale Object Shape branch (MSOS) and the Normalized Object Coordinate Space branch (NOCS). The MSOS branch estimates the metric scale shape observed in the camera coordinates. The NOCS branch predicts the normalized object coordinate space (NOCS) map and performs similarity transformation with the rendered depth map from a predicted metric scale mesh to obtain 6d pose and size. Additionally, we introduce the Normalized Object Center Estimation (NOCE) to estimate the geometrically aligned distance from the camera to the object center. We validated our method on both synthetic and real-world datasets to evaluate category-level object pose and shape.

READ FULL TEXT

page 1

page 2

page 4

page 7

page 8

research
03/18/2023

SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variations

Most learning-based approaches to category-level 6D pose estimation are ...
research
01/09/2019

Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimation

The goal of this paper is to estimate the 6D pose and dimensions of unse...
research
09/19/2023

RGB-based Category-level Object Pose Estimation via Decoupled Metric Scale Recovery

While showing promising results, recent RGB-D camera-based category-leve...
research
06/06/2019

Mesh R-CNN

Rapid advances in 2D perception have led to systems that accurately dete...
research
12/06/2018

ROI-10D: Monocular Lifting of 2D Detection to 6D Pose and Metric Shape

We present a deep learning method for end-to-end monocular 3D object det...
research
03/08/2021

Fully Convolutional Geometric Features for Category-level Object Alignment

This paper focuses on pose registration of different object instances fr...
research
08/17/2023

MV-ROPE: Multi-view Constraints for Robust Category-level Object Pose and Size Estimation

We propose a novel framework for RGB-based category-level 6D object pose...

Please sign up or login with your details

Forgot password? Click here to reset