Recovery of Superquadrics from Range Images using Deep Learning: A Preliminary Study

04/13/2019
by   Tim Oblak, et al.
10

It has been a longstanding goal in computer vision to describe the 3D physical space in terms of parameterized volumetric models that would allow autonomous machines to understand and interact with their surroundings. Such models are typically motivated by human visual perception and aim to represents all elements of the physical word ranging from individual objects to complex scenes using a small set of parameters. One of the de facto stadards to approach this problem are superquadrics - volumetric models that define various 3D shape primitives and can be fitted to actual 3D data (either in the form of point clouds or range images). However, existing solutions to superquadric recovery involve costly iterative fitting procedures, which limit the applicability of such techniques in practice. To alleviate this problem, we explore in this paper the possibility to recover superquadrics from range images without time consuming iterative parameter estimation techniques by using contemporary deep-learning models, more specifically, convolutional neural networks (CNNs). We pose the superquadric recovery problem as a regression task and develop a CNN regressor that is able to estimate the parameters of a superquadric model from a given range image. We train the regressor on a large set of synthetic range images, each containing a single (unrotated) superquadric shape and evaluate the learned model in comparaitve experiments with the current state-of-the-art. Additionally, we also present a qualitative analysis involving a dataset of real-world objects. The results of our experiments show that the proposed regressor not only outperforms the existing state-of-the-art, but also ensures a 270x faster execution time.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

research
01/28/2020

Segmentation and Recovery of Superquadric Models using Convolutional Neural Networks

In this paper we address the problem of representing 3D visual data with...
research
06/05/2019

Learning Shape Representation on Sparse Point Clouds for Volumetric Image Segmentation

Volumetric image segmentation with convolutional neural networks (CNNs) ...
research
02/10/2018

Vehicle Pose and Shape Estimation through Multiple Monocular Vision

In this paper, we present an accurate approach to estimate vehicles' pos...
research
10/19/2020

Learning to Reconstruct and Segment 3D Objects

To endow machines with the ability to perceive the real-world in a three...
research
11/29/2021

Robust and Accurate Superquadric Recovery: a Probabilistic Approach

Interpreting objects with basic geometric primitives has long been studi...
research
05/24/2022

Effect of Gender, Pose and Camera Distance on Human Body Dimensions Estimation

Human Body Dimensions Estimation (HBDE) is a task that an intelligent ag...
research
05/18/2018

Synthetically Trained Neural Networks for Learning Human-Readable Plans from Real-World Demonstrations

We present a system to infer and execute a human-readable program from a...

Please sign up or login with your details

Forgot password? Click here to reset