Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimation

by   Qihao Liu, et al.

We propose an unsupervised vision-based system to estimate the joint configurations of the robot arm from a sequence of RGB or RGB-D images without knowing the model a priori, and then adapt it to the task of category-independent articulated object pose estimation. We combine a classical geometric formulation with deep learning and extend the use of epipolar constraint to multi-rigid-body systems to solve this task. Given a video sequence, the optical flow is estimated to get the pixel-wise dense correspondences. After that, the 6D pose is computed by a modified PnP algorithm. The key idea is to leverage the geometric constraints and the constraint between multiple frames. Furthermore, we build a synthetic dataset with different kinds of robots and multi-joint articulated objects for the research of vision-based robot control and robotic vision. We demonstrate the effectiveness of our method on three benchmark datasets and show that our method achieves higher accuracy than the state-of-the-art supervised methods in estimating joint angles of robot arms and articulated objects.



There are no comments yet.


page 6


Unsupervised Joint Learning of Depth, Optical Flow, Ego-motion from Video

Estimating geometric elements such as depth, camera motion, and optical ...

Single-view robot pose and joint angle estimation via render compare

We introduce RoboPose, a method to estimate the joint angles and the 6D ...

Towards Accurate Task Accomplishment with Low-Cost Robotic Arms

Training a robotic arm to accomplish real-world tasks has been attractin...

DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion

A key technical challenge in performing 6D object pose estimation from R...

Learning Accurate Dense Correspondences and When to Trust Them

Establishing dense correspondences between a pair of images is an import...

Vision-Based Shape Reconstruction of Soft Continuum Arms Using a Geometric Strain Parametrization

Interest in soft continuum arms has increased as their inherent material...

Vision-based Excavator Activity Analysis and Safety Monitoring System

In this paper, we propose an excavator activity analysis and safety moni...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.