DeepAI AI Chat
Log In Sign Up

Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimation

by   Qihao Liu, et al.

We propose an unsupervised vision-based system to estimate the joint configurations of the robot arm from a sequence of RGB or RGB-D images without knowing the model a priori, and then adapt it to the task of category-independent articulated object pose estimation. We combine a classical geometric formulation with deep learning and extend the use of epipolar constraint to multi-rigid-body systems to solve this task. Given a video sequence, the optical flow is estimated to get the pixel-wise dense correspondences. After that, the 6D pose is computed by a modified PnP algorithm. The key idea is to leverage the geometric constraints and the constraint between multiple frames. Furthermore, we build a synthetic dataset with different kinds of robots and multi-joint articulated objects for the research of vision-based robot control and robotic vision. We demonstrate the effectiveness of our method on three benchmark datasets and show that our method achieves higher accuracy than the state-of-the-art supervised methods in estimating joint angles of robot arms and articulated objects.


Unsupervised Joint Learning of Depth, Optical Flow, Ego-motion from Video

Estimating geometric elements such as depth, camera motion, and optical ...

DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion

A key technical challenge in performing 6D object pose estimation from R...

Single-view robot pose and joint angle estimation via render compare

We introduce RoboPose, a method to estimate the joint angles and the 6D ...

Instance-specific 6-DoF Object Pose Estimation from Minimal Annotations

In many robotic applications, the environment setting in which the 6-DoF...

Towards Accurate Task Accomplishment with Low-Cost Robotic Arms

Training a robotic arm to accomplish real-world tasks has been attractin...

Improved Object Pose Estimation via Deep Pre-touch Sensing

For certain manipulation tasks, object pose estimation from head-mounted...

6D Object Pose Estimation from Approximate 3D Models for Orbital Robotics

We present a novel technique to estimate the 6D pose of objects from sin...