Learning a High-Precision Robotic Assembly Task Using Pose Estimation from Simulated Depth Images

by   Yuval Litvak, et al.

Most of industrial robotic assembly tasks today require fixed initial conditions for successful assembly. These constraints induce high production costs and low adaptability to new tasks. In this work we aim towards flexible and adaptable robotic assembly by using 3D CAD models for all parts to be assembled. We focus on a generic assembly task - the Siemens Innovation Challenge - in which a robot needs to assemble a gear-like mechanism with high precision into an operating system. To obtain the millimeter-accuracy required for this task and industrial settings alike, we use a depth camera mounted near the robot end-effector. We present a high-accuracy three-stage pose estimation pipeline based on deep convolutional neural networks, which includes detection, pose estimation, refinement, and handling of near- and full symmetries of parts. The networks are trained on simulated depth images by means to ensure successful transfer to the real robot. We obtain an average pose estimation error of 2.14 millimeters and 1.09 degree leading to 88.6 robotic assembly of randomly distributed parts. To the best of our knowledge, this is the first time that the Siemens Innovation Challenge is fully solved, opening up new possibilities for automated industrial assembly.


page 1

page 3


6D Robotic Assembly Based on RGB-only Object Pose Estimation

Vision-based robotic assembly is a crucial yet challenging task as the i...

Siamese Convolutional Neural Network for Sub-millimeter-accurate Camera Pose Estimation and Visual Servoing

Visual Servoing (VS), where images taken from a camera typically attache...

CFVS: Coarse-to-Fine Visual Servoing for 6-DoF Object-Agnostic Peg-In-Hole Assembly

Robotic peg-in-hole assembly remains a challenging task due to its high ...

Optimal decision making in robotic assembly and other trial-and-error tasks

Uncertainty in perception, actuation, and the environment often require ...

Continuous close-range 3D object pose estimation

In the context of future manufacturing lines, removing fixtures will be ...

Team O2AS at the World Robot Summit 2018: An Approach to Robotic Kitting and Assembly Tasks using General Purpose Grippers and Tools

We propose a versatile robotic system for kitting and assembly tasks whi...

Assembly Planning from Observations under Physical Constraints

This paper addresses the problem of copying an unknown assembly of primi...

Please sign up or login with your details

Forgot password? Click here to reset