Accurate Vision-based Manipulation through Contact Reasoning

11/08/2019
by   Alina Kloss, et al.
18

Planning contact interactions is one of the core challenges of many robotic tasks. Optimizing contact locations while taking dynamics into account is computationally costly and in only partially observed environments, executing contact-based tasks often suffers from low accuracy. We present an approach that addresses these two challenges for the problem of vision-based manipulation. First, we propose to disentangle contact from motion optimization. Thereby, we improve planning efficiency by focusing computation on promising contact locations. Second, we use a hybrid approach for perception and state estimation that combines neural networks with a physically meaningful state representation. In simulation and real-world experiments on the task of planar pushing, we show that our method is more efficient and achieves a higher manipulation accuracy than previous vision-based approaches.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 4

09/28/2021

TrajectoTree: Trajectory Optimization Meets Tree Search for Planning Multi-contact Dexterous Manipulation

Dexterous manipulation tasks often require contact switching, where fing...
02/23/2021

Interpretability in Contact-Rich Manipulation via Kinodynamic Images

Deep Neural Networks (NNs) have been widely utilized in contact-rich man...
02/27/2020

In-Hand Object Pose Tracking via Contact Feedback and GPU-Accelerated Robotic Simulation

Tracking the pose of an object while it is being held and manipulated by...
11/23/2020

COCOI: Contact-aware Online Context Inference for Generalizable Non-planar Pushing

General contact-rich manipulation problems are long-standing challenges ...
03/29/2021

Fundamental Challenges in Deep Learning for Stiff Contact Dynamics

Frictional contact has been extensively studied as the core underlying b...
12/09/2020

Constraining Dense Hand Surface Tracking with Elasticity

Many of the actions that we take with our hands involve self-contact and...
09/28/2020

Vision based Target Interception using Aerial Manipulation

Selective interception of objects in unknown environment autonomously by...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.