Log In Sign Up

Introspective Visuomotor Control: Exploiting Uncertainty in Deep Visuomotor Control for Failure Recovery

by   Chia-Man Hung, et al.

End-to-end visuomotor control is emerging as a compelling solution for robot manipulation tasks. However, imitation learning-based visuomotor control approaches tend to suffer from a common limitation, lacking the ability to recover from an out-of-distribution state caused by compounding errors. In this paper, instead of using tactile feedback or explicitly detecting the failure through vision, we investigate using the uncertainty of a policy neural network. We propose a novel uncertainty-based approach to detect and recover from failure cases. Our hypothesis is that policy uncertainties can implicitly indicate the potential failures in the visuomotor control task and that robot states with minimum uncertainty are more likely to lead to task success. To recover from high uncertainty cases, the robot monitors its uncertainty along a trajectory and explores possible actions in the state-action space to bring itself to a more certain state. Our experiments verify this hypothesis and show a significant improvement on task success rate: 12 pick-and-reach and 22


page 1

page 4

page 6


Automatic Failure Recovery for End-User Programs on Service Mobile Robots

For service mobile robots to be most effective, it must be possible for ...

Safe end-to-end imitation learning for model predictive control

We propose the use of Bayesian networks, which provide both a mean value...

Derivative-Free Failure Avoidance Control for Manipulation using Learned Support Constraints

Learning to accomplish tasks such as driving, grasping or surgery from s...

Imitation Learning of Robot Policies by Combining Language, Vision and Demonstration

In this work we propose a novel end-to-end imitation learning approach w...

Uncertainty-aware deep learning for robot touch: Application to Bayesian tactile servo control

This work investigates uncertainty-aware deep learning (DL) in tactile r...

Bayesian Gaussian mixture model for robotic policy imitation

A common approach to learn robotic skills is to imitate a policy demonst...

Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learning

Humans are capable of completing a range of challenging manipulation tas...