Improved Learning of Robot Manipulation Tasks via Tactile Intrinsic Motivation

02/22/2021
by   Nikola Vulin, et al.
0

In this paper we address the challenge of exploration in deep reinforcement learning for robotic manipulation tasks. In sparse goal settings, an agent does not receive any positive feedback until randomly achieving the goal, which becomes infeasible for longer control sequences. Inspired by touch-based exploration observed in children, we formulate an intrinsic reward based on the sum of forces between a robot's force sensors and manipulation objects that encourages physical interaction. Furthermore, we introduce contact-prioritized experience replay, a sampling scheme that prioritizes contact rich episodes and transitions. We show that our solution accelerates the exploration and outperforms state-of-the-art methods on three fundamental robot manipulation benchmarks.

READ FULL TEXT

page 1

page 3

research
03/20/2019

Learning Gentle Object Manipulation with Curiosity-Driven Deep Reinforcement Learning

Robots must know how to be gentle when they need to interact with fragil...
research
07/28/2021

Value-Based Reinforcement Learning for Continuous Control Robotic Manipulation in Multi-Task Sparse Reward Settings

Learning continuous control in high-dimensional sparse reward settings, ...
research
03/05/2023

Seq2Seq Imitation Learning for Tactile Feedback-based Manipulation

Robot control for tactile feedback-based manipulation can be difficult d...
research
04/01/2021

Touch-based Curiosity for Sparse-Reward Tasks

Robots in many real-world settings have access to force/torque sensors i...
research
08/10/2019

Learning to Explore in Motion and Interaction Tasks

Model free reinforcement learning suffers from the high sampling complex...
research
03/15/2018

Rearrangement with Nonprehensile Manipulation Using Deep Reinforcement Learning

Rearranging objects on a tabletop surface by means of nonprehensile mani...
research
06/01/2022

Active Inference for Robotic Manipulation

Robotic manipulation stands as a largely unsolved problem despite signif...

Please sign up or login with your details

Forgot password? Click here to reset