DeepAI
Log In Sign Up

Improved Learning of Robot Manipulation Tasks via Tactile Intrinsic Motivation

02/22/2021
by   Nikola Vulin, et al.
0

In this paper we address the challenge of exploration in deep reinforcement learning for robotic manipulation tasks. In sparse goal settings, an agent does not receive any positive feedback until randomly achieving the goal, which becomes infeasible for longer control sequences. Inspired by touch-based exploration observed in children, we formulate an intrinsic reward based on the sum of forces between a robot's force sensors and manipulation objects that encourages physical interaction. Furthermore, we introduce contact-prioritized experience replay, a sampling scheme that prioritizes contact rich episodes and transitions. We show that our solution accelerates the exploration and outperforms state-of-the-art methods on three fundamental robot manipulation benchmarks.

READ FULL TEXT

page 1

page 3

03/20/2019

Learning Gentle Object Manipulation with Curiosity-Driven Deep Reinforcement Learning

Robots must know how to be gentle when they need to interact with fragil...
10/23/2022

Active Exploration for Robotic Manipulation

Robotic manipulation stands as a largely unsolved problem despite signif...
04/01/2021

Touch-based Curiosity for Sparse-Reward Tasks

Robots in many real-world settings have access to force/torque sensors i...
03/15/2018

Rearrangement with Nonprehensile Manipulation Using Deep Reinforcement Learning

Rearranging objects on a tabletop surface by means of nonprehensile mani...
08/10/2019

Learning to Explore in Motion and Interaction Tasks

Model free reinforcement learning suffers from the high sampling complex...
08/01/2022

Relay Hindsight Experience Replay: Continual Reinforcement Learning for Robot Manipulation Tasks with Sparse Rewards

Learning with sparse rewards is usually inefficient in Reinforcement Lea...