Tactile Gym 2.0: Sim-to-real Deep Reinforcement Learning for Comparing Low-cost High-Resolution Robot Touch

07/21/2022
by   Yijiong Lin, et al.
0

High-resolution optical tactile sensors are increasingly used in robotic learning environments due to their ability to capture large amounts of data directly relating to agent-environment interaction. However, there is a high barrier of entry to research in this area due to the high cost of tactile robot platforms, specialised simulation software, and sim-to-real methods that lack generality across different sensors. In this letter we extend the Tactile Gym simulator to include three new optical tactile sensors (TacTip, DIGIT and DigiTac) of the two most popular types, Gelsight-style (image-shading based) and TacTip-style (marker based). We demonstrate that a single sim-to-real approach can be used with these three different sensors to achieve strong real-world performance despite the significant differences between real tactile images. Additionally, we lower the barrier of entry to the proposed tasks by adapting them to an inexpensive 4-DoF robot arm, further enabling the dissemination of this benchmark. We validate the extended environment on three physically-interactive tasks requiring a sense of touch: object pushing, edge following and surface following. The results of our experimental validation highlight some differences between these sensors, which may help future researchers select and customize the physical characteristics of tactile sensors for different manipulations scenarios.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

research
06/27/2022

DigiTac: A DIGIT-TacTip Hybrid Tactile Sensor for Comparing Low-Cost High-Resolution Robot Touch

Deep learning combined with high-resolution tactile sensing could lead t...
research
06/16/2021

Optical Tactile Sim-to-Real Policy Transfer via Real-to-Sim Tactile Image Translation

Simulation has recently become key for deep reinforcement learning to sa...
research
07/12/2023

Bi-Touch: Bimanual Tactile Manipulation with Sim-to-Real Deep Reinforcement Learning

Bimanual manipulation with tactile feedback will be key to human-level r...
research
03/01/2022

Rapidly Customizable 3D Printed Tactile Input Devices with No Assembly Required

Physical input devices serve as a tactile interface between users and co...
research
01/19/2023

Tacchi: A Pluggable and Low Computational Cost Elastomer Deformation Simulator for Optical Tactile Sensors

Simulation is widely applied in robotics research to save time and resou...
research
07/23/2021

SmartHand: Towards Embedded Smart Hands for Prosthetic and Robotic Applications

The sophisticated sense of touch of the human hand significantly contrib...
research
08/06/2020

Deep Reinforcement Learning for Tactile Robotics: Learning to Type on a Braille Keyboard

Artificial touch would seem well-suited for Reinforcement Learning (RL),...

Please sign up or login with your details

Forgot password? Click here to reset