TANDEM: Learning Joint Exploration and Decision Making with Tactile Sensors

03/01/2022
by   Jingxi Xu, et al.
0

Inspired by the human ability to perform complex manipulation in the complete absence of vision (like retrieving an object from a pocket), the robotic manipulation field is motivated to develop new methods for tactile-based object interaction. However, tactile sensing presents the challenge of being an active sensing modality: a touch sensor provides sparse, local data, and must be used in conjunction with effective exploration strategies in order to collect information. In this work, we focus on the process of guiding tactile exploration, and its interplay with task-related decision making. We propose TANDEM (TActile exploration aNd DEcision Making), an architecture to learn efficient exploration strategies in conjunction with decision making. Our approach is based on separate but co-trained modules for exploration and discrimination. We demonstrate this method on a tactile object recognition task, where a robot equipped with a touch sensor must explore and identify an object from a known set based on tactile feedback alone. TANDEM achieves higher accuracy with fewer actions than alternative methods and is also shown to be more robust to sensor noise.

READ FULL TEXT

page 1

page 3

page 6

page 7

research
09/19/2022

TANDEM3D: Active Tactile Exploration for 3D Object Recognition

Tactile recognition of 3D objects remains a challenging task. Compared t...
research
10/18/2004

Neural Architectures for Robot Intelligence

We argue that the direct experimental approaches to elucidate the archit...
research
07/13/2023

Robotic surface exploration with vision and tactile sensing for cracks detection and characterisation

This paper presents a novel algorithm for crack localisation and detecti...
research
01/18/2020

A Transfer Learning Approach to Cross-Modal Object Recognition: From Visual Observation to Robotic Haptic Exploration

In this work, we introduce the problem of cross-modal visuo-tactile obje...
research
05/21/2018

Principal Components of Touch

Our human sense of touch enables us to manipulate our surroundings; ther...
research
09/12/2019

Learning to Live Life on the Edge: Online Learning for Data-Efficient Tactile Contour Following

Tactile sensing has been used for a variety of robotic exploration and m...
research
03/12/2023

Re-evaluating Parallel Finger-tip Tactile Sensing for Inferring Object Adjectives: An Empirical Study

Finger-tip tactile sensors are increasingly used for robotic sensing to ...

Please sign up or login with your details

Forgot password? Click here to reset