Learning efficient haptic shape exploration with a rigid tactile sensor array

02/20/2019
by   Sascha Fleer, et al.
10

Haptic exploration is a key skill for both robots and humans to discriminate and handle unknown or recognize familiar objects. Its active nature is impressively evident in humans which from early on reliably acquire sophisticated sensory-motor capabilites for active exploratory touch and directed manual exploration that associates surfaces and object properties with their spatial locations. In stark contrast, in robotics the relative lack of good real-world interaction models, along with very restricted sensors and a scarcity of suitable training data to leverage machine learning methods has so far rendered haptic exploration a largely underdeveloped skill for robots, very unlike vision where deep learning approaches and an abundance of available training data have triggered huge advances. In the present work, we connect recent advances in recurrent models of visual attention (RAM) with previous insights about the organisation of human haptic search behavior, exploratory procedures and haptic glances for a novel learning architecture that learns a generative model of haptic exploration in a simplified three-dimensional environment. The proposed algorithm simultaneously optimizes main perception-action loop components: feature extraction, integration of features over time, and the control strategy, while continuously acquiring data online. The resulting method has been successfully tested with four different objects. It achieved results close to 100 object contour exploration that has been optimized for its own sensor morphology.

READ FULL TEXT

page 3

page 6

page 12

page 13

research
07/20/2021

Active 3D Shape Reconstruction from Vision and Touch

Humans build 3D understandings of the world through active object explor...
research
11/02/2017

Active Clothing Material Perception using Tactile Sensing and Deep Learning

Humans represent the objects in the same category using their properties...
research
09/08/2021

Active Multi-Object Exploration and Recognition via Tactile Whiskers

Robotic exploration under uncertain environments is challenging when opt...
research
10/24/2022

Task-Driven In-Hand Manipulation of Unknown Objects with Tactile Sensing

Manipulation of objects in-hand without an object model is a foundationa...
research
02/17/2021

EEG-based Texture Roughness Classification in Active Tactile Exploration with Invariant Representation Learning Networks

During daily activities, humans use their hands to grasp surrounding obj...
research
03/09/2018

Deep Visuo-Tactile Learning: Estimation of Material Properties from Images

Estimation of materials properties, such as softness or roughness from v...

Please sign up or login with your details

Forgot password? Click here to reset