Placing by Touching: An empirical study on the importance of tactile sensing for precise object placing

10/05/2022
by   Luca Lach, et al.
0

Tactile sensors are promising tools for endowing robots with embodied intelligence and increased dexterity. These sensors can provide robotic systems with direct information about physical interactions with the world, which is difficult to obtain from extrinsic perception systems. This work deals with a practical everyday living problem: stable object placement on flat surfaces starting from unknown initial poses. Common approaches for object placing either require complete scene specifications or indirect sensor measurements, such as cameras which are prone to suffer from occlusions. Instead, this work proposes a novel approach for stable object placing that combines tactile feedback and proprioceptive sensing. We devise a neural architecture that estimates a rotation matrix which results in a corrective gripper movement that aligns the object with the table and paves the way for the subsequent stable object placement. We compare models with different sensing modalities, such as force-torque and an external motion capture system, in real-world object placement tasks with different objects. Our experimental evaluation of the placing policies with a set of unknown everyday objects reveals an impressive generalization of the tactile-based pipeline and suggests that tactile sensing plays a vital role in the intrinsic understanding of dexterous object manipulation. Videos of our approach are available at https://sites.google.com/view/placing-by-touching.

READ FULL TEXT

page 1

page 3

page 4

page 5

research
03/12/2023

Re-evaluating Parallel Finger-tip Tactile Sensing for Inferring Object Adjectives: An Empirical Study

Finger-tip tactile sensors are increasingly used for robotic sensing to ...
research
03/23/2023

TactoFind: A Tactile Only System for Object Retrieval

We study the problem of object retrieval in scenarios where visual sensi...
research
06/09/2023

Augmenting Off-the-Shelf Grippers with Tactile Sensing

The development of tactile sensing and its fusion with computer vision i...
research
02/19/2022

Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network

The ability to perceive object slip via tactile feedback enables humans ...
research
05/08/2023

Rotational Slippage Prediction from Segmentation of Tactile Images

Adding tactile sensors to a robotic system is becoming a common practice...
research
10/15/2018

Robust Learning of Tactile Force Estimation through Robot Interaction

Current methods for estimating force from tactile sensor signals are eit...
research
12/03/2020

Goal-Driven Robotic Pushing Using Tactile and Proprioceptive Feedback

In robots, nonprehensile manipulation operations such as pushing are a u...

Please sign up or login with your details

Forgot password? Click here to reset