Simultaneous Tactile Exploration and Grasp Refinement for Unknown Objects

02/28/2021
by   Cristiana de Farias, et al.
0

This paper addresses the problem of simultaneously exploring an unknown object to model its shape, using tactile sensors on robotic fingers, while also improving finger placement to optimise grasp stability. In many situations, a robot will have only a partial camera view of the near side of an observed object, for which the far side remains occluded. We show how an initial grasp attempt, based on an initial guess of the overall object shape, yields tactile glances of the far side of the object which enable the shape estimate and consequently the successive grasps to be improved. We propose a grasp exploration approach using a probabilistic representation of shape, based on Gaussian Process Implicit Surfaces. This representation enables initial partial vision data to be augmented with additional data from successive tactile glances. This is combined with a probabilistic estimate of grasp quality to refine grasp configurations. When choosing the next set of finger placements, a bi-objective optimisation method is used to mutually maximise grasp quality and improve shape representation during successive grasp attempts. Experimental results show that the proposed approach yields stable grasp configurations more efficiently than a baseline method, while also yielding improved shape estimate of the grasped object.

READ FULL TEXT

page 1

page 4

page 7

research
05/10/2018

Learning to Grasp Without Seeing

Can a robot grasp an unknown object without seeing it? In this paper, we...
research
05/30/2019

Bayesian Grasp: Robotic visual stable grasp based on prior tactile knowledge

Robotic grasp detection is a fundamental capability for intelligent mani...
research
02/13/2018

Active Exploration Using Gaussian Random Fields and Gaussian Process Implicit Surfaces

In this work we study the problem of exploring surfaces and building com...
research
03/05/2018

Tactile Regrasp: Grasp Adjustments via Simulated Tactile Transformations

This paper presents a novel regrasp control policy that makes use of tac...
research
08/15/2023

Grasp Transfer based on Self-Aligning Implicit Representations of Local Surfaces

Objects we interact with and manipulate often share similar parts, such ...
research
09/12/2022

PoseIt: A Visual-Tactile Dataset of Holding Poses for Grasp Stability Analysis

When humans grasp objects in the real world, we often move our arms to h...
research
06/27/2021

Improving Grasp Planning Efficiency with Human Grasp Tendencies*

After a grasp has been planned, if the object orientation changes, the i...

Please sign up or login with your details

Forgot password? Click here to reset