Enabling Robot Manipulation of Soft and Rigid Objects with Vision-based Tactile Sensors

06/09/2023
by   Michael C. Welle, et al.
0

Endowing robots with tactile capabilities opens up new possibilities for their interaction with the environment, including the ability to handle fragile and/or soft objects. In this work, we equip the robot gripper with low-cost vision-based tactile sensors and propose a manipulation algorithm that adapts to both rigid and soft objects without requiring any knowledge of their properties. The algorithm relies on a touch and slip detection method, which considers the variation in the tactile images with respect to reference ones. We validate the approach on seven different objects, with different properties in terms of rigidity and fragility, to perform unplugging and lifting tasks. Furthermore, to enhance applicability, we combine the manipulation algorithm with a grasp sampler for the task of finding and picking a grape from a bunch without damaging it.

READ FULL TEXT

page 1

page 3

page 5

research
04/14/2022

GelSight Fin Ray: Incorporating Tactile Sensing into a Soft Compliant Robotic Gripper

To adapt to constantly changing environments and be safe for human inter...
research
12/24/2020

Simulation of Vision-based Tactile Sensors using Physics based Rendering

Tactile sensing has seen a rapid adoption with the advent of vision-base...
research
09/09/2023

DeRi-IGP: Manipulating Rigid Objects Using Deformable Objects via Iterative Grasp-Pull

Heterogeneous systems manipulation, i.e., manipulating rigid objects via...
research
11/16/2020

Multi-Step Recurrent Q-Learning for Robotic Velcro Peeling

Learning object manipulation is a critical skill for robots to interact ...
research
09/28/2022

DTact: A Vision-Based Tactile Sensor that Measures High-Resolution 3D Geometry Directly from Darkness

Vision-based tactile sensors that can measure 3D geometry of the contact...
research
02/20/2021

Digger Finger: GelSight Tactile Sensor for Object Identification Inside Granular Media

In this paper we present an early prototype of the Digger Finger that is...
research
01/07/2021

Zero-shot sim-to-real transfer of tactile control policies for aggressive swing-up manipulation

This paper aims to show that robots equipped with a vision-based tactile...

Please sign up or login with your details

Forgot password? Click here to reset