In-Hand Gravitational Pivoting Using Tactile Sensing

10/11/2022
by   Jason Toskov, et al.
0

We study gravitational pivoting, a constrained version of in-hand manipulation, where we aim to control the rotation of an object around the grip point of a parallel gripper. To achieve this, instead of controlling the gripper to avoid slip, we embrace slip to allow the object to rotate in-hand. We collect two real-world datasets, a static tracking dataset and a controller-in-the loop dataset, both annotated with object angle and angular velocity labels. Both datasets contain force-based tactile information on ten different household objects. We train an LSTM model to predict the angular position and velocity of the held object from purely tactile data. We integrate this model with a controller that opens and closes the gripper allowing the object to rotate to desired relative angles. We conduct real-world experiments where the robot is tasked to achieve a relative target angle. We show that our approach outperforms a sliding-window based MLP in a zero-shot generalization setting with unseen objects. Furthermore, we show a 16.6 performance when the LSTM model is fine-tuned on a small set of data collected with both the LSTM model and the controller in-the-loop. Code and videos are available at https://rhys-newbury.github.io/projects/pivoting/

READ FULL TEXT

page 1

page 3

page 4

research
03/20/2023

Rotating Objects via In-Hand Pivoting using Vision, Force and Touch

We propose a robotic manipulation system that can pivot objects on a sur...
research
06/16/2023

Tactile-Reactive Roller Grasper

Manipulation of objects within a robot's hand is one of the most importa...
research
04/10/2023

PoseFusion: Robust Object-in-Hand Pose Estimation with SelectLSTM

Accurate estimation of the relative pose between an object and a robot h...
research
10/03/2019

Cable Manipulation with a Tactile-Reactive Gripper

Manipulation of flexible cables is relevant to both industrial and house...
research
02/05/2021

Towards integrated tactile sensorimotor control in anthropomorphic soft robotic hands

In this work, we report on the integrated sensorimotor control of the Pi...
research
06/28/2022

Learning Variable Impedance Control for Aerial Sliding on Uneven Heterogeneous Surfaces by Proprioceptive and Tactile Sensing

The recent development of novel aerial vehicles capable of physically in...
research
11/01/2020

Technical Report: A New Hopping Controller for Highly Dynamical Bipeds

We present angle of attack control, a novel control strategy for a hip e...

Please sign up or login with your details

Forgot password? Click here to reset