Tactile Pose Estimation and Policy Learning for Unknown Object Manipulation

03/21/2022
by   Tarik Kelestemur, et al.
0

Object pose estimation methods allow finding locations of objects in unstructured environments. This is a highly desired skill for autonomous robot manipulation as robots need to estimate the precise poses of the objects in order to manipulate them. In this paper, we investigate the problems of tactile pose estimation and manipulation for category-level objects. Our proposed method uses a Bayes filter with a learned tactile observation model and a deterministic motion model. Later, we train policies using deep reinforcement learning where the agents use the belief estimation from the Bayes filter. Our models are trained in simulation and transferred to the real world. We analyze the reliability and the performance of our framework through a series of simulated and real-world experiments and compare our method to the baseline work. Our results show that the learned tactile observation model can localize the pose of novel objects at 2-mm and 1-degree resolution for position and orientation, respectively. Furthermore, we experiment on a bottle opening task where the gripper needs to reach the desired grasp state.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 8

research
04/11/2023

Dexterous In-Hand Manipulation of Slender Cylindrical Objects through Deep Reinforcement Learning with Tactile Sensing

Continuous in-hand manipulation is an important physical interaction ski...
research
11/11/2020

Learning Bayes Filter Models for Tactile Localization

Localizing and tracking the pose of robotic grippers are necessary skill...
research
07/14/2022

Visuo-Tactile Manipulation Planning Using Reinforcement Learning with Affordance Representation

Robots are increasingly expected to manipulate objects in ever more unst...
research
09/26/2021

Markerless Suture Needle 6D Pose Tracking with Robust Uncertainty Estimation for Autonomous Minimally Invasive Robotic Surgery

Suture needle localization plays a crucial role towards autonomous sutur...
research
11/13/2020

Tactile SLAM: Real-time inference of shape and pose from planar pushing

Tactile perception is central to robot manipulation in unstructured envi...
research
09/27/2019

Deep Gated Multi-modal Learning: In-hand Object Pose Estimation with Tactile and Image

In robot manipulation tasks, especially in-hand manipulation, estimation...
research
11/17/2022

TAX-Pose: Task-Specific Cross-Pose Estimation for Robot Manipulation

How do we imbue robots with the ability to efficiently manipulate unseen...

Please sign up or login with your details

Forgot password? Click here to reset