Active Visuo-Tactile Point Cloud Registration for Accurate Pose Estimation of Objects in an Unknown Workspace

08/09/2021
by   Prajval Kumar Murali, et al.
0

This paper proposes a novel active visuo-tactile based methodology wherein the accurate estimation of the time-invariant SE(3) pose of objects is considered for autonomous robotic manipulators. The robot equipped with tactile sensors on the gripper is guided by a vision estimate to actively explore and localize the objects in the unknown workspace. The robot is capable of reasoning over multiple potential actions, and execute the action to maximize information gain to update the current belief of the object. We formulate the pose estimation process as a linear translation invariant quaternion filter (TIQF) by decoupling the estimation of translation and rotation and formulating the update and measurement model in linear form. We perform pose estimation sequentially on acquired measurements using very sparse point cloud as acquiring each measurement using tactile sensing is time consuming. Furthermore, our proposed method is computationally efficient to perform an exhaustive uncertainty-based active touch selection strategy in real-time without the need for trading information gain with execution time. We evaluated the performance of our approach extensively in simulation and by a robotic system.

READ FULL TEXT
research
09/28/2021

On the Empirical Evaluation of Information Gain Criteria for Active Action Selection

Accurate object pose estimation using multi-modal perception such as vis...
research
05/10/2022

An Empirical Evaluation of Various Information Gain Criteria for Active Tactile Action Selection for Pose Estimation

Accurate object pose estimation using multi-modal perception such as vis...
research
02/04/2022

Active Visuo-Tactile Interactive Robotic Perception for Accurate Object Pose Estimation in Dense Clutter

This work presents a novel active visuo-tactile based framework for robo...
research
07/30/2023

Touch if it's transparent! ACTOR: Active Tactile-based Category-Level Transparent Object Reconstruction

Accurate shape reconstruction of transparent objects is a challenging ta...
research
03/08/2022

A Hierarchical Approach to Active Pose Estimation

Creating mobile robots which are able to find and manipulate objects in ...
research
04/29/2021

Uncertainty-aware deep learning for robot touch: Application to Bayesian tactile servo control

This work investigates uncertainty-aware deep learning (DL) in tactile r...

Please sign up or login with your details

Forgot password? Click here to reset