Tac-VGNN: A Voronoi Graph Neural Network for Pose-Based Tactile Servoing

03/05/2023
by   Wen Fan, et al.
0

Tactile pose estimation and tactile servoing are fundamental capabilities of robot touch. Reliable and precise pose estimation can be provided by applying deep learning models to high-resolution optical tactile sensors. Given the recent successes of Graph Neural Network (GNN) and the effectiveness of Voronoi features, we developed a Tactile Voronoi Graph Neural Network (Tac-VGNN) to achieve reliable pose-based tactile servoing relying on a biomimetic optical tactile sensor (TacTip). The GNN is well suited to modeling the distribution relationship between shear motions of the tactile markers, while the Voronoi diagram supplements this with area-based tactile features related to contact depth. The experiment results showed that the Tac-VGNN model can help enhance data interpretability during graph generation and model training efficiency significantly than CNN-based methods. It also improved pose estimation accuracy along vertical depth by 28.57 achieved better performance on the real surface following tasks with smoother robot control trajectories. For more project details, please view our website: https://sites.google.com/view/tac-vgnn/home

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

research
07/26/2023

Attention for Robot Touch: Tactile Saliency Prediction for Robust Sim-to-Real Tactile Control

High-resolution tactile sensing can provide accurate information about l...
research
06/29/2023

TacMMs: Tactile Mobile Manipulators for Warehouse Automation

Multi-robot platforms are playing an increasingly important role in ware...
research
04/29/2021

Uncertainty-aware deep learning for robot touch: Application to Bayesian tactile servo control

This work investigates uncertainty-aware deep learning (DL) in tactile r...
research
03/04/2020

Optimal Deep Learning for Robot Touch

This article illustrates the application of deep learning to robot touch...
research
07/08/2023

Robust Learning-Based Incipient Slip Detection using the PapillArray Optical Tactile Sensor for Improved Robotic Gripping

The ability to detect slip, particularly incipient slip, enables robotic...
research
05/10/2022

An Empirical Evaluation of Various Information Gain Criteria for Active Tactile Action Selection for Pose Estimation

Accurate object pose estimation using multi-modal perception such as vis...
research
07/22/2021

DeltaCharger: Charging Robot with Inverted Delta Mechanism and CNN-driven High Fidelity Tactile Perception for Precise 3D Positioning

DeltaCharger is a novel charging robot with an Inverted Delta structure ...

Please sign up or login with your details

Forgot password? Click here to reset