Probabilistic Surface Friction Estimation Based on Visual and Haptic Measurements

10/16/2020
by   Tran Nguyen Le, et al.
4

Accurately modeling local surface properties of objects is crucial to many robotic applications, from grasping to material recognition. Surface properties like friction are however difficult to estimate, as visual observation of the object does not convey enough information over these properties. In contrast, haptic exploration is time consuming as it only provides information relevant to the explored parts of the object. In this work, we propose a joint visuo-haptic object model that enables the estimation of surface friction coefficient over an entire object by exploiting the correlation of visual and haptic information, together with a limited haptic exploration by a robotic arm. We demonstrate the validity of the proposed method by showing its ability to estimate varying friction coefficients on a range of real multi-material objects. Furthermore, we illustrate how the estimated friction coefficients can improve grasping success rate by guiding a grasp planner toward high friction areas.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

research
03/17/2023

DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations

Robotic dexterous grasping is a challenging problem due to the high degr...
research
10/18/2021

Active Tapping via Gaussian Process for Efficient Unknown Object Surface Reconstruction

Object surface reconstruction brings essential benefits to robot graspin...
research
04/06/2021

Visual Vibration Tomography: Estimating Interior Material Properties from Monocular Video

An object's interior material properties, while invisible to the human e...
research
07/18/2017

AirCode: Unobtrusive Physical Tags for Digital Fabrication

We present AirCode, a technique that allows the user to tag physically f...
research
06/12/2023

Learning Any-View 6DoF Robotic Grasping in Cluttered Scenes via Neural Surface Rendering

Robotic manipulation is critical for admitting robotic agents to various...
research
07/25/2022

Exploiting High Quality Tactile Sensors for Simplified Grasping

Robots are expected to grasp a wide range of objects varying in shape, w...
research
07/03/2022

Pregrasp Object Material Classification by a Novel Gripper Design with Integrated Spectroscopy

Robots benefit from being able to classify objects they interact with or...

Please sign up or login with your details

Forgot password? Click here to reset