A soft thumb-sized vision-based sensor with accurate all-round force perception

11/10/2021
by   Huanbo Sun, et al.
14

Vision-based haptic sensors have emerged as a promising approach to robotic touch due to affordable high-resolution cameras and successful computer-vision techniques. However, their physical design and the information they provide do not yet meet the requirements of real applications. We present a robust, soft, low-cost, vision-based, thumb-sized 3D haptic sensor named Insight: it continually provides a directional force-distribution map over its entire conical sensing surface. Constructed around an internal monocular camera, the sensor has only a single layer of elastomer over-molded on a stiff frame to guarantee sensitivity, robustness, and soft contact. Furthermore, Insight is the first system to combine photometric stereo and structured light using a collimator to detect the 3D deformation of its easily replaceable flexible outer shell. The force information is inferred by a deep neural network that maps images to the spatial distribution of 3D contact force (normal and shear). Insight has an overall spatial resolution of 0.4 mm, force magnitude accuracy around 0.03 N, and force direction accuracy around 5 degrees over a range of 0.03–2 N for numerous distinct contacts with varying contact area. The presented hardware and software design concepts can be transferred to a wide variety of robot parts.

READ FULL TEXT

page 4

page 12

page 14

page 27

page 28

page 29

page 31

page 33

research
04/21/2023

Minsight: A Fingertip-Sized Vision-Based Tactile Sensor for Robotic Manipulation

Intelligent interaction with the physical world requires perceptual abil...
research
10/31/2019

Towards vision-based robotic skins: a data-driven, multi-camera tactile sensor

This paper describes the design of a multi-camera optical tactile sensor...
research
02/04/2022

DelTact: A Vision-based Tactile Sensor Using Dense Color Pattern

Tactile sensing is an essential perception for robots to complete dexter...
research
09/19/2022

WiForceSticker: Batteryless, Thin Sticker-like Flexible Force Sensor

Any two objects in contact with each other exert a force that could be s...
research
02/17/2022

Predict the Rover Mobility over Soft Terrain using Articulated Wheeled Bevameter

Robot mobility is critical for mission success, especially in soft or de...
research
09/09/2019

Ground truth force distribution for learning-based tactile sensing: a finite element approach

Skin-like tactile sensors provide robots with rich feedback related to t...
research
06/01/2022

A Flexible and Robust Vision Trap for Automated Part Feeder Design

Fast, robust, and flexible part feeding is essential for enabling automa...

Please sign up or login with your details

Forgot password? Click here to reset