Soft Robotic Link with Controllable Transparency for Vision-based Tactile and Proximity Sensing

11/07/2022
by   Quan Khanh Luu, et al.
0

Robots have been brought to work close to humans in many scenarios. For coexistence and collaboration, robots should be safe and pleasant for humans to interact with. To this end, the robots could be both physically soft with multimodal sensing/perception, so that the robots could have better awareness of the surrounding environment, as well as to respond properly to humans' action/intention. This paper introduces a novel soft robotic link, named ProTac, that possesses multiple sensing modes: tactile and proximity sensing, based on computer vision and a functional material. These modalities come from a layered structure of a soft transparent silicon skin, a polymer dispersed liquid crystal (PDLC) film, and reflective markers. Here, the PDLC film can switch actively between the opaque and the transparent state, from which the tactile sensing and proximity sensing can be obtained by using cameras solely built inside the ProTac link. In this paper, inference algorithms for tactile proximity perception are introduced. Evaluation results of two sensing modalities demonstrated that, with a simple activation strategy, ProTac link could effectively perceive useful information from both approaching and in-contact obstacles. The proposed sensing device is expected to bring in ultimate solutions for design of robots with softness, whole-body and multimodal sensing, and safety control strategies.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
04/18/2022

Multimodal Proximity and Visuotactile Sensing With a Selectively Transmissive Soft Membrane

The most common sensing modalities found in a robot perception system ar...
research
03/12/2023

StereoTac: a Novel Visuotactile Sensor that Combines Tactile Sensing with 3D Vision

Combining 3D vision with tactile sensing could unlock a greater level of...
research
07/06/2021

Tactile Sensing with a Tendon-Driven Soft Robotic Finger

In this paper, a novel tactile sensing mechanism for soft robotic finger...
research
10/03/2019

Exoskeleton-covered soft finger with vision-based proprioception and exteroception

Soft robots offer significant advantages in adaptability, safety, and de...
research
02/21/2018

ViTac: Feature Sharing between Vision and Tactile Sensing for Cloth Texture Recognition

Vision and touch are two of the important sensing modalities for humans ...
research
05/02/2023

Touch and deformation perception of soft manipulators with capacitive e-skins and deep learning

Tactile sensing in soft robots remains particularly challenging because ...
research
06/19/2018

iCLAP: Shape Recognition by Combining Proprioception and Touch Sensing

For humans, both the proprioception and touch sensing are highly utilize...

Please sign up or login with your details

Forgot password? Click here to reset