Sensing and Reconstruction of 3D Deformation on Pneumatic Soft Robots

12/22/2020
by   Rob B. N. Scharff, et al.
0

Real-time proprioception is a challenging problem for soft robots, which have almost infinite degrees-of-freedom in body deformation. When multiple actuators are used, it becomes more difficult as deformation can also occur on actuators caused by interaction between each other. To tackle this problem, we present a method in this paper to sense and reconstruct 3D deformation on pneumatic soft robots by first integrating multiple low-cost sensors inside the chambers of pneumatic actuators and then using machine learning to convert the captured signals into shape parameters of soft robots. An exterior motion capture system is employed to generate the datasets for both training and testing. With the help of good shape parameterization, the 3D shape of a soft robot can be accurately reconstructed from signals obtained from multiple sensors. We demonstrate the effectiveness of this approach on two designs of soft robots – a robotic joint and a deformable membrane. After parameterizing the deformation of these soft robots into compact shape parameters, we can effectively train the neural networks to reconstruct the 3D deformation from the sensor signals. The sensing and shape prediction pipeline can run at 50Hz in real-time on a consumer-level device.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

page 7

research
04/08/2019

Real-time Soft Robot 3D Proprioception via Deep Vision-based Sensing

The soft robots are welcomed in many robotic applications because of the...
research
12/27/2020

Jacobian-based learning for inverse kinematics of soft robots

This paper presents a new method to solve the inverse kinematic (IK) pro...
research
05/10/2022

Soft Robotic Mannequin: Design and Algorithm for Deformation Control

This paper presents a novel soft robotic system for a deformable mannequ...
research
02/25/2023

3D Printed Proprioceptive Soft Fluidic Actuators with graded porosity

Integration of both actuation and proprioception into the robot body ena...
research
11/09/2022

ViSE: Vision-Based 3D Real-Time Shape Estimation of Continuously Deformable Robots

The precise control of soft and continuum robots requires knowledge of t...
research
04/04/2019

Shape Sensing of Variable Stiffness Soft Robots using Electrical Impedance Tomography

Soft robotic systems offer benefits over traditional rigid systems throu...
research
06/08/2017

OrbTouch: Recognizing Human Touch in Deformable Interfaces with Deep Neural Networks

User interfaces provide an interactive window between physical and virtu...

Please sign up or login with your details

Forgot password? Click here to reset