Visual Servoing for Pose Control of Soft Continuum Arm in a Structured Environment

02/10/2022
by   Shivani Kamtikar, et al.
0

For soft continuum arms, visual servoing is a popular control strategy that relies on visual feedback to close the control loop. However, robust visual servoing is challenging as it requires reliable feature extraction from the image, accurate control models and sensors to perceive the shape of the arm, both of which can be hard to implement in a soft robot. This letter circumvents these challenges by presenting a deep neural network-based method to perform smooth and robust 3D positioning tasks on a soft arm by visual servoing using a camera mounted at the distal end of the arm. A convolutional neural network is trained to predict the actuations required to achieve the desired pose in a structured environment. Integrated and modular approaches for estimating the actuations from the image are proposed and are experimentally compared. A proportional control law is implemented to reduce the error between the desired and current image as seen by the camera. The model together with the proportional feedback control makes the described approach robust to several variations such as new targets, lighting, loads, and diminution of the soft arm. Furthermore, the model lends itself to be transferred to a new environment with minimal effort.

READ FULL TEXT

page 2

page 5

research
11/18/2020

Vision-Based Shape Reconstruction of Soft Continuum Arms Using a Geometric Strain Parametrization

Interest in soft continuum arms has increased as their inherent material...
research
05/24/2017

Visual Servoing from Deep Neural Networks

We present a deep neural network-based method to perform high-precision,...
research
12/11/2020

A Vision-based Sensing Approach for a Spherical Soft Robotic Arm

Sensory feedback is essential for the control of soft robotic systems an...
research
09/17/2021

A physics-informed, vision-based method to reconstruct all deformation modes in slender bodies

This paper is concerned with the problem of estimating (interpolating an...
research
10/02/2020

Controlling a CyberOctopus Soft Arm with Muscle-like Actuation

This paper entails the application of the energy shaping methodology to ...
research
04/01/2022

A Sensory Feedback Control Law for Octopus Arm Movements

The main contribution of this paper is a novel sensory feedback control ...
research
08/24/2022

Visual Servoing in Orchard Settings

We present a general framework for accurate positioning of sensors and e...

Please sign up or login with your details

Forgot password? Click here to reset