Deep Reinforcement Learning for Concentric Tube Robot Path Planning

01/22/2023
by   Keshav Iyengar, et al.
0

As surgical interventions trend towards minimally invasive approaches, Concentric Tube Robots (CTRs) have been explored for various interventions such as brain, eye, fetoscopic, lung, cardiac and prostate surgeries. Arranged concentrically, each tube is rotated and translated independently to move the robot end-effector position, making kinematics and control challenging. Classical model-based approaches have been previously investigated with developments in deep learning based approaches outperforming more classical approaches in both forward kinematics and shape estimation. We propose a deep reinforcement learning approach to control where we generalise across two to four systems, an element not yet achieved in any other deep learning approach for CTRs. In this way we explore the likely robustness of the control approach. Also investigated is the impact of rotational constraints applied on tube actuation and the effects on error metrics. We evaluate inverse kinematics errors and tracking error for path following tasks and compare the results to those achieved using state of the art methods. Additionally, as current results are performed in simulation, we also investigate a domain transfer approach known as domain randomization and evaluate error metrics as an initial step towards hardware implementation. Finally, we compare our method to a Jacobian approach found in literature.

READ FULL TEXT
research
08/03/2020

Tracking the Race Between Deep Reinforcement Learning and Imitation Learning – Extended Version

Learning-based approaches for solving large sequential decision making p...
research
01/14/2023

Deep-Reinforcement-Learning-based Path Planning for Industrial Robots using Distance Sensors as Observation

Industrial robots are widely used in various manufacturing environments ...
research
10/04/2022

Learning to Control Random Boolean Networks: A Deep Reinforcement Learning Approach

In this paper we describe the application of a Deep Reinforcement Learni...
research
05/29/2023

Perimeter Control Using Deep Reinforcement Learning: A Model-free Approach towards Homogeneous Flow Rate Optimization

Perimeter control maintains high traffic efficiency within protected reg...
research
01/09/2020

Closed-loop deep learning: generating forward models with back-propagation

A reflex is a simple closed loop control approach which tries to minimis...
research
07/10/2019

Deep Lagrangian Networks for end-to-end learning of energy-based control for under-actuated systems

Applying Deep Learning to control has a lot of potential for enabling th...
research
02/09/2022

Scenario-Assisted Deep Reinforcement Learning

Deep reinforcement learning has proven remarkably useful in training age...

Please sign up or login with your details

Forgot password? Click here to reset