Deep reinforcement learning for guidewire navigation in coronary artery phantom

10/05/2021
by   Jihoon Kweon, et al.
24

In percutaneous intervention for treatment of coronary plaques, guidewire navigation is a primary procedure for stent delivery. Steering a flexible guidewire within coronary arteries requires considerable training, and the non-linearity between the control operation and the movement of the guidewire makes precise manipulation difficult. Here, we introduce a deep reinforcement learning(RL) framework for autonomous guidewire navigation in a robot-assisted coronary intervention. Using Rainbow, a segment-wise learning approach is applied to determine how best to accelerate training using human demonstrations with deep Q-learning from demonstrations (DQfD), transfer learning, and weight initialization. `State' for RL is customized as a focus window near the guidewire tip, and subgoals are placed to mitigate a sparse reward problem. The RL agent improves performance, eventually enabling the guidewire to reach all valid targets in `stable' phase. Our framework opens anew direction in the automation of robot-assisted intervention, providing guidance on RL in physical spaces involving mechanical fatigue.

READ FULL TEXT

page 3

page 4

page 6

page 8

page 10

research
06/06/2023

Reinforcement Learning-Based Control of CrazyFlie 2.X Quadrotor

The objective of the project is to explore synergies between classical c...
research
05/18/2018

Reinforced Imitation: Sample Efficient Deep Reinforcement Learning for Map-less Navigation by Leveraging Prior Demonstrations

This work presents a learning-based approach for target driven map-less ...
research
02/27/2020

Exploration-efficient Deep Reinforcement Learning with Demonstration Guidance for Robot Control

Although deep reinforcement learning (DRL) algorithms have made importan...
research
02/06/2023

Holistic Deep-Reinforcement-Learning-based Training of Autonomous Navigation Systems

In recent years, Deep Reinforcement Learning emerged as a promising appr...
research
12/08/2019

Effects of a Social Force Model reward in Robot Navigation based on Deep Reinforcement Learning

In this paper is proposed an inclusion of the Social Force Model (SFM) i...
research
01/15/2021

Local Navigation and Docking of an Autonomous Robot Mower using Reinforcement Learning and Computer Vision

We demonstrate a successful navigation and docking control system for th...
research
06/30/2021

Decomposing the Prediction Problem; Autonomous Navigation by neoRL Agents

Navigating the world is a fundamental ability for any living entity. Acc...

Please sign up or login with your details

Forgot password? Click here to reset