Automatic View Planning with Multi-scale Deep Reinforcement Learning Agents

06/08/2018
by   Amir Alansary, et al.
Imperial College London
10

We propose a fully automatic method to find standardized view planes in 3D image acquisitions. Standard view images are important in clinical practice as they provide a means to perform biometric measurements from similar anatomical regions. These views are often constrained to the native orientation of a 3D image acquisition. Navigating through target anatomy to find the required view plane is tedious and operator-dependent. For this task, we employ a multi-scale reinforcement learning (RL) agent framework and extensively evaluate several Deep Q-Network (DQN) based strategies. RL enables a natural learning paradigm by interaction with the environment, which can be used to mimic experienced operators. We evaluate our results using the distance between the anatomical landmarks and detected planes, and the angles between their normal vector and target. The proposed algorithm is assessed on the mid-sagittal and anterior-posterior commissure planes of brain MRI, and the 4-chamber long-axis plane commonly used in cardiac MRI, achieving accuracy of 1.53mm, 1.98mm and 4.84mm, respectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/01/2022

Agent with Tangent-based Formulation and Anatomical Perception for Standard Plane Localization in 3D Ultrasound

Standard plane (SP) localization is essential in routine clinical ultras...
09/24/2021

Training Automatic View Planner for Cardiac MR Imaging via Self-Supervision by Spatial Relationship between Views

View planning for the acquisition of cardiac magnetic resonance imaging ...
08/18/2020

Communicative Reinforcement Learning Agents for Landmark Detection in Brain Images

Accurate detection of anatomical landmarks is an essential step in sever...
01/13/2023

Multi-Target Landmark Detection with Incomplete Images via Reinforcement Learning and Shape Prior

Medical images are generally acquired with limited field-of-view (FOV), ...
03/26/2021

Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound

Accurate standard plane (SP) localization is the fundamental step for pr...

Please sign up or login with your details

Forgot password? Click here to reset