Iteratively-Refined Interactive 3D Medical Image Segmentation with Multi-Agent Reinforcement Learning

11/23/2019
by   Xuan Liao, et al.
46

Existing automatic 3D image segmentation methods usually fail to meet the clinic use. Many studies have explored an interactive strategy to improve the image segmentation performance by iteratively incorporating user hints. However, the dynamic process for successive interactions is largely ignored. We here propose to model the dynamic process of iterative interactive image segmentation as a Markov decision process (MDP) and solve it with reinforcement learning (RL). Unfortunately, it is intractable to use single-agent RL for voxel-wise prediction due to the large exploration space. To reduce the exploration space to a tractable size, we treat each voxel as an agent with a shared voxel-level behavior strategy so that it can be solved with multi-agent reinforcement learning. An additional advantage of this multi-agent model is to capture the dependency among voxels for segmentation task. Meanwhile, to enrich the information of previous segmentations, we reserve the prediction uncertainty in the state space of MDP and derive an adjustment action space leading to a more precise and finer segmentation. In addition, to improve the efficiency of exploration, we design a relative cross-entropy gain-based reward to update the policy in a constrained direction. Experimental results on various medical datasets have shown that our method significantly outperforms existing state-of-the-art methods, with the advantage of fewer interactions and a faster convergence.

READ FULL TEXT

page 4

page 7

page 8

research
03/19/2023

Boundary-aware Supervoxel-level Iteratively Refined Interactive 3D Image Segmentation with Multi-agent Reinforcement Learning

Interactive segmentation has recently been explored to effectively and e...
research
04/12/2022

RL-CoSeg : A Novel Image Co-Segmentation Algorithm with Deep Reinforcement Learning

This paper proposes an automatic image co-segmentation algorithm based o...
research
06/10/2021

RLCorrector: Reinforced Proofreading for Connectomics Image Segmentation

The segmentation of nanoscale electron microscopy (EM) images is crucial...
research
11/15/2021

Interactive Medical Image Segmentation with Self-Adaptive Confidence Calibration

Medical image segmentation is one of the fundamental problems for artifi...
research
06/08/2021

Left Ventricle Contouring in Cardiac Images Based on Deep Reinforcement Learning

Medical image segmentation is one of the important tasks of computer-aid...
research
02/02/2019

When Collaborative Filtering Meets Reinforcement Learning

In this paper, we study a multi-step interactive recommendation problem,...
research
11/03/2022

Theta-Resonance: A Single-Step Reinforcement Learning Method for Design Space Exploration

Given an environment (e.g., a simulator) for evaluating samples in a spe...

Please sign up or login with your details

Forgot password? Click here to reset