Is Deep Reinforcement Learning Ready for Practical Applications in Healthcare? A Sensitivity Analysis of Duel-DDQN for Sepsis Treatment

05/08/2020
by   MingYu Lu, et al.
0

The potential of Reinforcement Learning (RL) has been demonstrated through successful applications to games such as Go and Atari. However, while it is straightforward to evaluate the performance of an RL algorithm in a game setting by simply using it to play the game, evaluation is a major challenge in clinical settings where it could be unsafe to follow RL policies in practice. Thus, understanding sensitivity of RL policies to the host of decisions made during implementation is an important step toward building the type of trust in RL required for eventual clinical uptake. In this work, we perform a sensitivity analysis on a state-of-the-art RL algorithm (Dueling Double Deep Q-Networks)applied to hemodynamic stabilization treatment strategies for septic patients in the ICU. We consider sensitivity of learned policies to input features, time discretization, reward function, and random seeds. We find that varying these settings can significantly impact learned policies, which suggests a need for caution when interpreting RL agent output.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/23/2018

Model-Based Reinforcement Learning for Sepsis Treatment

Sepsis is a dangerous condition that is a leading cause of patient morta...
research
06/05/2016

Deep Q-Networks for Accelerating the Training of Deep Neural Networks

In this paper, we propose a principled deep reinforcement learning (RL) ...
research
05/31/2018

Evaluating Reinforcement Learning Algorithms in Observational Health Settings

Much attention has been devoted recently to the development of machine l...
research
07/17/2022

Reinforcement Learning For Survival, A Clinically Motivated Method For Critically Ill Patients

There has been considerable interest in leveraging RL and stochastic con...
research
11/23/2020

An Empirical Study of Representation Learning for Reinforcement Learning in Healthcare

Reinforcement Learning (RL) has recently been applied to sequential esti...
research
03/29/2021

pH-RL: A personalization architecture to bring reinforcement learning to health practice

While reinforcement learning (RL) has proven to be the approach of choic...
research
01/09/2020

Identifying Distinct, Effective Treatments for Acute Hypotension with SODA-RL: Safely Optimized Diverse Accurate Reinforcement Learning

Hypotension in critical care settings is a life-threatening emergency th...

Please sign up or login with your details

Forgot password? Click here to reset