Model-Based Reinforcement Learning for Type 1Diabetes Blood Glucose Control

10/13/2020
by   Taku Yamagata, et al.
0

In this paper we investigate the use of model-based reinforcement learning to assist people with Type 1 Diabetes with insulin dose decisions. The proposed architecture consists of multiple Echo State Networks to predict blood glucose levels combined with Model Predictive Controller for planning. Echo State Network is a version of recurrent neural networks which allows us to learn long term dependencies in the input of time series data in an online manner. Additionally, we address the quantification of uncertainty for a more robust control. Here, we used ensembles of Echo State Networks to capture model (epistemic) uncertainty. We evaluated the approach with the FDA-approved UVa/Padova Type 1 Diabetes simulator and compared the results against baseline algorithms such as Basal-Bolus controller and Deep Q-learning. The results suggest that the model-based reinforcement learning algorithm can perform equally or better than the baseline algorithms for the majority of virtual Type 1 Diabetes person profiles tested.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/16/2020

Data-Driven Robust Control Using Reinforcement Learning

This paper proposes a robust control design method using reinforcement-l...
research
04/07/2022

Offline Reinforcement Learning for Safer Blood Glucose Control in People with Type 1 Diabetes

Hybrid closed loop systems represent the future of care for people with ...
research
06/15/2020

Efficient Model-Based Reinforcement Learning through Optimistic Policy Search and Planning

Model-based reinforcement learning algorithms with probabilistic dynamic...
research
05/18/2020

Basal Glucose Control in Type 1 Diabetes using Deep Reinforcement Learning: An In Silico Validation

People with Type 1 diabetes (T1D) require regular exogenous infusion of ...
research
06/02/2021

Deep Personalized Glucose Level Forecasting Using Attention-based Recurrent Neural Networks

In this paper, we study the problem of blood glucose forecasting and pro...
research
11/29/2017

Automating Vehicles by Deep Reinforcement Learning using Task Separation with Hill Climbing

Within the context of autonomous vehicles, classical model-based control...
research
03/19/2020

Learning to Fly via Deep Model-Based Reinforcement Learning

Learning to control robots without requiring models has been a long-term...

Please sign up or login with your details

Forgot password? Click here to reset