Robust and Efficient Transfer Learning with Hidden-Parameter Markov Decision Processes

06/20/2017
by   Taylor Killian, et al.
0

We introduce a new formulation of the Hidden Parameter Markov Decision Process (HiP-MDP), a framework for modeling families of related tasks using low-dimensional latent embeddings. Our new framework correctly models the joint uncertainty in the latent parameters and the state space. We also replace the original Gaussian Process-based model with a Bayesian Neural Network, enabling more scalable inference. Thus, we expand the scope of the HiP-MDP to applications with higher dimensions and more complex dynamics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/15/2013

Hidden Parameter Markov Decision Processes: A Semiparametric Regression Approach for Discovering Latent Task Parametrizations

Control applications often feature tasks with similar, but not identical...
research
12/01/2016

Transfer Learning Across Patient Variations with Hidden Parameter Markov Decision Processes

Due to physiological variation, patients diagnosed with the same conditi...
research
04/25/2017

Sufficient Markov Decision Processes with Alternating Deep Neural Networks

Advances in mobile computing technologies have made it possible to monit...
research
03/12/2021

On Incorporating Forecasts into Linear State Space Model Markov Decision Processes

Weather forecast information will very likely find increasing applicatio...
research
09/26/2019

Markov Decision Process for Video Generation

We identify two pathological cases of temporal inconsistencies in video ...
research
12/10/2019

Before we can find a model, we must forget about perfection

With Reinforcement Learning we assume that a model of the world does exi...
research
11/28/2018

AI based Safety System for Employees of Manufacturing Industries in Developing Countries

In this paper authors are going to present a Markov Decision Process (MD...

Please sign up or login with your details

Forgot password? Click here to reset