AI Chat AI Image Generator AI Video Text to Speech

A note on the article "On Exploiting Spectral Properties for Solving MDP with Large State Space"

07/18/2021

∙

by D. Maran, et al.

∙

∙

We improve a theoretical result of the article "On Exploiting Spectral Properties for Solving MDP with Large State Space" showing that their algorithm, which was proved to converge under some unrealistic assumptions, is actually guaranteed to converge always.

page 1

page 2

page 3

research

∙ 09/28/2019

Accelerating the Computation of UCB and Related Indices for Reinforcement Learning

In this paper we derive an efficient method for computing the indices as...

17 Wesley Cowan, et al. ∙

research

∙ 09/09/2019

Solving Continual Combinatorial Selection via Deep Reinforcement Learning

We consider the Markov Decision Process (MDP) of selecting a subset of i...

0 HyungSeok Song, et al. ∙

research

∙ 07/12/2014

Extreme State Aggregation Beyond MDPs

We consider a Reinforcement Learning setup where an agent interacts with...

0 Marcus Hutter, et al. ∙

research

∙ 02/06/2013

Model Reduction Techniques for Computing Approximately Optimal Solutions for Markov Decision Processes

We present a method for solving implicit (factored) Markov decision proc...

0 Thomas L. Dean, et al. ∙

research

∙ 11/03/2019

Reply to on some problems in the article "Efficient likelihood estimation in state space models" by Cheng-Der Fuh [Ann, Statist. 34 (2006) 2026-2068]

This note replies Dr. Jensen (2010) comments on Problem 2.3, which was l...

0 Cheng-Der Fuh, et al. ∙

research

∙ 06/24/2021

A Note on Exhaustive State Space Search for Efficient Code Generation

This note explores state space search to find efficient instruction sequ...

0 Aart J. C. Bik, et al. ∙

research

∙ 09/06/2021

Optimal Prediction of Unmeasured Output from Measurable Outputs In LTI Systems

In this short article, we showcase the derivation of an optimal predicto...

0 Deividas Eringis, et al. ∙