Deep Reinforcement Learning in System Optimization

08/04/2019
by   Ameer Haj-Ali, et al.
6

The recent advancements in deep reinforcement learning have opened new horizons and opportunities to tackle various problems in system optimization. Such problems are generally tailored to delayed, aggregated, and sequential rewards, which is an inherent behavior in the reinforcement learning setting, where an agent collects rewards while exploring and exploiting the environment to maximize the long term reward. However, in some cases, it is not clear why deep reinforcement learning is a good fit for the problem. Sometimes, it does not perform better than the state-of-the-art solutions. And in other cases, random search or greedy algorithms could outperform deep reinforcement learning. In this paper, we review, discuss, and evaluate the recent trends of using deep reinforcement learning in system optimization. We propose a set of essential metrics to guide future works in evaluating the efficacy of using deep reinforcement learning in system optimization. Our evaluation includes challenges, the types of problems, their formulation in the deep reinforcement learning setting, embedding, the model used, efficiency, and robustness. We conclude with a discussion on open challenges and potential directions for pushing further the integration of reinforcement learning in system optimization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/06/2018

Faster Deep Q-learning using Neural Episodic Control

The Research on deep reinforcement learning to estimate Q-value by deep ...
research
08/15/2023

Deep reinforcement learning for process design: Review and perspective

The transformation towards renewable energy and feedstock supply in the ...
research
06/29/2021

Multiagent Deep Reinforcement Learning: Challenges and Directions Towards Human-Like Approaches

This paper surveys the field of multiagent deep reinforcement learning. ...
research
11/13/2020

Robust Quadruped Jumping via Deep Reinforcement Learning

In this paper we consider a general task of jumping varying distances an...
research
08/10/2023

Beyond Deep Reinforcement Learning: A Tutorial on Generative Diffusion Models in Network Optimization

Generative Diffusion Models (GDMs) have emerged as a transformative forc...
research
12/31/2021

SimSR: Simple Distance-based State Representation for Deep Reinforcement Learning

This work explores how to learn robust and generalizable state represent...

Please sign up or login with your details

Forgot password? Click here to reset