Challenges of Real-World Reinforcement Learning

04/29/2019
by   Gabriel Dulac-Arnold, et al.
0

Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL are often hard to leverage in real-world systems due to a series of assumptions that are rarely satisfied in practice. We present a set of nine unique challenges that must be addressed to productionize RL to real world problems. For each of these challenges, we specify the exact meaning of the challenge, present some approaches from the literature, and specify some metrics for evaluating that challenge. An approach that addresses all nine challenges would be applicable to a large number of real world problems. We also present an example domain that has been modified to present these challenges as a testbed for practical RL research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/24/2020

An empirical investigation of the challenges of real-world reinforcement learning

Reinforcement learning (RL) has proven its worth in a series of artifici...
research
02/04/2021

How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learned

Deep reinforcement learning (RL) has emerged as a promising approach for...
research
11/04/2020

Learning from Human Feedback: Challenges for Real-World Reinforcement Learning in NLP

Large volumes of interaction logs can be collected from NLP systems that...
research
10/28/2021

Extracting Clinician's Goals by What-if Interpretable Modeling

Although reinforcement learning (RL) has tremendous success in many fiel...
research
06/28/2023

Structure in Reinforcement Learning: A Survey and Open Problems

Reinforcement Learning (RL), bolstered by the expressive capabilities of...
research
06/14/2022

A Layered Reference Model for Penetration Testing with Reinforcement Learning and Attack Graphs

This paper considers key challenges to using reinforcement learning (RL)...
research
09/06/2018

Challenges of Context and Time in Reinforcement Learning: Introducing Space Fortress as a Benchmark

Research in deep reinforcement learning (RL) has coalesced around improv...

Please sign up or login with your details

Forgot password? Click here to reset