Review of Metrics to Measure the Stability, Robustness and Resilience of Reinforcement Learning

03/22/2022
by   Laura L. Pullum, et al.
0

Reinforcement learning has received significant interest in recent years, due primarily to the successes of deep reinforcement learning at solving many challenging tasks such as playing Chess, Go and online computer games. However, with the increasing focus on reinforcement learning, applications outside of gaming and simulated environments require understanding the robustness, stability, and resilience of reinforcement learning methods. To this end, we conducted a comprehensive literature review to characterize the available literature on these three behaviors as they pertain to reinforcement learning. We classify the quantitative and theoretical approaches used to indicate or measure robustness, stability, and resilience behaviors. In addition, we identified the action or event to which the quantitative approaches were attempting to be stable, robust, or resilient. Finally, we provide a decision tree useful for selecting metrics to quantify the behaviors. We believe that this is the first comprehensive review of stability, robustness and resilience specifically geared towards reinforcement learning.

READ FULL TEXT

page 12

page 21

page 22

page 26

page 28

page 34

page 35

page 37

research
12/05/2021

Beyond Robustness: Resilience Verification of Tree-Based Classifiers

In this paper we criticize the robustness measure traditionally employed...
research
06/03/2019

RL-Based Method for Benchmarking the Adversarial Resilience and Robustness of Deep Reinforcement Learning Policies

This paper investigates the resilience and robustness of Deep Reinforcem...
research
08/18/2022

A Review of Uncertainty for Deep Reinforcement Learning

Uncertainty is ubiquitous in games, both in the agents playing games and...
research
03/12/2019

A Review of Reinforcement Learning for Autonomous Building Energy Management

The area of building energy management has received a significant amount...
research
10/26/2018

Stability-certified reinforcement learning: A control-theoretic perspective

We investigate the important problem of certifying stability of reinforc...
research
06/06/2022

Deep Reinforcement Learning for Cybersecurity Threat Detection and Protection: A Review

The cybersecurity threat landscape has lately become overly complex. Thr...
research
07/26/2020

Network resilience

Many systems on our planet are known to shift abruptly and irreversibly ...

Please sign up or login with your details

Forgot password? Click here to reset