DeepAI AI Chat
Log In Sign Up

Complementary reinforcement learning toward explainable agents

01/01/2019
by   Jung Hoon Lee, et al.
Allen Institute
34

Reinforcement learning (RL) algorithms allow agents to learn skills and strategies to perform complex tasks without detailed instructions or expensive labelled training examples. That is, RL agents can learn, as we learn. Given the importance of learning in our intelligence, RL has been thought to be one of key components to general artificial intelligence, and recent breakthroughs in deep reinforcement learning suggest that neural networks (NN) are natural platforms for RL agents. However, despite the efficiency and versatility of NN-based RL agents, their decision-making remains incomprehensible, reducing their utilities. To deploy RL into a wider range of applications, it is imperative to develop explainable NN-based RL agents. Here, we propose a method to derive a secondary comprehensible agent from a NN-based RL agent, whose decision-makings are based on simple rules. Our empirical evaluation of this secondary agent's performance supports the possibility of building a comprehensible and transparent agent using a NN-based RL agent.

READ FULL TEXT

page 11

page 12

page 13

11/26/2018

Environments for Lifelong Reinforcement Learning

To achieve general artificial intelligence, reinforcement learning (RL) ...
10/19/2019

Explainable AI: Deep Reinforcement Learning Agents for Residential Demand Side Cost Savings in Smart Grids

Motivated by the recent advancements in deep Reinforcement Learning (RL)...
11/11/2022

Global and Local Analysis of Interestingness for Competency-Aware Deep Reinforcement Learning

In recent years, advances in deep learning have resulted in a plethora o...
11/14/2021

Free Will Belief as a consequence of Model-based Reinforcement Learning

The debate on whether or not humans have free will has been raging for c...
01/15/2019

Comparing Knowledge-based Reinforcement Learning to Neural Networks in a Strategy Game

We compare a novel Knowledge-based Reinforcement Learning (KB-RL) approa...
10/09/2021

Theoretically Principled Deep RL Acceleration via Nearest Neighbor Function Approximation

Recently, deep reinforcement learning (RL) has achieved remarkable empir...
12/14/2021

Representation and Invariance in Reinforcement Learning

If we changed the rules, would the wise trade places with the fools? Dif...