Explainable Deep Reinforcement Learning Using Introspection in a Non-episodic Task

08/18/2021
by   Angel Ayala, et al.
0

Explainable reinforcement learning allows artificial agents to explain their behavior in a human-like manner aiming at non-expert end-users. An efficient alternative of creating explanations is to use an introspection-based method that transforms Q-values into probabilities of success used as the base to explain the agent's decision-making process. This approach has been effectively used in episodic and discrete scenarios, however, to compute the probability of success in non-episodic and more complex environments has not been addressed yet. In this work, we adapt the introspection method to be used in a non-episodic task and try it in a continuous Atari game scenario solved with the Rainbow algorithm. Our initial results show that the probability of success can be computed directly from the Q-values for all possible actions.

READ FULL TEXT
research
12/14/2022

Explaining Agent's Decision-making in a Hierarchical Reinforcement Learning Scenario

Reinforcement learning is a machine learning approach based on behaviora...
research
06/24/2020

Explainable robotic systems: Interpreting outcome-focused actions in a reinforcement learning scenario

Robotic systems are more present in our society every day. In human-robo...
research
07/07/2022

Evaluating Human-like Explanations for Robot Actions in Reinforcement Learning Scenarios

Explainable artificial intelligence is a research field that tries to pr...
research
11/23/2022

Introspection-based Explainable Reinforcement Learning in Episodic and Non-episodic Scenarios

With the increasing presence of robotic systems and human-robot environm...
research
06/09/2023

Explaining Reinforcement Learning with Shapley Values

For reinforcement learning systems to be widely adopted, their users mus...
research
10/31/2017

Visualizing and Understanding Atari Agents

Deep reinforcement learning (deep RL) agents have achieved remarkable su...
research
06/10/2022

Large-Scale Retrieval for Reinforcement Learning

Effective decision making involves flexibly relating past experiences an...

Please sign up or login with your details

Forgot password? Click here to reset