SDRL: Interpretable and Data-efficient Deep Reinforcement LearningLeveraging Symbolic Planning

10/31/2018
by   Daoming Lyu, et al.
0

Deep reinforcement learning (DRL) has gained great success by learning directly from high-dimensional sensory inputs, yet is notorious for the lack of interpretability. Interpretability of the subtasks is critical in hierarchical decision-making as it increases the transparency of black-box-style DRL approach and helps the RL practitioners to understand the high-level behavior of the system better. In this paper, we introduce symbolic planning into DRL and propose a framework of Symbolic Deep Reinforcement Learning (SDRL) that can handle both high-dimensional sensory inputs and symbolic planning. The task-level interpretability is enabled by relating symbolic actions to options.This framework features a planner -- controller -- meta-controller architecture, which takes charge of subtask scheduling, data-driven subtask learning, and subtask evaluation, respectively. The three components cross-fertilize each other and eventually converge to an optimal symbolic plan along with the learned subtasks, bringing together the advantages of long-term planning capability with symbolic knowledge and end-to-end reinforcement learning directly from a high-dimensional sensory input. Experimental results validate the interpretability of subtasks, along with improved data efficiency compared with state-of-the-art approaches.

READ FULL TEXT
research
10/31/2018

SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planning

Deep reinforcement learning (DRL) has gained great success by learning d...
research
05/16/2019

Knowledge-Based Sequential Decision-Making Under Uncertainty

Deep reinforcement learning (DRL) algorithms have achieved great success...
research
08/13/2021

TDM: Trustworthy Decision-Making via Interpretability Enhancement

Human-robot interactive decision-making is increasingly becoming ubiquit...
research
06/21/2021

Interpretable Model-based Hierarchical Reinforcement Learning using Inductive Logic Programming

Recently deep reinforcement learning has achieved tremendous success in ...
research
12/30/2022

Symbolic Visual Reinforcement Learning: A Scalable Framework with Object-Level Abstraction and Differentiable Expression Search

Learning efficient and interpretable policies has been a challenging tas...
research
09/18/2016

Towards Deep Symbolic Reinforcement Learning

Deep reinforcement learning (DRL) brings the power of deep neural networ...
research
02/14/2018

From Gameplay to Symbolic Reasoning: Learning SAT Solver Heuristics in the Style of Alpha(Go) Zero

Despite the recent successes of deep neural networks in various fields s...

Please sign up or login with your details

Forgot password? Click here to reset