Reinforcement Learning with Knowledge Representation and Reasoning: A Brief Survey

04/24/2023
by   Chao Yu, et al.
0

Reinforcement Learning(RL) has achieved tremendous development in recent years, but still faces significant obstacles in addressing complex real-life problems due to the issues of poor system generalization, low sample efficiency as well as safety and interpretability concerns. The core reason underlying such dilemmas can be attributed to the fact that most of the work has focused on the computational aspect of value functions or policies using a representational model to describe atomic components of rewards, states and actions etc, thus neglecting the rich high-level declarative domain knowledge of facts, relations and rules that can be either provided a priori or acquired through reasoning over time. Recently, there has been a rapidly growing interest in the use of Knowledge Representation and Reasoning(KRR) methods, usually using logical languages, to enable more abstract representation and efficient learning in RL. In this survey, we provide a preliminary overview on these endeavors that leverage the strengths of KRR to help solving various problems in RL, and discuss the challenging open problems and possible directions for future work in this area.

READ FULL TEXT

page 2

page 6

research
08/19/2020

A Survey of Knowledge-based Sequential Decision Making under Uncertainty

Reasoning with declarative knowledge (RDK) and sequential decision-makin...
research
06/03/2022

Challenges to Solving Combinatorially Hard Long-Horizon Deep RL Tasks

Deep reinforcement learning has shown promise in discrete domains requir...
research
08/19/2019

Reinforcement Learning Applications

We start with a brief introduction to reinforcement learning (RL), about...
research
05/12/2023

Knowledge Authoring for Rules and Actions

Knowledge representation and reasoning (KRR) systems describe and reason...
research
09/28/2018

Robot Representing and Reasoning with Knowledge from Reinforcement Learning

Reinforcement learning (RL) agents aim at learning by interacting with a...
research
01/19/2020

A Survey of Reinforcement Learning Techniques: Strategies, Recent Development, and Future Directions

Reinforcement learning is one of the core components in designing an art...
research
03/04/2022

Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventions

Reinforcement learning (RL) is acquiring a key role in the space of adap...

Please sign up or login with your details

Forgot password? Click here to reset