Relational Abstractions for Generalized Reinforcement Learning on Symbolic Problems

04/27/2022
by   Rushang Karia, et al.
0

Reinforcement learning in problems with symbolic state spaces is challenging due to the need for reasoning over long horizons. This paper presents a new approach that utilizes relational abstractions in conjunction with deep learning to learn a generalizable Q-function for such problems. The learned Q-function can be efficiently transferred to related problems that have different object names and object quantities, and thus, entirely different state spaces. We show that the learned generalized Q-function can be utilized for zero-shot transfer to related problems without an explicit, hand-coded curriculum. Empirical evaluations on a range of problems show that our method facilitates efficient zero-shot transfer of learned knowledge to much larger problem instances containing many objects.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/10/2020

Learning Generalized Relational Heuristic Networks for Model-Agnostic Planning

Computing goal-directed behavior (sequential decision-making, or plannin...
research
02/08/2020

Learning State Abstractions for Transfer in Continuous Control

Can simple algorithms with a good representation solve challenging reinf...
research
11/04/2021

Value Function Spaces: Skill-Centric State Abstractions for Long-Horizon Reasoning

Reinforcement learning can train policies that effectively perform compl...
research
10/04/2022

Learning Dynamic Abstract Representations for Sample-Efficient Reinforcement Learning

In many real-world problems, the learning agent needs to learn a problem...
research
12/23/2019

Towards Practical Multi-Object Manipulation using Relational Reinforcement Learning

Learning robotic manipulation tasks using reinforcement learning with sp...
research
09/23/2020

Worst-Case-Aware Curriculum Learning for Zero and Few Shot Transfer

Multi-task transfer learning based on pre-trained language encoders achi...
research
10/10/2017

Using Task Descriptions in Lifelong Machine Learning for Improved Performance and Zero-Shot Transfer

Knowledge transfer between tasks can improve the performance of learned ...

Please sign up or login with your details

Forgot password? Click here to reset