Composable Planning with Attributes

03/01/2018
by   Amy Zhang, et al.
0

The tasks that an agent will need to solve often are not known during training. However, if the agent knows which properties of the environment are important then, after learning how its actions affect those properties, it may be able to use this knowledge to solve complex tasks without training specifically for them. Towards this end, we consider a setup in which an environment is augmented with a set of user defined attributes that parameterize the features of interest. We propose a method that learns a policy for transitioning between "nearby" sets of attributes, and maintains a graph of possible transitions. Given a task at test time that can be expressed in terms of a target set of attributes, and a current state, our model infers the attributes of the current state and searches over paths through attribute space to get a high level plan, and then uses its low level policy to execute the plan. We show in 3D block stacking, grid-world games, and StarCraft that our model is able to generalize to longer, more complex tasks at test time by composing simpler learned policies.

READ FULL TEXT

Authors

page 7

09/06/2018

Planning with Arithmetic and Geometric Attributes

A desirable property of an intelligent agent is its ability to understan...
10/30/2019

Plan Arithmetic: Compositional Plan Vectors for Multi-Task Control

Autonomous agents situated in real-world environments must be able to ma...
10/02/2018

Time Reversal as Self-Supervision

A longstanding challenge in robot learning for manipulation tasks has be...
06/05/2020

Rapid Task-Solving in Novel Environments

When thrust into an unfamiliar environment and charged with solving a se...
03/23/2019

Long Range Neural Navigation Policies for the Real World

Learned Neural Network based policies have shown promising results for r...
07/03/2021

Supervised Off-Policy Ranking

Off-policy evaluation (OPE) leverages data generated by other policies t...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.