Planning for Novelty: Width-Based Algorithms for Common Problems in Control, Planning and Reinforcement Learning

06/09/2021
by   Nir Lipovetzky, et al.
0

Width-based algorithms search for solutions through a general definition of state novelty. These algorithms have been shown to result in state-of-the-art performance in classical planning, and have been successfully applied to model-based and model-free settings where the dynamics of the problem are given through simulation engines. Width-based algorithms performance is understood theoretically through the notion of planning width, providing polynomial guarantees on their runtime and memory consumption. To facilitate synergies across research communities, this paper summarizes the area of width-based planning, and surveys current and future research directions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/17/2021

Approximate Novelty Search

Width-based search algorithms seek plans by prioritizing states accordin...
research
06/23/2021

Width-based Lookaheads with Learnt Base Policies and Heuristics Over the Atari-2600 Benchmark

We propose new width-based planning and learning algorithms applied over...
research
01/14/2022

Comparing Model-free and Model-based Algorithms for Offline Reinforcement Learning

Offline reinforcement learning (RL) Algorithms are often designed with e...
research
01/15/2021

Hierarchical Width-Based Planning and Learning

Width-based search methods have demonstrated state-of-the-art performanc...
research
09/29/2021

Learning Dynamics Models for Model Predictive Agents

Model-Based Reinforcement Learning involves learning a dynamics model fr...
research
12/16/2020

Planning From Pixels in Atari With Learned Symbolic Representations

Width-based planning methods have been shown to yield state-of-the-art p...
research
07/08/2021

A note on 'Variable Neighborhood Search Based Algorithms for Crossdock Truck Assignment'

Some implementations of variable neighborhood search based algorithms we...

Please sign up or login with your details

Forgot password? Click here to reset