Learning to Sequence Robot Behaviors for Visual Navigation

03/05/2018
by   Hadi Salman, et al.
0

Recent literature in the robotics community has focused on learning robot behaviors that abstract out lower-level details of robot control. To fully leverage the efficacy of such behaviors, it is necessary to select and sequence them to achieve a given task. In this paper, we present an approach to both learn and sequence robot behaviors, applied to the problem of visual navigation of mobile robots. We construct a layered representation of control policies composed of low- level behaviors and a meta-level policy. The low-level behaviors enable the robot to locomote in a particular environment while avoiding obstacles, and the meta-level policy actively selects the low-level behavior most appropriate for the current situation based purely on visual feedback. We demonstrate the effectiveness of our method on three simulated robot navigation tasks: a legged hexapod robot which must successfully traverse varying terrain, a wheeled robot which must navigate a maze-like course while avoiding obstacles, and finally a wheeled robot navigating in the presence of dynamic obstacles. We show that by learning control policies in a layered manner, we gain the ability to successfully traverse new compound environments composed of distinct sub-environments, and outperform both the low-level behaviors in their respective sub-environments, as well as a hand-crafted selection of low-level policies on these compound environments.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

research
03/05/2018

Hierarchical Reinforcement Learning for Sequencing Behaviors

Recent literature in the robot learning community has focused on learnin...
research
11/07/2018

Generative Adversarial Policy Networks for Behavioural Repertoire

Learning algorithms are enabling robots to solve increasingly challengin...
research
03/12/2018

A Deep Learning Based Behavioral Approach to Indoor Autonomous Navigation

We present a semantically rich graph representation for indoor robotic n...
research
03/23/2019

Long Range Neural Navigation Policies for the Real World

Learned Neural Network based policies have shown promising results for r...
research
12/17/2022

Cascaded Compositional Residual Learning for Complex Interactive Behaviors

Real-world autonomous missions often require rich interaction with nearb...
research
08/17/2020

Learning to Actively Reduce Memory Requirements for Robot Control Tasks

Robots equipped with rich sensing modalities (e.g., RGB-D cameras) perfo...
research
05/24/2020

Learning visual servo policies via planner cloning

Learning control policies for visual servoing in novel environments is a...

Please sign up or login with your details

Forgot password? Click here to reset