Learning to Actively Reduce Memory Requirements for Robot Control Tasks

08/17/2020
by   Meghan Booker, et al.
0

Robots equipped with rich sensing modalities (e.g., RGB-D cameras) performing long-horizon tasks motivate the need for policies that are highly memory-efficient. State-of-the-art approaches for controlling robots often use memory representations that are excessively rich for the task or rely on hand-crafted tricks for memory efficiency. Instead, this work provides a general approach for jointly synthesizing memory representations and policies; the resulting policies actively seek to reduce memory requirements (i.e., take actions that reduce memory usage). Specifically, we present a reinforcement learning framework that leverages an implementation of the group LASSO regularization to synthesize policies that employ low-dimensional and task-centric memory representations. We demonstrate the efficacy of our approach with simulated examples including navigation in discrete and continuous spaces as well as vision-based indoor navigation set in a photo-realistic simulator. The results on these examples indicate that our method is capable of finding policies that rely only on low-dimensional memory representations and actively reduce memory requirements.

READ FULL TEXT

page 2

page 8

research
07/04/2021

Low Dimensional State Representation Learning with Robotics Priors in Continuous Action Spaces

Autonomous robots require high degrees of cognitive and motoric intellig...
research
02/04/2020

Learning Task-Driven Control Policies via Information Bottlenecks

This paper presents a reinforcement learning approach to synthesizing ta...
research
03/05/2018

Learning to Sequence Robot Behaviors for Visual Navigation

Recent literature in the robotics community has focused on learning robo...
research
01/05/2021

An A* Curriculum Approach to Reinforcement Learning for RGBD Indoor Robot Navigation

Training robots to navigate diverse environments is a challenging proble...
research
10/07/2022

GNM: A General Navigation Model to Drive Any Robot

Learning provides a powerful tool for vision-based navigation, but the c...
research
06/05/2020

An Ergodic Measure for Active Learning From Equilibrium

This paper develops KL-Ergodic Exploration from Equilibrium (KL-E^3), a ...

Please sign up or login with your details

Forgot password? Click here to reset