M-EMBER: Tackling Long-Horizon Mobile Manipulation via Factorized Domain Transfer

05/23/2023
by   Bohan Wu, et al.
0

In this paper, we propose a method to create visuomotor mobile manipulation solutions for long-horizon activities. We propose to leverage the recent advances in simulation to train visual solutions for mobile manipulation. While previous works have shown success applying this procedure to autonomous visual navigation and stationary manipulation, applying it to long-horizon visuomotor mobile manipulation is still an open challenge that demands both perceptual and compositional generalization of multiple skills. In this work, we develop Mobile-EMBER, or M-EMBER, a factorized method that decomposes a long-horizon mobile manipulation activity into a repertoire of primitive visual skills, reinforcement-learns each skill, and composes these skills to a long-horizon mobile manipulation activity. On a mobile manipulation robot, we find that M-EMBER completes a long-horizon mobile manipulation activity, cleaning_kitchen, achieving a 53 planning and executing five factorized, learned visual skills.

READ FULL TEXT

page 5

page 6

research
09/06/2022

Multi-skill Mobile Manipulation for Object Rearrangement

We study a modular approach to tackle long-horizon mobile manipulation t...
research
09/21/2021

Example-Driven Model-Based Reinforcement Learning for Solving Long-Horizon Visuomotor Tasks

In this paper, we study the problem of learning a repertoire of low-leve...
research
02/09/2023

ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills

Generalizable manipulation skills, which can be composed to tackle long-...
research
04/01/2023

Adaptive Skill Coordination for Robotic Mobile Manipulation

We present Adaptive Skill Coordination (ASC) - an approach for accomplis...
research
10/10/2018

Receding horizon estimation and control with structured noise blocking for mobile robot slip compensation

The control of field robots in varying and uncertain terrain conditions ...
research
06/08/2020

Learning compositional models of robot skills for task and motion planning

The objective of this work is to augment the basic abilities of a robot ...
research
10/20/2020

Autonomous Extension of a Symbolic Mobile Manipulation Skill Set

Today's methods of programming mobile manipulation systems' behavior for...

Please sign up or login with your details

Forgot password? Click here to reset