MOMA-Force: Visual-Force Imitation for Real-World Mobile Manipulation

08/07/2023
by   Taozheng Yang, et al.
0

In this paper, we present a novel method for mobile manipulators to perform multiple contact-rich manipulation tasks. While learning-based methods have the potential to generate actions in an end-to-end manner, they often suffer from insufficient action accuracy and robustness against noise. On the other hand, classical control-based methods can enhance system robustness, but at the cost of extensive parameter tuning. To address these challenges, we present MOMA-Force, a visual-force imitation method that seamlessly combines representation learning for perception, imitation learning for complex motion generation, and admittance whole-body control for system robustness and controllability. MOMA-Force enables a mobile manipulator to learn multiple complex contact-rich tasks with high success rates and small contact forces. In a real household setting, our method outperforms baseline methods in terms of task success rates. Moreover, our method achieves smaller contact forces and smaller force variances compared to baseline methods without force imitation. Overall, we offer a promising approach for efficient and robust mobile manipulation in the real world. Videos and more details can be found on <https://visual-force-imitation.github.io>

READ FULL TEXT

page 1

page 5

page 7

research
08/01/2022

A System for Imitation Learning of Contact-Rich Bimanual Manipulation Policies

In this paper, we discuss a framework for teaching bimanual manipulation...
research
09/21/2023

ForceSight: Text-Guided Mobile Manipulation with Visual-Force Goals

We present ForceSight, a system for text-guided mobile manipulation that...
research
09/30/2019

A Mobile Manipulation System for One-Shot Teaching of Complex Tasks in Homes

We describe a mobile manipulation hardware and software system capable o...
research
11/09/2018

Imitation Learning for Object Manipulation Based on Position/Force Information Using Bilateral Control

This study proposes an imitation learning method based on force and posi...
research
04/28/2021

Seeing All the Angles: Learning Multiview Manipulation Policies for Contact-Rich Tasks from Demonstrations

Learned visuomotor policies have shown considerable success as an altern...
research
05/01/2020

Learning Compliance Adaptation in Contact-Rich Manipulation

Compliant robot behavior is crucial for the realization of contact-rich ...
research
02/20/2021

Imitation Learning for Variable Speed Object Manipulation

To operate in a real-world environment, robots have several requirements...

Please sign up or login with your details

Forgot password? Click here to reset