Multi-Task Reinforcement Learning based Mobile Manipulation Control for Dynamic Object Tracking and Grasping

06/07/2020
by   Cong Wang, et al.
15

Agile control of mobile manipulator is challenging because of the high complexity coupled by the robotic system and the unstructured working environment. Tracking and grasping a dynamic object with a random trajectory is even harder. In this paper, a multi-task reinforcement learning-based mobile manipulation control framework is proposed to achieve general dynamic object tracking and grasping. Several basic types of dynamic trajectories are chosen as the task training set. To improve the policy generalization in practice, random noise and dynamics randomization are introduced during the training process. Extensive experiments show that our policy trained can adapt to unseen random dynamic trajectories with about 0.1m tracking error and 75% grasping success rate of dynamic objects. The trained policy can also be successfully deployed on a real mobile manipulator.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
03/09/2021

Deep 6-DoF Tracking of Unknown Objects for Reactive Grasping

Robotic manipulation of unknown objects is an important field of researc...
research
03/04/2022

GraspARL: Dynamic Grasping via Adversarial Reinforcement Learning

Grasping moving objects, such as goods on a belt or living animals, is a...
research
12/15/2021

Visually Guided UGV for Autonomous Mobile Manipulation in Dynamic and Unstructured GPS Denied Environments

A robotic solution for the unmanned ground vehicles (UGVs) to execute th...
research
11/04/2021

Generalization in Dexterous Manipulation via Geometry-Aware Multi-Task Learning

Dexterous manipulation of arbitrary objects, a fundamental daily task fo...
research
09/07/2023

ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation

We present ArtiGrasp, a novel method to synthesize bi-manual hand-object...
research
02/16/2023

Learning a Meta-Controller for Dynamic Grasping

Grasping moving objects is a challenging task that combines multiple sub...
research
01/04/2019

A probabilistic framework for tracking uncertainties in robotic manipulation

Precisely tracking uncertainties is crucial for robots to successfully a...

Please sign up or login with your details

Forgot password? Click here to reset