Excavation Reinforcement Learning Using Geometric Representation

01/27/2022
by   Qingkai Lu, et al.
0

Excavation of irregular rigid objects in clutter, such as fragmented rocks and wood blocks, is very challenging due to their complex interaction dynamics and highly variable geometries. In this paper, we adopt reinforcement learning (RL) to tackle this challenge and learn policies to plan for a sequence of excavation trajectories for irregular rigid objects, given point clouds of excavation scenes. Moreover, we separately learn a compact representation of the point cloud on geometric tasks that do not require human labeling. We show that using the representation reduces training time for RL, while achieving similar asymptotic performance compare to an end-to-end RL algorithm. When using a policy trained in simulation directly on a real scene, we show that the policy trained with the representation outperforms end-to-end RL. To our best knowledge, this paper presents the first application of RL to plan a sequence of excavation trajectories of irregular rigid objects in clutter.

READ FULL TEXT

page 2

page 4

page 6

page 7

research
07/09/2021

Excavation Learning for Rigid Objects in Clutter

Autonomous excavation for hard or compact materials, especially irregula...
research
04/26/2021

End-to-end grasping policies for human-in-the-loop robots via deep reinforcement learning

State-of-the-art human-in-the-loop robot grasping is hugely suffered by ...
research
02/12/2022

End-to-end Reinforcement Learning of Robotic Manipulation with Robust Keypoints Representation

We present an end-to-end Reinforcement Learning(RL) framework for roboti...
research
09/13/2023

Efficient Reinforcement Learning for Jumping Monopods

In this work, we consider the complex control problem of making a monopo...
research
06/03/2016

End-to-end LSTM-based dialog control optimized with supervised and reinforcement learning

This paper presents a model for end-to-end learning of task-oriented dia...
research
12/05/2022

Learning Physically Realizable Skills for Online Packing of General 3D Shapes

We study the problem of learning online packing skills for irregular 3D ...
research
04/28/2019

Deep Neuroevolution of Recurrent and Discrete World Models

Neural architectures inspired by our own human cognitive system, such as...

Please sign up or login with your details

Forgot password? Click here to reset