Learning Goal-Oriented Non-Prehensile Pushing in Cluttered Scenes

03/04/2022
by   Nils Dengler, et al.
0

Pushing objects through cluttered scenes is a challenging task, especially when the objects to be pushed have initially unknown dynamics and touching other entities has to be avoided to reduce the risk of damage. In this paper, we approach this problem by applying deep reinforcement learning to generate pushing actions for a robotic manipulator acting on a planar surface where objects have to be pushed to goal locations while avoiding other items in the same workspace. With the latent space learned from a depth image of the scene and other observations of the environment, such as contact information between the end effector and the object as well as distance to the goal, our framework is able to learn contact-rich pushing actions that avoid collisions with other objects. As the experimental results with a six degrees of freedom robotic arm show, our system is able to successfully push objects from start to end positions while avoiding nearby objects. Furthermore, we evaluate our learned policy in comparison to a state-of-the-art pushing controller for mobile robots and show that our agent performs better in terms of success rate, collisions with other objects, and continuous object contact in various scenarios.

READ FULL TEXT

page 1

page 3

page 5

page 6

research
03/06/2023

Viewpoint Push Planning for Mapping of Unknown Confined Spaces

Viewpoint planning is an important task in any application where objects...
research
08/01/2022

Learning to Grasp on the Moon from 3D Octree Observations with Deep Reinforcement Learning

Extraterrestrial rovers with a general-purpose robotic arm have many pot...
research
07/06/2022

NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Hands

We introduce a neural implicit representation for grasps of objects from...
research
02/23/2018

Edge-Based Recognition of Novel Objects for Robotic Grasping

In this paper, we investigate the problem of grasping novel objects in u...
research
08/09/2021

Mapless Humanoid Navigation Using Learned Latent Dynamics

In this paper, we propose a novel Deep Reinforcement Learning approach t...
research
12/03/2020

Goal-Driven Robotic Pushing Using Tactile and Proprioceptive Feedback

In robots, nonprehensile manipulation operations such as pushing are a u...
research
10/17/2021

CLASP: Constrained Latent Shape Projection for Refining Object Shape from Robot Contact

Robots need both visual and contact sensing to effectively estimate the ...

Please sign up or login with your details

Forgot password? Click here to reset