DeepAI AI Chat
Log In Sign Up

Learning 6-DoF Grasping and Pick-Place Using Attention Focus

by   Marcus Gualtieri, et al.
Northeastern University

We address a class of manipulation problems where the robot perceives the scene with a depth sensor and can move its end effector in a space with six degrees of freedom -- 3D position and orientation. Our approach is to formulate the problem as a Markov decision process (MDP) with abstract yet generally applicable state and action representations. Finding a good solution to the MDP requires adding constraints on the allowed actions. We develop a specific set of constraints called hierarchical SE(3) sampling (HSE3S) which causes the robot to learn a sequence of gazes to focus attention on the task-relevant parts of the scene. We demonstrate the effectiveness of our approach on three challenging pick-place tasks (with novel objects in clutter and nontrivial places) both in simulation and on a real robot, even though all training is done in simulation.


page 4

page 6

page 9


Policy learning in SE(3) action spaces

In the spatial action representation, the action space spans the space o...

Sim2Real Transfer for Reinforcement Learning without Dynamics Randomization

In this work we show how to use the Operational Space Control framework ...

Pick2Place: Task-aware 6DoF Grasp Estimation via Object-Centric Perspective Affordance

The choice of a grasp plays a critical role in the success of downstream...

Formal Language Constraints for Markov Decision Processes

In order to satisfy safety conditions, a reinforcement learned (RL) agen...

Hierarchical Solution of Markov Decision Processes using Macro-actions

We investigate the use of temporally abstract actions, or macro-actions,...

Learning Manipulation Skills Via Hierarchical Spatial Attention

Learning generalizable skills in robotic manipulation has long been chal...

Optimization of Robot Tasks with Cartesian Degrees of Freedom using Virtual Joints

A common task in robotics is unloading identical goods from a tray with ...