Pick2Place: Task-aware 6DoF Grasp Estimation via Object-Centric Perspective Affordance

by   Zhanpeng He, et al.

The choice of a grasp plays a critical role in the success of downstream manipulation tasks. Consider a task of placing an object in a cluttered scene; the majority of possible grasps may not be suitable for the desired placement. In this paper, we study the synergy between the picking and placing of an object in a cluttered scene to develop an algorithm for task-aware grasp estimation. We present an object-centric action space that encodes the relationship between the geometry of the placement scene and the object to be placed in order to provide placement affordance maps directly from perspective views of the placement scene. This action space enables the computation of a one-to-one mapping between the placement and picking actions allowing the robot to generate a diverse set of pick-and-place proposals and to optimize for a grasp under other task constraints such as robot kinematics and collision avoidance. With experiments both in simulation and on a real robot we demonstrate that with our method, the robot is able to successfully complete the task of placement-aware grasping with over 89 generalizes to novel objects and scenes.


page 1

page 3

page 4

page 5

page 6


Learning to Regrasp by Learning to Place

In this paper, we explore whether a robot can learn to regrasp a diverse...

Learning Tri-mode Grasping for Ambidextrous Robot Picking

Object picking in cluttered scenes is a widely investigated field of rob...

Precise Object Placement with Pose Distance Estimations for Different Objects and Grippers

This paper introduces a novel approach for the grasping and precise plac...

Learning to Place Objects onto Flat Surfaces in Human-Preferred Orientations

We study the problem of placing a grasped object on an empty flat surfac...

Scene Editing as Teleoperation: A Case Study in 6DoF Kit Assembly

Studies in robot teleoperation have been centered around action specific...

Learning 6-DoF Grasping and Pick-Place Using Attention Focus

We address a class of manipulation problems where the robot perceives th...

Integrating Risk in Humanoid Robot Control for Applications in the Nuclear Industry

This paper discuss the integration of risk into a robot control framewor...

Please sign up or login with your details

Forgot password? Click here to reset