kPAM 2.0: Feedback Control for Category-Level Robotic Manipulation

02/11/2021
by   Wei Gao, et al.
0

In this paper, we explore generalizable, perception-to-action robotic manipulation for precise, contact-rich tasks. In particular, we contribute a framework for closed-loop robotic manipulation that automatically handles a category of objects, despite potentially unseen object instances and significant intra-category variations in shape, size and appearance. Previous approaches typically build a feedback loop on top of a real-time 6-DOF pose estimator. However, representing an object with a parameterized transformation from a fixed geometric template does not capture large intra-category shape variation. Hence we adopt the keypoint-based object representation proposed in kPAM for category-level pick-and-place, and extend it to closed-loop manipulation policies with contact-rich tasks. We first augment keypoints with local orientation information. Using the oriented keypoints, we propose a novel object-centric action representation in terms of regulating the linear/angular velocity or force/torque of these oriented keypoints. This formulation is surprisingly versatile – we demonstrate that it can accomplish contact-rich manipulation tasks that require precision and dexterity for a category of objects with different shapes, sizes and appearances, such as peg-hole insertion for pegs and holes with significant shape variation and tight clearance. With the proposed object and action representation, our framework is also agnostic to the robot grasp pose and initial object configuration, making it flexible for integration and deployment.

READ FULL TEXT

page 1

page 4

page 6

research
03/15/2019

kPAM: KeyPoint Affordances for Category-Level Robotic Manipulation

We would like robots to achieve purposeful manipulation by placing any i...
research
09/16/2019

kPAM-SC: Generalizable Manipulation Planning using KeyPoint Affordance and Shape Completion

Manipulation planning is the task of computing robot trajectories that m...
research
06/25/2022

Learning Preconditions of Hybrid Force-Velocity Controllers for Contact-Rich Manipulation

Robots need to manipulate objects in constrained environments like shelv...
research
01/30/2022

You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstration

Promising results have been achieved recently in category-level manipula...
research
07/16/2020

Model-Based Manipulation of Linear Flexible Objects with Visual Curvature Feedback

Manipulation of deformable objects is a desired skill in making robots u...
research
08/21/2023

CHORD: Category-level Hand-held Object Reconstruction via Shape Deformation

In daily life, humans utilize hands to manipulate objects. Modeling the ...
research
06/26/2021

Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Tasks

Highly constrained manipulation tasks continue to be challenging for aut...

Please sign up or login with your details

Forgot password? Click here to reset