IFOR: Iterative Flow Minimization for Robotic Object Rearrangement

02/01/2022
by   Ankit Goyal, et al.
6

Accurate object rearrangement from vision is a crucial problem for a wide variety of real-world robotics applications in unstructured environments. We propose IFOR, Iterative Flow Minimization for Robotic Object Rearrangement, an end-to-end method for the challenging problem of object rearrangement for unknown objects given an RGBD image of the original and final scenes. First, we learn an optical flow model based on RAFT to estimate the relative transformation of the objects purely from synthetic data. This flow is then used in an iterative minimization algorithm to achieve accurate positioning of previously unseen objects. Crucially, we show that our method applies to cluttered scenes, and in the real world, while training only on synthetic data. Videos are available at https://imankgoyal.github.io/ifor.html.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

research
12/05/2018

Unsupervised Generation of Optical Flow Datasets from Videos in the Wild

Dense optical flow ground truth of non-rigid motion for real-world image...
research
03/15/2023

Rethinking Optical Flow from Geometric Matching Consistent Perspective

Optical flow estimation is a challenging problem remaining unsolved. Rec...
research
09/05/2023

Structural Concept Learning via Graph Attention for Multi-Level Rearrangement Planning

Robotic manipulation tasks, such as object rearrangement, play a crucial...
research
11/04/2021

A System for General In-Hand Object Re-Orientation

In-hand object reorientation has been a challenging problem in robotics ...
research
04/18/2023

Learning Sim-to-Real Dense Object Descriptors for Robotic Manipulation

It is crucial to address the following issues for ubiquitous robotics ma...
research
01/20/2020

The benefits of synthetic data for action categorization

In this paper, we study the value of using synthetically produced videos...
research
09/28/2020

Amodal 3D Reconstruction for Robotic Manipulation via Stability and Connectivity

Learning-based 3D object reconstruction enables single- or few-shot esti...

Please sign up or login with your details

Forgot password? Click here to reset