Temporal and Physical Reasoning for Perception-Based Robotic Manipulation

10/11/2017
by   Felix Jonathan, et al.
0

Accurate knowledge of object poses is crucial to successful robotic manipulation tasks, and yet most current approaches only work in laboratory settings. Noisy sensors and cluttered scenes interfere with accurate pose recognition, which is problematic especially when performing complex tasks involving object interactions. This is because most pose estimation algorithms focus only on estimating objects from a single frame, which means they lack continuity between frames. Further, they often do not consider resulting physical properties of the predicted scene such as intersecting objects or objects in unstable positions. In this work, we enhance the accuracy and stability of estimated poses for a whole scene by enforcing these physical constraints over time through the integration of a physics simulation. This allows us to accurately determine relationships between objects for a construction task. Scene parsing performance was evaluated on both simulated and real- world data. We apply our method to a real-world block stacking task, where the robot must build a tall tower of colored blocks.

READ FULL TEXT

page 1

page 6

page 7

research
03/10/2019

Domain Randomization for Active Pose Estimation

Accurate state estimation is a fundamental component of robotic control....
research
04/22/2022

Implicit Object Mapping With Noisy Data

Modelling individual objects as Neural Radiance Fields (NeRFs) within a ...
research
05/10/2019

Support Relation Analysis for Objects in Multiple View RGB-D Images

Understanding physical relations between objects, especially their suppo...
research
11/03/2020

Learning 3D Dynamic Scene Representations for Robot Manipulation

3D scene representation for robot manipulation should capture three key ...
research
01/24/2019

Teaching robots to imitate a human with no on-teacher sensors. What are the key challenges?

In this paper, we consider the problem of learning object manipulation t...
research
02/07/2019

Virtual Training for a Real Application: Accurate Object-Robot Relative Localization without Calibration

Localizing an object accurately with respect to a robot is a key step fo...
research
05/11/2019

Explaining intuitive difficulty judgments by modeling physical effort and risk

The ability to estimate task difficulty is critical for many real-world ...

Please sign up or login with your details

Forgot password? Click here to reset