Real-Time Physics-Based Object Pose Tracking during Non-Prehensile Manipulation

11/24/2022
by   Zisong Xu, et al.
0

We propose a method to track the 6D pose of an object over time, while the object is under non-prehensile manipulation by a robot. At any given time during the manipulation of the object, we assume access to the robot joint controls and an image from a camera looking at the scene. We use the robot joint controls to perform a physics-based prediction of how the object might be moving. We then combine this prediction with the observation coming from the camera, to estimate the object pose as accurately as possible. We use a particle filtering approach to combine the control information with the visual information. We compare the proposed method with two baselines: (i) using only an image-based pose estimation system at each time-step, and (ii) a particle filter which does not perform the computationally expensive physics predictions, but assumes the object moves with constant velocity. Our results show that making physics-based predictions is worth the computational cost, resulting in more accurate tracking, and estimating object pose even when the object is not clearly visible to the camera.

READ FULL TEXT

page 2

page 5

research
03/10/2019

Domain Randomization for Active Pose Estimation

Accurate state estimation is a fundamental component of robotic control....
research
10/12/2017

Markerless visual servoing on unknown objects for humanoid robot platforms

To precisely reach for an object with a humanoid robot, it is of central...
research
05/22/2019

PoseRBPF: A Rao-Blackwellized Particle Filter for 6D Object Pose Tracking

Tracking 6D poses of objects from videos provides rich information to a ...
research
03/20/2019

Combining Coarse and Fine Physics for Manipulation using Parallel-in-Time Integration

We present a method for fast and accurate physics-based predictions duri...
research
08/08/2021

BeatNet: CRNN and Particle Filtering for Online Joint Beat Downbeat and Meter Tracking

The online estimation of rhythmic information, such as beat positions, d...
research
11/06/2021

ROFT: Real-Time Optical Flow-Aided 6D Object Pose and Velocity Tracking

6D object pose tracking has been extensively studied in the robotics and...
research
07/10/2021

SynPick: A Dataset for Dynamic Bin Picking Scene Understanding

We present SynPick, a synthetic dataset for dynamic scene understanding ...

Please sign up or login with your details

Forgot password? Click here to reset