Robust 3D Vision for Autonomous Robots

08/27/2022
by   Farhad Aghili, et al.
0

This paper presents a fault-tolerant 3D vision system for autonomous robotic operation. In particular, pose estimation of space objects is achieved using 3D vision data in an integrated Kalman filter (KF) and an Iterative Closest Point (ICP) algorithm in a closed-loop configuration. The initial guess for the internal ICP iteration is provided by the state estimate propagation of the Kalman filer. The Kalman filter is capable of not only estimating the target's states but also its inertial parameters. This allows the motion of the target to be predictable as soon as the filter converges. Consequently, the ICP can maintain pose tracking over a wider range of velocity due to the increased precision of ICP initialization. Furthermore, incorporation of the target's dynamics model in the estimation process allows the estimator continuously provide pose estimation even when the sensor temporally loses its signal namely due to obstruction. The capabilities of the pose estimation methodology is demonstrated by a ground testbed for Automated Rendezvous Docking. In this experiment, Neptec's Laser Camera System (LCS) is used for real-time scanning of a satellite model attached to a manipulator arm, which is driven by a simulator according to orbital and attitude dynamics. The results showed that robust tracking of the free-floating tumbling satellite can be achieved only if the Kalman filter and ICP are in a closed-loop configuration.

READ FULL TEXT
research
06/25/2019

EKFPnP: Extended Kalman Filter for Camera Pose Estimation in a Sequence of Images

In real-world applications the Perspective-n-Point (PnP) problem should ...
research
09/05/2022

Adaptive Visual Servo Control for Autonomous Robots

This paper focuses on an adaptive and fault-tolerant vision-guided robot...
research
11/28/2013

Real-time High Resolution Fusion of Depth Maps on GPU

A system for live high quality surface reconstruction using a single mov...
research
02/12/2021

Fast Fault Detection on a Quadrotor using Onboard Sensors and a Kalman Filter Approach

This paper presents a novel method for fast and robust detection of actu...
research
07/28/2019

Real-time Tracking-by-Detection of Human Motion in RGB-D Camera Networks

This paper presents a novel real-time tracking system capable of improvi...
research
09/20/2023

Online Supervised Training of Spaceborne Vision during Proximity Operations using Adaptive Kalman Filtering

This work presents an Online Supervised Training (OST) method to enable ...
research
08/06/2017

Long Short-Term Memory Kalman Filters:Recurrent Neural Estimators for Pose Regularization

One-shot pose estimation for tasks such as body joint localization, came...

Please sign up or login with your details

Forgot password? Click here to reset