Fast Active Monocular Distance Estimation from Time-to-Contact

03/14/2022
by   Levi Burner, et al.
0

Distance estimation is fundamental for a variety of robotic applications including navigation, manipulation and planning. Inspired by the mammal's visual system, which gazes at specific objects (active fixation), and estimates when the object will reach it (time-to-contact), we develop a novel constraint between time-to-contact, acceleration, and distance that we call the τ-constraint. It allows an active monocular camera to estimate depth using time-to-contact and inertial measurements (linear accelerations and angular velocities) within a window of time. Our work differs from other approaches by focusing on patches instead of feature points. This is, because the change in the patch area determines the time-to-contact directly. The result enables efficient estimation of distance while using only a small portion of the image, leading to a large speedup. We successfully validate the proposed τ-constraint in the application of estimating camera position with a monocular grayscale camera and an Inertial Measurement Unit (IMU). Specifically, we test our method on different real-world planar objects over trajectories 8-40 seconds in duration and 7-35 meters long. Our method achieves 8.5 cm Average Trajectory Error (ATE) while the popular Visual-Inertial Odometry methods VINS-Mono and ROVIO achieve 12.2 and 16.9 cm ATE respectively. Additionally, our implementation runs 27× faster than VINS-Mono's and 6.8× faster than ROVIO's. We believe these results indicate the τ-constraints potential to be the basis of robust, sophisticated algorithms for a multitude of applications involving an active camera and an IMU.

READ FULL TEXT

page 14

page 15

page 17

page 18

page 19

page 20

page 22

page 23

research
08/21/2018

Estimating Metric Poses of Dynamic Objects Using Monocular Visual-Inertial Fusion

A monocular 3D object tracking system generally has only up-to-scale pos...
research
10/18/2022

Edge-based Monocular Thermal-Inertial Odometry in Visually Degraded Environments

State estimation in complex illumination environments based on conventio...
research
03/20/2018

Hybrid Contact Preintegration for Visual-Inertial-Contact State Estimation within Factor Graphs

The factor graph framework is a convenient modeling technique for roboti...
research
01/12/2021

Binary TTC: A Temporal Geofence for Autonomous Navigation

Time-to-contact (TTC), the time for an object to collide with the observ...
research
03/01/2023

Probabilistic Contact State Estimation for Legged Robots using Inertial Information

Legged robot navigation in unstructured and slippery terrains depends he...
research
08/10/2023

Mono-hydra: Real-time 3D scene graph construction from monocular camera input with IMU

The ability of robots to autonomously navigate through 3D environments d...
research
07/14/2019

State Estimation in Visual Inertial Autonomous Helicopter Landing Using Optimisation on Manifold

Autonomous helicopter landing is a challenging task that requires precis...

Please sign up or login with your details

Forgot password? Click here to reset