Toward Efficient and Robust Multiple Camera Visual-inertial Odometry

09/24/2021
by   Yao He, et al.
0

Efficiency and robustness are the essential criteria for the visual-inertial odometry (VIO) system. To process massive visual data, the high cost on CPU resources and computation latency limits VIO's possibility in integration with other applications. Recently, the powerful embedded GPUs have great potentials to improve the front-end image processing capability. Meanwhile, multi-camera systems can increase the visual constraints for back-end optimization. Inspired by these insights, we incorporate the GPU-enhanced algorithms in the field of VIO and thus propose a new front-end with NVIDIA Vision Programming Interface (VPI). This new front-end then enables multi-camera VIO feature association and provides more stable back-end pose optimization. Experiments with our new front-end on monocular datasets show the CPU resource occupation rate and computational latency are reduced by 40.4 compared with the original VIO. The multi-camera system shows a higher VIO initialization success rate and better robustness overall state estimation.

READ FULL TEXT

page 1

page 3

page 5

page 6

research
03/30/2020

Faster than FAST: GPU-Accelerated Frontend for High-Speed VIO

The recent introduction of powerful embedded graphics processing units (...
research
10/18/2022

Edge-based Monocular Thermal-Inertial Odometry in Visually Degraded Environments

State estimation in complex illumination environments based on conventio...
research
06/14/2023

Ground-VIO: Monocular Visual-Inertial Odometry with Online Calibration of Camera-Ground Geometric Parameters

Monocular visual-inertial odometry (VIO) is a low-cost solution to provi...
research
04/08/2021

An Equivariant Filter for Visual Inertial Odometry

Visual Inertial Odometry (VIO) is of great interest due the ubiquity of ...
research
01/11/2022

DM-VIO: Delayed Marginalization Visual-Inertial Odometry

We present DM-VIO, a monocular visual-inertial odometry system based on ...
research
07/15/2020

Learning Multiplicative Interactions with Bayesian Neural Networks for Visual-Inertial Odometry

This paper presents an end-to-end multi-modal learning approach for mono...
research
06/01/2021

Resource-aware Online Parameter Adaptation for Computationally-constrained Visual-Inertial Navigation Systems

In this paper, a computational resources-aware parameter adaptation meth...

Please sign up or login with your details

Forgot password? Click here to reset