R2LIVE: A Robust, Real-time, LiDAR-Inertial-Visual tightly-coupled state Estimator and mapping

by   Jiarong Lin, et al.

In this letter, we propose a robust, real-time tightly-coupled multi-sensor fusion framework, which fuses measurement from LiDAR, inertial sensor, and visual camera to achieve robust and accurate state estimation. Our proposed framework is composed of two parts: the filter-based odometry and factor graph optimization. To guarantee real-time performance, we estimate the state within the framework of error-state iterated Kalman-filter, and further improve the overall precision with our factor graph optimization. Taking advantage of measurement from all individual sensors, our algorithm is robust enough to various visual failure, LiDAR-degenerated scenarios, and is able to run in real-time on an on-board computation platform, as shown by extensive experiments conducted in indoor, outdoor, and mixed environment of different scale. Moreover, the results show that our proposed framework can improve the accuracy of state-of-the-art LiDAR-inertial or visual-inertial odometry. To share our findings and to make contributions to the community, we open source our codes on our Github.



There are no comments yet.


page 1

page 2

page 3

page 4

page 5

page 6

page 8

page 9


R3LIVE: A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping package

In this letter, we propose a novel LiDAR-Inertial-Visual sensor fusion f...

LINS: A Lidar-Inerital State Estimator for Robust and Fast Navigation

Robust and fast ego-motion estimation is a critical problem for autonomo...

IC-GVINS: A Robust, Real-time, INS-Centric GNSS-Visual-Inertial Navigation System for Wheeled Robot

In this letter, we present a robust, real-time, inertial navigation syst...

Deep Odometry Systems on Edge with EKF-LoRa Backend for Real-Time Positioning in Adverse Environment

Ubiquitous positioning for pedestrian in adverse environment has served ...

FAST-LIO: A Fast, Robust LiDAR-inertial Odometry Package by Tightly-Coupled Iterated Kalman Filter

This paper presents a computationally efficient and robust LiDAR-inertia...

Incremental learning of LSTM framework for sensor fusion in attitude estimation

This paper presents a novel method for attitude estimation of an object ...

VID-Fusion: Robust Visual-Inertial-Dynamics Odometry for Accurate External Force Estimation

Recently, quadrotors are gaining significant attention in aerial transpo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.