Lvio-Fusion: A Self-adaptive Multi-sensor Fusion SLAM Framework Using Actor-critic Method

06/12/2021
by   Yupeng Jia, et al.
0

State estimation with sensors is essential for mobile robots. Due to sensors have different performance in different environments, how to fuse measurements of various sensors is a problem. In this paper, we propose a tightly-coupled multi-sensor fusion framework, Lvio-Fusion, which fuses stereo camera, Lidar, IMU, and GPS based on the graph optimization. Especially for urban traffic scenes, we introduce a segmented global pose graph optimization with GPS and loop-closure, which can eliminate accumulated drifts. Additionally, we creatively use a actor-critic method in reinforcement learning to adaptively adjust sensors' weight. After training, actor-critic agent can provide the system with better and dynamic sensors' weight. We evaluate the performance of our system on public datasets and compare it with other state-of-the-art methods, showing that the proposed method achieves high estimation accuracy and robustness to various environments. And our implementations are open source and highly scalable.

READ FULL TEXT

page 4

page 5

page 6

research
01/11/2019

A General Optimization-based Framework for Global Pose Estimation with Multiple Sensors

Accurate state estimation is a fundamental problem for autonomous robots...
research
06/12/2020

Shared Experience Actor-Critic for Multi-Agent Reinforcement Learning

Exploration in multi-agent reinforcement learning is a challenging probl...
research
01/11/2019

A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensors

Nowadays, more and more sensors are equipped on robots to increase robus...
research
10/03/2019

SensorDrop: A Reinforcement Learning Framework for Communication Overhead Reduction on the Edge

In IoT solutions, it is usually desirable to collect data from a large n...
research
09/10/2018

Expert-augmented actor-critic for ViZDoom and Montezumas Revenge

We propose an expert-augmented actor-critic algorithm, which we evaluate...
research
09/17/2018

The Rosario Dataset: Multisensor Data for Localization and Mapping in Agricultural Environments

In this paper we present The Rosario Dataset, a collection of sensor dat...
research
07/05/2022

Ask-AC: An Initiative Advisor-in-the-Loop Actor-Critic Framework

Despite the promising results achieved, state-of-the-art interactive rei...

Please sign up or login with your details

Forgot password? Click here to reset