RL-PGO: Reinforcement Learning-based Planar Pose-Graph Optimization

02/26/2022
by   Nikolaos Kourtzanidis, et al.
0

The objective of pose SLAM or pose-graph optimization (PGO) is to estimate the trajectory of a robot given odometric and loop closing constraints. State-of-the-art iterative approaches typically involve the linearization of a non-convex objective function and then repeatedly solve a set of normal equations. Furthermore, these methods may converge to a local minima yielding sub-optimal results. In this work, we present to the best of our knowledge the first Deep Reinforcement Learning (DRL) based environment and proposed agent for 2D pose-graph optimization. We demonstrate that the pose-graph optimization problem can be modeled as a partially observable Markov Decision Process and evaluate performance on real-world and synthetic datasets. The proposed agent outperforms state-of-the-art solver g2o on challenging instances where traditional nonlinear least-squares techniques may fail or converge to unsatisfactory solutions. Experimental results indicate that iterative-based solvers bootstrapped with the proposed approach allow for significantly higher quality estimations. We believe that reinforcement learning-based PGO is a promising avenue to further accelerate research towards globally optimal algorithms. Thus, our work paves the way to new optimization strategies in the 2D pose SLAM domain.

READ FULL TEXT

page 1

page 5

research
09/20/2018

Guaranteed Globally Optimal Planar Pose Graph and Landmark SLAM via Sparse-Bounded Sums-of-Squares Programming

Autonomous navigation requires an accurate model or map of the environme...
research
06/01/2018

A Recursive Least Square Method for 3D Pose Graph Optimization Problem

Pose Graph Optimization (PGO) is an important non-convex optimization pr...
research
09/04/2018

Matrix Difference in Pose-Graph Optimization

Pose-Graph optimization is a crucial component of many modern SLAM syste...
research
03/08/2023

kollagen: A Collaborative SLAM Pose Graph Generator

In this paper, we address the lack of datasets for - and the issue of re...
research
12/04/2020

Generalized Proximal Methods for Pose Graph Optimization

In this paper, we generalize proximal methods that were originally desig...
research
03/30/2023

Switching Pushing Skill Combined MPC and Deep Reinforcement Learning for Planar Non-prehensile Manipulation

In this paper, a novel switching pushing skill algorithm is proposed to ...
research
03/31/2022

Mask Atari for Deep Reinforcement Learning as POMDP Benchmarks

We present Mask Atari, a new benchmark to help solve partially observabl...

Please sign up or login with your details

Forgot password? Click here to reset