Asynchronous Optimisation for Event-based Visual Odometry

03/02/2022
by   Daqi Liu, et al.
5

Event cameras open up new possibilities for robotic perception due to their low latency and high dynamic range. On the other hand, developing effective event-based vision algorithms that fully exploit the beneficial properties of event cameras remains work in progress. In this paper, we focus on event-based visual odometry (VO). While existing event-driven VO pipelines have adopted continuous-time representations to asynchronously process event data, they either assume a known map, restrict the camera to planar trajectories, or integrate other sensors into the system. Towards map-free event-only monocular VO in SE(3), we propose an asynchronous structure-from-motion optimisation back-end. Our formulation is underpinned by a principled joint optimisation problem involving non-parametric Gaussian Process motion modelling and incremental maximum a posteriori inference. A high-performance incremental computation engine is employed to reason about the camera trajectory with every incoming event. We demonstrate the robustness of our asynchronous back-end in comparison to frame-based methods which depend on accurate temporal accumulation of measurements.

READ FULL TEXT

page 1

page 6

research
09/18/2023

End-to-End Learned Event- and Image-based Visual Odometry

Visual Odometry (VO) is crucial for autonomous robotic navigation, espec...
research
06/01/2023

Event-based Visual Odometry with Full Temporal Resolution via Continuous-time Gaussian Process Regression

Event-based cameras asynchronously capture individual visual changes in ...
research
03/05/2023

Continuous-Time Gaussian Process Motion-Compensation for Event-vision Pattern Tracking with Distance Fields

This work addresses the issue of motion compensation and pattern trackin...
research
04/12/2022

Exploring Event Camera-based Odometry for Planetary Robots

Due to their resilience to motion blur and high robustness in low-light ...
research
03/01/2021

Representation Learning for Event-based Visuomotor Policies

Event-based cameras are dynamic vision sensors that can provide asynchro...
research
03/19/2023

ANMS: Asynchronous Non-Maximum Suppression in Event Stream

The non-maximum suppression (NMS) is widely used in frame-based tasks as...
research
02/27/2023

Fast Trajectory End-Point Prediction with Event Cameras for Reactive Robot Control

Prediction skills can be crucial for the success of tasks where robots h...

Please sign up or login with your details

Forgot password? Click here to reset