DeepAI AI Chat
Log In Sign Up

A Model for Multi-View Residual Covariances based on Perspective Deformation

by   Alejandro Fontan, et al.
University of Zaragoza

In this work, we derive a model for the covariance of the visual residuals in multi-view SfM, odometry and SLAM setups. The core of our approach is the formulation of the residual covariances as a combination of geometric and photometric noise sources. And our key novel contribution is the derivation of a term modelling how local 2D patches suffer from perspective deformation when imaging 3D surfaces around a point. Together, these add up to an efficient and general formulation which not only improves the accuracy of both feature-based and direct methods, but can also be used to estimate more accurate measures of the state entropy and hence better founded point visibility thresholds. We validate our model with synthetic and real data and integrate it into photometric and feature-based Bundle Adjustment, improving their accuracy with a negligible overhead.


Error-Robust Multi-View Clustering: Progress, Challenges and Opportunities

With recent advances in data collection from multiple sources, multi-vie...

CubeSLAM: Monocular 3D Object Detection and SLAM without Prior Models

We present a method for single image 3D cuboid object detection and mult...

Single-View and Multi-View Depth Fusion

Dense and accurate 3D mapping from a monocular sequence is a key technol...

ROVO: Robust Omnidirectional Visual Odometry for Wide-baseline Wide-FOV Camera Systems

In this paper we propose a robust visual odometry system for a wide-base...

Multi-View Vision-to-Geometry Knowledge Transfer for 3D Point Cloud Shape Analysis

As two fundamental representation modalities of 3D objects, 2D multi-vie...

Revisiting Rolling Shutter Bundle Adjustment: Toward Accurate and Fast Solution

We propose a robust and fast bundle adjustment solution that estimates t...

Simplified_edition_Multi-robot SLAM Multi-view Target Tracking based on Panoramic Vision in Irregular Environment

In order to improve the precision of multi-robot SLAM multi-view target ...