Lidar-Monocular Surface Reconstruction Using Line Segments

04/06/2021
by   Victor Amblard, et al.
15

Structure from Motion (SfM) often fails to estimate accurate poses in environments that lack suitable visual features. In such cases, the quality of the final 3D mesh, which is contingent on the accuracy of those estimates, is reduced. One way to overcome this problem is to combine data from a monocular camera with that of a LIDAR. This allows fine details and texture to be captured while still accurately representing featureless subjects. However, fusing these two sensor modalities is challenging due to their fundamentally different characteristics. Rather than directly fusing image features and LIDAR points, we propose to leverage common geometric features that are detected in both the LIDAR scans and image data, allowing data from the two sensors to be processed in a higher-level space. In particular, we propose to find correspondences between 3D lines extracted from LIDAR scans and 2D lines detected in images before performing a bundle adjustment to refine poses. We also exploit the detected and optimized line segments to improve the quality of the final mesh. We test our approach on the recently published dataset, Newer College Dataset. We compare the accuracy and the completeness of the 3D mesh to a ground truth obtained with a survey-grade 3D scanner. We show that our method delivers results that are comparable to a state-of-the-art LIDAR survey while not requiring highly accurate ground truth pose estimates.

READ FULL TEXT

page 1

page 4

page 5

page 6

04/01/2020

Monocular Camera Localization in Prior LiDAR Maps with 2D-3D Line Correspondences

Light-weight camera localization in existing maps is essential for visio...
07/01/2019

A Joint Optimization Approach of LiDAR-Camera Fusion for Accurate Dense 3D Reconstructions

Fusing data from LiDAR and camera is conceptually attractive because of ...
03/12/2020

The Newer College Dataset: Handheld LiDAR, Inertial and Vision with Ground Truth

In this paper we present a large dataset with a variety of mobile mappin...
09/24/2018

Improved Semantic Stixels via Multimodal Sensor Fusion

This paper presents a compact and accurate representation of 3D scenes t...
11/16/2020

Recovering and Simulating Pedestrians in the Wild

Sensor simulation is a key component for testing the performance of self...
06/01/2020

3D Lidar Mapping Relative Accuracy Automatic Evaluation Algorithm

HD (High Definition) map based on 3D lidar plays a vital role in autonom...
10/19/2020

Elastic and Efficient LiDAR Reconstruction for Large-Scale Exploration Tasks

We present an efficient, elastic 3D LiDAR reconstruction framework which...