SARNet: Semantic Augmented Registration of Large-Scale Urban Point Clouds

06/27/2022
by   Chao Liu, et al.
0

Registering urban point clouds is a quite challenging task due to the large-scale, noise and data incompleteness of LiDAR scanning data. In this paper, we propose SARNet, a novel semantic augmented registration network aimed at achieving efficient registration of urban point clouds at city scale. Different from previous methods that construct correspondences only in the point-level space, our approach fully exploits semantic features as assistance to improve registration accuracy. Specifically, we extract per-point semantic labels with advanced semantic segmentation networks and build a prior semantic part-to-part correspondence. Then we incorporate the semantic information into a learning-based registration pipeline, consisting of three core modules: a semantic-based farthest point sampling module to efficiently filter out outliers and dynamic objects; a semantic-augmented feature extraction module for learning more discriminative point descriptors; a semantic-refined transformation estimation module that utilizes prior semantic matching as a mask to refine point correspondences by reducing false matching for better convergence. We evaluate the proposed SARNet extensively by using real-world data from large regions of urban scenes and comparing it with alternative methods. The code is available at https://github.com/WinterCodeForEverything/SARNet.

READ FULL TEXT

page 1

page 8

research
03/07/2021

Robust Point Cloud Registration Framework Based on Deep Graph Matching

3D point cloud registration is a fundamental problem in computer vision ...
research
02/21/2022

Fast Semantic-Assisted Outlier Removal for Large-scale Point Cloud Registration

With current trends in sensors (cheaper, more volume of data) and applic...
research
10/04/2021

PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Clouds

Rigid registration of point clouds with partial overlaps is a longstandi...
research
07/16/2023

HRHD-HK: A benchmark dataset of high-rise and high-density urban scenes for 3D semantic segmentation of photogrammetric point clouds

Many existing 3D semantic segmentation methods, deep learning in compute...
research
03/13/2022

A Single Correspondence Is Enough: Robust Global Registration to Avoid Degeneracy in Urban Environments

Global registration using 3D point clouds is a crucial technology for mo...
research
04/25/2018

SegMap: 3D Segment Mapping using Data-Driven Descriptors

When performing localization and mapping, working at the level of struct...
research
07/18/2023

MarS3D: A Plug-and-Play Motion-Aware Model for Semantic Segmentation on Multi-Scan 3D Point Clouds

3D semantic segmentation on multi-scan large-scale point clouds plays an...

Please sign up or login with your details

Forgot password? Click here to reset