DeepAI AI Chat
Log In Sign Up

SceneEncoder: Scene-Aware Semantic Segmentation of Point Clouds with A Learnable Scene Descriptor

by   Jiachen Xu, et al.
Shanghai Jiao Tong University

Besides local features, global information plays an essential role in semantic segmentation, while recent works usually fail to explicitly extract the meaningful global information and make full use of it. In this paper, we propose a SceneEncoder module to impose a scene-aware guidance to enhance the effect of global information. The module predicts a scene descriptor, which learns to represent the categories of objects existing in the scene and directly guides the point-level semantic segmentation through filtering out categories not belonging to this scene. Additionally, to alleviate segmentation noise in local region, we design a region similarity loss to propagate distinguishing features to their own neighboring points with the same label, leading to the enhancement of the distinguishing ability of point-wise features. We integrate our methods into several prevailing networks and conduct extensive experiments on benchmark datasets ScanNet and ShapeNet. Results show that our methods greatly improve the performance of baselines and achieve state-of-the-art performance.


Boundary-Aware Geometric Encoding for Semantic Segmentation of Point Clouds

Boundary information plays a significant role in 2D image segmentation, ...

PS^2-Net: A Locally and Globally Aware Network for Point-Based Semantic Segmentation

In this paper, we present the PS^2-Net -- a locally and globally aware d...

LACV-Net: Semantic Segmentation of Large-Scale Point Cloud Scene via Local Adaptive and Comprehensive VLAD

Large-scale point cloud semantic segmentation is an important task in 3D...

SemAffiNet: Semantic-Affine Transformation for Point Cloud Segmentation

Conventional point cloud semantic segmentation methods usually employ an...

Adaptive Learning of Region-based pLSA Model for Total Scene Annotation

In this paper, we present a region-based pLSA model to accomplish the ta...

Bi-Directional Attention for Joint Instance and Semantic Segmentation in Point Clouds

Instance segmentation in point clouds is one of the most fine-grained wa...

Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation

We achieve 3D semantic scene labeling by exploring semantic relation bet...