DeepAI AI Chat
Log In Sign Up

3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation

by   Francis Engelmann, et al.

We present 3D-MPA, a method for instance segmentation on 3D point clouds. Given an input point cloud, we propose an object-centric approach where each point votes for its object center. We sample object proposals from the predicted object centers. Then, we learn proposal features from grouped point features that voted for the same object center. A graph convolutional network introduces inter-proposal relations, providing higher-level feature learning in addition to the lower-level point features. Each proposal comprises a semantic label, a set of associated points over which we define a foreground-background mask, an objectness score and aggregation features. Previous works usually perform non-maximum-suppression (NMS) over proposals to obtain the final object detections or semantic instances. However, NMS can discard potentially correct predictions. Instead, our approach keeps all proposals and groups them together based on the learned aggregation features. We show that grouping proposals improves over NMS and outperforms previous state-of-the-art methods on the tasks of 3D object detection and semantic instance segmentation on the ScanNetV2 benchmark and the S3DIS dataset.


page 1

page 6


SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation

We introduce Similarity Group Proposal Network (SGPN), a simple and intu...

Path Aggregation Network for Instance Segmentation

The way that information propagates in neural networks is of great impor...

Learning to Segment Object Candidates

Recent object detection systems rely on two critical steps: (1) a set of...

NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds

We introduce a method for instance proposal generation for 3D point clou...

3D Graph Embedding Learning with a Structure-aware Loss Function for Point Cloud Semantic Instance Segmentation

This paper introduces a novel approach for 3D semantic instance segmenta...

Learning Gaussian Instance Segmentation in Point Clouds

This paper presents a novel method for instance segmentation of 3D point...

Hierarchical Aggregation for 3D Instance Segmentation

Instance segmentation on point clouds is a fundamental task in 3D scene ...