LatticeNet: Fast Spatio-Temporal Point Cloud Segmentation Using Permutohedral Lattices

08/09/2021
by   Radu Alexandru Rosu, et al.
9

Deep convolutional neural networks (CNNs) have shown outstanding performance in the task of semantically segmenting images. Applying the same methods on 3D data still poses challenges due to the heavy memory requirements and the lack of structured data. Here, we propose LatticeNet, a novel approach for 3D semantic segmentation, which takes raw point clouds as input. A PointNet describes the local geometry which we embed into a sparse permutohedral lattice. The lattice allows for fast convolutions while keeping a low memory footprint. Further, we introduce DeformSlice, a novel learned data-dependent interpolation for projecting lattice features back onto the point cloud. We present results of 3D segmentation on multiple datasets where our method achieves state-of-the-art performance. We also extend and evaluate our network for instance and dynamic object segmentation.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

page 10

page 11

12/12/2019

LatticeNet: Fast Point Cloud Segmentation Using Permutohedral Lattices

Deep convolutional neural networks (CNNs) have shown outstanding perform...
04/04/2019

Generalizing discrete convolutions for unstructured point clouds

Point clouds are unstructured and unordered data, as opposed to images. ...
05/29/2019

NPTC-net: Narrow-Band Parallel Transport Convolutional Neural Network on Point Clouds

Convolution plays a crucial role in various applications in signal and i...
02/22/2018

SPLATNet: Sparse Lattice Networks for Point Cloud Processing

We present a network architecture for processing point clouds that direc...
12/15/2018

3DTI-Net: Learn Inner Transform Invariant 3D Geometry Features using Dynamic GCN

Deep learning on point clouds has made a lot of progress recently. Many ...
04/03/2019

Point Cloud Oversegmentation with Graph-Structured Deep Metric Learning

We propose a new supervized learning framework for oversegmenting 3D poi...
12/14/2020

Learning Hybrid Representations for Automatic 3D Vessel Centerline Extraction

Automatic blood vessel extraction from 3D medical images is crucial for ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.