Tangent Convolutions for Dense Prediction in 3D

07/06/2018
by   Maxim Tatarchenko, et al.
12

We present an approach to semantic scene analysis using deep convolutional networks. Our approach is based on tangent convolutions - a new construction for convolutional networks on 3D data. In contrast to volumetric approaches, our method operates directly on surface geometry. Crucially, the construction is applicable to unstructured point clouds and other noisy real-world data. We show that tangent convolutions can be evaluated efficiently on large-scale point clouds with millions of points. Using tangent convolutions, we design a deep fully-convolutional network for semantic segmentation of 3D point clouds, and apply it to challenging real-world datasets of indoor and outdoor 3D environments. Experimental results show that the presented approach outperforms other recent deep network constructions in detailed analysis of large 3D scenes.

READ FULL TEXT

page 1

page 8

page 12

page 13

research
04/04/2019

Generalizing discrete convolutions for unstructured point clouds

Point clouds are unstructured and unordered data, as opposed to images. ...
research
08/21/2018

Fully-Convolutional Point Networks for Large-Scale Point Clouds

This work proposes a general-purpose, fully-convolutional network archit...
research
11/27/2017

Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs

We propose a novel deep learning-based framework to tackle the challenge...
research
11/30/2021

RADU: Ray-Aligned Depth Update Convolutions for ToF Data Denoising

Time-of-Flight (ToF) cameras are subject to high levels of noise and dis...
research
07/01/2019

Automatic reconstruction of fully volumetric 3D building models from point clouds

We present a novel method for reconstructing parametric, volumetric, mul...
research
06/05/2017

Submanifold Sparse Convolutional Networks

Convolutional network are the de-facto standard for analysing spatio-tem...
research
11/28/2017

3D Semantic Segmentation with Submanifold Sparse Convolutional Networks

Convolutional networks are the de-facto standard for analyzing spatio-te...

Please sign up or login with your details

Forgot password? Click here to reset