Deep Learning with Sets and Point Clouds

11/14/2016
by   Siamak Ravanbakhsh, et al.
0

We introduce a simple permutation equivariant layer for deep learning with set structure.This type of layer, obtained by parameter-sharing, has a simple implementation and linear-time complexity in the size of each set. We use deep permutation-invariant networks to perform point-could classification and MNIST-digit summation, where in both cases the output is invariant to permutations of the input. In a semi-supervised setting, where the goal is make predictions for each instance within a set, we demonstrate the usefulness of this type of layer in set-outlier detection as well as semi-supervised learning with clustering side-information.

READ FULL TEXT

page 6

page 11

research
07/09/2015

Semi-Supervised Learning with Ladder Networks

We combine supervised learning with unsupervised learning in deep neural...
research
06/09/2020

An Overview of Deep Semi-Supervised Learning

Deep neural networks demonstrated their ability to provide remarkable pe...
research
10/10/2017

Safe Semi-Supervised Learning of Sum-Product Networks

In several domains obtaining class annotations is expensive while at the...
research
06/08/2023

Equivariant vs. Invariant Layers: A Comparison of Backbone and Pooling for Point Cloud Classification

Learning from set-structured data, such as point clouds, has gained sign...
research
10/05/2021

Geometric Algebra Attention Networks for Small Point Clouds

Much of the success of deep learning is drawn from building architecture...
research
06/23/2022

Set Norm and Equivariant Skip Connections: Putting the Deep in Deep Sets

Permutation invariant neural networks are a promising tool for making pr...
research
09/10/2017

Classifying Unordered Feature Sets with Convolutional Deep Averaging Networks

Unordered feature sets are a nonstandard data structure that traditional...

Please sign up or login with your details

Forgot password? Click here to reset