Canonical Capsules: Unsupervised Capsules in Canonical Pose

12/08/2020
by   Weiwei Sun, et al.
6

We propose an unsupervised capsule architecture for 3D point clouds. We compute capsule decompositions of objects through permutation-equivariant attention, and self-supervise the process by training with pairs of randomly rotated objects. Our key idea is to aggregate the attention masks into semantic keypoints, and use these to supervise a decomposition that satisfies the capsule invariance/equivariance properties. This not only enables the training of a semantically consistent decomposition, but also allows us to learn a canonicalization operation that enables object-centric reasoning. In doing so, we require neither classification labels nor manually-aligned training datasets to train. Yet, by learning an object-centric representation in an unsupervised manner, our method outperforms the state-of-the-art on 3D point cloud reconstruction, registration, and unsupervised classification. We will release the code and dataset to reproduce our results as soon as the paper is published.

READ FULL TEXT
research
12/06/2019

Geometric Capsule Autoencoders for 3D Point Clouds

We propose a method to learn object representations from 3D point clouds...
research
12/27/2019

Quaternion Equivariant Capsule Networks for 3D Point Clouds

We present a 3D capsule architecture for processing of point clouds that...
research
12/27/2018

3D Point-Capsule Networks

In this paper, we propose 3D point-capsule networks, an auto-encoder des...
research
12/21/2021

PointCaps: Raw Point Cloud Processing using Capsule Networks with Euclidean Distance Routing

Raw point cloud processing using capsule networks is widely adopted in c...
research
09/13/2018

Canonical and Compact Point Cloud Representation for Shape Classification

We present a novel compact point cloud representation that is inherently...
research
10/11/2021

Recurrent Attention Models with Object-centric Capsule Representation for Multi-object Recognition

The visual system processes a scene using a sequence of selective glimps...
research
11/20/2018

Unsupervised Learning of Shape Concepts - From Real-World Objects to Mental Simulation

An unsupervised shape analysis is proposed to learn concepts reflecting ...

Please sign up or login with your details

Forgot password? Click here to reset