Capsule networks with non-iterative cluster routing

09/19/2021
by   Zhihao Zhao, et al.
0

Capsule networks use routing algorithms to flow information between consecutive layers. In the existing routing procedures, capsules produce predictions (termed votes) for capsules of the next layer. In a nutshell, the next-layer capsule's input is a weighted sum over all the votes it receives. In this paper, we propose non-iterative cluster routing for capsule networks. In the proposed cluster routing, capsules produce vote clusters instead of individual votes for next-layer capsules, and each vote cluster sends its centroid to a next-layer capsule. Generally speaking, the next-layer capsule's input is a weighted sum over the centroid of each vote cluster it receives. The centroid that comes from a cluster with a smaller variance is assigned a larger weight in the weighted sum process. Compared with the state-of-the-art capsule networks, the proposed capsule networks achieve the best accuracy on the Fashion-MNIST and SVHN datasets with fewer parameters, and achieve the best accuracy on the smallNORB and CIFAR-10 datasets with a moderate number of parameters. The proposed capsule networks also produce capsules with disentangled representation and generalize well to images captured at novel viewpoints. The proposed capsule networks also preserve 2D spatial information of an input image in the capsule channels: if the capsule channels are rotated, the object reconstructed from these channels will be rotated by the same transformation. Codes are available at https://github.com/ZHAOZHIHAO/ClusterRouting.

READ FULL TEXT

page 7

page 8

page 9

research
02/12/2020

Capsules with Inverted Dot-Product Attention Routing

We introduce a new routing algorithm for capsule networks, in which a ch...
research
08/27/2018

Generalized Capsule Networks with Trainable Routing Procedure

CapsNet (Capsule Network) was first proposed by capsule and later anothe...
research
08/20/2018

CapsDeMM: Capsule network for Detection of Munro' s Microabscess in skin biopsy images

This paper presents an approach for automatic detection of Munro' s Micr...
research
11/02/2019

An Algorithm for Routing Capsules in All Domains

Building on recent work on capsule networks, we propose a new form of "r...
research
01/05/2022

Quantum Capsule Networks

Capsule networks, which incorporate the paradigms of connectionism and s...
research
01/29/2021

Efficient-CapsNet: Capsule Network with Self-Attention Routing

Deep convolutional neural networks, assisted by architectural design str...
research
10/20/2022

Iterative collaborative routing among equivariant capsules for transformation-robust capsule networks

Transformation-robustness is an important feature for machine learning m...

Please sign up or login with your details

Forgot password? Click here to reset