DeepAI AI Chat
Log In Sign Up

P-CapsNets: a General Form of Convolutional Neural Networks

12/18/2019
by   Zhenhua Chen, et al.
Indiana University Bloomington
Washington University in St Louis
117

We propose Pure CapsNets (P-CapsNets) which is a generation of normal CNNs structurally. Specifically, we make three modifications to current CapsNets. First, we remove routing procedures from CapsNets based on the observation that the coupling coefficients can be learned implicitly. Second, we replace the convolutional layers in CapsNets to improve efficiency. Third, we package the capsules into rank-3 tensors to further improve efficiency. The experiment shows that P-CapsNets achieve better performance than CapsNets with varied routing procedures by using significantly fewer parameters on MNIST&CIFAR10. The high efficiency of P-CapsNets is even comparable to some deep compressing models. For example, we achieve more than 99% percent accuracy on MNIST by using only 3888 parameters. We visualize the capsules as well as the corresponding correlation matrix to show a possible way of initializing CapsNets in the future. We also explore the adversarial robustness of P-CapsNets compared to CNNs.

READ FULL TEXT

page 2

page 4

page 6

page 7

08/27/2018

Generalized Capsule Networks with Trainable Routing Procedure

CapsNet (Capsule Network) was first proposed by capsule and later anothe...
03/16/2020

SlimConv: Reducing Channel Redundancy in Convolutional Neural Networks by Weights Flipping

The channel redundancy in feature maps of convolutional neural networks ...
03/29/2023

A Tensor-based Convolutional Neural Network for Small Dataset Classification

Inspired by the ConvNets with structured hidden representations, we prop...
12/03/2020

Interpretable Graph Capsule Networks for Object Recognition

Capsule Networks, as alternatives to Convolutional Neural Networks, have...
04/15/2019

Fast Inference in Capsule Networks Using Accumulated Routing Coefficients

We present a method for fast inference in Capsule Networks (CapsNets) by...
07/25/2018

Conditional Information Gain Networks

Deep neural network models owe their representational power to the high ...