Grouping Capsules Based Different Types

11/12/2019
by   Qiang Ren, et al.
7

Capsule network was introduced as a new architecture of neural networks, it encoding features as capsules to overcome the lacking of equivariant in the convolutional neural networks. It uses dynamic routing algorithm to train parameters in different capsule layers, but the dynamic routing algorithm need to be improved. In this paper, we propose a novel capsule network architecture and discussed the effect of initialization method of the coupling coefficient c_ij on the model. First, we analyze the rate of change of the initial value of c_ij when the dynamic routing algorithm iterates. The larger the initial value of c_ij, the better effect of the model. Then, we proposed improvement that training different types of capsules by grouping capsules based different types. And this improvement can adjust the initial value of c_ij to make it more suitable. We experimented with our improvements on some computer vision datasets and achieved better results than the original capsule network

READ FULL TEXT

page 7

page 10

research
11/19/2019

Adaptive Routing Between Capsules

Capsule network is the most recent exciting advancement in the deep lear...
research
04/26/2018

Capsule networks for low-data transfer learning

We propose a capsule network-based architecture for generalizing learnin...
research
07/31/2019

Capsule Networks Need an Improved Routing Algorithm

In capsule networks, the routing algorithm connects capsules in consecut...
research
05/28/2018

Fast Dynamic Routing Based on Weighted Kernel Density Estimation

Capsules as well as dynamic routing between them are most recently propo...
research
04/11/2021

Deformable Capsules for Object Detection

Capsule networks promise significant benefits over convolutional network...
research
04/27/2020

Continuous sign language recognition from wearable IMUs using deep capsule networks and game theory

Sign Language is used by the deaf community all over world. The work pre...
research
07/26/2019

Training products of expert capsules with mixing by dynamic routing

This study develops an unsupervised learning algorithm for products of e...

Please sign up or login with your details

Forgot password? Click here to reset