How to Accelerate Capsule Convolutions in Capsule Networks

04/06/2021
by   Zhenhua Chen, et al.
0

How to improve the efficiency of routing procedures in CapsNets has been studied a lot. However, the efficiency of capsule convolutions has largely been neglected. Capsule convolution, which uses capsules rather than neurons as the basic computation unit, makes it incompatible with current deep learning frameworks' optimization solution. As a result, capsule convolutions are usually very slow with these frameworks. We observe that capsule convolutions can be considered as the operations of `multiplication of multiple small matrics' plus tensor-based combination. Based on this observation, we develop two acceleration schemes with CUDA APIs and test them on a custom CapsNet. The result shows that our solution achieves a 4X acceleration.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

08/16/2021

Learning Friction Model for Tethered Capsule Robot

With the potential applications of capsule robots in medical endoscopy, ...
08/04/2019

Building Deep, Equivariant Capsule Networks

Capsule networks are constrained by their, relative, inability to deeper...
12/29/2018

Attention-Based Capsule Networks with Dynamic Routing for Relation Extraction

A capsule is a group of neurons, whose activity vector represents the in...
01/05/2022

Quantum Capsule Networks

Capsule networks, which incorporate the paradigms of connectionism and s...
07/13/2019

Using dynamic routing to extract intermediate features for developing scalable capsule networks

Capsule networks have gained a lot of popularity in short time due to it...
07/26/2019

Training products of expert capsules with mixing by dynamic routing

This study develops an unsupervised learning algorithm for products of e...
11/03/2021

Autonomous Magnetic Navigation Framework for Active Wireless Capsule Endoscopy Inspired by Conventional Colonoscopy Procedures

In recent years, simultaneous magnetic actuation and localization (SMAL)...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.