A Capsule-unified Framework of Deep Neural Networks for Graphical Programming

03/07/2019
by   Yujian Li, et al.
0

Recently, the growth of deep learning has produced a large number of deep neural networks. How to describe these networks unifiedly is becoming an important issue. We first formalize neural networks in a mathematical definition, give their directed graph representations, and prove a generation theorem about the induced networks of connected directed acyclic graphs. Then, using the concept of capsule to extend neural networks, we set up a capsule-unified framework for deep learning, including a mathematical definition of capsules, an induced model for capsule networks and a universal backpropagation algorithm for training them. Finally, we discuss potential applications of the framework to graphical programming with standard graphical symbols of capsules, neurons, and connections.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/09/2018

A Unified Framework of Deep Neural Networks by Capsules

With the growth of deep learning, how to describe deep neural networks u...
research
01/29/2020

Examining the Benefits of Capsule Neural Networks

Capsule networks are a recently developed class of neural networks that ...
research
08/19/2022

Towards Efficient Capsule Networks

From the moment Neural Networks dominated the scene for image processing...
research
07/30/2020

An Improvement for Capsule Networks using Depthwise Separable Convolution

Capsule Networks face a critical problem in computer vision in the sense...
research
07/18/2023

The semantic landscape paradigm for neural networks

Deep neural networks exhibit a fascinating spectrum of phenomena ranging...
research
11/21/2019

A Unified Framework for Lifelong Learning in Deep Neural Networks

Humans can learn a variety of concepts and skills incrementally over the...
research
06/21/2022

Enabling Capsule Networks at the Edge through Approximate Softmax and Squash Operations

Complex Deep Neural Networks such as Capsule Networks (CapsNets) exhibit...

Please sign up or login with your details

Forgot password? Click here to reset