Kernel-based Translations of Convolutional Networks

03/19/2019
by   Corinne Jones, et al.
0

Convolutional Neural Networks, as most artificial neural networks, are commonly viewed as methods different in essence from kernel-based methods. We provide a systematic translation of Convolutional Neural Networks (ConvNets) into their kernel-based counterparts, Convolutional Kernel Networks (CKNs), and demonstrate that this perception is unfounded both formally and empirically. We show that, given a Convolutional Neural Network, we can design a corresponding Convolutional Kernel Network, easily trainable using a new stochastic gradient algorithm based on an accurate gradient computation, that performs on par with its Convolutional Neural Network counterpart. We present experimental results supporting our claims on landmark ConvNet architectures comparing each ConvNet to its CKN counterpart over several parameter settings.

READ FULL TEXT
research
04/23/2014

One weird trick for parallelizing convolutional neural networks

I present a new way to parallelize the training of convolutional neural ...
research
06/12/2019

On regularization for a convolutional kernel in neural networks

Convolutional neural network is a very important model of deep learning....
research
06/24/2020

On the Empirical Neural Tangent Kernel of Standard Finite-Width Convolutional Neural Network Architectures

The Neural Tangent Kernel (NTK) is an important milestone in the ongoing...
research
02/05/2021

Regularization for convolutional kernel tensors to avoid unstable gradient problem in convolutional neural networks

Convolutional neural networks are very popular nowadays. Training neural...
research
12/28/2019

A Genetic Algorithm based Kernel-size Selection Approach for a Multi-column Convolutional Neural Network

Deep neural network-based architectures give promising results in variou...
research
02/24/2018

Convolutional Neural Networks combined with Runge-Kutta Methods

A convolutional neural network for image classification can be construct...
research
07/20/2020

Cephalometric Landmark Regression with Convolutional Neural Networks on 3D Computed Tomography Data

In this paper, we address the problem of automatic three-dimensional cep...

Please sign up or login with your details

Forgot password? Click here to reset