Naive Gabor Networks

12/09/2019
by   Chenying Liu, et al.
11

In this paper, we introduce naive Gabor Networks or Gabor-Nets which, for the first time in the literature, design and learn convolutional kernels strictly in the form of Gabor filters, aiming to reduce the number of parameters and constrain the solution space for convolutional neural networks (CNNs). In comparison with other Gabor-based methods, Gabor-Nets exploit the phase offset of the sinusoid harmonic to control the frequency characteristics of Gabor kernels, being able to adjust the convolutional kernels in accordance with the data from a frequency perspective. Furthermore, a fast 1-D decomposition of the Gabor kernel is implemented, bringing the original quadratic computational complexity of 2-D convolutions to a linear one. We evaluated our newly developed Gabor-Nets on two remotely sensed hyperspectral benchmarks, showing that our model architecture can significantly improve the convergence speed and the performance of CNNs, particularly when very limited training samples are available.

READ FULL TEXT

page 3

page 7

research
07/21/2022

Efficient CNN Architecture Design Guided by Visualization

Modern efficient Convolutional Neural Networks(CNNs) always use Depthwis...
research
04/30/2019

Harmonic Networks with Limited Training Samples

Convolutional neural networks (CNNs) are very popular nowadays for image...
research
02/03/2020

DWM: A Decomposable Winograd Method for Convolution Acceleration

Winograd's minimal filtering algorithm has been widely used in Convoluti...
research
10/15/2021

FlexConv: Continuous Kernel Convolutions with Differentiable Kernel Sizes

When designing Convolutional Neural Networks (CNNs), one must select the...
research
03/27/2020

Acceleration of Convolutional Neural Network Using FFT-Based Split Convolutions

Convolutional neural networks (CNNs) have a large number of variables an...
research
11/16/2021

Learning with convolution and pooling operations in kernel methods

Recent empirical work has shown that hierarchical convolutional kernels ...
research
10/19/2020

ERIC: Extracting Relations Inferred from Convolutions

Our main contribution is to show that the behaviour of kernels across mu...

Please sign up or login with your details

Forgot password? Click here to reset