Frequency learning for structured CNN filters with Gaussian fractional derivatives

11/12/2021
by   Nikhil Saldanha, et al.
0

Frequency information lies at the base of discriminating between textures, and therefore between different objects. Classical CNN architectures limit the frequency learning through fixed filter sizes, and lack a way of explicitly controlling it. Here, we build on the structured receptive field filters with Gaussian derivative basis. Yet, rather than using predetermined derivative orders, which typically result in fixed frequency responses for the basis functions, we learn these. We show that by learning the order of the basis we can accurately learn the frequency of the filters, and hence adapt to the optimal frequencies for the underlying learning task. We investigate the well-founded mathematical formulation of fractional derivatives to adapt the filter frequencies during training. Our formulation leads to parameter savings and data efficiency when compared to the standard CNNs and the Gaussian derivative CNN filter networks that we build upon.

READ FULL TEXT

page 1

page 5

page 7

research
05/31/2021

Speaker Identification from Raw Waveform with LineNet

Speaker Identification using i-vector has gradually been replaced by spe...
research
12/09/2020

A Differential Model of the Complex Cell

The receptive fields of simple cells in the visual cortex can be underst...
research
06/07/2021

Resolution learning in deep convolutional networks using scale-space theory

Resolution in deep convolutional neural networks (CNNs) is typically bou...
research
06/28/2021

On the matrices in B-spline collocation methods for Riesz fractional equations and their spectral properties

In this work, we focus on a fractional differential equation in Riesz fo...
research
07/18/2022

Fully trainable Gaussian derivative convolutional layer

The Gaussian kernel and its derivatives have already been employed for C...
research
04/25/2019

Blurring the Line Between Structure and Learning to Optimize and Adapt Receptive Fields

The visual world is vast and varied, but its variations divide into stru...
research
12/15/2019

Digital filters with vanishing moments for shape analysis

Shape- and scale-selective digital-filters, with steerable finite/infini...

Please sign up or login with your details

Forgot password? Click here to reset