Filter sharing: Efficient learning of parameters for volumetric convolutions

12/08/2016
by   Rahul Venkataramani, et al.
0

Typical convolutional neural networks (CNNs) have several millions of parameters and require a large amount of annotated data to train them. In medical applications where training data is hard to come by, these sophisticated machine learning models are difficult to train. In this paper, we propose a method to reduce the inherent complexity of CNNs during training by exploiting the significant redundancy that is noticed in the learnt CNN filters. Our method relies on finding a small set of filters and mixing coefficients to derive every filter in each convolutional layer at the time of training itself, thereby reducing the number of parameters to be trained. We consider the problem of 3D lung nodule segmentation in CT images and demonstrate the effectiveness of our method in achieving good results with only few training examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/27/2017

Transfer Learning in CNNs Using Filter-Trees

Convolutional Neural Networks (CNNs) are very effective for many pattern...
research
04/30/2019

Harmonic Networks with Limited Training Samples

Convolutional neural networks (CNNs) are very popular nowadays for image...
research
12/07/2017

Take it in your stride: Do we need striding in CNNs?

Since their inception, CNNs have utilized some type of striding operator...
research
04/12/2018

3D G-CNNs for Pulmonary Nodule Detection

Convolutional Neural Networks (CNNs) require a large amount of annotated...
research
03/30/2018

Learning Structure and Strength of CNN Filters for Small Sample Size Training

Convolutional Neural Networks have provided state-of-the-art results in ...
research
10/28/2022

LOFT: Finding Lottery Tickets through Filter-wise Training

Recent work on the Lottery Ticket Hypothesis (LTH) shows that there exis...
research
12/09/2019

Temporal Factorization of 3D Convolutional Kernels

3D convolutional neural networks are difficult to train because they are...

Please sign up or login with your details

Forgot password? Click here to reset