Efficient CNN with uncorrelated Bag of Features pooling

09/22/2022
by   Firas Laakom, et al.
9

Despite the superior performance of CNN, deploying them on low computational power devices is still limited as they are typically computationally expensive. One key cause of the high complexity is the connection between the convolution layers and the fully connected layers, which typically requires a high number of parameters. To alleviate this issue, Bag of Features (BoF) pooling has been recently proposed. BoF learns a dictionary, that is used to compile a histogram representation of the input. In this paper, we propose an approach that builds on top of BoF pooling to boost its efficiency by ensuring that the items of the learned dictionary are non-redundant. We propose an additional loss term, based on the pair-wise correlation of the items of the dictionary, which complements the standard loss to explicitly regularize the model to learn a more diverse and rich dictionary. The proposed strategy yields an efficient variant of BoF and further boosts its performance, without any additional parameters.

READ FULL TEXT
research
09/11/2018

Deep Micro-Dictionary Learning and Coding Network

In this paper, we propose a novel Deep Micro-Dictionary Learning and Cod...
research
05/21/2020

When Dictionary Learning Meets Deep Learning: Deep Dictionary Learning and Coding Network for Image Recognition with Limited Data

We present a new Deep Dictionary Learning and Coding Network (DDLCN) for...
research
01/15/2013

Pooling-Invariant Image Feature Learning

Unsupervised dictionary learning has been a key component in state-of-th...
research
09/03/2016

Stochastic Learning of Multi-Instance Dictionary for Earth Mover's Distance based Histogram Comparison

Dictionary plays an important role in multi-instance data representation...
research
12/14/2016

Sparse Factorization Layers for Neural Networks with Limited Supervision

Whereas CNNs have demonstrated immense progress in many vision problems,...
research
12/28/2020

LookHops: light multi-order convolution and pooling for graph classification

Convolution and pooling are the key operations to learn hierarchical rep...

Please sign up or login with your details

Forgot password? Click here to reset