When Naïve Bayes Nearest Neighbours Meet Convolutional Neural Networks

11/12/2015
by   Ilja Kuzborskij, et al.
0

Since Convolutional Neural Networks (CNNs) have become the leading learning paradigm in visual recognition, Naive Bayes Nearest Neighbour (NBNN)-based classifiers have lost momentum in the community. This is because (1) such algorithms cannot use CNN activations as input features; (2) they cannot be used as final layer of CNN architectures for end-to-end training , and (3) they are generally not scalable and hence cannot handle big data. This paper proposes a framework that addresses all these issues, thus bringing back NBNNs on the map. We solve the first by extracting CNN activations from local patches at multiple scale levels, similarly to [1]. We address simultaneously the second and third by proposing a scalable version of Naive Bayes Non-linear Learning (NBNL, [2]). Results obtained using pre-trained CNNs on standard scene and domain adaptation databases show the strength of our approach, opening a new season for NBNNs.

READ FULL TEXT

page 2

page 9

research
03/26/2015

Towards Learning free Naive Bayes Nearest Neighbor-based Domain Adaptation

As of today, object categorization algorithms are not able to achieve th...
research
12/04/2014

Fisher Kernel for Deep Neural Activations

Compared to image representation based on low-level local descriptors, d...
research
01/31/2018

Naive Bayes Entrapment Detection for Planetary Rovers

Entrapment detection is a prerequisite for planetary rovers to perform a...
research
02/25/2017

Learning Deep NBNN Representations for Robust Place Categorization

This paper presents an approach for semantic place categorization using ...
research
12/07/2015

Scalable domain adaptation of convolutional neural networks

Convolutional neural networks (CNNs) tend to become a standard approach ...
research
09/18/2014

Deformable Part Models are Convolutional Neural Networks

Deformable part models (DPMs) and convolutional neural networks (CNNs) a...
research
12/31/2021

Separation of scales and a thermodynamic description of feature learning in some CNNs

Deep neural networks (DNNs) are powerful tools for compressing and disti...

Please sign up or login with your details

Forgot password? Click here to reset