On the Behavior of Convolutional Nets for Feature Extraction

03/03/2017
by   Dario Garcia-Gasulla, et al.
0

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within a trained CNN model (in the case of image data), and reusing it for other purposes is a field of interest, as it provides access to the visual descriptors previously learnt by the CNN after processing millions of images, without requiring an expensive training phase. Contributions to this field (commonly known as feature representation transfer or transfer learning) have been purely empirical so far, extracting all CNN features from a single layer close to the output and testing their performance by feeding them to a classifier. This approach has provided consistent results, although its relevance is limited to classification tasks. In a completely different approach, in this paper we statistically measure the discriminative power of every single feature found within a deep CNN, when used for characterizing every class of 11 datasets. We seek to provide new insights into the behavior of CNN features, particularly the ones from convolutional layers, as this can be relevant for their application to knowledge representation and reasoning. Our results confirm that low and middle level features may behave differently to high level features, but only under certain conditions. We find that all CNN features can be used for knowledge representation purposes both by their presence or by their absence, doubling the information a single CNN feature may provide. We also study how much noise these features may include, and propose a thresholding approach to discard most of it. All these insights have a direct application to the generation of CNN embedding spaces.

READ FULL TEXT

page 7

page 8

page 9

page 12

page 15

research
05/22/2017

An Out-of-the-box Full-network Embedding for Convolutional Neural Networks

Transfer learning for feature extraction can be used to exploit deep rep...
research
11/15/2018

Selective Feature Connection Mechanism: Concatenating Multi-layer CNN Features with a Feature Selector

Different layers of deep convolutional neural networks(CNN) can encode d...
research
04/01/2020

Depth Selection for Deep ReLU Nets in Feature Extraction and Generalization

Deep learning is recognized to be capable of discovering deep features f...
research
04/01/2016

Good Practice in CNN Feature Transfer

The objective of this paper is the effective transfer of the Convolution...
research
03/02/2021

Contextually Guided Convolutional Neural Networks for Learning Most Transferable Representations

Deep Convolutional Neural Networks (CNNs), trained extensively on very l...
research
10/25/2018

On the dissection of degenerate cosmologies with machine learning

Based on the DUSTGRAIN-pathfinder suite of simulations, we investigate o...
research
06/11/2022

Memorization-Dilation: Modeling Neural Collapse Under Noise

The notion of neural collapse refers to several emergent phenomena that ...

Please sign up or login with your details

Forgot password? Click here to reset