Deep Feature Space: A Geometrical Perspective

06/30/2020
by   Ioannis Kansizoglou, et al.
0

One of the most prominent attributes of Neural Networks (NNs) constitutes their capability of learning to extract robust and descriptive features from high dimensional data, like images. Hence, such an ability renders their exploitation as feature extractors particularly frequent in an abundant of modern reasoning systems. Their application scope mainly includes complex cascade tasks, like multi-modal recognition and deep Reinforcement Learning (RL). However, NNs induce implicit biases that are difficult to avoid or to deal with and are not met in traditional image descriptors. Moreover, the lack of knowledge for describing the intra-layer properties – and thus their general behavior – restricts the further applicability of the extracted features. With the paper at hand, a novel way of visualizing and understanding the vector space before the NNs' output layer is presented, aiming to enlighten the deep feature vectors' properties under classification tasks. Main attention is paid to the nature of overfitting in the feature space and its adverse effect on further exploitation. We present the findings that can be derived from our model's formulation, and we evaluate them on realistic recognition scenarios, proving its prominence by improving the obtained results.

READ FULL TEXT

page 3

page 7

page 8

page 9

research
02/05/2022

Decision boundaries and convex hulls in the feature space that deep learning functions learn from images

The success of deep neural networks in image classification and learning...
research
12/20/2019

Exploiting the potential of deep reinforcement learning for classification tasks in high-dimensional and unstructured data

This paper presents a framework for efficiently learning feature selecti...
research
12/13/2019

Laguerre-Gauss Preprocessing: Line Profiles as Image Features for Aerial Images Classification

An image preprocessing methodology based on Fourier analysis together wi...
research
12/06/2021

Extrapolation Frameworks in Cognitive Psychology Suitable for Study of Image Classification Models

We study the functional task of deep learning image classification model...
research
04/14/2021

Do Neural Network Weights account for Classes Centers?

The exploitation of Deep Neural Networks (DNNs) as descriptors in featur...
research
05/12/2021

Deep and Shallow Covariance Feature Quantization for 3D Facial Expression Recognition

Facial expressions recognition (FER) of 3D face scans has received a sig...
research
08/26/2023

Reinforcement Learning Based Multi-modal Feature Fusion Network for Novel Class Discovery

With the development of deep learning techniques, supervised learning ha...

Please sign up or login with your details

Forgot password? Click here to reset