TensorProjection Layer: A Tensor-Based Dimensionality Reduction Method in CNN

04/09/2020
by   Toshinari Morimoto, et al.
0

In this paper, we propose a dimensionality reduction method applied to tensor-structured data as a hidden layer (we call it TensorProjection Layer) in a convolutional neural network. Our proposed method transforms input tensors into ones with a smaller dimension by projection. The directions of projection are viewed as training parameters associated with our proposed layer and trained via a supervised learning criterion such as minimization of the cross-entropy loss function. We discuss the gradients of the loss function with respect to the parameters associated with our proposed layer. We also implement simple numerical experiments to evaluate the performance of the TensorProjection Layer.

READ FULL TEXT
research
01/25/2018

NDDR-CNN: Layer-wise Feature Fusing in Multi-Task CNN by Neural Discriminative Dimensionality Reduction

State-of-the-art Convolutional Neural Network (CNN) benefits a lot from ...
research
12/03/2017

Tensor Train Neighborhood Preserving Embedding

In this paper, we propose a Tensor Train Neighborhood Preserving Embeddi...
research
05/14/2019

Dimensionality Reduction for Tukey Regression

We give the first dimensionality reduction methods for the overconstrain...
research
07/03/2017

Vectorial Dimension Reduction for Tensors Based on Bayesian Inference

Dimensionality reduction for high-order tensors is a challenging problem...
research
03/17/2023

An evaluation framework for dimensionality reduction through sectional curvature

Unsupervised machine learning lacks ground truth by definition. This pos...
research
12/02/2021

Mixing Deep Learning and Multiple Criteria Optimization: An Application to Distributed Learning with Multiple Datasets

The training phase is the most important stage during the machine learni...
research
04/17/2020

Adaptive Neuron-wise Discriminant Criterion and Adaptive Center Loss at Hidden Layer for Deep Convolutional Neural Network

A deep convolutional neural network (CNN) has been widely used in image ...

Please sign up or login with your details

Forgot password? Click here to reset