Category coding with neural network application

05/21/2018
by   Qizhi Zhang, et al.
0

In many applications of neural network, it is common to introduce huge amounts of input categorical features, as well as output labels. However, since the required network size should have rapid growth with respect to the dimensions of input and output space, there exists huge cost in both computation and memory resources. In this paper, we present a novel method called category coding (CC), where the design philosophy follows the principle of minimal collision to reduce the input and output dimension effectively. In addition, we introduce three types of category coding based on different Euclidean domains. Experimental results show that all three proposed methods outperform the existing state-of-the-art coding methods, such as standard cut-off and error-correct output coding (ECOC) methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/22/2020

Normalization of Input-output Shared Embeddings in Text Generation Models

Neural Network based models have been state-of-the-art models for variou...
research
06/08/2022

Constellation Design for Deep Joint Source-Channel Coding

Deep learning-based joint source-channel coding (JSCC) has shown excelle...
research
05/07/2020

Model Reduction and Neural Networks for Parametric PDEs

We develop a general framework for data-driven approximation of input-ou...
research
08/03/2017

Detection of Abnormal Input-Output Associations

We study a novel outlier detection problem that aims to identify abnorma...
research
01/10/2023

Exoshuffle-CloudSort

We present Exoshuffle-CloudSort, a sorting application running on top of...
research
06/12/2019

Action-Sensitive Phonological Dependencies

This paper defines a subregular class of functions called the tier-based...
research
04/13/2018

Understanding Community Structure in Layered Neural Networks

A layered neural network is now one of the most common choices for the p...

Please sign up or login with your details

Forgot password? Click here to reset