Introducing Curvature to the Label Space

10/22/2018
by   Conor Sheehan, et al.
0

One-hot encoding is a labelling system that embeds classes as standard basis vectors in a label space. Despite seeing near-universal use in supervised categorical classification tasks, the scheme is problematic in its geometric implication that, as all classes are equally distant, all classes are equally different. This is inconsistent with most, if not all, real-world tasks due to the prevalence of ancestral and convergent relationships generating a varying degree of morphological similarity across classes. We address this issue by introducing curvature to the label-space using a metric tensor as a self-regulating method that better represents these relationships as a bolt-on, learning-algorithm agnostic solution. We propose both general constraints and specific statistical parameterizations of the metric and identify a direction for future research using autoencoder-based parameterizations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/16/2022

Acute Triangulation of Constant Curvature Polygonal Complexes

We prove that every 2-dimensional polygonal complex, where each polygon ...
research
02/05/2018

ClassSim: Similarity between Classes Defined by Misclassification Ratios of Trained Classifiers

Deep neural networks (DNNs) have achieved exceptional performances in ma...
research
06/04/2018

Similarity encoding for learning with dirty categorical variables

For statistical learning, categorical variables in a table are usually c...
research
03/18/2023

UNREAL:Unlabeled Nodes Retrieval and Labeling for Heavily-imbalanced Node Classification

Extremely skewed label distributions are common in real-world node class...
research
03/21/2023

Equiangular Basis Vectors

We propose Equiangular Basis Vectors (EBVs) for classification tasks. In...
research
05/18/2022

Exploring the Advantages of Dense-Vector to One-Hot Encoding of Intent Classes in Out-of-Scope Detection Tasks

This work explores the intrinsic limitations of the popular one-hot enco...

Please sign up or login with your details

Forgot password? Click here to reset