Hierarchical Image Classification using Entailment Cone Embeddings

04/02/2020
by   Ankit Dhall, et al.
4

Image classification has been studied extensively, but there has been limited work in using unconventional, external guidance other than traditional image-label pairs for training. We present a set of methods for leveraging information about the semantic hierarchy embedded in class labels. We first inject label-hierarchy knowledge into an arbitrary CNN-based classifier and empirically show that availability of such external semantic information in conjunction with the visual semantics from images boosts overall performance. Taking a step further in this direction, we model more explicitly the label-label and label-image interactions using order-preserving embeddings governed by both Euclidean and hyperbolic geometries, prevalent in natural language, and tailor them to hierarchical image classification and representation learning. We empirically validate all the models on the hierarchical ETHEC dataset.

READ FULL TEXT
research
04/02/2020

Learning Representations For Images With Hierarchical Labels

Image classification has been studied extensively but there has been lim...
research
12/14/2015

Semantic-enriched Visual Vocabulary Construction in a Weakly Supervised Context

One of the prevalent learning tasks involving images is content-based im...
research
08/28/2020

Semantics Preserving Hierarchy based Retrieval of Indian heritage monuments

Monument classification can be performed on the basis of their appearanc...
research
11/01/2021

Hierarchical Image Classification with A Literally Toy Dataset

Unsupervised domain adaptation (UDA) in image classification remains a b...
research
01/26/2022

Evaluating language-biased image classification based on semantic representations

Humans show language-biased image recognition for a word-embedded image,...
research
01/13/2021

Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification

We consider the problem of multi-label classification where the labels l...
research
08/01/2023

Beyond One-Hot-Encoding: Injecting Semantics to Drive Image Classifiers

Images are loaded with semantic information that pertains to real-world ...

Please sign up or login with your details

Forgot password? Click here to reset