DeepAI AI Chat
Log In Sign Up

Learning Representations For Images With Hierarchical Labels

by   Ankit Dhall, et al.

Image classification has been studied extensively but there has been limited work in the direction of using non-conventional, external guidance other than traditional image-label pairs to train such models. In this thesis we present a set of methods to leverage information about the semantic hierarchy induced by class labels. In the first part of the thesis, we inject label-hierarchy knowledge to an arbitrary classifier and empirically show that availability of such external semantic information in conjunction with the visual semantics from images boosts overall performance. Taking a step further in this direction, we model more explicitly the label-label and label-image interactions by using order-preserving embedding-based models, prevalent in natural language, and tailor them to the domain of computer vision to perform image classification. Although, contrasting in nature, both the CNN-classifiers injected with hierarchical information, and the embedding-based models outperform a hierarchy-agnostic model on the newly presented, real-world ETH Entomological Collection image dataset.


page 11

page 12


Hierarchical Image Classification using Entailment Cone Embeddings

Image classification has been studied extensively, but there has been li...

Learning with Hierarchical Complement Objective

Label hierarchies widely exist in many vision-related problems, ranging ...

Angle-based hierarchical classification using exact label embedding

Hierarchical classification problems are commonly seen in practice. Howe...

Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification

We consider the problem of multi-label classification where the labels l...

Semantic-enriched Visual Vocabulary Construction in a Weakly Supervised Context

One of the prevalent learning tasks involving images is content-based im...

Building a visual semantics aware object hierarchy

The semantic gap is defined as the difference between the linguistic rep...

Semantics Preserving Hierarchy based Retrieval of Indian heritage monuments

Monument classification can be performed on the basis of their appearanc...