CORE: Learning Consistent Ordinal REpresentations for Image Ordinal Estimation

01/15/2023
by   Yiming Lei, et al.
1

The goal of image ordinal estimation is to estimate the ordinal label of a given image with a convolutional neural network. Existing methods are mainly based on ordinal regression and particularly focus on modeling the ordinal mapping from the feature representation of the input to the ordinal label space. However, the manifold of the resultant feature representations does not maintain the intrinsic ordinal relations of interest, which hinders the effectiveness of the image ordinal estimation. Therefore, this paper proposes learning intrinsic Consistent Ordinal REpresentations (CORE) from ordinal relations residing in groundtruth labels while encouraging the feature representations to embody the ordinal low-dimensional manifold. First, we develop an ordinal totally ordered set (toset) distribution (OTD), which can (i) model the label embeddings to inherit ordinal information and measure distances between ordered labels of samples in a neighborhood, and (ii) model the feature embeddings to infer numerical magnitude with unknown ordinal information among the features of different samples. Second, through OTD, we convert the feature representations and labels into the same embedding space for better alignment, and then compute the Kullback Leibler (KL) divergence between the ordinal labels and feature representations to endow the latent space with consistent ordinal relations. Third, we optimize the KL divergence through ordinal prototype-constrained convex programming with dual decomposition; our theoretical analysis shows that we can obtain the optimal solutions via gradient backpropagation. Extensive experimental results demonstrate that the proposed CORE can accurately construct an ordinal latent space and significantly enhance existing deep ordinal regression methods to achieve better results.

READ FULL TEXT

page 1

page 4

page 9

page 10

research
01/31/2021

Meta ordinal weighting net for improving lung nodule classification

The progression of lung cancer implies the intrinsic ordinal relationshi...
research
07/12/2022

Learning from Label Relationships in Human Affect

Human affect and mental state estimation in an automated manner, face a ...
research
03/25/2021

Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regression

Uncertainty is the only certainty there is. Modeling data uncertainty is...
research
06/06/2022

OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regression

This paper presents a language-powered paradigm for ordinal regression. ...
research
08/16/2016

Variational Gaussian Process Auto-Encoder for Ordinal Prediction of Facial Action Units

We address the task of simultaneous feature fusion and modeling of discr...
research
07/09/2015

Learning Structured Ordinal Measures for Video based Face Recognition

This paper presents a structured ordinal measure method for video-based ...
research
09/07/2020

Ordinal-Content VAE: Isolating Ordinal-Valued Content Factors in Deep Latent Variable Models

In deep representational learning, it is often desired to isolate a part...

Please sign up or login with your details

Forgot password? Click here to reset