Semi-Supervised Ordinal Regression Based on Empirical Risk Minimization

01/31/2019
by   Taira Tsuchiya, et al.
6

We consider the semi-supervised ordinal regression problem, where unlabeled data are given in addition to ordinal labeled data. There are many evaluation metrics in ordinal regression such as the mean absolute error, mean squared error, and mean classification error. Existing work does not take the evaluation metric into account, has a restriction on the model choice, and has no theoretical guarantee. To mitigate these problems, we propose a method based on the empirical risk minimization (ERM) framework that is applicable to optimizing all of the metrics mentioned above. Also, our method has flexible choices of models, surrogate losses, and optimization algorithms. Moreover, our method does not require a restrictive assumption on unlabeled data such as the cluster assumption and manifold assumption. We provide an estimation error bound to show that our learning method is consistent. Finally, we conduct experiments to show the usefulness of our framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2019

Classification from Pairwise Similarities/Dissimilarities and Unlabeled Data via Empirical Risk Minimization

Pairwise similarities and dissimilarities between data points might be e...
research
06/01/2020

An Effectiveness Metric for Ordinal Classification: Formal Properties and Experimental Results

In Ordinal Classification tasks, items have to be assigned to classes th...
research
11/07/2016

Minimax-optimal semi-supervised regression on unknown manifolds

We consider semi-supervised regression when the predictor variables are ...
research
06/08/2018

Nonparametric Regression with Comparisons: Escaping the Curse of Dimensionality with Ordinal Information

In supervised learning, we leverage a labeled dataset to design methods ...
research
09/30/2022

CEREAL: Few-Sample Clustering Evaluation

Evaluating clustering quality with reliable evaluation metrics like norm...
research
09/01/2020

Semi-Supervised Empirical Risk Minimization: When can unlabeled data improve prediction

We present a general methodology for using unlabeled data to design semi...
research
05/10/2022

THOR: Threshold-Based Ranking Loss for Ordinal Regression

In this work, we present a regression-based ordinal regression algorithm...

Please sign up or login with your details

Forgot password? Click here to reset