An Application of Multiple-Instance Learning to Estimate Generalization Risk

11/14/2019
by   Daiki Suehiro, et al.
0

We focus on several learning approaches that employ max-operator to evaluate the margin. For example, such approaches are commonly used in multi-class learning task and top-rank learning task. In general, in order to estimate the theoretical generalization risk, we need to individually evaluate the complexity of each hypothesis class used in the learning approaches. In this paper, we provide a technique to estimate a theoretical generalization risk for such learning approaches in a same fashion. The key idea is to "redundantly" reformulate the learning problem as one-class multiple-instance learning by redefining the specific input space based on the original input space. Surprisingly, we succeed to improve the generalization risk bounds for some multi-class learning and top-rank learning algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/30/2016

Multi-class classification: mirror descent approach

We consider the problem of multi-class classification and a stochastic o...
research
10/06/2022

Generalization Properties of Retrieval-based Models

Many modern high-performing machine learning models such as GPT-3 primar...
research
11/13/2018

Theoretical Analysis of Adversarial Learning: A Minimax Approach

We propose a general theoretical method for analyzing the risk bound in ...
research
05/24/2019

A Generalization Error Bound for Multi-class Domain Generalization

Domain generalization is the problem of assigning labels to an unlabeled...
research
08/11/2022

Goodness of Fit Metrics for Multi-class Predictor

The multi-class prediction had gained popularity over recent years. Thus...
research
02/27/2023

How optimal transport can tackle gender biases in multi-class neural-network classifiers for job recommendations?

Automatic recommendation systems based on deep neural networks have beco...
research
12/03/2018

Rademacher Complexity and Generalization Performance of Multi-category Margin Classifiers

One of the main open problems in the theory of multi-category margin cla...

Please sign up or login with your details

Forgot password? Click here to reset