Learning from Aggregate Observations

04/14/2020
by   Yivan Zhang, et al.
0

We study the problem of learning from aggregate observations where supervision signals are given to sets of instances instead of individual instances, while the goal is still to predict labels of unseen individuals. A well-known example is multiple instance learning (MIL). In this paper, we extend MIL beyond binary classification to other problems such as multiclass classification and regression. We present a probabilistic framework that is applicable to a variety of aggregate observations, e.g., pairwise similarity for classification and mean/difference/rank observation for regression. We propose a simple yet effective method based on the maximum likelihood principle, which can be simply implemented for various differentiable models such as deep neural networks and gradient boosting machines. Experiments on three novel problem settings – classification via triplet comparison and regression via mean/rank observation indicate the effectiveness of the proposed method.

READ FULL TEXT
research
06/20/2023

A Universal Unbiased Method for Classification from Aggregate Observations

In conventional supervised classification, true labels are required for ...
research
10/10/2019

Learning from Indirect Observations

Weakly-supervised learning is a paradigm for alleviating the scarcity of...
research
11/04/2020

Filtering for Aggregate Hidden Markov Models with Continuous Observations

We consider a class of filtering problems for large populations where ea...
research
06/11/2020

Similarity-based Classification: Connecting Similarity Learning to Binary Classification

In real-world classification problems, pairwise supervision (i.e., a pai...
research
10/12/2020

A Generalized Stacking for Implementing Ensembles of Gradient Boosting Machines

The gradient boosting machine is one of the powerful tools for solving r...
research
04/21/2019

Explaining a prediction in some nonlinear models

In this article we will analyse how to compute the contribution of each ...
research
05/03/2018

Learning Pretopological Spaces to Model Complex Propagation Phenomena: A Multiple Instance Learning Approach Based on a Logical Modeling

This paper addresses the problem of learning the concept of "propagation...

Please sign up or login with your details

Forgot password? Click here to reset