Unsupervised Ensemble Learning with Dependent Classifiers

10/20/2015
by   Ariel Jaffe, et al.
0

In unsupervised ensemble learning, one obtains predictions from multiple sources or classifiers, yet without knowing the reliability and expertise of each source, and with no labeled data to assess it. The task is to combine these possibly conflicting predictions into an accurate meta-learner. Most works to date assumed perfect diversity between the different sources, a property known as conditional independence. In realistic scenarios, however, this assumption is often violated, and ensemble learners based on it can be severely sub-optimal. The key challenges we address in this paper are: (i) how to detect, in an unsupervised manner, strong violations of conditional independence; and (ii) construct a suitable meta-learner. To this end we introduce a statistical model that allows for dependencies between classifiers. Our main contributions are the development of novel unsupervised methods to detect strongly dependent classifiers, better estimate their accuracies, and construct an improved meta-learner. Using both artificial and real datasets, we showcase the importance of taking classifier dependencies into account and the competitive performance of our approach.

READ FULL TEXT

page 8

page 20

research
07/29/2014

Estimating the Accuracies of Multiple Classifiers Without Labeled Data

In various situations one is given only the predictions of multiple clas...
research
02/06/2016

A Deep Learning Approach to Unsupervised Ensemble Learning

We show how deep learning methods can be applied in the context of crowd...
research
06/22/2019

Unsupervised Ensemble Classification with Dependent Data

Ensemble learning, the machine learning paradigm where multiple algorith...
research
12/23/2015

Adaptive Ensemble Learning with Confidence Bounds

Extracting actionable intelligence from distributed, heterogeneous, corr...
research
03/13/2013

Ranking and combining multiple predictors without labeled data

In a broad range of classification and decision making problems, one is ...
research
03/08/2017

Unsupervised Ensemble Regression

Consider a regression problem where there is no labeled data and the onl...
research
10/17/2020

Aggregating Dependent Gaussian Experts in Local Approximation

Distributed Gaussian processes (DGPs) are prominent local approximation ...

Please sign up or login with your details

Forgot password? Click here to reset