Auxiliary Class Based Multiple Choice Learning

08/06/2021
by   Sihwan Kim, et al.
0

The merit of ensemble learning lies in having different outputs from many individual models on a single input, i.e., the diversity of the base models. The high quality of diversity can be achieved when each model is specialized to different subsets of the whole dataset. Moreover, when each model explicitly knows to which subsets it is specialized, more opportunities arise to improve diversity. In this paper, we propose an advanced ensemble method, called Auxiliary class based Multiple Choice Learning (AMCL), to ultimately specialize each model under the framework of multiple choice learning (MCL). The advancement of AMCL is originated from three novel techniques which control the framework from different directions: 1) the concept of auxiliary class to provide more distinct information through the labels, 2) the strategy, named memory-based assignment, to determine the association between the inputs and the models, and 3) the feature fusion module to achieve generalized features. To demonstrate the performance of our method compared to all variants of MCL methods, we conduct extensive experiments on the image classification and segmentation tasks. Overall, the performance of AMCL exceeds all others in most of the public datasets trained with various networks as members of the ensembles.

READ FULL TEXT

page 6

page 16

research
06/12/2017

Confident Multiple Choice Learning

Ensemble methods are arguably the most trustworthy techniques for boosti...
research
10/27/2021

Diversity Matters When Learning From Ensembles

Deep ensembles excel in large-scale image classification tasks both in t...
research
05/12/2019

Predictive Ensemble Learning with Application to Scene Text Detection

Deep learning based approaches have achieved significant progresses in d...
research
10/20/2020

Promoting High Diversity Ensemble Learning with EnsembleBench

Ensemble learning is gaining renewed interests in recent years. This pap...
research
06/05/2023

Input gradient diversity for neural network ensembles

Deep Ensembles (DEs) demonstrate improved accuracy, calibration and robu...
research
03/11/2023

AugDiff: Diffusion based Feature Augmentation for Multiple Instance Learning in Whole Slide Image

Multiple Instance Learning (MIL), a powerful strategy for weakly supervi...
research
03/29/2020

Ensemble Forecasting of Monthly Electricity Demand using Pattern Similarity-based Methods

This work presents ensemble forecasting of monthly electricity demand us...

Please sign up or login with your details

Forgot password? Click here to reset