Mutual Information-based Generalized Category Discovery

12/01/2022
by   Florent Chiaroni, et al.
0

We introduce an information-maximization approach for the Generalized Category Discovery (GCD) problem. Specifically, we explore a parametric family of loss functions evaluating the mutual information between the features and the labels, and find automatically the one that maximizes the predictive performances. Furthermore, we introduce the Elbow Maximum Centroid-Shift (EMaCS) technique, which estimates the number of classes in the unlabeled set. We report comprehensive experiments, which show that our mutual information-based approach (MIB) is both versatile and highly competitive under various GCD scenarios. The gap between the proposed approach and the existing methods is significant, more so when dealing with fine-grained classification problems. Our code: <https://github.com/fchiaroni/Mutual-Information-Based-GCD>.

READ FULL TEXT
research
06/23/2021

Mutual-Information Based Few-Shot Classification

We introduce Transductive Infomation Maximization (TIM) for few-shot lea...
research
02/08/2022

On Sibson's α-Mutual Information

We explore a family of information measures that stems from Rényi's α-Di...
research
12/13/2020

Active Feature Selection for the Mutual Information Criterion

We study active feature selection, a novel feature selection setting in ...
research
08/26/2021

Quadratic mutual information regularization in real-time deep CNN models

In this paper, regularized lightweight deep convolutional neural network...
research
03/13/2020

Mutual Information Maximization for Effective Lip Reading

Lip reading has received an increasing research interest in recent years...
research
09/15/2020

Evaluating representations by the complexity of learning low-loss predictors

We consider the problem of evaluating representations of data for use in...
research
09/08/2019

L_DMI: An Information-theoretic Noise-robust Loss Function

Accurately annotating large scale dataset is notoriously expensive both ...

Please sign up or login with your details

Forgot password? Click here to reset