Improving Multi-class Classifier Using Likelihood Ratio Estimation with Regularization

10/28/2022
by   Masato Kikuchi, et al.
0

The universal-set naive Bayes classifier (UNB) <cit.>, defined using likelihood ratios (LRs), was proposed to address imbalanced classification problems. However, the LR estimator used in the UNB overestimates LRs for low-frequency data, degrading the classification performance. Our previous study <cit.> proposed an effective LR estimator even for low-frequency data. This estimator uses regularization to suppress the overestimation, but we did not consider imbalanced data. In this paper, we integrated the estimator with the UNB. Our experiments with imbalanced data showed that our proposed classifier effectively adjusts the classification scores according to the class balance using regularization parameters and improves the classification performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/25/2018

Superensemble Classifier for Improving Predictions in Imbalanced Datasets

Learning from an imbalanced dataset is a tricky proposition. Because the...
research
11/21/2018

Adversarial Classifier for Imbalanced Problems

Adversarial approach has been widely used for data generation in the las...
research
08/14/2021

Equity-Directed Bootstrapping: Examples and Analysis

When faced with severely imbalanced binary classification problems, we o...
research
11/05/2021

Feature Selective Likelihood Ratio Estimator for Low- and Zero-frequency N-grams

In natural language processing (NLP), the likelihood ratios (LRs) of N-g...
research
10/28/2022

Conservative Likelihood Ratio Estimator for Infrequent Data Slightly above a Frequency Threshold

A naive likelihood ratio (LR) estimation using the observed frequencies ...
research
06/06/2023

Convergence properties of multi-environment causal regularization

Causal regularization was introduced as a stable causal inference strate...
research
03/04/2015

Class Probability Estimation via Differential Geometric Regularization

We study the problem of supervised learning for both binary and multicla...

Please sign up or login with your details

Forgot password? Click here to reset