Data Uncertainty without Prediction Models

04/25/2022
by   Bongjoon Park, et al.
0

Data acquisition processes for machine learning are often costly. To construct a high-performance prediction model with fewer data, a degree of difficulty in prediction is often deployed as the acquisition function in adding a new data point. The degree of difficulty is referred to as uncertainty in prediction models. We propose an uncertainty estimation method named a Distance-weighted Class Impurity without explicit use of prediction models. We estimated uncertainty using distances and class impurities around the location, and compared it with several methods based on prediction models for uncertainty estimation by active learning tasks. We verified that the Distance-weighted Class Impurity works effectively regardless of prediction models.

READ FULL TEXT
research
04/15/2021

Efficient Click-Through Rate Prediction for Developing Countries via Tabular Learning

Despite the rapid growth of online advertisement in developing countries...
research
11/16/2022

Can Strategic Data Collection Improve the Performance of Poverty Prediction Models?

Machine learning-based estimates of poverty and wealth are increasingly ...
research
01/04/2018

Model Class Reliance: Variable Importance Measures for any Machine Learning Model Class, from the "Rashomon" Perspective

There are serious drawbacks to many current variable importance (VI) met...
research
07/01/2020

Data-Driven Method for Enhanced Corrosion Assessment of Reinforced Concrete Structures

Corrosion is a major problem affecting the durability of reinforced conc...
research
10/03/2019

Silas: High Performance, Explainable and Verifiable Machine Learning

This paper introduces a new classification tool named Silas, which is bu...
research
06/21/2022

Performance Prediction Under Dataset Shift

ML models deployed in production often have to face unknown domain chang...
research
07/02/2020

Crowdfunding for Design Innovation: Prediction Model with Critical Factors

Online reward-based crowdfunding campaigns have emerged as an innovative...

Please sign up or login with your details

Forgot password? Click here to reset