Null/No Information Rate (NIR): a statistical test to assess if a classification accuracy is significant for a given problem

06/09/2023
by   Manuele Bicego, et al.
0

In many research contexts, especially in the biomedical field, after studying and developing a classification system a natural question arises: "Is this accuracy enough high?", or better, "Can we say, with a statistically significant confidence, that our classification system is able to solve the problem"? To answer to this question, we can use the statistical test described in this paper, which is referred in some cases as NIR (No Information Rate or Null Information Rate).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2019

The posterior probability of a null hypothesis given a statistically significant result

Some researchers informally assume that, when they carry out a null hypo...
research
09/06/2023

MCMC Sampling of Directed Flag Complexes with Fixed Undirected Graphs

Constructing null models to test the significance of extracted informati...
research
03/12/2018

Statistical tests for evaluating an earthquake prediction method

The impact of including postcursors in the null hypothesis test is discu...
research
05/11/2018

Decision problems for Clark-congruential languages

A common question when studying a class of context-free grammars is whet...
research
05/04/2023

Credibility of high R^2 in regression problems: a permutation approach

The question of whether Y can be predicted based on X often arises and w...
research
12/02/2018

Dynamic Patch Generation for Null Pointer Exceptions using Metaprogramming

Null pointer exceptions (NPE) are the number one cause of uncaught crash...
research
12/14/2017

Rate of Change Analysis for Interestingness Measures

The use of Association Rule Mining techniques in diverse contexts and do...

Please sign up or login with your details

Forgot password? Click here to reset