New ideas for method comparison: a Monte Carlo power analysis

05/10/2021
by   Giorgio Pioda, et al.
0

In this paper some new proposals for method comparison are presented. On the one hand, two new robust regressions, the M-Deming and the MM-Deming, have been developed by modifying Linnet's method of the weighted Deming regression. The M-Deming regression shows superior qualities to the Passing-Bablok regression; it does not suffer from bias when the data to be validated have a reduced precision, and therefore turns out to be much more reliable. On the other hand, a graphical method (box and ellipses) for validations has been developed which is also equipped with a unified statistical test. In this test the intercept and slope pairs obtained from a bootstrap process are combined into a multinomial distribution by robust determination of the covariance matrix. The Mahalanobis distance from the point representing the null hypothesis is evaluated using the χ^2 distribution. It is emphasized that the interpretation of the graph is more important than the probability obtained from the test. The unified test has been evaluated through Monte Carlo simulations, comparing the theoretical α levels with the empirical rate of rejections (type-I errors). In addition, a power comparison of the various (new and old) methods was conducted using the same techniques. This unified method, regardless of the regression chosen, shows much higher power and allows a significant reduction in the sample size required for validations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2020

Bootstrap p-values reduce type 1 error of the robust rank-order test of difference in medians

The robust rank-order test (Fligner and Policello, 1981) was designed as...
research
02/20/2022

A Unified Nonparametric Test of Transformations on Distribution Functions with Nuisance Parameters

This paper proposes a simple unified approach to testing transformations...
research
03/20/2023

An Effective Multivariate Normality Test via Hessians of Empirical Cumulant Generating Functions

In this article, we propose a new class of consistent tests for p-variat...
research
06/08/2022

Identification testing via sample splitting – an application to Structural VAR models

In this article, a novel identification test is proposed, which can be a...
research
07/16/2022

Exact and asymptotic goodness-of-fit tests based on the maximum and its location of the empirical process

The supremum of the standardized empirical process is a promising statis...
research
02/23/2019

A unified perspective on modified Poisson likelihoods for limited Monte Carlo data

Counting experiments often rely on Monte Carlo simulations for predictio...
research
12/05/2022

Robust multiple method comparison and transformation

A generalization of Passing-Bablok regression for the simultaneous compa...

Please sign up or login with your details

Forgot password? Click here to reset