Exploring Consequences of Simulation Design for Apparent Performance of Statistical Methods. 1: Results from simulations with constant sample sizes

06/30/2020
by   Elena Kulinskaya, et al.
0

Contemporary statistical publications rely on simulation to evaluate performance of new methods and compare them with established methods. In the context of meta-analysis of log-odds-ratios, we investigate how the ways in which simulations are implemented affect such conclusions. Choices of distributions for sample sizes and/or control probabilities considerably affect conclusions about statistical methods. Here we report on the results for constant sample sizes. Our two subsequent publications will cover normally and uniformly distributed sample sizes.

READ FULL TEXT
research
03/16/2022

Finite Sample t-Tests for High-Dimensional Means

Size distortion can occur if an asymptotic testing procedure requiring d...
research
10/05/2020

Statistical Reliability of 10 Years of Cyber Security User Studies (Extended Version)

Background. In recent years, cyber security security user studies have b...
research
01/08/2022

Evaluation of histological findings with severity grade, to analyze toxicology in-vivo studies

In-vivo toxicological studies are characterized by multiple primary endp...
research
09/14/2020

Simulation Models for Aggregated Data Meta-Analysis: Evaluation of Pooling Effect Sizes and Publication Biases

Simulation studies are commonly used to evaluate the performance of newl...
research
05/17/2023

Exploring Uniform Finite Sample Stickiness

It is well known, that Fréchet means on non-Euclidean spaces may exhibit...

Please sign up or login with your details

Forgot password? Click here to reset