Using simulation studies to evaluate statistical methods

12/08/2017
by   Tim P Morris, et al.
0

Simulation studies are computer experiments which involve creating data by pseudorandom sampling. The key strength of simulation studies is the ability to understand the behaviour of statistical methods because some `truth' is known from the process of generating the data. This allows us to consider properties of methods, such as bias. While widely used, simulation studies are often poorly designed, analysed and reported. This article outlines the rationale for using simulation studies and offers guidance for design, execution, analysis, reporting and presentation. In particular, we provide: a structured approach for planning and reporting simulation studies; coherent terminology for simulation studies; guidance on coding simulation studies; a critical discussion of key performance measures and their computation; ideas on structuring tabular and graphical presentation of results; and new graphical presentations. With a view to describing current practice and identifying areas for improvement, we review 100 articles taken from Volume 34 of Statistics in Medicine which included at least one simulation study.

READ FULL TEXT

page 1

page 22

research
09/09/2019

INTEREST: INteractive Tool for Exploring REsults from Simulation sTudies

Simulation studies allow us to explore the properties of statistical met...
research
11/26/2021

Let's practice what we preach: Planning and interpreting simulation studies with design and analysis of experiments

Statisticians recommend the Design and Analysis of Experiments (DAE) for...
research
03/24/2022

Pitfalls and Potentials in Simulation Studies

Comparative simulation studies are workhorse tools for benchmarking stat...
research
10/15/2020

An Artifact-based Workflow for Finite-Element Simulation Studies

Workflow support typically focuses on single simulation experiments. Thi...
research
07/05/2023

Replicability of Simulation Studies for the Investigation of Statistical Methods: The RepliSims Project

Results of simulation studies evaluating the performance of statistical ...
research
04/27/2020

Simulation studies on Python using sstudy package with SQL databases as storage

Performance assessment is a key issue in the process of proposing new ma...
research
01/02/2018

Cautionary note on "Semiparametric modeling of grouped current duration data with preferential reporting'"

This report is designed to clarify a few points about the article "Semip...

Please sign up or login with your details

Forgot password? Click here to reset