A numerical variability approach to results stability tests and its application to neuroimaging

by   Yohan Chatelain, et al.

Ensuring the long-term reproducibility of data analyses requires results stability tests to verify that analysis results remain within acceptable variation bounds despite inevitable software updates and hardware evolutions. This paper introduces a numerical variability approach for results stability tests, which determines acceptable variation bounds using random rounding of floating-point calculations. By applying the resulting stability test to , a widely-used neuroimaging tool, we show that the test is sensitive enough to detect subtle updates in image processing methods while remaining specific enough to accept numerical variations within a reference version of the application. This result contributes to enhancing the reliability and reproducibility of data analyses by providing a robust and flexible method for stability testing.


page 6

page 7

page 8

page 10

page 11

page 12

page 13

page 14


A Case Study on the Stability of Performance Tests for Serverless Applications

Context. While in serverless computing, application resource management ...

Multi-level analysis of compiler induced variability and performance tradeoffs

Floating-point arithmetic is the computational foundation of numerical s...

Comparing Perturbation Models for Evaluating Stability of Post-Processing Pipelines in Neuroimaging

A lack of software reproducibility has become increasingly apparent in t...

Spatial Data Generators

This gem describes a standard method for generating synthetic spatial da...

Numerically more stable computation of the p-values for the two-sample Kolmogorov-Smirnov test

The two-sample Kolmogorov-Smirnov test is a widely used statistical test...

Computational Reproducibility in Metabolite Quantification Applied to Short Echo Time in Vivo MR Spectroscopy

In vivo metabolite quantification by short echo time MR spectroscopy is ...

Please sign up or login with your details

Forgot password? Click here to reset