A Plot is Worth a Thousand Tests: Assessing Residual Diagnostics with the Lineup Protocol

08/11/2023
by   Weihao Li, et al.
Monash University
University of Nebraska–Lincoln
Australian National University
0

Regression experts consistently recommend plotting residuals for model diagnosis, despite the availability of many numerical hypothesis test procedures designed to use residuals to assess problems with a model fit. Here we provide evidence for why this is good advice using data from a visual inference experiment. We show how conventional tests are too sensitive, which means that too often the conclusion would be that the model fit is inadequate. The experiment uses the lineup protocol which puts a residual plot in the context of null plots. This helps generate reliable and consistent reading of residual plots for better model diagnosis. It can also help in an obverse situation where a conventional test would fail to detect a problem with a model due to contaminated data. The lineup protocol also detects a range of departures from good residuals simultaneously.

READ FULL TEXT

page 6

page 12

page 14

page 20

page 38

page 39

page 40

page 41

07/09/2020

Supplemental Studies for Simultaneous Goodness-of-Fit Testing

Testing to see whether a given data set comes from some specified distri...
06/24/2021

Cauchy or not Cauchy? New goodness-of-fit tests for the Cauchy distribution

We introduce a new characterization of the Cauchy distribution and propo...
12/20/2018

Testing multivariate uniformity based on random geometric graphs

We present new families of goodness-of-fit tests of uniformity on a full...
09/12/2022

More asymptotic theory for the test of exponentiality based on the mean residual life function

We revisit the family of goodness-of-fit tests for exponentiality based ...
11/08/2019

A Binary Regression Adaptive Goodness-of-fit Test (BAGofT)

The Pearson's χ^2 test and residual deviance test are two classical good...
05/26/2020

Exhaustive goodness-of-fit via smoothed inference and graphics

Classical tests of goodness-of-fit aim to validate the conformity of a p...

Please sign up or login with your details

Forgot password? Click here to reset