Parsimony in Model Selection: Tools for Assessing Fit Propensity

07/07/2020
by   Carl Falk, et al.
0

Theories can be represented as statistical models for empirical testing. There is a vast literature on model selection and multimodel inference that focuses on how to assess which statistical model, and therefore which theory, best fits the available data. For example, given some data, one can compare models on various information criterion or other fit statistics. However, what these indices fail to capture is the full range of counterfactuals. That is, some models may fit the given data better not because they represent a more correct theory, but simply because these models have more fit propensity - a tendency to fit a wider range of data, even nonsensical data, better. Current approaches fall short in considering the principle of parsimony (Occam's Razor), often equating it with the number of model parameters. Here we offer a toolkit for researchers to better study and understand parsimony through the fit propensity of Structural Equation Models. We provide an R package (ockhamSEM) built on the popular lavaan package. To illustrate the importance of evaluating fit propensity, we use ockhamSEM to investigate the factor structure of the Rosenberg Self-Esteem Scale.

READ FULL TEXT

Authors

page 20

04/16/2020

Assessing the Significance of Model Selection in Ecology

Model Selection is a key part of many ecological studies, with Akaike's ...
05/22/2018

How To Solve Moral Conundrums with Computability Theory

Various moral conundrums plague population ethics: The Non-Identity Prob...
06/28/2018

A Bootstrap Method for Goodness of Fit and Model Selection with a Single Observed Network

Network models are applied in numerous domains where data can be represe...
05/03/2022

Complementary Goodness of Fit Procedure for Crash Frequency Models

This paper presents a new procedure for evaluating the goodness of fit o...
09/08/2017

A Statistical Comparison of Some Theories of NP Word Order

A frequent object of study in linguistic typology is the order of elemen...
04/06/2021

Statistical Network Analysis with Bergm

Recent advances in computational methods for intractable models have mad...
10/11/2019

Analytical Quantile Solution for the S-distribution, Random Number Generation and Statistical Data Modeling

The selection of a specific statistical distribution is seldom a simple ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.