"Predicting" after peeking into the future: Correcting a fundamental flaw in the SAOM – TERGM comparison of Leifeld and Cranmer (2019)

11/04/2019
by   Per Block, et al.
0

We review the empirical comparison of SAOMs and TERGMs by Leifeld and Cranmer (2019) in Network Science. We note that their model specification uses nodal covariates calculated from observed degrees instead of using structural effects, thus turning endogeneity into circularity. In consequence, their out-of-sample predictions using TERGMs are based on out-of-sample information and thereby predict the future using observations from the future. We conclude that their analysis rest on erroneous model specifications that render the article's conclusions meaningless. Consequently, researchers should disregard recommendations from the criticized paper when making informed modelling choices.

READ FULL TEXT
research
09/13/2020

Which Wilcoxon should we use? An interactive rank test and other alternatives

Classical nonparametric tests to compare multiple samples, such as the W...
research
02/10/2021

Predicting Customer Lifetime Values – ecommerce use case

Predicting customer future purchases and lifetime value is a key metrics...
research
12/10/2020

Optimal selection of a common subset of covariates for different regressions

Given a regression dataset of size n, most of the classical model select...
research
07/13/2021

For high-dimensional hierarchical models, consider exchangeability of effects across covariates instead of across datasets

Hierarchical Bayesian methods enable information sharing across multiple...
research
06/25/2023

Improved LM Test for Model Specification Searches in Covariance Structure Analysis

Model specification searches and modifications are commonly employed in ...
research
11/03/2022

Conformal Prediction for STL Runtime Verification

We are interested in predicting failures of cyber-physical systems durin...
research
10/01/2019

A note on the empirical comparison of RBG and Ludii

We present an experimental comparison of the efficiency of three General...

Please sign up or login with your details

Forgot password? Click here to reset