"Predicting" after peeking into the future: Correcting a fundamental flaw in the SAOM – TERGM comparison of Leifeld and Cranmer (2019)

11/04/2019
by   Per Block, et al.
0

We review the empirical comparison of SAOMs and TERGMs by Leifeld and Cranmer (2019) in Network Science. We note that their model specification uses nodal covariates calculated from observed degrees instead of using structural effects, thus turning endogeneity into circularity. In consequence, their out-of-sample predictions using TERGMs are based on out-of-sample information and thereby predict the future using observations from the future. We conclude that their analysis rest on erroneous model specifications that render the article's conclusions meaningless. Consequently, researchers should disregard recommendations from the criticized paper when making informed modelling choices.

READ FULL TEXT
09/13/2020

Which Wilcoxon should we use? An interactive rank test and other alternatives

Classical nonparametric tests to compare multiple samples, such as the W...
02/10/2021

Predicting Customer Lifetime Values – ecommerce use case

Predicting customer future purchases and lifetime value is a key metrics...
12/10/2020

Optimal selection of a common subset of covariates for different regressions

Given a regression dataset of size n, most of the classical model select...
07/13/2021

For high-dimensional hierarchical models, consider exchangeability of effects across covariates instead of across datasets

Hierarchical Bayesian methods enable information sharing across multiple...
01/24/2020

Valid distribution-free inferential models for prediction

A fundamental problem in statistics and machine learning is that of usin...
10/01/2019

A note on the empirical comparison of RBG and Ludii

We present an experimental comparison of the efficiency of three General...
12/01/2021

Controlling for multiple covariates

A fundamental problem in statistics is to compare the outcomes attained ...