Limited Functional Form, Misspecification, and Unreliable Interpretations in Psychology and Social Science

09/21/2020
by   Matthew J. Vowels, et al.
0

The replicability crisis has drawn attention to numerous weaknesses in psychology and social science research practice. In this work we focus on three issues that deserve more attention: The use of models with limited functional form, the use of misspecified causal models, and unreliable interpretation of results. We demonstrate a number of possible consequences via simulation, and provide recommendations for researchers to improve their research practice. We believe it is extremely important to encourage psychologists and social scientists to engage with the debate surrounding areas of possible analytical and statistical improvements, particularly given that these shortfalls have the potential to seriously hinder scientific progress. Every research question and hypothesis may present its own unique challenges, and it is only through an awareness and understanding of varied statistical methods for predictive and causal modeling, that researchers will have the tools with which to appropriately address them.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/29/2018

Computer-Assisted Text Analysis for Social Science: Topic Models and Beyond

Topic models are a family of statistical-based algorithms to summarize, ...
research
06/10/2022

A Causal Research Pipeline and Tutorial for Psychologists and Social Scientists

Causality is a fundamental part of the scientific endeavour to understan...
research
03/27/2023

"That's important, but...": How Computer Science Researchers Anticipate Unintended Consequences of Their Research Innovations

Computer science research has led to many breakthrough innovations but h...
research
09/07/2018

A Primer on Causality in Data Science

Many questions in Data Science are fundamentally causal in that our obje...
research
08/17/2022

Transformer Encoder for Social Science

High-quality text data has become an important data source for social sc...
research
09/19/2019

Understanding the Information needs of Social Scientists in Germany

The information needs of social science researchers are manifold and alm...
research
06/01/2021

Understanding peacefulness through the world news

Peacefulness is a principal dimension of well-being for all humankind an...

Please sign up or login with your details

Forgot password? Click here to reset