Cognitive Modeling of Semantic Fluency Using Transformers

08/20/2022
by   Animesh Nighojkar, et al.
0

Can deep language models be explanatory models of human cognition? If so, what are their limits? In order to explore this question, we propose an approach called hyperparameter hypothesization that uses predictive hyperparameter tuning in order to find individuating descriptors of cognitive-behavioral profiles. We take the first step in this approach by predicting human performance in the semantic fluency task (SFT), a well-studied task in cognitive science that has never before been modeled using transformer-based language models (TLMs). In our task setup, we compare several approaches to predicting which word an individual performing SFT will utter next. We report preliminary evidence suggesting that, despite obvious implementational differences in how people and TLMs learn and use language, TLMs can be used to identify individual differences in human fluency task behaviors better than existing computational models, and may offer insights into human memory retrieval strategies – cognitive process not typically considered to be the kinds of things TLMs can model. Finally, we discuss the implications of this work for cognitive modeling of knowledge representations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/20/2021

Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?

Despite being designed for performance rather than cognitive plausibilit...
research
08/09/2013

Deconstructing analogy

Analogy has been shown to be important in many key cognitive abilities, ...
research
11/29/2017

Predicting and Explaining Human Semantic Search in a Cognitive Model

Recent work has attempted to characterize the structure of semantic memo...
research
05/28/2023

Language Models are Pragmatic Speakers

How do language models "think"? This paper formulates a probabilistic co...
research
05/29/2020

Towards a Human-Centred Cognitive Model of Visuospatial Complexity in Everyday Driving

We develop a human-centred, cognitive model of visuospatial complexity i...
research
05/22/2023

Cognitive network science reveals bias in GPT-3, ChatGPT, and GPT-4 mirroring math anxiety in high-school students

Large language models are becoming increasingly integrated into our live...
research
06/04/2019

Modeling e-Learners' Cognitive and Metacognitive Strategy in Comparative Question Solving

Cognitive and metacognitive strategy had demonstrated a significant role...

Please sign up or login with your details

Forgot password? Click here to reset