Neural reality of argument structure constructions

02/24/2022
by   Bai Li, et al.
0

In lexicalist linguistic theories, argument structure is assumed to be predictable from the meaning of verbs. As a result, the verb is the primary determinant of the meaning of a clause. In contrast, construction grammarians propose that argument structure is encoded in constructions (or form-meaning pairs) that are distinct from verbs. Decades of psycholinguistic research have produced substantial empirical evidence in favor of the construction view. Here we adapt several psycholinguistic studies to probe for the existence of argument structure constructions (ASCs) in Transformer-based language models (LMs). First, using a sentence sorting experiment, we find that sentences sharing the same construction are closer in embedding space than sentences sharing the same verb. Furthermore, LMs increasingly prefer grouping by construction with more input data, mirroring the behaviour of non-native language learners. Second, in a "Jabberwocky" priming-based experiment, we find that LMs associate ASCs with meaning, even in semantically nonsensical sentences. Our work offers the first evidence for ASCs in LMs and highlights the potential to devise novel probing methods grounded in psycholinguistic research.

READ FULL TEXT

page 5

page 6

page 7

page 8

research
02/04/2023

Construction Grammar Provides Unique Insight into Neural Language Models

Construction Grammar (CxG) has recently been used as the basis for probi...
research
06/05/2023

Enhancing Language Representation with Constructional Information for Natural Language Understanding

Natural language understanding (NLU) is an essential branch of natural l...
research
07/20/2022

Integrating Linguistic Theory and Neural Language Models

Transformer-based language models have recently achieved remarkable resu...
research
08/04/2019

Separating Argument Structure from Logical Structure in AMR

The AMR (Abstract Meaning Representation) formalism for representing mea...
research
05/29/2023

A Method for Studying Semantic Construal in Grammatical Constructions with Interpretable Contextual Embedding Spaces

We study semantic construal in grammatical constructions using large lan...
research
01/29/2023

A Discerning Several Thousand Judgments: GPT-3 Rates the Article + Adjective + Numeral + Noun Construction

Knowledge of syntax includes knowledge of rare, idiosyncratic constructi...

Please sign up or login with your details

Forgot password? Click here to reset