A Discerning Several Thousand Judgments: GPT-3 Rates the Article + Adjective + Numeral + Noun Construction

01/29/2023
by   Kyle Mahowald, et al.
0

Knowledge of syntax includes knowledge of rare, idiosyncratic constructions. LLMs must overcome frequency biases in order to master such constructions. In this study, I prompt GPT-3 to give acceptability judgments on the English-language Article + Adjective + Numeral + Noun construction (e.g., "a lovely five days"). I validate the prompt using the CoLA corpus of acceptability judgments and then zero in on the AANN construction. I compare GPT- 3's judgments to crowdsourced human judgments on a subset of sentences. GPT-3's judgments are broadly similar to human judgments and generally align with proposed constraints in the literature but, in some cases, GPT-3's judgments and human judgments diverge from the literature and from each other.

READ FULL TEXT

page 4

page 5

research
11/19/2018

A Note on Two Constructions of Zero-Difference Balanced Functions

Notes on two constructions of zero-difference balanced (ZDB) functions a...
research
08/18/2017

The Natural Stories Corpus

It is now a common practice to compare models of human language processi...
research
05/29/2023

A Method for Studying Semantic Construal in Grammatical Constructions with Interpretable Contextual Embedding Spaces

We study semantic construal in grammatical constructions using large lan...
research
04/11/2020

New Construction of Optimal Type-II Binary Z-Complementary Pairs

A pair of sequences is called a Z-complementary pair (ZCP) if it has zer...
research
01/03/2022

On Automating Triangle Constructions in Absolute and Hyperbolic Geometry

We describe first steps towards a system for automated triangle construc...
research
04/03/2021

Finding Variants for Construction-Based Dialectometry: A Corpus-Based Approach to Regional CxGs

This paper develops a construction-based dialectometry capable of identi...
research
02/24/2022

Neural reality of argument structure constructions

In lexicalist linguistic theories, argument structure is assumed to be p...

Please sign up or login with your details

Forgot password? Click here to reset