Emergence of Syntax Needs Minimal Supervision

05/03/2020
by   Raphaël Bailly, et al.
0

This paper is a theoretical contribution to the debate on the learnability of syntax from a corpus without explicit syntax-specific guidance. Our approach originates in the observable structure of a corpus, which we use to define and isolate grammaticality (syntactic information) and meaning/pragmatics information. We describe the formal characteristics of an autonomous syntax and show that it becomes possible to search for syntax-based lexical categories with a simple optimization process, without any prior hypothesis on the form of the model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/20/2022

When Does Syntax Mediate Neural Language Model Performance? Evidence from Dropout Probes

Recent causal probing literature reveals when language models and syntac...
research
06/15/2018

An Empirical Analysis of the Correlation of Syntax and Prosody

The relation of syntax and prosody (the syntax--prosody interface) has b...
research
05/26/2022

GNOLL: Efficient Software for Real-World Dice Notation and Extensions

GNOLL ("GNOLL's Not *OLL") is a software library for dice notation. Unli...
research
10/01/2017

Mathematical foundations of matrix syntax

Matrix syntax is a formal model of syntactic relations in language. The ...
research
02/16/2000

Syntactic Autonomy: Why There is no Autonomy without Symbols and How Self-Organization Might Evolve Them

Two different types of agency are discussed based on dynamically coheren...
research
06/24/2022

The syntax-lexicon tradeoff in writing

As speakers turn their thoughts into sentences, they maintain a balance ...
research
05/04/2020

What is Learned in Visually Grounded Neural Syntax Acquisition

Visual features are a promising signal for learning bootstrap textual mo...

Please sign up or login with your details

Forgot password? Click here to reset