Predicting emergent linguistic compositions through time: Syntactic frame extension via multimodal chaining

09/10/2021
by   Lei Yu, et al.
0

Natural language relies on a finite lexicon to express an unbounded set of emerging ideas. One result of this tension is the formation of new compositions, such that existing linguistic units can be combined with emerging items into novel expressions. We develop a framework that exploits the cognitive mechanisms of chaining and multimodal knowledge to predict emergent compositional expressions through time. We present the syntactic frame extension model (SFEM) that draws on the theory of chaining and knowledge from "percept", "concept", and "language" to infer how verbs extend their frames to form new compositions with existing and novel nouns. We evaluate SFEM rigorously on the 1) modalities of knowledge and 2) categorization models of chaining, in a syntactically parsed English corpus over the past 150 years. We show that multimodal SFEM predicts newly emerged verb syntax and arguments substantially better than competing models using purely linguistic or unimodal knowledge. We find support for an exemplar view of chaining as opposed to a prototype view and reveal how the joint approach of multimodal chaining may be fundamental to the creation of literal and figurative language uses including metaphor and metonymy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/13/2017

El Lenguaje Natural como Lenguaje Formal

Formal languages theory is useful for the study of natural language. In ...
research
04/04/2017

From Modal to Multimodal Ambiguities: a Classification Approach

This paper deals with classifying ambiguities for Multimodal Languages. ...
research
08/24/2023

Can Linguistic Knowledge Improve Multimodal Alignment in Vision-Language Pretraining?

The multimedia community has shown a significant interest in perceiving ...
research
07/15/2023

Three-way Decisions with Evaluative Linguistic Expressions

We propose a linguistic interpretation of three-way decisions, where the...
research
01/05/2022

Frame Shift Prediction

Frame shift is a cross-linguistic phenomenon in translation which result...
research
10/27/2022

Natural Language Syntax Complies with the Free-Energy Principle

Natural language syntax yields an unbounded array of hierarchically stru...
research
09/11/2016

Divide and...conquer? On the limits of algorithmic approaches to syntactic semantic structure

In computer science, divide and conquer (D&C) is an algorithm design par...

Please sign up or login with your details

Forgot password? Click here to reset