Semantic Spaces

05/13/2016
by   Yuri Manin, et al.
0

Any natural language can be considered as a tool for producing large databases (consisting of texts, written, or discursive). This tool for its description in turn requires other large databases (dictionaries, grammars etc.). Nowadays, the notion of database is associated with computer processing and computer memory. However, a natural language resides also in human brains and functions in human communication, from interpersonal to intergenerational one. We discuss in this survey/research paper mathematical, in particular geometric, constructions, which help to bridge these two worlds. In particular, in this paper we consider the Vector Space Model of semantics based on frequency matrices, as used in Natural Language Processing. We investigate underlying geometries, formulated in terms of Grassmannians, projective spaces, and flag varieties. We formulate the relation between vector space models and semantic spaces based on semic axes in terms of projectability of subvarieties in Grassmannians and projective spaces. We interpret Latent Semantics as a geometric flow on Grassmannians. We also discuss how to formulate Gärdenfors' notion of "meeting of minds" in our geometric setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/20/2021

Anaphora and Ellipsis in Lambek Calculus with a Relevant Modality: Syntax and Semantics

Lambek calculus with a relevant modality !𝐋^* of arXiv:1601.06303 syntac...
research
05/12/2017

Evaluating vector-space models of analogy

Vector-space representations provide geometric tools for reasoning about...
research
04/02/2019

Neural Vector Conceptualization for Word Vector Space Interpretation

Distributed word vector spaces are considered hard to interpret which hi...
research
08/10/2022

A Quantum Natural Language Processing Approach to Pronoun Resolution

We use the Lambek Calculus with soft sub-exponential modalities to model...
research
05/04/2019

A categorical construction for the computational definition of vector spaces

Lambda-S is an extension to first-order lambda calculus unifying two app...
research
09/24/2018

Text Similarity in Vector Space Models: A Comparative Study

Automatic measurement of semantic text similarity is an important task i...
research
09/14/2022

vec2text with Round-Trip Translations

We investigate models that can generate arbitrary natural language text ...

Please sign up or login with your details

Forgot password? Click here to reset