Language Modeling with Reduced Densities

07/08/2020
by   Tai-Danae Bradley, et al.
0

We present a framework for modeling words, phrases, and longer expressions in a natural language using reduced density operators. We show these operators capture something of the meaning of these expressions and, under the Loewner order on positive semidefinite operators, preserve both a simple form of entailment and the relevant statistics therein. Pulling back the curtain, the assignment is shown to be a functor between categories enriched over probabilities.

READ FULL TEXT

page 1

page 2

page 3

page 4

08/04/2016

Dual Density Operators and Natural Language Meaning

Density operators allow for representing ambiguity about a vector repres...
04/12/2020

At the Interface of Algebra and Statistics

This thesis takes inspiration from quantum physics to investigate mathem...
12/18/2009

A Survey of Paraphrasing and Textual Entailment Methods

Paraphrasing methods recognize, generate, or extract phrases, sentences,...
08/04/2016

Entailment Relations on Distributions

In this paper we give an overview of partial orders on the space of prob...
04/26/2021

Generation of musical patterns through operads

We introduce the notion of multi-pattern, a combinatorial abstraction of...
09/22/2020

Context-theoretic Semantics for Natural Language: an Algebraic Framework

Techniques in which words are represented as vectors have proved useful ...
11/21/2019

About the foundation of the Kubo Generalized Cumulants theory. A revisited and corrected approach

More than fifty years ago, in a couple of seminal works Kubo introduced ...