A Geometric Method to Obtain the Generation Probability of a Sentence

06/04/2014
by   Chen Lijiang, et al.
0

"How to generate a sentence" is the most critical and difficult problem in all the natural language processing technologies. In this paper, we present a new approach to explain the generation process of a sentence from the perspective of mathematics. Our method is based on the premise that in our brain a sentence is a part of a word network which is formed by many word nodes. Experiments show that the probability of the entire sentence can be obtained by the probabilities of single words and the probabilities of the co-occurrence of word pairs, which indicate that human use the synthesis method to generate a sentence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/14/2021

Learning a Word-Level Language Model with Sentence-Level Noise Contrastive Estimation for Contextual Sentence Probability Estimation

Inferring the probability distribution of sentences or word sequences is...
research
12/28/2018

The role of grammar in transition-probabilities of subsequent words in English text

Sentence formation is a highly structured, history-dependent, and sample...
research
07/19/2017

Expect the unexpected: Harnessing Sentence Completion for Sarcasm Detection

The trigram `I love being' is expected to be followed by positive words ...
research
11/16/2020

Evaluating Sentence Segmentation and Word Tokenization Systems on Estonian Web Texts

Texts obtained from web are noisy and do not necessarily follow the orth...
research
08/13/2021

Generalized Optimal Linear Orders

The sequential structure of language, and the order of words in a senten...
research
03/11/2020

From Algebraic Word Problem to Program: A Formalized Approach

In this paper, we propose a pipeline to convert grade school level algeb...
research
05/20/2020

Sentence level estimation of psycholinguistic norms using joint multidimensional annotations

Psycholinguistic normatives represent various affective and mental const...

Please sign up or login with your details

Forgot password? Click here to reset