Quantum-inspired Complex Word Embedding

05/29/2018
by   Qiuchi Li, et al.
0

A challenging task for word embeddings is to capture the emergent meaning or polarity of a combination of individual words. For example, existing approaches in word embeddings will assign high probabilities to the words "Penguin" and "Fly" if they frequently co-occur, but it fails to capture the fact that they occur in an opposite sense - Penguins do not fly. We hypothesize that humans do not associate a single polarity or sentiment to each word. The word contributes to the overall polarity of a combination of words depending upon which other words it is combined with. This is analogous to the behavior of microscopic particles which exist in all possible states at the same time and interfere with each other to give rise to new states depending upon their relative phases. We make use of the Hilbert Space representation of such particles in Quantum Mechanics where we subscribe a relative phase to each word, which is a complex number, and investigate two such quantum inspired models to derive the meaning of a combination of words. The proposed models achieve better performances than state-of-the-art non-quantum models on the binary sentence classification task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/12/2019

word2ket: Space-efficient Word Embeddings inspired by Quantum Entanglement

Deep learning natural language processing models often use vector word e...
research
02/08/2019

Humor in Word Embeddings: Cockamamie Gobbledegook for Nincompoops

We study humor in Word Embeddings, a popular AI tool that associates eac...
research
04/06/2020

Quantum Inspired Word Representation and Computation

Word meaning has different aspects, while the existing word representati...
research
01/18/2021

Can a Fruit Fly Learn Word Embeddings?

The mushroom body of the fruit fly brain is one of the best studied syst...
research
07/19/2018

Imparting Interpretability to Word Embeddings

As an ubiquitous method in natural language processing, word embeddings ...
research
07/09/2020

Cultural Cartography with Word Embeddings

Using the presence or frequency of keywords is a classic approach in the...
research
03/20/2017

Towards a Quantum World Wide Web

We elaborate a quantum model for corpora of written documents, like the ...

Please sign up or login with your details

Forgot password? Click here to reset