Quantum Language Model with Entanglement Embedding for Question Answering

08/23/2020
by   Yiwei Chen, et al.
0

Quantum Language Models (QLMs) in which words are modelled as quantum superposition of sememes have demonstrated a high level of model transparency and good post-hoc interpretability. Nevertheless, in the current literature word sequences are basically modelled as a classical mixture of word states, which cannot fully exploit the potential of a quantum probabilistic description. A full quantum model is yet to be developed to explicitly capture the non-classical correlations within the word sequences. We propose a neural network model with a novel Entanglement Embedding (EE) module, whose function is to transform the word sequences into entangled pure states of many-body quantum systems. Strong quantum entanglement, which is the central concept of quantum information and an indication of parallelized correlations among the words, is observed within the word sequences. Numerical experiments show that the proposed QLM with EE (QLM-EE) achieves superior performance compared with the classical deep neural network models and other QLMs on Question Answering (QA) datasets. In addition, the post-hoc interpretability of the model can be improved by quantizing the degree of entanglement among the words.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 7

page 8

page 10

research
03/24/2018

Learning architectures based on quantum entanglement: a simple matrix product state algorithm for image recognition

It is a fundamental, but still elusive question whether methods based on...
research
08/28/2018

A Quantum Many-body Wave Function Inspired Language Modeling Approach

The recently proposed quantum language model (QLM) aimed at a principled...
research
04/10/2019

CNM: An Interpretable Complex-valued Network for Matching

This paper seeks to model human language by the mathematical framework o...
research
08/04/2017

The physical structure of grammatical correlations: equivalences, formalizations and consequences

In this paper we consider some well-known facts in syntax from a physics...
research
06/22/2020

Attention-based Quantum Tomography

With rapid progress across platforms for quantum systems, the problem of...
research
11/01/2018

A Boolean Functions Theoretic Approach to Quantum Hypergraph States and Entanglement

We establish an one-to-one correspondence between the Boolean functions ...
research
03/16/2022

Application of Quantum Density Matrix in Classical Question Answering and Classical Image Classification

Quantum density matrix represents all the information of the entire quan...

Please sign up or login with your details

Forgot password? Click here to reset