Variational Quantum Classifiers for Natural-Language Text

03/04/2023
by   Daniel T Chang, et al.
0

As part of the recent research effort on quantum natural language processing (QNLP), variational quantum sentence classifiers (VQSCs) have been implemented and supported in lambeq / DisCoPy, based on the DisCoCat model of sentence meaning. We discuss in some detail VQSCs, including category theory, DisCoCat for modeling sentence as string diagram, and DisCoPy for encoding string diagram as parameterized quantum circuit. Many NLP tasks, however, require the handling of text consisting of multiple sentences, which is not supported in lambeq / DisCoPy. A good example is sentiment classification of customer feedback or product review. We discuss three potential approaches to variational quantum text classifiers (VQTCs), in line with VQSCs. The first is a weighted bag-of-sentences approach which treats text as a group of independent sentences with task-specific sentence weighting. The second is a coreference resolution approach which treats text as a consolidation of its member sentences with coreferences among them resolved. Both approaches are based on the DisCoCat model and should be implementable in lambeq / DisCoCat. The third approach, on the other hand, is based on the DisCoCirc model which considers both ordering of sentences and interaction of words in composing text meaning from word and sentence meanings. DisCoCirc makes fundamental modification of DisCoCat since a sentence in DisCoCirc updates meanings of words, whereas all meanings are static in DisCoCat. It is not clear if DisCoCirc can be implemented in lambeq / DisCoCat without breaking DisCoCat.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/02/2021

Parametrized Quantum Circuits of Synonymous Sentences in Quantum Natural Language Processing

In this paper, we develop a compositional vector-based semantics of posi...
research
04/06/2019

The Mathematics of Text Structure

In previous work we gave a mathematical foundation, referred to as DisCo...
research
01/03/2020

Meaning updating of density matrices

The DisCoCat model of natural language meaning assigns meaning to a sent...
research
05/13/2022

Design and Implementation of a Quantum Kernel for Natural Language Processing

Natural language processing (NLP) is the field that attempts to make hum...
research
05/09/2023

Estimating related words computationally using language model from the Mahabharata – an Indian epic

'Mahabharata' is the most popular among many Indian pieces of literature...
research
10/08/2021

lambeq: An Efficient High-Level Python Library for Quantum NLP

We present lambeq, the first high-level Python library for Quantum Natur...
research
08/28/2018

A Quantum Many-body Wave Function Inspired Language Modeling Approach

The recently proposed quantum language model (QLM) aimed at a principled...

Please sign up or login with your details

Forgot password? Click here to reset