Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairs

01/26/2021
by   Kuan-Hao Huang, et al.
0

Paraphrase generation plays an essential role in natural language process (NLP), and it has many downstream applications. However, training supervised paraphrase models requires many annotated paraphrase pairs, which are usually costly to obtain. On the other hand, the paraphrases generated by existing unsupervised approaches are usually syntactically similar to the source sentences and are limited in diversity. In this paper, we demonstrate that it is possible to generate syntactically various paraphrases without the need for annotated paraphrase pairs. We propose Syntactically controlled Paraphrase Generator (SynPG), an encoder-decoder based model that learns to disentangle the semantics and the syntax of a sentence from a collection of unannotated texts. The disentanglement enables SynPG to control the syntax of output paraphrases by manipulating the embedding in the syntactic space. Extensive experiments using automatic metrics and human evaluation show that SynPG performs better syntactic control than unsupervised baselines, while the quality of the generated paraphrases is competitive. We also demonstrate that the performance of SynPG is competitive or even better than supervised models when the unannotated data is large. Finally, we show that the syntactically controlled paraphrases generated by SynPG can be utilized for data augmentation to improve the robustness of NLP models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/02/2022

Unsupervised Syntactically Controlled Paraphrase Generation with Abstract Meaning Representations

Syntactically controlled paraphrase generation has become an emerging re...
research
05/26/2023

ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translation

Paraphrase generation is a long-standing task in natural language proces...
research
04/17/2018

Adversarial Example Generation with Syntactically Controlled Paraphrase Networks

We propose syntactically controlled paraphrase networks (SCPNs) and use ...
research
05/05/2020

Neural Syntactic Preordering for Controlled Paraphrase Generation

Paraphrasing natural language sentences is a multifaceted process: it mi...
research
02/09/2021

Bootstrapping Relation Extractors using Syntactic Search by Examples

The advent of neural-networks in NLP brought with it substantial improve...
research
03/21/2022

Quality Controlled Paraphrase Generation

Paraphrase generation has been widely used in various downstream tasks. ...
research
06/02/2021

Metaphor Generation with Conceptual Mappings

Generating metaphors is a difficult task as it requires understanding nu...

Please sign up or login with your details

Forgot password? Click here to reset