RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translation

05/26/2023
by   Gabriele Sarti, et al.
0

Attribute-controlled translation (ACT) is a subtask of machine translation that involves controlling stylistic or linguistic attributes (like formality and gender) of translation outputs. While ACT has garnered attention in recent years due to its usefulness in real-world applications, progress in the task is currently limited by dataset availability, since most prior approaches rely on supervised methods. To address this limitation, we propose Retrieval and Attribute-Marking enhanced Prompting (RAMP), which leverages large multilingual language models to perform ACT in few-shot and zero-shot settings. RAMP improves generation accuracy over the standard prompting approach by (1) incorporating a semantic similarity retrieval component for selecting similar in-context examples, and (2) marking in-context examples with attribute annotations. Our comprehensive experiments show that RAMP is a viable approach in both zero-shot and few-shot settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2023

How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?

Customizing machine translation models to comply with fine-grained attri...
research
08/22/2023

ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation

With large language models (LLMs) achieving remarkable breakthroughs in ...
research
08/10/2023

Exploring Linguistic Similarity and Zero-Shot Learning for Multilingual Translation of Dravidian Languages

Current research in zero-shot translation is plagued by several issues s...
research
05/17/2023

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM's Translation Capability

Large, multilingual language models exhibit surprisingly good zero- or f...
research
06/11/2021

Zero-Shot Controlled Generation with Encoder-Decoder Transformers

Controlling neural network-based models for natural language generation ...
research
05/20/2022

Understanding and Mitigating the Uncertainty in Zero-Shot Translation

Zero-shot translation is a promising direction for building a comprehens...
research
10/12/2020

Controllable Paraphrasing and Translation with a Syntactic Exemplar

Most prior work on exemplar-based syntactically controlled paraphrase ge...

Please sign up or login with your details

Forgot password? Click here to reset