Denoising Pre-Training and Data Augmentation Strategies for Enhanced RDF Verbalization with Transformers

12/01/2020

∙

by   Sebastien Montella, et al.

∙

0

∙

share

The task of verbalization of RDF triples has known a growth in popularity due to the rising ubiquity of Knowledge Bases (KBs). The formalism of RDF triples is a simple and efficient way to store facts at a large scale. However, its abstract representation makes it difficult for humans to interpret. For this purpose, the WebNLG challenge aims at promoting automated RDF-to-text generation. We propose to leverage pre-trainings from augmented data with the Transformer model using a data augmentation strategy. Our experiment results show a minimum relative increases of 3.73 for seen categories, unseen entities and unseen categories respectively over the standard training.