Learning Better Representation for Tables by Self-Supervised Tasks

by   Liang Li, et al.

Table-to-text generation aims at automatically generating natural text to help people to conveniently obtain the important information in tables. Although neural models for table-to-text have achieved remarkable progress, some problems still overlooked. The first is that the values recorded in many tables are mostly numbers in practice. The existing approaches do not do special treatment for these, and still regard these as words in natural language text. Secondly, the target texts in training dataset may contain redundant information or facts do not exist in the input tables. These may give wrong supervision signals to some methods based on content selection and planning and auxiliary supervision. To solve these problems, we propose two self-supervised tasks, Number Ordering and Significance Ordering, to help to learn better table representation. The former works on the column dimension to help to incorporate the size property of numbers into table representation. The latter acts on row dimension and help to learn a significance-aware table representation. We test our methods on the widely used dataset ROTOWIRE which consists of NBA game statistic and related news. The experimental results demonstrate that the model trained together with these two self-supervised tasks can generate text that contains more salient and well-organized facts, even without modeling context selection and planning. And we achieve the state-of-the-art performance on automatic metrics.


page 1

page 2

page 3

page 4


Table-to-Text Generation with Effective Hierarchical Encoder on Three Dimensions (Row, Column and Time)

Although Seq2Seq models for table-to-text generation have achieved remar...

Retrieving Complex Tables with Multi-Granular Graph Representation Learning

The task of natural language table retrieval (NLTR) seeks to retrieve se...

TABBIE: Pretrained Representations of Tabular Data

Existing work on tabular representation learning jointly models tables a...

Few-Shot Table-to-Text Generation with Prototype Memory

Neural table-to-text generation models have achieved remarkable progress...

Table-to-Text Natural Language Generation with Unseen Schemas

Traditional table-to-text natural language generation (NLG) tasks focus ...

Data Discovery using Natural Language Questions via a Self-Supervised Approach

Data discovery systems help users identify relevant data among large tab...

Putting Self-Supervised Token Embedding on the Tables

Information distribution by electronic messages is a privileged means of...

Please sign up or login with your details

Forgot password? Click here to reset