An Investigation Between Schema Linking and Text-to-SQL Performance

02/03/2021
by   Yasufumi Taniguchi, et al.
0

Text-to-SQL is a crucial task toward developing methods for understanding natural language by computers. Recent neural approaches deliver excellent performance; however, models that are difficult to interpret inhibit future developments. Hence, this study aims to provide a better approach toward the interpretation of neural models. We hypothesize that the internal behavior of models at hand becomes much easier to analyze if we identify the detailed performance of schema linking simultaneously as the additional information of the text-to-SQL performance. We provide the ground-truth annotation of schema linking information onto the Spider dataset. We demonstrate the usefulness of the annotated data and how to analyze the current state-of-the-art neural models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2022

Semantic Enhanced Text-to-SQL Parsing via Iteratively Learning Schema Linking Graph

The generalizability to new databases is of vital importance to Text-to-...
research
09/11/2021

Natural SQL: Making SQL Easier to Infer from Natural Language Specifications

Addressing the mismatch between natural language descriptions and the co...
research
09/30/2020

A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL Parsing

In Text-to-SQL semantic parsing, selecting the correct entities (tables ...
research
06/28/2022

Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsing

The importance of building text-to-SQL parsers which can be applied to n...
research
10/21/2020

DuoRAT: Towards Simpler Text-to-SQL Models

Recent research has shown that neural text-to-SQL models can effectively...
research
06/02/2021

Towards Robustness of Text-to-SQL Models against Synonym Substitution

Recently, there has been significant progress in studying neural network...
research
05/17/2021

SeaD: End-to-end Text-to-SQL Generation with Schema-aware Denoising

In text-to-SQL task, seq-to-seq models often lead to sub-optimal perform...

Please sign up or login with your details

Forgot password? Click here to reset