DeepAI AI Chat
Log In Sign Up

Generating Synthetic Data for Neural Keyword-to-Question Models

07/14/2018
by   Heng Ding, et al.
Wuhan University
University of Stavanger
0

Search typically relies on keyword queries, but these are often semantically ambiguous. We propose to overcome this by offering users natural language questions, based on their keyword queries, to disambiguate their intent. This keyword-to-question task may be addressed using neural machine translation techniques. Neural translation models, however, require massive amounts of training data (keyword-question pairs), which is unavailable for this task. The main idea of this paper is to generate large amounts of synthetic training data from a small seed set of hand-labeled keyword-question pairs. Since natural language questions are available in large quantities, we develop models to automatically generate the corresponding keyword queries. Further, we introduce various filtering mechanisms to ensure that synthetic training data is of high quality. We demonstrate the feasibility of our approach using both automatic and manual evaluation. This is an extended version of the article published with the same title in the Proceedings of ICTIR'18.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/07/2020

Translating Web Search Queries into Natural Language Questions

Users often query a search engine with a specific question in mind and o...
12/16/2019

Predicting detection filters for small footprint open-vocabulary keyword spotting

In many scenarios, detecting keywords from natural language queries is s...
08/29/2018

A Reinforcement Learning-driven Translation Model for Search-Oriented Conversational Systems

Search-oriented conversational systems rely on information needs express...
03/20/2020

TNT-KID: Transformer-based Neural Tagger for Keyword Identification

With growing amounts of available textual data, development of algorithm...
06/04/2018

An unsupervised and customizable misspelling generator for mining noisy health-related text sources

In this paper, we present a customizable datacentric system that automat...