Learning to Generate Questions by Learning What not to Generate

02/27/2019
by   Bang Liu, et al.
0

Automatic question generation is an important technique that can improve the training of question answering, help chatbots to start or continue a conversation with humans, and provide assessment materials for educational purposes. Existing neural question generation models are not sufficient mainly due to their inability to properly model the process of how each word in the question is selected, i.e., whether repeating the given passage or being generated from a vocabulary. In this paper, we propose our Clue Guided Copy Network for Question Generation (CGC-QG), which is a sequence-to-sequence generative model with copying mechanism, yet employing a variety of novel components and techniques to boost the performance of question generation. In CGC-QG, we design a multi-task labeling strategy to identify whether a question word should be copied from the input passage or be generated instead, guiding the model to learn the accurate boundaries between copying and generation. Furthermore, our input passage encoder takes as input, among a diverse range of other features, the prediction made by a clue word predictor, which helps identify whether each word in the input passage is a potential clue to be copied into the target question. The clue word predictor is designed based on a novel application of Graph Convolutional Networks onto a syntactic dependency tree representation of each passage, thus being able to predict clue words only based on their context in the passage and their relative positions to the answer in the tree. We jointly train the clue prediction as well as question generation with multi-task learning and a number of practical strategies to reduce the complexity. Extensive evaluations show that our model significantly improves the performance of question generation and out-performs all previous state-of-the-art neural question generation models by a substantial margin.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/30/2019

Multi-Task Learning with Language Modeling for Question Generation

This paper explores the task of answer-aware questions generation. Based...
research
09/07/2018

Improving Neural Question Generation using Answer Separation

Neural question generation (NQG) is the task of generating a question fr...
research
08/19/2016

Learning to Start for Sequence to Sequence Architecture

The sequence to sequence architecture is widely used in the response gen...
research
09/04/2017

A Unified Query-based Generative Model for Question Generation and Question Answering

We propose a query-based generative model for solving both tasks of ques...
research
09/10/2020

Accelerating Real-Time Question Answering via Question Generation

Existing approaches to real-time question answering (RTQA) rely on learn...
research
09/29/2020

Sequence-to-Sequence Learning for Indonesian Automatic Question Generator

Automatic question generation is defined as the task of automating the c...
research
06/20/2019

Hindi Question Generation Using Dependency Structures

Hindi question answering systems suffer from a lack of data. To address ...

Please sign up or login with your details

Forgot password? Click here to reset