Sequence-to-Sequence Learning for Indonesian Automatic Question Generator

09/29/2020
by   Ferdiant Joshua Muis, et al.
0

Automatic question generation is defined as the task of automating the creation of question given a various of textual data. Research in automatic question generator (AQG) has been conducted for more than 10 years, mainly focused on factoid question. In all these studies, the state-of-the-art is attained using sequence-to-sequence approach. However, AQG system for Indonesian has not ever been researched intensely. In this work we construct an Indonesian automatic question generator, adapting the architecture from some previous works. In summary, we used sequence-to-sequence approach using BiGRU, BiLSTM, and Transformer with additional linguistic features, copy mechanism, and coverage mechanism. Since there is no public large dan popular Indonesian dataset for question generation, we translated SQuAD v2.0 factoid question answering dataset, with additional Indonesian TyDiQA dev set for testing. The system achieved BLEU1, BLEU2, BLEU3, BLEU4, and ROUGE-L score at 38,35, 20,96, 10,68, 5,78, and 43,4 for SQuAD, and 39.9, 20.78, 10.26, 6.31, 44.13 for TyDiQA, respectively. The system performed well when the expected answers are named entities and are syntactically close with the context explaining them. Additionally, from native Indonesian perspective, the best questions generated by our best models on their best cases are acceptable and reasonably useful.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

08/15/2018

A framework for automatic question generation from text using deep reinforcement learning

Automatic question generation (QG) is a useful yet challenging task in N...
11/21/2019

Improving Conditioning in Context-Aware Sequence to Sequence Models

Neural sequence to sequence models are well established for applications...
06/14/2017

Neural Models for Key Phrase Detection and Question Generation

We propose a two-stage neural model to tackle question generation from d...
03/07/2018

Translating Questions into Answers using DBPedia n-triples

In this paper we present a question answering system using a neural netw...
02/11/2021

Generating Coherent and Diverse Slogans with Sequence-to-Sequence Transformer

Previous work in slogan generation focused on generating novel slogans b...
02/27/2019

Learning to Generate Questions by Learning What not to Generate

Automatic question generation is an important technique that can improve...
04/04/2019

Answer-based Adversarial Training for Generating Clarification Questions

We present an approach for generating clarification questions with the g...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.