BERT-based distractor generation for Swedish reading comprehension questions using a small-scale dataset

08/09/2021
by   Dmytro Kalpakchi, et al.
0

An important part when constructing multiple-choice questions (MCQs) for reading comprehension assessment are the distractors, the incorrect but preferably plausible answer options. In this paper, we present a new BERT-based method for automatically generating distractors using only a small-scale dataset. We also release a new such dataset of Swedish MCQs (used for training the model), and propose a methodology for assessing the generated distractors. Evaluation shows that from a student's perspective, our method generated one or more plausible distractors for more than 50 a teacher's perspective, about 50 appropriate. We also do a thorough analysis of the results.

READ FULL TEXT

page 13

page 16

research
11/28/2022

Automatically generating question-answer pairs for assessing basic reading comprehension in Swedish

This paper presents an evaluation of the quality of automatically genera...
research
06/14/2019

Learning to Ask Unanswerable Questions for Machine Reading Comprehension

Machine reading comprehension with unanswerable questions is a challengi...
research
08/05/2019

Beyond English-only Reading Comprehension: Experiments in Zero-Shot Multilingual Transfer for Bulgarian

Recently, reading comprehension models achieved near-human performance o...
research
07/03/2023

Analyzing Multiple-Choice Reading and Listening Comprehension Tests

Multiple-choice reading and listening comprehension tests are an importa...
research
06/06/2019

Generating Question-Answer Hierarchies

The process of knowledge acquisition can be viewed as a question-answer ...
research
12/20/2019

SberQuAD – Russian Reading Comprehension Dataset: Description and Analysis

SberQuAD—a large scale analog of Stanford SQuAD in the Russian language—...
research
03/18/2021

Quinductor: a multilingual data-driven method for generating reading-comprehension questions using Universal Dependencies

We propose a multilingual data-driven method for generating reading comp...

Please sign up or login with your details

Forgot password? Click here to reset