Integrated Triaging for Fast Reading Comprehension

09/28/2019
by   Felix Wu, et al.
0

Although according to several benchmarks automatic machine reading comprehension (MRC) systems have recently reached super-human performance, less attention has been paid to their computational efficiency. However, efficiency is of crucial importance for training and deployment in real world applications. This paper introduces Integrated Triaging, a framework that prunes almost all context in early layers of a network, leaving the remaining (deep) layers to scan only a tiny fraction of the full corpus. This pruning drastically increases the efficiency of MRC models and further prevents the later layers from overfitting to prevalent short paragraphs in the training set. Our framework is extremely flexible and naturally applicable to a wide variety of models. Our experiment on doc-SQuAD and TriviaQA tasks demonstrates its effectiveness in consistently improving both speed and quality of several diverse MRC models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/28/2019

Sogou Machine Reading Comprehension Toolkit

Machine reading comprehension have been intensively studied in recent ye...
research
12/29/2019

ORB: An Open Reading Benchmark for Comprehensive Evaluation of Machine Reading Comprehension

Reading comprehension is one of the crucial tasks for furthering researc...
research
06/30/2019

Machine Reading Comprehension: a Literature Review

Machine reading comprehension aims to teach machines to understand a tex...
research
11/13/2020

Unsupervised Explanation Generation for Machine Reading Comprehension

With the blooming of various Pre-trained Language Models (PLMs), Machine...
research
05/15/2023

EMBRACE: Evaluation and Modifications for Boosting RACE

When training and evaluating machine reading comprehension models, it is...
research
06/24/2021

Towards Measuring and Quantifying the Comprehensibility of Process Models – The Process Model Comprehension Framework

Process models constitute crucial artifacts in modern information system...

Please sign up or login with your details

Forgot password? Click here to reset