Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond

05/13/2020
by   Zhuosheng Zhang, et al.
6

Machine reading comprehension (MRC) aims to teach machines to read and comprehend human languages, which is a long-standing goal of natural language processing (NLP). With the burst of deep neural networks and the evolution of contextualized language models (CLMs), the research of MRC has experienced two significant breakthroughs. MRC and CLM, as a phenomenon, have a great impact on the NLP community. In this survey, we provide a comprehensive and comparative review on MRC covering overall research topics about 1) the origin and development of MRC and CLM, with a particular focus on the role of CLMs; 2) the impact of MRC and CLM to the NLP community; 3) the definition, datasets, and evaluation of MRC; 4) general MRC architecture and technical methods in the view of two-stage Encoder-Decoder solving architecture from the insights of the cognitive process of humans; 5) previous highlights, emerging topics, and our empirical analysis, among which we especially focus on what works in different periods of MRC researches. We propose a full-view categorization and new taxonomies on these topics. The primary views we have arrived at are that 1) MRC boosts the progress from language processing to understanding; 2) the rapid improvement of MRC systems greatly benefits from the development of CLMs; 3) the theme of MRC is gradually moving from shallow text matching to cognitive reasoning.

READ FULL TEXT

page 6

page 9

page 13

page 18

page 22

page 23

page 28

page 32

research
01/01/2023

Integrating Semantic Information into Sketchy Reading Module of Retro-Reader for Vietnamese Machine Reading Comprehension

Machine Reading Comprehension has become one of the most advanced and po...
research
10/10/2018

New Vistas to study Bhartrhari: Cognitive NLP

The Sanskrit grammatical tradition which has commenced with Panini's Ast...
research
12/08/2022

A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approaches

Machine reading comprehension (MRC) is a long-standing topic in natural ...
research
03/04/2018

CAESAR: Context Awareness Enabled Summary-Attentive Reader

Comprehending meaning from natural language is a primary objective of Na...
research
09/05/2022

A Survey on Measuring and Mitigating Reasoning Shortcuts in Machine Reading Comprehension

The issue of shortcut learning is widely known in NLP and has been an im...
research
05/15/2023

What's the Meaning of Superhuman Performance in Today's NLU?

In the last five years, there has been a significant focus in Natural La...
research
05/22/2023

Kanbun-LM: Reading and Translating Classical Chinese in Japanese Methods by Language Models

Recent studies in natural language processing (NLP) have focused on mode...

Please sign up or login with your details

Forgot password? Click here to reset