Understanding Human Reading Comprehension with Brain Signals

08/03/2021
by   Ziyi Ye, et al.
9

Reading comprehension is a complex cognitive process involving many human brain activities. Plenty of works have studied the reading patterns and attention allocation mechanisms in the reading process. However, little is known about what happens in human brain during reading comprehension and how we can utilize this information as implicit feedback to facilitate information acquisition performance. With the advances in brain imaging techniques such as EEG, it is possible to collect high-precision brain signals in almost real time. With neuroimaging techniques, we carefully design a lab-based user study to investigate brain activities during reading comprehension. Our findings show that neural responses vary with different types of contents, i.e., contents that can satisfy users' information needs and contents that cannot. We suggest that various cognitive activities, e.g., cognitive loading, semantic-thematic understanding, and inferential processing, at the micro-time scale during reading comprehension underpin these neural responses. Inspired by these detectable differences in cognitive activities, we construct supervised learning models based on EEG features for two reading comprehension tasks: answer sentence classification and answer extraction. Results show that it is feasible to improve their performance with brain signals. These findings imply that brain signals are valuable feedback for enhancing human-computer interactions during reading comprehension.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/30/2022

A Survey of Machine Narrative Reading Comprehension Assessments

As the body of research on machine narrative comprehension grows, there ...
research
03/31/2022

Analyzing Wrap-Up Effects through an Information-Theoretic Lens

Numerous analyses of reading time (RT) data have been implemented – all ...
research
09/22/2021

Why Don't You Click: Neural Correlates of Non-Click Behaviors in Web Search

Web search heavily relies on click-through behavior as an essential feed...
research
09/05/2019

Reading Comprehension Ability Test-A Turing Test for Reading Comprehension

Reading comprehension is an important ability of human intelligence. Lit...
research
01/03/2020

Characterizing Reading Time on Enterprise Emails

Email is an integral part of people's work and life, enabling them to pe...
research
04/02/2019

Understanding language-elicited EEG data by predicting it from a fine-tuned language model

Electroencephalography (EEG) recordings of brain activity taken while pa...
research
05/15/2019

Learning Open Information Extraction of Implicit Relations from Reading Comprehension Datasets

The relationship between two entities in a sentence is often implied by ...

Please sign up or login with your details

Forgot password? Click here to reset