Improving state-of-the-art in Detecting Student Engagement with Resnet and TCN Hybrid Network

04/20/2021
by   Ali Abedi, et al.
0

Automatic detection of students' engagement in online learning settings is a key element to improve the quality of learning and to deliver personalized learning materials to them. Varying levels of engagement exhibited by students in an online classroom is an affective behavior that takes place over space and time. Therefore, we formulate detecting levels of students' engagement from videos as a spatio-temporal classification problem. In this paper, we present a novel end-to-end Residual Network (ResNet) and Temporal Convolutional Network (TCN) hybrid neural network architecture for students' engagement level detection in videos. The 2D ResNet extracts spatial features from consecutive video frames, and the TCN analyzes the temporal changes in video frames to detect the level of engagement. The spatial and temporal arms of the hybrid network are jointly trained on raw video frames of a large publicly available students' engagement detection dataset, DAiSEE. We compared our method with several competing students' engagement detection methods on this dataset. The ResNet+TCN architecture outperforms all other studied methods, improves the state-of-the-art engagement level detection accuracy, and sets a new baseline for future research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2021

Affect-driven Engagement Measurement from Videos

In education and intervention programs, person's engagement has been ide...
research
04/08/2022

Engagement Detection with Multi-Task Training in E-Learning Environments

Recognition of user interaction, in particular engagement detection, bec...
research
04/03/2018

Prediction and Localization of Student Engagement in the Wild

Student engagement localization can play a key role in designing success...
research
08/12/2022

Class-attention Video Transformer for Engagement Intensity Prediction

In order to deal with variant-length long videos, prior works extract mu...
research
04/13/2022

DMCNet: Diversified Model Combination Network for Understanding Engagement from Video Screengrabs

Engagement is an essential indicator of the Quality-of-Learning Experien...
research
11/13/2022

Detecting Disengagement in Virtual Learning as an Anomaly

Student engagement is an important factor in meeting the goals of virtua...
research
09/18/2019

Student Engagement Detection Using Emotion Analysis, Eye Tracking and Head Movement with Machine Learning

With the increase of distance learning, in general, and e-learning, in p...

Please sign up or login with your details

Forgot password? Click here to reset