QLens: Visual Analytics of Multi-step Problem-solving Behaviors for Improving Question Design

09/27/2020
by   Meng Xia, et al.
1

With the rapid development of online education in recent years, there has been an increasing number of learning platforms that provide students with multi-step questions to cultivate their problem-solving skills. To guarantee the high quality of such learning materials, question designers need to inspect how students' problem-solving processes unfold step by step to infer whether students' problem-solving logic matches their design intent. They also need to compare the behaviors of different groups (e.g., students from different grades) to distribute questions to students with the right level of knowledge. The availability of fine-grained interaction data, such as mouse movement trajectories from the online platforms, provides the opportunity to analyze problem-solving behaviors. However, it is still challenging to interpret, summarize, and compare the high dimensional problem-solving sequence data. In this paper, we present a visual analytics system, QLens, to help question designers inspect detailed problem-solving trajectories, compare different student groups, distill insights for design improvements. In particular, QLens models problem-solving behavior as a hybrid state transition graph and visualizes it through a novel glyph-embedded Sankey diagram, which reflects students' problem-solving logic, engagement, and encountered difficulties. We conduct three case studies and three expert interviews to demonstrate the usefulness of QLens on real-world datasets that consist of thousands of problem-solving traces.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/07/2019

Visual Analytics of Student Learning Behaviors on K-12 Mathematics E-learning Platforms

With increasing popularity in online learning, a surge of E-learning pla...
research
08/04/2020

Peer-inspired Student Performance Prediction in Interactive Online Question Pools with Graph Neural Network

Student performance prediction is critical to online education. It can b...
research
01/20/2021

A Visual Analytics Approach to Facilitate the Proctoring of Online Exams

Online exams have become widely used to evaluate students' performance i...
research
12/14/2018

Using Detailed Access Trajectories for Learning Behavior Analysis

Student learning activity in MOOCs can be viewed from multiple perspecti...
research
10/18/2022

DAGKT: Difficulty and Attempts Boosted Graph-based Knowledge Tracing

In the field of intelligent education, knowledge tracing (KT) has attrac...
research
10/08/2020

Extending the Hint Factory for the assistance dilemma: A novel, data-driven HelpNeed Predictor for proactive problem-solving help

Determining when and whether to provide personalized support is a well-k...
research
12/09/2019

A Continuous-Time Dynamic Choice Measurement Model for Problem-Solving Process Data

Problem solving has been recognized as a central skill that today's stud...

Please sign up or login with your details

Forgot password? Click here to reset