Evaluation of mathematical questioning strategies using data collected through weak supervision

by   Debajyoti Datta, et al.

A large body of research demonstrates how teachers' questioning strategies can improve student learning outcomes. However, developing new scenarios is challenging because of the lack of training data for a specific scenario and the costs associated with labeling. This paper presents a high-fidelity, AI-based classroom simulator to help teachers rehearse research-based mathematical questioning skills. Using a human-in-the-loop approach, we collected a high-quality training dataset for a mathematical questioning scenario. Using recent advances in uncertainty quantification, we evaluated our conversational agent for usability and analyzed the practicality of incorporating a human-in-the-loop approach for data collection and system evaluation for a mathematical questioning scenario.



page 1

page 2

page 3

page 4


Improving mathematical questioning in teacher training

High-fidelity, AI-based simulated classroom systems enable teachers to r...

A data-centric weak supervised learning for highway traffic incident detection

Using the data from loop detector sensors for near-real-time detection o...

Multi-fidelity methods for uncertainty propagation in kinetic equations

The construction of efficient methods for uncertainty quantification in ...

A Survey on Programmatic Weak Supervision

Labeling training data has become one of the major roadblocks to using m...

Improving Classification through Weak Supervision in Context-specific Conversational Agent Development for Teacher Education

Machine learning techniques applied to the Natural Language Processing (...

Scaling Robot Supervision to Hundreds of Hours with RoboTurk: Robotic Manipulation Dataset through Human Reasoning and Dexterity

Large, richly annotated datasets have accelerated progress in fields suc...

Beat the AI: Investigating Adversarial Human Annotations for Reading Comprehension

Innovations in annotation methodology have been a propellant for Reading...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.