End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematics

11/07/2022
by   Eda Okur, et al.
0

The advances in language-based Artificial Intelligence (AI) technologies applied to build educational applications can present AI for social-good opportunities with a broader positive impact. Across many disciplines, enhancing the quality of mathematics education is crucial in building critical thinking and problem-solving skills at younger ages. Conversational AI systems have started maturing to a point where they could play a significant role in helping students learn fundamental math concepts. This work presents a task-oriented Spoken Dialogue System (SDS) built to support play-based learning of basic math concepts for early childhood education. The system has been evaluated via real-world deployments at school while the students are practicing early math concepts with multimodal interactions. We discuss our efforts to improve the SDS pipeline built for math learning, for which we explore utilizing MathBERT representations for potential enhancement to the Natural Language Understanding (NLU) module. We perform an end-to-end evaluation using real-world deployment outputs from the Automatic Speech Recognition (ASR), Intent Recognition, and Dialogue Manager (DM) components to understand how error propagation affects the overall performance in real-world scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2023

Inspecting Spoken Language Understanding from Kids for Basic Math Learning at Home

Enriching the quality of early childhood education with interactive math...
research
05/09/2022

Data Augmentation with Paraphrase Generation and Entity Extraction for Multimodal Dialogue System

Contextually aware intelligent agents are often required to understand t...
research
05/27/2022

NLU for Game-based Learning in Real: Initial Evaluations

Intelligent systems designed for play-based interactions should be conte...
research
02/01/2018

Edu-Edition Spreadsheet Competency Framework

Based on the Spreadsheet Competency Framework for finance professionals,...
research
11/16/2021

An AI-based Learning Companion Promoting Lifelong Learning Opportunities for All

Artifical Intelligence (AI) in Education has great potential for buildin...
research
05/08/2023

Multi-source Education Knowledge Graph Construction and Fusion for College Curricula

The field of education has undergone a significant transformation due to...
research
11/28/2019

Designing the Next Generation of Intelligent Personal Robotic Assistants for the Physically Impaired

The physically impaired commonly have difficulties performing simple rou...

Please sign up or login with your details

Forgot password? Click here to reset