Long-Term, in-the-Wild Study of Feedback about Speech Intelligibility for K-12 Students Attending Class via a Telepresence Robot

by   Matthew Rueben, et al.

Telepresence robots offer presence, embodiment, and mobility to remote users, making them promising options for homebound K-12 students. It is difficult, however, for robot operators to know how well they are being heard in remote and noisy classroom environments. One solution is to estimate the operator's speech intelligibility to their listeners in order to provide feedback about it to the operator. This work contributes the first evaluation of a speech intelligibility feedback system for homebound K-12 students attending class remotely. In our four long-term, in-the-wild deployments we found that students speak at different volumes instead of adjusting the robot's volume, and that detailed audio calibration and network latency feedback are needed. We also contribute the first findings about the types and frequencies of multimodal comprehension cues given to homebound students by listeners in the classroom. By annotating and categorizing over 700 cues, we found that the most common cue modalities were conversation turn timing and verbal content. Conversation turn timing cues occurred more frequently overall, whereas verbal content cues contained more information and might be the most frequent modality for negative cues. Our work provides recommendations for telepresence systems that could intervene to ensure that remote users are being heard.


Empathic Robot for Group Learning: A Field Study

This work explores a group learning scenario with an autonomous empathic...

Common Problems and Effects of Feedback on Fun When Programming Ozobots in Primary School

Computational thinking is increasingly introduced at primary school leve...

Understanding Acoustic Patterns of Human Teachers Demonstrating Manipulation Tasks to Robots

Humans use audio signals in the form of spoken language or verbal reacti...

Human-Robot Commensality: Bite Timing Prediction for Robot-Assisted Feeding in Groups

We develop data-driven models to predict when a robot should feed during...

The L2L System for Second Language Learning Using Visualised Zoom Calls Among Students

An important part of second language learning is conversation which is b...

Bimanual Telemanipulation with Force and Haptic Feedback through an Anthropomorphic Avatar System

Robotic teleoperation is a key technology for a wide variety of applicat...

Multimodal Learning For Classroom Activity Detection

Classroom activity detection (CAD) focuses on accurately classifying whe...

Please sign up or login with your details

Forgot password? Click here to reset