Real-time Continuous Uncertainty Annotation (RCUA) for Spatial Navigation Studies

07/27/2022
by   Qi Yang, et al.
0

Navigation uncertainty is crucial for understanding the wayfinding behaviors while no method has been developed to effectively measured uncertainty in real-world scenarios. We developed the Real-time Continous Uncertainty Annotation (RCUA) to continuously measure perceived uncertainty by asking users to push the joystick in during the wayfinding process. We tested its test-retest reliability and validated RCUA based on 40 participants using the known group and known treatment. We also compared it with a discrete self-report scale and continuous postexperiment video annotation (CUA). The result demonstrated that most participants were able to output four distinct levels of uncertainty, though high variability and errors were observed. Both known group and known treatment proved good validity of the measure and RCUA was moderately correlated with self-report uncertainty. Self-report surveys showed that participants can continuously push the joystick and conduct wayfinding tasks at the same time. A comparison between RCUA and CUA showed that RCUA had a higher granularity but participants tended to overreport uncertainty using RCUA.

READ FULL TEXT
research
12/06/2018

A dataset of continuous affect annotations and physiological signals for emotion analysis

From a computational viewpoint, emotions continue to be intriguingly har...
research
07/06/2021

Logit-based Uncertainty Measure in Classification

We introduce a new, reliable, and agnostic uncertainty measure for class...
research
03/19/2019

Cross-study Reliability of the Open Card Sorting Method

Information architecture forms the foundation of users' navigation exper...
research
08/15/2023

Confidence Contours: Uncertainty-Aware Annotation for Medical Semantic Segmentation

Medical image segmentation modeling is a high-stakes task where understa...

Please sign up or login with your details

Forgot password? Click here to reset