Supporting User Autonomy with Multimodal Fusion to Detect when a User Needs Assistance from a Social Robot

12/07/2020
by   Alex Reneau, et al.
0

It is crucial for any assistive robot to prioritize the autonomy of the user. For a robot working in a task setting to effectively maintain a user's autonomy it must provide timely assistance and make accurate decisions. We use four independent high-precision, low-recall models, a mutual gaze model, task model, confirmatory gaze model, and a lexical model, that predict a user's need for assistance. Improving upon our four independent models, we used a sliding window method and a random forest classification algorithm to capture temporal dependencies and fuse the independent models with a late fusion approach. The late fusion approach strongly outperforms all four of the independent models providing a more wholesome approach with greater accuracy to better assist the user while maintaining their autonomy. These results can provide insight into the potential of including additional modalities and utilizing assistive robots in more task settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/18/2021

Enabling a Social Robot to Process Social Cues to Detect when to Help a User

It is important for socially assistive robots to be able to recognize wh...
research
09/14/2019

Developing Computational Models of Social Assistance to Guide Socially Assistive Robots

While there are many examples in which robots provide social assistance,...
research
12/05/2020

A Knowledge Driven Approach to Adaptive Assistance Using Preference Reasoning and Explanation

There is a need for socially assistive robots (SARs) to provide transpar...
research
11/12/2022

Human Autonomy as a Design Principle for Socially Assistive Robots

High levels of robot autonomy are a common goal, but there is a signific...
research
11/28/2022

Proactive Robot Assistance via Spatio-Temporal Object Modeling

Proactive robot assistance enables a robot to anticipate and provide for...
research
10/15/2018

I Can See Your Aim: Estimating User Attention From Gaze For Handheld Robot Collaboration

This paper explores the estimation of user attention in the setting of a...
research
09/12/2023

Predicting Routine Object Usage for Proactive Robot Assistance

Proactivity in robot assistance refers to the robot's ability to anticip...

Please sign up or login with your details

Forgot password? Click here to reset