User profile-driven large-scale multi-agent learning from demonstration in federated human-robot collaborative environments

by   Georgios Th. Papadopoulos, et al.

Learning from Demonstration (LfD) has been established as the dominant paradigm for efficiently transferring skills from human teachers to robots. In this context, the Federated Learning (FL) conceptualization has very recently been introduced for developing large-scale human-robot collaborative environments, targeting to robustly address, among others, the critical challenges of multi-agent learning and long-term autonomy. In the current work, the latter scheme is further extended and enhanced, by designing and integrating a novel user profile formulation for providing a fine-grained representation of the exhibited human behavior, adopting a Deep Learning (DL)-based formalism. In particular, a hierarchically organized set of key information sources is considered, including: a) User attributes (e.g. demographic, anthropomorphic, educational, etc.), b) User state (e.g. fatigue detection, stress detection, emotion recognition, etc.) and c) Psychophysiological measurements (e.g. gaze, electrodermal activity, heart rate, etc.) related data. Then, a combination of Long Short-Term Memory (LSTM) and stacked autoencoders, with appropriately defined neural network architectures, is employed for the modelling step. The overall designed scheme enables both short- and long-term analysis/interpretation of the human behavior (as observed during the feedback capturing sessions), so as to adaptively adjust the importance of the collected feedback samples when aggregating information originating from the same and different human teachers, respectively.



There are no comments yet.


page 1

page 5

page 7


Towards open and expandable cognitive AI architectures for large-scale multi-agent human-robot collaborative learning

Learning from Demonstration (LfD) constitutes one of the most robust met...

Real-Time Human-Robot Interaction for a Service Robot Based on 3D Human Activity Recognition and Human-like Decision Mechanism

This paper describes the development of a real-time Human-Robot Interact...

Robot Safe Interaction System for Intelligent Industrial Co-Robots

Human-robot interactions have been recognized to be a key element of fut...

Learning Autonomous Mobility Using Real Demonstration Data

This work proposed an efficient learning-based framework to learn feedba...

Sobi: An Interactive Social Service Robot for Long-Term Autonomy in Open Environments

Long-term autonomy in service robotics is a current research topic, espe...

A Predictive Autonomous Decision Aid for Calibrating Human-Autonomy Reliance in Multi-Agent Task Assignment

In this work, we develop a game-theoretic modeling of the interaction be...

Turn Signal Prediction: A Federated Learning Case Study

Driving etiquette takes a different flavor for each locality as drivers ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.