Probabilistic Multimodal Modeling for Human-Robot Interaction Tasks

08/14/2019
by   Joseph Campbell, et al.
0

Human-robot interaction benefits greatly from multimodal sensor inputs as they enable increased robustness and generalization accuracy. Despite this observation, few HRI methods are capable of efficiently performing inference for multimodal systems. In this work, we introduce a reformulation of Interaction Primitives which allows for learning from demonstration of interaction tasks, while also gracefully handling nonlinearities inherent to multimodal inference in such scenarios. We also empirically show that our method results in more accurate, more robust, and faster inference than standard Interaction Primitives and other common methods in challenging HRI scenarios.

READ FULL TEXT

page 1

page 3

page 6

research
08/15/2019

Learning Interactive Behaviors for Musculoskeletal Robots Using Bayesian Interaction Primitives

Musculoskeletal robots that are based on pneumatic actuation have a vari...
research
12/03/2022

Learning and Blending Robot Hugging Behaviors in Time and Space

We introduce an imitation learning-based physical human-robot interactio...
research
10/22/2022

MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interaction

Modeling interaction dynamics to generate robot trajectories that enable...
research
06/08/2022

Decentralized, not Dehumanized in the Metaverse: Bringing Utility to NFTs through Multimodal Interaction

User Interaction for NFTs (Non-fungible Tokens) is gaining increasing at...
research
09/16/2019

Multimodal Dataset of Human-Robot Hugging Interaction

A hug is a tight embrace and an expression of warmth, sympathy and camar...
research
05/06/2022

DULA and DEBA: Differentiable Ergonomic Risk Models for Postural Assessment and Optimization in Ergonomically Intelligent pHRI

Ergonomics and human comfort are essential concerns in physical human-ro...
research
10/14/2018

Modeling Multimodal Dynamic Spatiotemporal Graphs

Spatiotemporal graphs (STGs) are a powerful tool for modeling multi-agen...

Please sign up or login with your details

Forgot password? Click here to reset