Forecasting Nonverbal Social Signals during Dyadic Interactions with Generative Adversarial Neural Networks

10/18/2021
by   Nguyen Tan Viet Tuyen, et al.
14

We are approaching a future where social robots will progressively become widespread in many aspects of our daily lives, including education, healthcare, work, and personal use. All of such practical applications require that humans and robots collaborate in human environments, where social interaction is unavoidable. Along with verbal communication, successful social interaction is closely coupled with the interplay between nonverbal perception and action mechanisms, such as observation of gaze behaviour and following their attention, coordinating the form and function of hand gestures. Humans perform nonverbal communication in an instinctive and adaptive manner, with no effort. For robots to be successful in our social landscape, they should therefore engage in social interactions in a humanlike way, with increasing levels of autonomy. In particular, nonverbal gestures are expected to endow social robots with the capability of emphasizing their speech, or showing their intentions. Motivated by this, our research sheds a light on modeling human behaviors in social interactions, specifically, forecasting human nonverbal social signals during dyadic interactions, with an overarching goal of developing robotic interfaces that can learn to imitate human dyadic interactions. Such an approach will ensure the messages encoded in the robot gestures could be perceived by interacting partners in a facile and transparent manner, which could help improve the interacting partner perception and makes the social interaction outcomes enhanced.

READ FULL TEXT
research
12/26/2012

Human-Recognizable Robotic Gestures

For robots to be accommodated in human spaces and in humans daily activi...
research
06/10/2019

Towards Social Artificial Intelligence: Nonverbal Social Signal Prediction in A Triadic Interaction

We present a new research task and a dataset to understand human social ...
research
01/25/2022

Investigating the impact of free energy based behavior on human in human-agent interaction

Humans communicate non-verbally by sharing physical rhythms, such as nod...
research
04/03/2023

Clustering Social Touch Gestures for Human-Robot Interaction

Social touch provides a rich non-verbal communication channel between hu...
research
02/14/2021

Human-Robot Handshaking: A Review

For some years now, the use of social, anthropomorphic robots in various...
research
04/24/2023

Robots Taking Initiative in Collaborative Object Manipulation: Lessons from Physical Human-Human Interaction

Physical Human-Human Interaction (pHHI) involves the use of multiple sen...
research
03/20/2023

This Was (Not) Intended: How Intent Communication and Biometrics Can Enhance Social Interactions With Robots

Socially Assistive Robots (SARs) are robots that are designed to replica...

Please sign up or login with your details

Forgot password? Click here to reset