Property-Aware Robot Object Manipulation: a Generative Approach

06/08/2021
by   Luca Garello, et al.
18

When transporting an object, we unconsciously adapt our movement to its properties, for instance by slowing down when the item is fragile. The most relevant features of an object are immediately revealed to a human observer by the way the handling occurs, without any need for verbal description. It would greatly facilitate collaboration to enable humanoid robots to perform movements that convey similar intuitive cues to the observers. In this work, we focus on how to generate robot motion adapted to the hidden properties of the manipulated objects, such as their weight and fragility. We explore the possibility of leveraging Generative Adversarial Networks to synthesize new actions coherent with the properties of the object. The use of a generative approach allows us to create new and consistent motion patterns, without the need of collecting a large number of recorded human-led demonstrations. Besides, the informative content of the actions is preserved. Our results show that Generative Adversarial Nets can be a powerful tool for the generation of novel and meaningful transportation actions, which result effectively modulated as a function of the object weight and the carefulness required in its handling.

READ FULL TEXT
research
03/29/2022

Synthesis and Execution of Communicative Robotic Movements with Generative Adversarial Networks

Object manipulation is a natural activity we perform every day. How huma...
research
09/01/2021

From Movement Kinematics to Object Properties: Online Recognition of Human Carefulness

When manipulating objects, humans finely adapt their motions to the char...
research
03/02/2021

Careful with That! Observation of Human Movements to Estimate Objects Properties

Humans are very effective at interpreting subtle properties of the partn...
research
12/15/2018

Generative adversarial networks for generation and classification of physical rehabilitation movement episodes

This article proposes a method for mathematical modeling of human moveme...
research
10/24/2022

If You Are Careful, So Am I! How Robot Communicative Motions Can Influence Human Approach in a Joint Task

As humans, we have a remarkable capacity for reading the characteristics...
research
03/08/2019

Auto-Encoding Progressive Generative Adversarial Networks For 3D Multi Object Scenes

3D multi object generative models allow us to synthesize a large range o...
research
08/10/2019

Channel Decomposition on Generative Networks

This work presents a method to decompose a layer of the generative netwo...

Please sign up or login with your details

Forgot password? Click here to reset