Compact Real-time avoidance on a Humanoid Robot for Human-robot Interaction

01/17/2018
by   Dong Hai Phuong Nguyen, et al.
0

With robots leaving factories and entering less controlled domains, possibly sharing the space with humans, safety is paramount and multimodal awareness of the body surface and the surrounding environment is fundamental. Taking inspiration from peripersonal space representations in humans, we present a framework on a humanoid robot that dynamically maintains such a protective safety zone, composed of the following main components: (i) a human 2D keypoints estimation pipeline employing a deep learning based algorithm, extended here into 3D using disparity; (ii) a distributed peripersonal space representation around the robot's body parts; (iii) a reaching controller that incorporates all obstacles entering the robot's safety zone on the fly into the task. Pilot experiments demonstrate that an effective safety margin between the robot's and the human's body parts is kept. The proposed solution is flexible and versatile since the safety zone around individual robot and human body parts can be selectively modulated---here we demonstrate stronger avoidance of the human head compared to rest of the body. Our system works in real time and is self-contained, with no external sensory equipment and use of onboard cameras only.

READ FULL TEXT

page 1

page 2

page 4

page 6

research
09/13/2023

Towards Connecting Control to Perception: High-Performance Whole-Body Collision Avoidance Using Control-Compatible Obstacles

One of the most important aspects of autonomous systems is safety. This ...
research
02/24/2017

Simultaneous Feature and Body-Part Learning for Real-Time Robot Awareness of Human Behaviors

Robot awareness of human actions is an essential research problem in rob...
research
11/06/2022

Learning body models: from humans to humanoids

Humans and animals excel in combining information from multiple sensory ...
research
10/11/2018

Toward safe separation distance monitoring from RGB-D sensors in human-robot interaction

The interaction of humans and robots in less constrained environments ga...
research
01/20/2022

Body Models in Humans and Robots

Neurocognitive models of higher-level somatosensory processing have emph...
research
01/27/2022

Would You Mind Me if I Pass by You? Socially-Appropriate Behaviour for an Omni-based Social Robot in Narrow Environment

Interacting physically with robots and sharing environment with them lea...
research
07/15/2022

Human keypoint detection for close proximity human-robot interaction

We study the performance of state-of-the-art human keypoint detectors in...

Please sign up or login with your details

Forgot password? Click here to reset