Understanding Human Context in 3D Scenes by Learning Spatial Affordances with Virtual Skeleton Models

06/13/2019
by   Lasitha Piyathilaka, et al.
9

Robots are often required to operate in environments where humans are not present, but yet require the human context information for better human-robot interaction. Even when humans are present in the environment, detecting their presence in cluttered environments could be challenging. As a solution to this problem, this paper presents the concept of spatial affordance map which learns human context by looking at geometric features of the environment. Instead of observing real humans to learn human context, it uses virtual human models and their relationships with the environment to map hidden human affordances in 3D scenes by placing virtual skeleton models in 3D scenes with their confidence values. The spatial affordance map learning problem is formulated as a multi-label classification problem that can be learned using Support Vector Machine (SVM) based learners. Experiments carried out in a real 3D scene dataset recorded promising results and proved the applicability of affordance-map for mapping human context.

READ FULL TEXT

page 2

page 5

page 7

page 8

page 19

page 20

page 22

research
03/30/2023

Human-Robot Interaction using VAHR: Virtual Assistant, Human, and Robots in the Loop

Robots have become ubiquitous tools in various industries and households...
research
09/20/2022

Exploring Human-robot Interaction by Simulating Robots

As collaborative robots enter industrial shop floors, logistics, and man...
research
03/02/2023

Nonlinear Subsystem-based Adaptive Impedance Control of Physical Human-Robot-Environment Interaction in Contact-rich Tasks

Haptic upper limb exoskeletons are robots that assist human operators du...
research
07/17/2023

A Study in Zucker: Insights on Human-Robot Interactions

In recent years there has been a large focus on how robots can operate i...
research
01/31/2020

Robot Navigation in Unseen Spaces using an Abstract Map

Human navigation in built environments depends on symbolic spatial infor...
research
08/20/2019

Human activity recognition from skeleton poses

Human Action Recognition is an important task of Human Robot Interaction...
research
02/14/2019

A Framework towards Quantifying Human Restorativeness in Virtual Built Environments

The impact of built environment on the human restorativeness has long be...

Please sign up or login with your details

Forgot password? Click here to reset