Human Intention Estimation based on Hidden Markov Model Motion Validation for Safe Flexible Robotized Warehouses

11/20/2018
by   Tomislav Petković, et al.
0

With the substantial growth of logistics businesses the need for larger warehouses and their automation arises, thus using robots as assistants to human workers is becoming a priority. In order to operate efficiently and safely, robot assistants or the supervising system should recognize human intentions in real-time. Theory of mind (ToM) is an intuitive human conception of other humans' mental state, i.e., beliefs and desires, and how they cause behavior. In this paper we propose a ToM based human intention estimation algorithm for flexible robotized warehouses. We observe human's, i.e., worker's motion and validate it with respect to the goal locations using generalized Voronoi diagram based path planning. These observations are then processed by the proposed hidden Markov model framework which estimates worker intentions in an online manner, capable of handling changing environments. To test the proposed intention estimation we ran experiments in a real-world laboratory warehouse with a worker wearing Microsoft Hololens augmented reality glasses. Furthermore, in order to demonstrate the scalability of the approach to larger warehouses, we propose to use virtual reality digital warehouse twins in order to realistically simulate worker behavior. We conducted intention estimation experiments in the larger warehouse digital twin with up to 24 running robots. We demonstrate that the proposed framework estimates warehouse worker intentions precisely and in the end we discuss the experimental results.

READ FULL TEXT

page 2

page 5

page 10

page 11

page 13

page 15

research
04/05/2018

Human Intention Recognition in Flexible Robotized Warehouses based on Markov Decision Processes

The rapid growth of e-commerce increases the need for larger warehouses ...
research
05/22/2020

Human Intention Recognition for Human Aware Planning in Integrated Warehouse Systems

With the substantial growth of logistics businesses the need for larger ...
research
03/12/2019

A Path Planning Framework for a Flying Robot in Close Proximity of Humans

We present a path planning framework that takes into account the human's...
research
11/14/2018

A Scalable Framework For Real-Time Multi-Robot, Multi-Human Collision Avoidance

Robust motion planning is a well-studied problem in the robotics literat...
research
10/27/2020

Continuous Operator Authentication for Teleoperated Systems Using Hidden Markov Models

In this paper, we present a novel approach for continuous operator authe...
research
10/10/2021

An Augmented Reality Platform for Introducing Reinforcement Learning to K-12 Students with Robots

Interactive reinforcement learning, where humans actively assist during ...
research
10/28/2022

HaptiX: Extending Cobot's Motion Intention Visualization by Haptic Feedback

Nowadays, robots are found in a growing number of areas where they colla...

Please sign up or login with your details

Forgot password? Click here to reset