Robotic Learning the Sequence of Packing Irregular Objects from Human Demonstrations

10/04/2022
by   André Santos, et al.
0

We address the unsolved task of robotic bin packing with irregular objects, such as groceries, where the underlying constraints on object placement and manipulation, and the diverse objects' physical properties make preprogrammed strategies unfeasible. Our approach is to learn directly from expert demonstrations in order to extract implicit task knowledge and strategies to achieve an efficient space usage, safe object positioning and to generate human-like behaviors that enhance human-robot trust. We collect and make available a novel and diverse dataset, BoxED, of box packing demonstrations by humans in virtual reality. In total, 263 boxes were packed with supermarket-like objects by 43 participants, yielding 4644 object manipulations. We use the BoxED dataset to learn a Markov chain to predict the object packing sequence for a given set of objects and compare it with human performance. Our experimental results show that the model surpasses human performance by generating sequence predictions that humans classify as human-like more frequently than human-generated sequences.

READ FULL TEXT

page 1

page 2

page 3

research
11/17/2022

Planning Irregular Object Packing via Hierarchical Reinforcement Learning

Object packing by autonomous robots is an im-portant challenge in wareho...
research
12/10/2018

Stable bin packing of non-convex 3D objects with a robot manipulator

Recent progress in the field of robotic manipulation has generated inter...
research
08/04/2023

World-Model-Based Control for Industrial box-packing of Multiple Objects using NewtonianVAE

The process of industrial box-packing, which involves the accurate place...
research
09/14/2019

Towards Effective Human-AI Teams: The Case of Human-Robot Packing

We focus on the problem of designing an artificial agent capable of assi...
research
09/14/2019

Towards Effective Human-AI Teams: The Case of Collaborative Packing

We focus on the problem of designing an artificial agent, capable of ass...
research
10/22/2021

Action Planning for Packing Long Linear Elastic Objects into Compact Boxes with Bimanual Robotic Manipulation

Automatic packing of objects is a critical component for efficient shipp...
research
12/05/2022

Learning Physically Realizable Skills for Online Packing of General 3D Shapes

We study the problem of learning online packing skills for irregular 3D ...

Please sign up or login with your details

Forgot password? Click here to reset