A Scavenger Hunt for Service Robots

by   Harel Yedidsion, et al.

Creating robots that can perform general-purpose service tasks in a human-populated environment has been a longstanding grand challenge for AI and Robotics research. One particularly valuable skill that is relevant to a wide variety of tasks is the ability to locate and retrieve objects upon request. This paper models this skill as a Scavenger Hunt (SH) game, which we formulate as a variation of the NP-hard stochastic traveling purchaser problem. In this problem, the goal is to find a set of objects as quickly as possible, given probability distributions of where they may be found. We investigate the performance of several solution algorithms for the SH problem, both in simulation and on a real mobile robot. We use Reinforcement Learning (RL) to train an agent to plan a minimal cost path, and show that the RL agent can outperform a range of heuristic algorithms, achieving near optimal performance. In order to stimulate research on this problem, we introduce a publicly available software stack and associated website that enable users to upload scavenger hunts which robots can download, perform, and learn from to continually improve their performance on future hunts.



There are no comments yet.


page 6

page 9


Desiderata for Planning Systems in General-Purpose Service Robots

General-purpose service robots are expected to undertake a broad range o...

RL STaR Platform: Reinforcement Learning for Simulation based Training of Robots

Reinforcement learning (RL) is a promising field to enhance robotic auto...

Multi-Goal Reinforcement Learning: Challenging Robotics Environments and Request for Research

The purpose of this technical report is two-fold. First of all, it intro...

Robotic Surgery With Lean Reinforcement Learning

As surgical robots become more common, automating away some of the burde...

Say "Sul Sul!" to SimSim, A Sims-Inspired Platform for Sandbox Game AI

This paper proposes environment design in the life simulation game The S...

FireCommander: An Interactive, Probabilistic Multi-agent Environment for Joint Perception-Action Tasks

The purpose of this tutorial is to help individuals use the FireCommande...

Order allocation, rack allocation and rack sequencing for pickers in a mobile rack environment

In this paper we investigate the problem of simultaneously allocating or...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.