A Contextual Bandit Approach for Learning to Plan in Environments with Probabilistic Goal Configurations

11/29/2022
by   Sohan Rudra, et al.
1

Object-goal navigation (Object-nav) entails searching, recognizing and navigating to a target object. Object-nav has been extensively studied by the Embodied-AI community, but most solutions are often restricted to considering static objects (e.g., television, fridge, etc.). We propose a modular framework for object-nav that is able to efficiently search indoor environments for not just static objects but also movable objects (e.g. fruits, glasses, phones, etc.) that frequently change their positions due to human intervention. Our contextual-bandit agent efficiently explores the environment by showing optimism in the face of uncertainty and learns a model of the likelihood of spotting different objects from each navigable location. The likelihoods are used as rewards in a weighted minimum latency solver to deduce a trajectory for the robot. We evaluate our algorithms in two simulated environments and a real-world setting, to demonstrate high sample efficiency and reliability.

READ FULL TEXT

page 3

page 7

page 8

page 18

page 19

research
03/10/2023

Zero-Shot Object Searching Using Large-scale Object Relationship Prior

Home-assistant robots have been a long-standing research topic, and one ...
research
03/24/2022

Object Memory Transformer for Object Goal Navigation

This paper presents a reinforcement learning method for object goal navi...
research
01/24/2023

Effective Baselines for Multiple Object Rearrangement Planning in Partially Observable Mapped Environments

Many real-world tasks, from house-cleaning to cooking, can be formulated...
research
06/18/2020

Semantic Linking Maps for Active Visual Object Search

We aim for mobile robots to function in a variety of common human enviro...
research
12/02/2015

Object-based World Modeling in Semi-Static Environments with Dependent Dirichlet-Process Mixtures

To accomplish tasks in human-centric indoor environments, robots need to...
research
06/23/2020

ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects

We revisit the problem of Object-Goal Navigation (ObjectNav). In its sim...
research
09/19/2022

Active Visual Search in the Wild

In this paper, we focus on the problem of efficiently locating a target ...

Please sign up or login with your details

Forgot password? Click here to reset