Learning Embeddings that Capture Spatial Semantics for Indoor Navigation

07/31/2021
by   Vidhi Jain, et al.
13

Incorporating domain-specific priors in search and navigation tasks has shown promising results in improving generalization and sample complexity over end-to-end trained policies. In this work, we study how object embeddings that capture spatial semantic priors can guide search and navigation tasks in a structured environment. We know that humans can search for an object like a book, or a plate in an unseen house, based on the spatial semantics of bigger objects detected. For example, a book is likely to be on a bookshelf or a table, whereas a plate is likely to be in a cupboard or dishwasher. We propose a method to incorporate such spatial semantic awareness in robots by leveraging pre-trained language models and multi-relational knowledge bases as object embeddings. We demonstrate using these object embeddings to search a query object in an unseen indoor environment. We measure the performance of these embeddings in an indoor simulator (AI2Thor). We further evaluate different pre-trained embedding onSuccess Rate(SR) and success weighted by Path Length(SPL).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2022

Knowledge-driven Scene Priors for Semantic Audio-Visual Embodied Navigation

Generalisation to unseen contexts remains a challenge for embodied navig...
research
10/15/2018

Visual Semantic Navigation using Scene Priors

How do humans navigate to target objects in novel scenes? Do we use the ...
research
09/18/2023

Reasoning about the Unseen for Efficient Outdoor Object Navigation

Robots should exist anywhere humans do: indoors, outdoors, and even unma...
research
03/01/2019

RoboCSE: Robot Common Sense Embedding

Autonomous service robots require computational frameworks that allow th...
research
09/26/2017

UAV and Service Robot Coordination for Indoor Object Search Tasks

Our CoBot robots have successfully performed a variety of service tasks ...
research
04/10/2021

Object Priors for Classifying and Localizing Unseen Actions

This work strives for the classification and localization of human actio...
research
06/04/2022

Optimizing Indoor Navigation Policies For Spatial Distancing

In this paper, we focus on the modification of policies that can lead to...

Please sign up or login with your details

Forgot password? Click here to reset