DeepAI AI Chat
Log In Sign Up

SOON: Scenario Oriented Object Navigation with Graph-based Exploration

by   Fengda Zhu, et al.

The ability to navigate like a human towards a language-guided target from anywhere in a 3D embodied environment is one of the 'holy grail' goals of intelligent robots. Most visual navigation benchmarks, however, focus on navigating toward a target from a fixed starting point, guided by an elaborate set of instructions that depicts step-by-step. This approach deviates from real-world problems in which human-only describes what the object and its surrounding look like and asks the robot to start navigation from anywhere. Accordingly, in this paper, we introduce a Scenario Oriented Object Navigation (SOON) task. In this task, an agent is required to navigate from an arbitrary position in a 3D embodied environment to localize a target following a scene description. To give a promising direction to solve this task, we propose a novel graph-based exploration (GBE) method, which models the navigation state as a graph and introduces a novel graph-based exploration approach to learn knowledge from the graph and stabilize training by learning sub-optimal trajectories. We also propose a new large-scale benchmark named From Anywhere to Object (FAO) dataset. To avoid target ambiguity, the descriptions in FAO provide rich semantic scene information includes: object attribute, object relationship, region description, and nearby region description. Our experiments reveal that the proposed GBE outperforms various state-of-the-arts on both FAO and R2R datasets. And the ablation studies on FAO validates the quality of the dataset.


Reinforced Structured State-Evolution for Vision-Language Navigation

Vision-and-language Navigation (VLN) task requires an embodied agent to ...

GoToNet: Fast Monocular Scene Exposure and Exploration

Autonomous scene exposure and exploration, especially in localization or...

Zero-Shot Object Searching Using Large-scale Object Relationship Prior

Home-assistant robots have been a long-standing research topic, and one ...

Search for or Navigate to? Dual Adaptive Thinking for Object Navigation

"Search for" or "Navigate to"? When finding an object, the two choices a...

D-Lite: Navigation-Oriented Compression of 3D Scene Graphs under Communication Constraints

For a multi-robot team that collaboratively explores an unknown environm...

Fast Task-Specific Target Detection via Graph Based Constraints Representation and Checking

In this work, we present a fast target detection framework for real-worl...

ReVoLT: Relational Reasoning and Voronoi Local Graph Planning for Target-driven Navigation

Embodied AI is an inevitable trend that emphasizes the interaction betwe...