3-D Scene Graph: A Sparse and Semantic Representation of Physical Environments for Intelligent Agents

08/14/2019
by   Ue-Hwan Kim, et al.
2

Intelligent agents gather information and perceive semantics within the environments before taking on given tasks. The agents store the collected information in the form of environment models that compactly represent the surrounding environments. The agents, however, can only conduct limited tasks without an efficient and effective environment model. Thus, such an environment model takes a crucial role for the autonomy systems of intelligent agents. We claim the following characteristics for a versatile environment model: accuracy, applicability, usability, and scalability. Although a number of researchers have attempted to develop such models that represent environments precisely to a certain degree, they lack broad applicability, intuitive usability, and satisfactory scalability. To tackle these limitations, we propose 3-D scene graph as an environment model and the 3-D scene graph construction framework. The concise and widely used graph structure readily guarantees usability as well as scalability for 3-D scene graph. We demonstrate the accuracy and applicability of the 3-D scene graph by exhibiting the deployment of the 3-D scene graph in practical applications. Moreover, we verify the performance of the proposed 3-D scene graph and the framework by conducting a series of comprehensive experiments under various conditions.

READ FULL TEXT

page 1

page 3

page 9

page 11

research
05/17/2022

GraphMapper: Efficient Visual Navigation by Scene Graph Generation

Understanding the geometric relationships between objects in a scene is ...
research
04/30/2020

Towards Embodied Scene Description

Embodiment is an important characteristic for all intelligent agents (cr...
research
11/27/2020

Road Scene Graph: A Semantic Graph-Based Scene Representation Dataset for Intelligent Vehicles

Rich semantic information extraction plays a vital role on next-generati...
research
01/07/2018

Building Generalizable Agents with a Realistic and Rich 3D Environment

Towards bridging the gap between machine and human intelligence, it is o...
research
04/02/2023

Learning Similarity between Scene Graphs and Images with Transformers

Scene graph generation is conventionally evaluated by (mean) Recall@K, w...
research
08/22/2023

Faster Optimization in S-Graphs Exploiting Hierarchy

3D scene graphs hierarchically represent the environment appropriately o...

Please sign up or login with your details

Forgot password? Click here to reset