Contextual Scene Augmentation and Synthesis via GSACNet

03/29/2021
by   Mohammad Keshavarzi, et al.
1

Indoor scene augmentation has become an emerging topic in the field of computer vision and graphics with applications in augmented and virtual reality. However, current state-of-the-art systems using deep neural networks require large datasets for training. In this paper we introduce GSACNet, a contextual scene augmentation system that can be trained with limited scene priors. GSACNet utilizes a novel parametric data augmentation method combined with a Graph Attention and Siamese network architecture followed by an Autoencoder network to facilitate training with small datasets. We show the effectiveness of our proposed system by conducting ablation and comparative studies with alternative systems on the Matterport3D dataset. Our results indicate that our scene augmentation outperforms prior art in scene synthesis with limited scene priors available.

READ FULL TEXT

page 5

page 12

research
11/26/2021

Data Augmented 3D Semantic Scene Completion with 2D Segmentation Priors

Semantic scene completion (SSC) is a challenging Computer Vision task wi...
research
10/05/2021

Mix3D: Out-of-Context Data Augmentation for 3D Scenes

We present Mix3D, a data augmentation technique for segmenting large-sca...
research
09/25/2020

SceneGen: Generative Contextual Scene Augmentation using Scene Graph Priors

Spatial computing experiences are constrained by the real-world surround...
research
04/01/2022

Mutual Scene Synthesis for Mixed Reality Telepresence

Remote telepresence via next-generation mixed reality platforms can prov...
research
05/22/2023

Real-Aug: Realistic Scene Synthesis for LiDAR Augmentation in 3D Object Detection

Data and model are the undoubtable two supporting pillars for LiDAR obje...
research
02/16/2021

Dataset Condensation with Differentiable Siamese Augmentation

In many machine learning problems, large-scale datasets have become the ...
research
10/01/2022

NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review

Neural Radiance Field (NeRF), a new novel view synthesis with implicit s...

Please sign up or login with your details

Forgot password? Click here to reset