Real-time Semantic Scene Completion Via Feature Aggregation and Conditioned Prediction

03/20/2023
by   Xiaokang Chen, et al.
0

Semantic Scene Completion (SSC) aims to simultaneously predict the volumetric occupancy and semantic category of a 3D scene. In this paper, we propose a real-time semantic scene completion method with a feature aggregation strategy and conditioned prediction module. Feature aggregation fuses feature with different receptive fields and gathers context to improve scene completion performance. And the conditioned prediction module adopts a two-step prediction scheme that takes volumetric occupancy as a condition to enhance semantic completion prediction. We conduct experiments on three recognized benchmarks NYU, NYUCAD, and SUNCG. Our method achieves competitive performance at a speed of 110 FPS on one GTX 1080 Ti GPU.

READ FULL TEXT

page 2

page 4

research
11/28/2016

Semantic Scene Completion from a Single Depth Image

This paper focuses on semantic scene completion, a task for producing a ...
research
02/13/2018

Semantic Scene Completion Combining Colour and Depth: preliminary experiments

Semantic scene completion is the task of producing a complete 3D voxel r...
research
10/26/2020

SCFusion: Real-time Incremental Scene Reconstruction with Semantic Completion

Real-time scene reconstruction from depth data inevitably suffers from o...
research
03/16/2023

Cross-Dimensional Refined Learning for Real-Time 3D Visual Perception from Monocular Video

We present a novel real-time capable learning method that jointly percei...
research
09/03/2019

ForkNet: Multi-branch Volumetric Semantic Completion from a Single Depth Image

We propose a novel model for 3D semantic completion from a single depth ...
research
08/24/2020

LMSCNet: Lightweight Multiscale 3D Semantic Completion

We introduce a new approach for multiscale 3D semantic scene completion ...
research
03/24/2023

StereoScene: BEV-Assisted Stereo Matching Empowers 3D Semantic Scene Completion

3D semantic scene completion (SSC) is an ill-posed task that requires in...

Please sign up or login with your details

Forgot password? Click here to reset