Incorporating Luminance, Depth and Color Information by Fusion-based Networks for Semantic Segmentation

09/24/2018
by   Shang-Wei Hung, et al.
2

Semantic segmentation is paramount to accomplish many scene understanding applications such as autonomous driving. Although deep convolutional networks have already achieved encouraging results in semantic segmentation compared to traditional methods, there is still large room for further improvement. In this paper, we propose a preferred solution, which incorporates Luminance, Depth and color information by a Fusion-based network named LDFNet. It includes a distinctive encoder sub-network to process the depth maps and further employs the luminance images to assist the depth information in a process. LDFNet achieves very competitive results compared to the other state-of-art systems on the challenging Cityscapes dataset, while it maintains an inference speed faster than most of the existing top-performing networks. The experimental results show the effectiveness of the proposed information-fused approach and the potential of LDFNet for road scene understanding tasks.

READ FULL TEXT

page 1

page 3

page 7

research
02/24/2020

Real-time Fusion Network for RGB-D Semantic Segmentation Incorporating Unexpected Obstacle Detection for Road-driving Images

Semantic segmentation has made striking progress due to the success of d...
research
12/25/2019

Multi-Modal Attention-based Fusion Model for Semantic Segmentation of RGB-Depth Images

The 3D scene understanding is mainly considered as a crucial requirement...
research
04/10/2022

Scale Invariant Semantic Segmentation with RGB-D Fusion

In this paper, we propose a neural network architecture for scale-invari...
research
06/19/2019

Learning to Reconstruct and Understand Indoor Scenes from Sparse Views

This paper proposes a new method for simultaneous 3D reconstruction and ...
research
10/02/2019

Using Image Priors to Improve Scene Understanding

Semantic segmentation algorithms that can robustly segment objects acros...
research
03/16/2019

Real time backbone for semantic segmentation

The rapid development of autonomous driving in recent years presents lot...
research
06/27/2023

SSC-RS: Elevate LiDAR Semantic Scene Completion with Representation Separation and BEV Fusion

Semantic scene completion (SSC) jointly predicts the semantics and geome...

Please sign up or login with your details

Forgot password? Click here to reset