DeepAI AI Chat
Log In Sign Up

Incorporating Luminance, Depth and Color Information by Fusion-based Networks for Semantic Segmentation

by   Shang-Wei Hung, et al.

Semantic segmentation is paramount to accomplish many scene understanding applications such as autonomous driving. Although deep convolutional networks have already achieved encouraging results in semantic segmentation compared to traditional methods, there is still large room for further improvement. In this paper, we propose a preferred solution, which incorporates Luminance, Depth and color information by a Fusion-based network named LDFNet. It includes a distinctive encoder sub-network to process the depth maps and further employs the luminance images to assist the depth information in a process. LDFNet achieves very competitive results compared to the other state-of-art systems on the challenging Cityscapes dataset, while it maintains an inference speed faster than most of the existing top-performing networks. The experimental results show the effectiveness of the proposed information-fused approach and the potential of LDFNet for road scene understanding tasks.


page 1

page 3

page 7


Multi-Modal Attention-based Fusion Model for Semantic Segmentation of RGB-Depth Images

The 3D scene understanding is mainly considered as a crucial requirement...

Scale Invariant Semantic Segmentation with RGB-D Fusion

In this paper, we propose a neural network architecture for scale-invari...

Learning to Reconstruct and Understand Indoor Scenes from Sparse Views

This paper proposes a new method for simultaneous 3D reconstruction and ...

Using Image Priors to Improve Scene Understanding

Semantic segmentation algorithms that can robustly segment objects acros...

Real time backbone for semantic segmentation

The rapid development of autonomous driving in recent years presents lot...

SSC-RS: Elevate LiDAR Semantic Scene Completion with Representation Separation and BEV Fusion

Semantic scene completion (SSC) jointly predicts the semantics and geome...

Code Repositories


Network Description of LDFNet

view repo