CSC-Unet: A Novel Convolutional Sparse Coding Strategy based Neural Network for Semantic Segmentation

by   Haitong Tang, et al.

It is a challenging task to accurately perform semantic segmentation due to the complexity of real picture scenes. Many semantic segmentation methods based on traditional deep learning insufficiently captured the semantic and appearance information of images, which put limit on their generality and robustness for various application scenes. In this paper, we proposed a novel strategy that reformulated the popularly-used convolution operation to multi-layer convolutional sparse coding block to ease the aforementioned deficiency. This strategy can be possibly used to significantly improve the segmentation performance of any semantic segmentation model that involves convolutional operations. To prove the effectiveness of our idea, we chose the widely-used U-Net model for the demonstration purpose, and we designed CSC-Unet model series based on U-Net. Through extensive analysis and experiments, we provided credible evidence showing that the multi-layer convolutional sparse coding block enables semantic segmentation model to converge faster, can extract finer semantic and appearance information of images, and improve the ability to recover spatial detail information. The best CSC-Unet model significantly outperforms the results of the original U-Net on three public datasets with different scenarios, i.e., 87.14 dataset, 68.91 dataset, respectively.


page 3

page 7


Bitewing Radiography Semantic Segmentation Base on Conditional Generative Adversarial Nets

Currently, Segmentation of bitewing radiograpy images is a very challeng...

Multi-Resolution Networks for Semantic Segmentation in Whole Slide Images

Digital pathology provides an excellent opportunity for applying fully c...

Semantic Segmentation for Fully Automated Macrofouling Analysis on Coatings after Field Exposure

Biofouling is a major challenge for sustainable shipping, filter membran...

Deep Multi-Branch Aggregation Network for Real-Time Semantic Segmentation in Street Scenes

Real-time semantic segmentation, which aims to achieve high segmentation...

CEU-Net: Ensemble Semantic Segmentation of Hyperspectral Images Using Clustering

Most semantic segmentation approaches of Hyperspectral images (HSIs) use...

Deep multi-task learning for a geographically-regularized semantic segmentation of aerial images

When approaching the semantic segmentation of overhead imagery in the de...

A Comparison and Strategy of Semantic Segmentation on Remote Sensing Images

In recent years, with the development of aerospace technology, we use mo...

Please sign up or login with your details

Forgot password? Click here to reset