Lightweight and Progressively-Scalable Networks for Semantic Segmentation

07/27/2022
by   Yiheng Zhang, et al.
0

Multi-scale learning frameworks have been regarded as a capable class of models to boost semantic segmentation. The problem nevertheless is not trivial especially for the real-world deployments, which often demand high efficiency in inference latency. In this paper, we thoroughly analyze the design of convolutional blocks (the type of convolutions and the number of channels in convolutions), and the ways of interactions across multiple scales, all from lightweight standpoint for semantic segmentation. With such in-depth comparisons, we conclude three principles, and accordingly devise Lightweight and Progressively-Scalable Networks (LPS-Net) that novelly expands the network complexity in a greedy manner. Technically, LPS-Net first capitalizes on the principles to build a tiny network. Then, LPS-Net progressively scales the tiny network to larger ones by expanding a single dimension (the number of convolutional blocks, the number of channels, or the input resolution) at one time to meet the best speed/accuracy tradeoff. Extensive experiments conducted on three datasets consistently demonstrate the superiority of LPS-Net over several efficient semantic segmentation methods. More remarkably, our LPS-Net achieves 73.4 NVIDIA GTX 1080Ti, leading to a performance improvement by 1.5 speed-up against the state-of-the-art STDC. Code is available at <https://github.com/YihengZhang-CV/LPS-Net>.

READ FULL TEXT

page 4

page 11

research
04/13/2021

Lite-HRNet: A Lightweight High-Resolution Network

We present an efficient high-resolution network, Lite-HRNet, for human p...
research
05/02/2023

RT-K-Net: Revisiting K-Net for Real-Time Panoptic Segmentation

Panoptic segmentation is one of the most challenging scene parsing tasks...
research
03/23/2020

Learning Dynamic Routing for Semantic Segmentation

Recently, numerous handcrafted and searched networks have been applied f...
research
10/10/2022

Scale Equivariant U-Net

In neural networks, the property of being equivariant to transformations...
research
11/29/2020

Multi-stage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images

The attention mechanism can refine the extracted feature maps and boost ...
research
04/17/2019

nnU-Net: Breaking the Spell on Successful Medical Image Segmentation

Fueled by the diversity of datasets, semantic segmentation is a popular ...
research
03/28/2020

Semantically Mutil-modal Image Synthesis

In this paper, we focus on semantically multi-modal image synthesis (SMI...

Please sign up or login with your details

Forgot password? Click here to reset