JetSeg: Efficient Real-Time Semantic Segmentation Model for Low-Power GPU-Embedded Systems

05/19/2023
by   Miguel Lopez-Montiel, et al.
0

Real-time semantic segmentation is a challenging task that requires high-accuracy models with low-inference times. Implementing these models on embedded systems is limited by hardware capability and memory usage, which produces bottlenecks. We propose an efficient model for real-time semantic segmentation called JetSeg, consisting of an encoder called JetNet, and an improved RegSeg decoder. The JetNet is designed for GPU-Embedded Systems and includes two main components: a new light-weight efficient block called JetBlock, that reduces the number of parameters minimizing memory usage and inference time without sacrificing accuracy; a new strategy that involves the combination of asymmetric and non-asymmetric convolutions with depthwise-dilated convolutions called JetConv, a channel shuffle operation, light-weight activation functions, and a convenient number of group convolutions for embedded systems, and an innovative loss function named JetLoss, which integrates the Precision, Recall, and IoUB losses to improve semantic segmentation and reduce computational complexity. Experiments demonstrate that JetSeg is much faster on workstation devices and more suitable for Low-Power GPU-Embedded Systems than existing state-of-the-art models for real-time semantic segmentation. Our approach outperforms state-of-the-art real-time encoder-decoder models by reducing 46.70M parameters and 5.14 GFLOPs, which makes JetSeg up to 2x faster on the NVIDIA Titan RTX GPU and the Jetson Xavier than other models. The JetSeg code is available at https://github.com/mmontielpz/jetseg.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/27/2021

Feature Reuse and Fusion for Real-time Semantic segmentation

For real-time semantic segmentation, how to increase the speed while mai...
research
05/07/2019

LEDNet: A Lightweight Encoder-Decoder Network for Real-Time Semantic Segmentation

The extensive computational burden limits the usage of CNNs in mobile de...
research
06/17/2022

On Efficient Real-Time Semantic Segmentation: A Survey

Semantic segmentation is the problem of assigning a class label to every...
research
12/03/2019

RGPNet: A Real-Time General Purpose Semantic Segmentation

We propose a novel real-time general purpose semantic segmentation archi...
research
11/28/2018

ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network

We introduce a light-weight, power efficient, and general purpose convol...
research
10/08/2018

Light-Weight RefineNet for Real-Time Semantic Segmentation

We consider an important task of effective and efficient semantic image ...
research
09/07/2017

Real-time convolutional networks for sonar image classification in low-power embedded systems

Deep Neural Networks have impressive classification performance, but thi...

Please sign up or login with your details

Forgot password? Click here to reset