S3-Net: A Fast and Lightweight Video Scene Understanding Network by Single-shot Segmentation

11/04/2020
by   Yuan Cheng, et al.
18

Real-time understanding in video is crucial in various AI applications such as autonomous driving. This work presents a fast single-shot segmentation strategy for video scene understanding. The proposed net, called S3-Net, quickly locates and segments target sub-scenes, meanwhile extracts structured time-series semantic features as inputs to an LSTM-based spatio-temporal model. Utilizing tensorization and quantization techniques, S3-Net is intended to be lightweight for edge computing. Experiments using CityScapes, UCF11, HMDB51 and MOMENTS datasets demonstrate that the proposed S3-Net achieves an accuracy improvement of 8.1 reduction of 6.9x and an inference speed of 22.8 FPS on CityScapes with a GTX1080Ti GPU.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 7

research
10/28/2020

Semantic video segmentation for autonomous driving

We aim to solve semantic video segmentation in autonomous driving, namel...
research
04/10/2019

DSNet: An Efficient CNN for Road Scene Segmentation

Road scene understanding is a critical component in an autonomous drivin...
research
12/08/2021

STAF: A Spatio-Temporal Attention Fusion Network for Few-shot Video Classification

We propose STAF, a Spatio-Temporal Attention Fusion network for few-shot...
research
09/15/2019

MSU-Net: Multiscale Statistical U-Net for Real-time 3D Cardiac MRI Video Segmentation

Cardiac magnetic resonance imaging (MRI) is an essential tool for MRI-gu...
research
08/08/2017

Fast Scene Understanding for Autonomous Driving

Most approaches for instance-aware semantic labeling traditionally focus...
research
05/18/2021

Progressively Normalized Self-Attention Network for Video Polyp Segmentation

Existing video polyp segmentation (VPS) models typically employ convolut...
research
05/11/2022

Scene Consistency Representation Learning for Video Scene Segmentation

A long-term video, such as a movie or TV show, is composed of various sc...

Please sign up or login with your details

Forgot password? Click here to reset