UVid-Net: Enhanced Semantic Segmentation of UAV Aerial Videos by Embedding Temporal Information

by   Girisha S, et al.

Semantic segmentation of aerial videos has been extensively used for decision making in monitoring environmental changes, urban planning, and disaster management. The reliability of these decision support systems is dependent on the accuracy of the video semantic segmentation algorithms. The existing CNN based video semantic segmentation methods have enhanced the image semantic segmentation methods by incorporating an additional module such as LSTM or optical flow for computing temporal dynamics of the video which is a computational overhead. The proposed research work modifies the CNN architecture by incorporating temporal information to improve the efficiency of video semantic segmentation. In this work, an enhanced encoder-decoder based CNN architecture (UVid-Net) is proposed for UAV video semantic segmentation. The encoder of the proposed architecture embeds temporal information for temporally consistent labelling. The decoder is enhanced by introducing the feature retainer module, which aids in the accurate localization of the class labels. The proposed UVid-Net architecture for UAV video semantic segmentation is quantitatively evaluated on an extended ManipalUAVid dataset. The performance metric mIoU of 0.79 has been observed which is significantly greater than the other state-of-the-art algorithms. Further, the proposed work produced promising results even for the pre-trained model of UVid-Net on the urban street scene with fine-tuning the final layer on UAV aerial videos.


page 1

page 5

page 7

page 8

page 9


Semantic Segmentation of Video Sequences with Convolutional LSTMs

Most of the semantic segmentation approaches have been developed for sin...

Deep Learning with Anatomical Priors: Imitating Enhanced Autoencoders in Latent Space for Improved Pelvic Bone Segmentation in MRI

We propose a 2D Encoder-Decoder based deep learning architecture for sem...

Obscured Wildfire Flame Detection By Temporal Analysis of Smoke Patterns Captured by Unmanned Aerial Systems

This research paper addresses the challenge of detecting obscured wildfi...

Multi-stream CNN based Video Semantic Segmentation for Automated Driving

Majority of semantic segmentation algorithms operate on a single frame e...

Deep Segmentation and Registration in X-Ray Angiography Video

In interventional radiology, short video sequences of vein structure in ...

semantic segmentation for urban planning maps based on u-net

The automatic digitizing of paper maps is a significant and challenging ...

Exploring Temporal Information for Improved Video Understanding

In this dissertation, I present my work towards exploring temporal infor...

Please sign up or login with your details

Forgot password? Click here to reset