Joint-SRVDNet: Joint Super Resolution and Vehicle Detection Network

05/03/2020
by   Moktari Mostofa, et al.
0

In many domestic and military applications, aerial vehicle detection and super-resolutionalgorithms are frequently developed and applied independently. However, aerial vehicle detection on super-resolved images remains a challenging task due to the lack of discriminative information in the super-resolved images. To address this problem, we propose a Joint Super-Resolution and Vehicle DetectionNetwork (Joint-SRVDNet) that tries to generate discriminative, high-resolution images of vehicles fromlow-resolution aerial images. First, aerial images are up-scaled by a factor of 4x using a Multi-scaleGenerative Adversarial Network (MsGAN), which has multiple intermediate outputs with increasingresolutions. Second, a detector is trained on super-resolved images that are upscaled by factor 4x usingMsGAN architecture and finally, the detection loss is minimized jointly with the super-resolution loss toencourage the target detector to be sensitive to the subsequent super-resolution training. The network jointlylearns hierarchical and discriminative features of targets and produces optimal super-resolution results. Weperform both quantitative and qualitative evaluation of our proposed network on VEDAI, xView and DOTAdatasets. The experimental results show that our proposed framework achieves better visual quality than thestate-of-the-art methods for aerial super-resolution with 4x up-scaling factor and improves the accuracy ofaerial vehicle detection.

READ FULL TEXT

page 5

page 6

page 7

page 8

page 9

page 11

page 12

page 13

research
02/19/2018

Deep Residual Network for Joint Demosaicing and Super-Resolution

In digital photography, two image restoration tasks have been studied ex...
research
11/12/2021

Small or Far Away? Exploiting Deep Super-Resolution and Altitude Data for Aerial Animal Surveillance

Visuals captured by high-flying aerial drones are increasingly used to a...
research
05/17/2022

Semantically Accurate Super-Resolution Generative Adversarial Networks

This work addresses the problems of semantic segmentation and image supe...
research
03/16/2019

Robust Super-Resolution GAN, with Manifold-based and Perception Loss

Super-resolution using deep neural networks typically relies on highly c...
research
04/16/2022

Robust PCA Unrolling Network for Super-resolution Vessel Extraction in X-ray Coronary Angiography

Although robust PCA has been increasingly adopted to extract vessels fro...
research
10/04/2020

AFN: Attentional Feedback Network based 3D Terrain Super-Resolution

Terrain, representing features of an earth surface, plays a crucial role...
research
06/01/2021

Two-stage domain adapted training for better generalization in real-world image restoration and super-resolution

It is well-known that in inverse problems, end-to-end trained networks o...

Please sign up or login with your details

Forgot password? Click here to reset