SalGAN: Visual Saliency Prediction with Generative Adversarial Networks

01/04/2017
by   Junting Pan, et al.
0

We introduce SalGAN, a deep convolutional neural network for visual saliency prediction trained with adversarial examples. The first stage of the network consists of a generator model whose weights are learned by back-propagation computed from a binary cross entropy (BCE) loss over downsampled versions of the saliency maps. The resulting prediction is processed by a discriminator network trained to solve a binary classification task between the saliency maps generated by the generative stage and the ground truth ones. Our experiments show how adversarial training allows reaching state-of-the-art performance across different metrics when combined with a widely-used loss function like BCE.

READ FULL TEXT

page 1

page 3

page 8

page 9

research
04/02/2019

DSAL-GAN: Denoising based Saliency Prediction with Generative Adversarial Networks

Synthesizing high quality saliency maps from noisy images is a challengi...
research
07/11/2017

SaltiNet: Scan-path Prediction on 360 Degree Images using Saliency Volumes

We introduce SaltiNet, a deep neural network for scanpath prediction tra...
research
03/15/2023

MRGAN360: Multi-stage Recurrent Generative Adversarial Network for 360 Degree Image Saliency Prediction

Thanks to the ability of providing an immersive and interactive experien...
research
09/03/2018

PathGAN: Visual Scanpath Prediction with Generative Adversarial Networks

We introduce PathGAN, a deep neural network for visual scanpath predicti...
research
07/14/2021

AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense

We propose an AID-purifier that can boost the robustness of adversariall...
research
03/02/2016

Shallow and Deep Convolutional Networks for Saliency Prediction

The prediction of salient areas in images has been traditionally address...
research
05/29/2018

Webpage Saliency Prediction with Two-stage Generative Adversarial Networks

Web page saliency prediction is a challenge problem in image transformat...

Please sign up or login with your details

Forgot password? Click here to reset