Temporal recurrences for video saliency prediction

07/03/2019
by   Panagiotis Linardos, et al.
1

This paper investigates modifying an existing neural network architecture for static saliency prediction using two types of recurrences that integrate information from the temporal domain. The first modification is the addition of a ConvLSTM within the architecture, while the second is a computationally simple exponential moving average of an internal convolutional state. We use weights pre-trained on the SALICON dataset and fine-tune our model on DHF1K. Our results show that both modifications achieve state-of-the-art results and produce similar saliency maps.

READ FULL TEXT

page 3

page 9

page 10

research
07/03/2019

Simple vs complex temporal recurrences for video saliency prediction

This paper investigates modifying an existing neural network architectur...
research
08/28/2018

Temporal Saliency Adaptation in Egocentric Videos

This work adapts a deep neural model for image saliency prediction to th...
research
06/01/2016

OpenSalicon: An Open Source Implementation of the Salicon Saliency Model

In this technical report, we present our publicly downloadable implement...
research
08/15/2019

TASED-Net: Temporally-Aggregating Spatial Encoder-Decoder Network for Video Saliency Detection

TASED-Net is a 3D fully-convolutional network architecture for video sal...
research
05/02/2018

EML-NET:An Expandable Multi-Layer NETwork for Saliency Prediction

In this work, we apply state-of-the-art Convolutional Neural Network(CNN...
research
06/25/2021

Energy-Based Generative Cooperative Saliency Prediction

Conventional saliency prediction models typically learn a deterministic ...
research
01/12/2018

Deep saliency: What is learnt by a deep network about saliency?

Deep convolutional neural networks have achieved impressive performance ...

Please sign up or login with your details

Forgot password? Click here to reset