An Inter-observer consistent deep adversarial training for visual scanpath prediction

11/14/2022
by   Mohamed Amine Kerkouri, et al.
3

The visual scanpath is a sequence of points through which the human gaze moves while exploring a scene. It represents the fundamental concepts upon which visual attention research is based. As a result, the ability to predict them has emerged as an important task in recent years. In this paper, we propose an inter-observer consistent adversarial training approach for scanpath prediction through a lightweight deep neural network. The adversarial method employs a discriminative neural network as a dynamic loss that is better suited to model the natural stochastic phenomenon while maintaining consistency between the distributions related to the subjective nature of scanpaths traversed by different observers. Through extensive testing, we show the competitiveness of our approach in regard to state-of-the-art methods.

READ FULL TEXT
research
09/03/2018

PathGAN: Visual Scanpath Prediction with Generative Adversarial Networks

We introduce PathGAN, a deep neural network for visual scanpath predicti...
research
09/22/2022

A domain adaptive deep learning solution for scanpath prediction of paintings

Cultural heritage understanding and preservation is an important issue f...
research
07/08/2023

Sup-Norm Convergence of Deep Neural Network Estimator for Nonparametric Regression by Adversarial Training

We show the sup-norm convergence of deep neural network estimators with ...
research
03/06/2023

Adversarial Sampling for Fairness Testing in Deep Neural Network

In this research, we focus on the usage of adversarial sampling to test ...
research
10/13/2018

Enhancing Stock Movement Prediction with Adversarial Training

This paper contributes a new machine learning solution for stock movemen...
research
11/15/2020

Domain Adaptation Gaze Estimation by Embedding with Prediction Consistency

Gaze is the essential manifestation of human attention. In recent years,...

Please sign up or login with your details

Forgot password? Click here to reset