Few-Shot Personalized Saliency Prediction Using Tensor Regression for Preserving Structural Global Information

07/06/2023
by   Yuya Moroto, et al.
0

This paper presents a few-shot personalized saliency prediction using tensor-to-matrix regression for preserving the structural global information of personalized saliency maps (PSMs). In contrast to a general saliency map, a PSM has been great potential since its map indicates the person-specific visual attention that is useful for obtaining individual visual preferences from heterogeneity of gazed areas. The PSM prediction is needed for acquiring the PSM for the unseen image, but its prediction is still a challenging task due to the complexity of individual gaze patterns. For recognizing individual gaze patterns from the limited amount of eye-tracking data, the previous methods adopt the similarity of gaze tendency between persons. However, in the previous methods, the PSMs are vectorized for the prediction model. In this way, the structural global information of the PSMs corresponding to the image is ignored. For automatically revealing the relationship between PSMs, we focus on the tensor-based regression model that can preserve the structural information of PSMs, and realize the improvement of the prediction accuracy. In the experimental results, we confirm the proposed method including the tensor-based regression outperforms the comparative methods.

READ FULL TEXT

page 3

page 4

research
12/04/2021

Scanpath Prediction on Information Visualisations

We propose Unified Model of Saliency and Scanpaths (UMSS) – a model that...
research
10/09/2017

Personalized Saliency and its Prediction

Almost all existing visual saliency models focus on predicting a univers...
research
11/21/2017

Personalization of Saliency Estimation

Most existing saliency models use low-level features or task description...
research
02/22/2018

Where's YOUR focus: Personalized Attention

Human visual attention is subjective and biased according to the persona...
research
06/17/2022

Rectify ViT Shortcut Learning by Visual Saliency

Shortcut learning is common but harmful to deep learning models, leading...
research
10/23/2019

SalGaze: Personalizing Gaze Estimation Using Visual Saliency

Traditional gaze estimation methods typically require explicit user cali...
research
11/17/2022

Continuous Prediction of Web User Visual Attention on short span Windows based on Gaze Data Analytics

The existing approaches to identify personalized salience zones of a Web...

Please sign up or login with your details

Forgot password? Click here to reset