Learning of Proto-object Representations via Fixations on Low Resolution

12/23/2014
by   Chengyao Shen, et al.
0

While previous researches in eye fixation prediction typically rely on integrating low-level features (e.g. color, edge) to form a saliency map, recently it has been found that the structural organization of these features into a proto-object representation can play a more significant role. In this work, we present a computational framework based on deep network to demonstrate that proto-object representations can be learned from low-resolution image patches from fixation regions. We advocate the use of low-resolution inputs in this work due to the following reasons: (1) Proto-objects are computed in parallel over an entire visual field (2) People can perceive or recognize objects well even it is in low resolution. (3) Fixations from lower resolution images can predict fixations on higher resolution images. In the proposed computational model, we extract multi-scale image patches on fixation regions from eye fixation datasets, resize them to low resolution and feed them into a hierarchical. With layer-wise unsupervised feature learning, we find that many proto-objects like features responsive to different shapes of object blobs are learned out. Visualizations also show that these features are selective to potential objects in the scene and the responses of these features work well in predicting eye fixations on the images when combined with learned weights.

READ FULL TEXT
research
12/06/2017

Saliency Preservation in Low-Resolution Grayscale Images

Visual salience detection originated over 500 million years ago and is o...
research
08/27/2019

Unsupervised Deep Feature Transfer for Low Resolution Image Classification

In this paper, we propose a simple while effective unsupervised deep fea...
research
08/17/2023

SRMAE: Masked Image Modeling for Scale-Invariant Deep Representations

Due to the prevalence of scale variance in nature images, we propose to ...
research
09/27/2022

CEC-CNN: A Consecutive Expansion-Contraction Convolutional Network for Very Small Resolution Medical Image Classification

Deep Convolutional Neural Networks (CNNs) for image classification succe...
research
04/19/2022

Per-clip adaptive Lagrangian multiplier optimisation with low-resolution proxies

This work focuses on reducing the computational cost of repeated video e...
research
01/03/2021

An Evolution of CNN Object Classifiers on Low-Resolution Images

Object classification is a significant task in computer vision. It has b...
research
03/28/2019

Feature Intertwiner for Object Detection

A well-trained model should classify objects with a unanimous score for ...

Please sign up or login with your details

Forgot password? Click here to reset