Scene Image Representation by Foreground, Background and Hybrid Features

06/05/2020
by   Chiranjibi Sitaula, et al.
0

Previous methods for representing scene images based on deep learning primarily consider either the foreground or background information as the discriminating clues for the classification task. However, scene images also require additional information (hybrid) to cope with the inter-class similarity and intra-class variation problems. In this paper, we propose to use hybrid features in addition to foreground and background features to represent scene images. We suppose that these three types of information could jointly help to represent scene image more accurately. To this end, we adopt three VGG-16 architectures pre-trained on ImageNet, Places, and Hybrid (both ImageNet and Places) datasets for the corresponding extraction of foreground, background and hybrid information. All these three types of deep features are further aggregated to achieve our final features for the representation of scene images. Extensive experiments on two large benchmark scene datasets (MIT-67 and SUN-397) show that our method produces the state-of-the-art classification performance.

READ FULL TEXT

page 3

page 14

page 15

research
03/22/2020

HDF: Hybrid Deep Features for Scene Image Representation

Nowadays it is prevalent to take features extracted from pre-trained dee...
research
11/18/2022

Invariant Learning via Diffusion Dreamed Distribution Shifts

Though the background is an important signal for image classification, o...
research
06/05/2020

Content and Context Features for Scene Image Representation

Existing research in scene image classification has focused on either co...
research
06/24/2020

Time for a Background Check! Uncovering the impact of Background Features on Deep Neural Networks

With increasing expressive power, deep neural networks have significantl...
research
07/04/2023

Mitigating Bias: Enhancing Image Classification by Improving Model Explanations

Deep learning models have demonstrated remarkable capabilities in learni...
research
05/02/2015

Multi-Object Classification and Unsupervised Scene Understanding Using Deep Learning Features and Latent Tree Probabilistic Models

Deep learning has shown state-of-art classification performance on datas...
research
01/22/2023

BallGAN: 3D-aware Image Synthesis with a Spherical Background

3D-aware GANs aim to synthesize realistic 3D scenes such that they can b...

Please sign up or login with your details

Forgot password? Click here to reset