Reconciliation of Statistical and Spatial Sparsity For Robust Image and Image-Set Classification

by   Hao Cheng, et al.
Nanyang Technological University

Recent image classification algorithms, by learning deep features from large-scale datasets, have achieved significantly better results comparing to the classic feature-based approaches. However, there are still various challenges of image classifications in practice, such as classifying noisy image or image-set queries and training deep image classification models over the limited-scale dataset. Instead of applying generic deep features, the model-based approaches can be more effective and data-efficient for robust image and image-set classification tasks, as various image priors are exploited for modeling the inter- and intra-set data variations while preventing over-fitting. In this work, we propose a novel Joint Statistical and Spatial Sparse representation, dubbed J3S, to model the image or image-set data for classification, by reconciling both their local patch structures and global Gaussian distribution mapped into Riemannian manifold. To the best of our knowledge, no work to date utilized both global statistics and local patch structures jointly via joint sparse representation. We propose to solve the joint sparse coding problem based on the J3S model, by coupling the local and global image representations using joint sparsity. The learned J3S models are used for robust image and image-set classification. Experiments show that the proposed J3S-based image classification scheme outperforms the popular or state-of-the-art competing methods over FMD, UIUC, ETH-80 and YTC databases.


page 1

page 6


Efficient Deep Aesthetic Image Classification using Connected Local and Global Features

In this paper we investigate the aesthetic image classification problem,...

Joint Hierarchical Category Structure Learning and Large-Scale Image Classification

We investigate the scalable image classification problem with a large nu...

Unifying Deep Local and Global Features for Efficient Image Search

A key challenge in large-scale image retrieval problems is the trade-off...

Deep Neural Networks Fused with Textures for Image Classification

Fine-grained image classification (FGIC) is a challenging task in comput...

Representation Learning with Deep Extreme Learning Machines for Efficient Image Set Classification

Efficient and accurate joint representation of a collection of images, t...

Inference via Sparse Coding in a Hierarchical Vision Model

Sparse coding has been incorporated in models of the visual cortex for i...

Please sign up or login with your details

Forgot password? Click here to reset