Ensemble Network for Ranking Images Based on Visual Appeal

by   Sachin Singh, et al.

We propose a computational framework for ranking images (group photos in particular) taken at the same event within a short time span. The ranking is expected to correspond with human perception of overall appeal of the images. We hypothesize and provide evidence through subjective analysis that the factors that appeal to humans are its emotional content, aesthetics and image quality. We propose a network which is an ensemble of three information channels, each predicting a score corresponding to one of the three visual appeal factors. For group emotion estimation, we propose a convolutional neural network (CNN) based architecture for predicting group emotion from images. This new architecture enforces the network to put emphasis on the important regions in the images, and achieves comparable results to the state-of-the-art. Next, we develop a network for the image ranking task that combines group emotion, aesthetics and image quality scores. Owing to the unavailability of suitable databases, we created a new database of manually annotated group photos taken during various social events. We present experimental results on this database and other benchmark databases whenever available. Overall, our experiments show that the proposed framework can reliably predict the overall appeal of images with results closely corresponding to human ranking.


page 1

page 2

page 3


Predicting Group Cohesiveness in Images

Cohesiveness of a group is an essential indicator of emotional state, st...

A multiple attributes image quality database for smartphone camera photo quality assessment

Smartphone is the superstar product in digital device market and the qua...

Deep HVS-IQA Net: Human Visual System Inspired Deep Image Quality Assessment Networks

In image quality enhancement processing, it is the most important to pre...

Event Recognition with Automatic Album Detection based on Sequential Processing, Neural Attention and Image Captioning

In this paper a new formulation of event recognition task is examined: i...

Group Emotion Recognition Using Machine Learning

Automatic facial emotion recognition is a challenging task that has gain...

Ranking News-Quality Multimedia

News editors need to find the photos that best illustrate a news piece a...

Learning to Blindly Assess Image Quality in the Laboratory and Wild

Previous models for blind image quality assessment (BIQA) can only be tr...

Please sign up or login with your details

Forgot password? Click here to reset