Photo Aesthetics Ranking Network with Attributes and Content Adaptation

06/06/2016
by   Shu Kong, et al.
0

Real-world applications could benefit from the ability to automatically generate a fine-grained ranking of photo aesthetics. However, previous methods for image aesthetics analysis have primarily focused on the coarse, binary categorization of images into high- or low-aesthetic categories. In this work, we propose to learn a deep convolutional neural network to rank photo aesthetics in which the relative ranking of photo aesthetics are directly modeled in the loss function. Our model incorporates joint learning of meaningful photographic attributes and image content information which can help regularize the complicated photo aesthetics rating problem. To train and analyze this model, we have assembled a new aesthetics and attributes database (AADB) which contains aesthetic scores and meaningful attributes assigned to each image by multiple human raters. Anonymized rater identities are recorded across images allowing us to exploit intra-rater consistency using a novel sampling strategy when computing the ranking loss of training image pairs. We show the proposed sampling strategy is very effective and robust in face of subjective judgement of image aesthetics by individuals with different aesthetic tastes. Experiments demonstrate that our unified model can generate aesthetic rankings that are more consistent with human ratings. To further validate our model, we show that by simply thresholding the estimated aesthetic scores, we are able to achieve state-or-the-art classification performance on the existing AVA dataset benchmark.

READ FULL TEXT

page 2

page 5

page 10

page 18

page 19

page 22

page 23

page 24

research
02/12/2018

Image Retargetability

Real-world applications could benefit from the ability to automatically ...
research
11/16/2016

Will People Like Your Image? Learning the Aesthetic Space

Rating how aesthetically pleasing an image appears is a highly complex m...
research
06/01/2015

User Preferences Modeling and Learning for Pleasing Photo Collage Generation

In this paper we consider how to automatically create pleasing photo col...
research
08/09/2016

End-to-End Localization and Ranking for Relative Attributes

We propose an end-to-end deep convolutional network to simultaneously lo...
research
04/05/2017

Relative Learning from Web Images for Content-adaptive Enhancement

Personalized and content-adaptive image enhancement can find many applic...
research
06/17/2022

Understanding Aesthetics with Language: A Photo Critique Dataset for Aesthetic Assessment

Computational inference of aesthetics is an ill-defined task due to its ...
research
02/01/2017

Learning to Compose with Professional Photographs on the Web

Photo composition is an important factor affecting the aesthetics in pho...

Please sign up or login with your details

Forgot password? Click here to reset