Revisiting Image Aesthetic Assessment via Self-Supervised Feature Learning

11/26/2019
by   Kekai Sheng, et al.
0

Visual aesthetic assessment has been an active research field for decades. Although latest methods have achieved promising performance on benchmark datasets, they typically rely on a large number of manual annotations including both aesthetic labels and related image attributes. In this paper, we revisit the problem of image aesthetic assessment from the self-supervised feature learning perspective. Our motivation is that a suitable feature representation for image aesthetic assessment should be able to distinguish different expert-designed image manipulations, which have close relationships with negative aesthetic effects. To this end, we design two novel pretext tasks to identify the types and parameters of editing operations applied to synthetic instances. The features from our pretext tasks are then adapted for a one-layer linear classifier to evaluate the performance in terms of binary aesthetic classification. We conduct extensive quantitative experiments on three benchmark datasets and demonstrate that our approach can faithfully extract aesthetics-aware features and outperform alternative pretext schemes. Moreover, we achieve comparable results to state-of-the-art supervised methods that use 10 million labels from ImageNet.

READ FULL TEXT

page 1

page 3

research
02/16/2019

Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey

Large-scale labeled data are generally required to train deep neural net...
research
05/03/2019

Scaling and Benchmarking Self-Supervised Visual Representation Learning

Self-supervised learning aims to learn representations from the data its...
research
10/19/2020

Self-Supervised Visual Attention Learning for Vehicle Re-Identification

Visual attention learning (VAL) aims to produce a confidence map as weig...
research
02/05/2015

Collaborative Feature Learning from Social Media

Image feature representation plays an essential role in image recognitio...
research
11/15/2022

Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works

Deep learning has achieved great success in learning features from massi...
research
09/28/2022

Efficient Medical Image Assessment via Self-supervised Learning

High-performance deep learning methods typically rely on large annotated...
research
04/05/2020

Steering Self-Supervised Feature Learning Beyond Local Pixel Statistics

We introduce a novel principle for self-supervised feature learning base...

Please sign up or login with your details

Forgot password? Click here to reset