Multi-task convolutional neural network for image aesthetic assessment

05/16/2023
by   Derya Soydaner, et al.
11

As people's aesthetic preferences for images are far from understood, image aesthetic assessment is a challenging artificial intelligence task. The range of factors underlying this task is almost unlimited, but we know that some aesthetic attributes affect those preferences. In this study, we present a multi-task convolutional neural network that takes into account these attributes. The proposed neural network jointly learns the attributes along with the overall aesthetic scores of images. This multi-task learning framework allows for effective generalization through the utilization of shared representations. Our experiments demonstrate that the proposed method outperforms the state-of-the-art approaches in predicting overall aesthetic scores for images in one benchmark of image aesthetics. We achieve near-human performance in terms of overall aesthetic scores when considering the Spearman's rank correlations. Moreover, our model pioneers the application of multi-tasking in another benchmark, serving as a new baseline for future research. Notably, our approach achieves this performance while using fewer parameters compared to existing multi-task neural networks in the literature, and consequently makes our method more efficient in terms of computational complexity.

READ FULL TEXT

page 4

page 5

page 7

page 9

page 11

page 12

page 14

research
01/04/2016

Multi-task CNN Model for Attribute Prediction

This paper proposes a joint multi-task learning algorithm to better pred...
research
07/13/2017

Learning Photography Aesthetics with Deep CNNs

Automatic photo aesthetic assessment is a challenging artificial intelli...
research
01/29/2019

Two-Stream Multi-Task Network for Fashion Recognition

In this paper, we present a two-stream multi-task network for fashion re...
research
07/12/2020

HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections

Achieving state-of-the-art performance on natural language understanding...
research
04/25/2016

Attributes for Improved Attributes: A Multi-Task Network for Attribute Classification

Attributes, or semantic features, have gained popularity in the past few...
research
08/02/2017

OmniArt: Multi-task Deep Learning for Artistic Data Analysis

Vast amounts of artistic data is scattered on-line from both museums and...
research
12/31/2018

Predicting Group Cohesiveness in Images

Cohesiveness of a group is an essential indicator of emotional state, st...

Please sign up or login with your details

Forgot password? Click here to reset