Image Aesthetics Prediction Using Multiple Patches Preserving the Original Aspect Ratio of Contents

07/05/2020
by   Lijie Wang, et al.
0

The spread of social networking services has created an increasing demand for selecting, editing, and generating impressive images. This trend increases the importance of evaluating image aesthetics as a complementary function of automatic image processing. We propose a multi-patch method, named MPA-Net (Multi-Patch Aggregation Network), to predict image aesthetics scores by maintaining the original aspect ratios of contents in the images. Through an experiment involving the large-scale AVA dataset, which contains 250,000 images, we show that the effectiveness of the equal-interval multi-patch selection approach for aesthetics score prediction is significant compared to the single-patch prediction and random patch selection approaches. For this dataset, MPA-Net outperforms the neural image assessment algorithm, which was regarded as a baseline method. In particular, MPA-Net yields a 0.073 (11.5 higher linear correlation coefficient (LCC) of aesthetics scores and a 0.088 (14.4 reduces the mean square error (MSE) by 0.0115 (4.18 the LCC and SRCC that are comparable to those of the state-of-the-art continuous aesthetics score prediction methods. Most notably, MPA-Net yields a significant lower MSE especially for images with aspect ratios far from 1.0, indicating that MPA-Net is useful for a wide range of image aspect ratios. MPA-Net uses only images and does not require external information during the training nor prediction stages. Therefore, MPA-Net has great potential for applications aside from aesthetics score prediction such as other human subjectivity prediction.

READ FULL TEXT

page 1

page 2

page 4

page 12

research
11/20/2022

Patch-level Gaze Distribution Prediction for Gaze Following

Gaze following aims to predict where a person is looking in a scene, by ...
research
11/10/2020

Deep machine learning-assisted multiphoton microscopy to reduce light exposure and expedite imaging

Two-photon excitation fluorescence (2PEF) allows imaging of tissue up to...
research
04/20/2021

Posterior Sampling for Image Restoration using Explicit Patch Priors

Almost all existing methods for image restoration are based on optimizin...
research
08/18/2023

Generative Machine Listener

We show how a neural network can be trained on individual intrusive list...
research
03/22/2018

PlaneMatch: Patch Coplanarity Prediction for Robust RGB-D Reconstruction

We introduce a novel RGB-D patch descriptor designed for detecting copla...
research
12/07/2021

Hybrid guiding: A multi-resolution refinement approach for semantic segmentation of gigapixel histopathological images

Histopathological cancer diagnostics has become more complex, and the in...
research
01/15/2021

APEX-Net: Automatic Plot Extractor Network

Automatic extraction of raw data from 2D line plot images is a problem o...

Please sign up or login with your details

Forgot password? Click here to reset