Learning to Evaluate the Artness of AI-generated Images

05/08/2023
by   Junyu Chen, et al.
0

Assessing the artness of AI-generated images continues to be a challenge within the realm of image generation. Most existing metrics cannot be used to perform instance-level and reference-free artness evaluation. This paper presents ArtScore, a metric designed to evaluate the degree to which an image resembles authentic artworks by artists (or conversely photographs), thereby offering a novel approach to artness assessment. We first blend pre-trained models for photo and artwork generation, resulting in a series of mixed models. Subsequently, we utilize these mixed models to generate images exhibiting varying degrees of artness with pseudo-annotations. Each photorealistic image has a corresponding artistic counterpart and a series of interpolated images that range from realistic to artistic. This dataset is then employed to train a neural network that learns to estimate quantized artness levels of arbitrary images. Extensive experiments reveal that the artness levels predicted by ArtScore align more closely with human artistic evaluation than existing evaluation metrics, such as Gram loss and ArtFID.

READ FULL TEXT

page 2

page 4

page 7

research
02/17/2022

Revisiting the Evaluation Metrics of Paraphrase Generation

Paraphrase generation is an important NLP task that has achieved signifi...
research
11/21/2022

Evaluating the Knowledge Dependency of Questions

The automatic generation of Multiple Choice Questions (MCQ) has the pote...
research
01/11/2019

Using Scene Graph Context to Improve Image Generation

Generating realistic images from scene graphs asks neural networks to be...
research
04/26/2020

Evaluation Metrics for Conditional Image Generation

We present two new metrics for evaluating generative models in the class...
research
02/08/2023

GPTScore: Evaluate as You Desire

Generative Artificial Intelligence (AI) has enabled the development of s...
research
08/30/2023

CorrEmbed: Evaluating Pre-trained Model Image Similarity Efficacy with a Novel Metric

Detecting visually similar images is a particularly useful attribute to ...
research
10/26/2022

Visually Improved Erosion Algorithm for the Procedural Generation of Tile-based Terrain

Procedural terrain generation is the process of generating a digital rep...

Please sign up or login with your details

Forgot password? Click here to reset