Compression ensembles quantify aesthetic complexity and the evolution of visual art

05/20/2022
by   Andres Karjus, et al.
0

The quantification of visual aesthetics and complexity have a long history, the latter previously operationalized via the application of compression algorithms. Here we generalize and extend the compression approach beyond simple complexity measures to quantify algorithmic distance in historical and contemporary visual media. The proposed "ensemble" approach works by compressing a large number of transformed versions of a given input image, resulting in a vector of associated compression ratios. This approach is more efficient than other compression-based algorithmic distances, and is particularly suited for the quantitative analysis of visual artifacts, because human creative processes can be understood as algorithms in the broadest sense. Unlike comparable image embedding methods using machine learning, our approach is fully explainable through the transformations. We demonstrate that the method is cognitively plausible and fit for purpose by evaluating it against human complexity judgments, and on automated detection tasks of authorship and style. We show how the approach can be used to reveal and quantify trends in art historical data, both on the scale of centuries and in rapidly evolving contemporary NFT art markets. We further quantify temporal resemblance to disambiguate artists outside the documented mainstream from those who are deeply embedded in Zeitgeist. Finally, we note that compression ensembles constitute a quantitative representation of the concept of visual family resemblance, as distinct sets of dimensions correspond to shared visual characteristics otherwise hard to pin down. Our approach provides a new perspective for the study of visual art, algorithmic image analysis, and quantitative aesthetics more generally.

READ FULL TEXT

page 2

page 4

page 7

page 9

page 12

page 27

page 29

page 30

research
09/15/2018

History of art paintings through the lens of entropy and complexity

Art is the ultimate expression of human creativity that is deeply influe...
research
11/26/2018

A Consolidated Approach to Convolutional Neural Networks and the Kolmogorov Complexity

The ability to precisely quantify similarity between various entities ha...
research
11/21/2016

MDL-motivated compression of GLM ensembles increases interpretability and retains predictive power

Over the years, ensemble methods have become a staple of machine learnin...
research
04/12/2018

Deformation Aware Image Compression

Lossy compression algorithms aim to compactly encode images in a way whi...
research
10/19/2019

ProxIQA: A Proxy Approach to Perceptual Optimization of Learned Image Compression

The use of ℓ_p(p=1,2) norms has largely dominated the measurement of los...
research
09/30/2020

Demographic Influences on Contemporary Art with Unsupervised Style Embeddings

Computational art analysis has, through its reliance on classification t...
research
01/24/2019

Learning to compress and search visual data in large-scale systems

The problem of high-dimensional and large-scale representation of visual...

Please sign up or login with your details

Forgot password? Click here to reset