Machine: The New Art Connoisseur

11/22/2019
by   Yucheng Zhu, et al.
37

The process of identifying and understanding art styles to discover artistic influences is essential to the study of art history. Traditionally, trained experts review fine details of the works and compare them to other known works. To automate and scale this task, we use several state-of-the-art CNN architectures to explore how a machine may help perceive and quantify art styles. This study explores: (1) How accurately can a machine classify art styles? (2) What may be the underlying relationships among different styles and artists? To help answer the first question, our best-performing model using Inception V3 achieves a 9-class classification accuracy of 88.35 outperforms the model in Elgammal et al.'s study by more than 20 percent. Visualizations using Grad-CAM heat maps confirm that the model correctly focuses on the characteristic parts of paintings. To help address the second question, we conduct network analysis on the influences among styles and artists by extracting 512 features from the best-performing classification model. Through 2D and 3D T-SNE visualizations, we observe clear chronological patterns of development and separation among the art styles. The network analysis also appears to show anticipated artist level connections from an art historical perspective. This technique appears to help identify some previously unknown linkages that may shed light upon new directions for further exploration by art historians. We hope that humans and machines working in concert may bring new opportunities to the field.

READ FULL TEXT

page 6

page 7

page 8

research
01/23/2018

The Shape of Art History in the Eyes of the Machine

How does the machine classify styles in art? And how does it relate to a...
research
05/19/2023

Inventing painting styles through natural inspiration

We propose two procedures to create painting styles using models trained...
research
09/15/2018

History of art paintings through the lens of entropy and complexity

Art is the ultimate expression of human creativity that is deeply influe...
research
02/23/2021

Quantifying Confounding Bias in Generative Art: A Case Study

In recent years, AI generated art has become very popular. From generati...
research
06/21/2021

Photozilla: A Large-Scale Photography Dataset and Visual Embedding for 20 Photography Styles

The advent of social media platforms has been a catalyst for the develop...
research
04/03/2020

From Paris to Berlin: Discovering Fashion Style Influences Around the World

The evolution of clothing styles and their migration across the world is...
research
12/07/2021

VizExtract: Automatic Relation Extraction from Data Visualizations

Visual graphics, such as plots, charts, and figures, are widely used to ...

Please sign up or login with your details

Forgot password? Click here to reset