Art2Real: Unfolding the Reality of Artworks via Semantically-Aware Image-to-Image Translation

11/26/2018
by   Matteo Tomei, et al.
0

The applicability of computer vision to real paintings and artworks has been rarely investigated, even though a vast heritage would greatly benefit from techniques which can understand and process data from the artistic domain. This is partially due to the small amount of annotated artistic data, which is not even comparable to that of natural images captured by cameras. In this paper, we propose a semantic-aware architecture which can translate artworks to photo-realistic visualizations, thus reducing the gap between visual features of artistic and realistic data. Our architecture can generate natural images by retrieving and learning details from real photos through a similarity matching strategy which leverages a weakly-supervised semantic understanding of the scene. Experimental results show that the proposed technique leads to increased realism and to a reduction in domain shift, which improves the performance of pre-trained architectures for classification, detection, and segmentation. Code will be made publicly available.

READ FULL TEXT

page 13

page 14

page 15

page 16

page 17

page 18

page 19

page 21

research
06/11/2023

Semantically-aware Mask CycleGAN for Translating Artistic Portraits to Photo-realistic Visualizations

Image-to-image translation (I2I) is defined as a computer vision task wh...
research
03/08/2022

Language Matters: A Weakly Supervised Pre-training Approach for Scene Text Detection and Spotting

Recently, Vision-Language Pre-training (VLP) techniques have greatly ben...
research
01/21/2021

Pre-training without Natural Images

Is it possible to use convolutional neural networks pre-trained without ...
research
03/24/2021

Can Vision Transformers Learn without Natural Images?

Can we complete pre-training of Vision Transformers (ViT) without natura...
research
09/04/2017

WESPE: Weakly Supervised Photo Enhancer for Digital Cameras

Low-end and compact mobile cameras demonstrate limited photo quality mai...
research
04/16/2023

Translating Simulation Images to X-ray Images via Multi-Scale Semantic Matching

Endovascular intervention training is increasingly being conducted in vi...
research
10/18/2021

Distinguishing Natural and Computer-Generated Images using Multi-Colorspace fused EfficientNet

The problem of distinguishing natural images from photo-realistic comput...

Please sign up or login with your details

Forgot password? Click here to reset