Mixed X-Ray Image Separation for Artworks with Concealed Designs

01/23/2022
by   Wei Pu, et al.
2

In this paper, we focus on X-ray images of paintings with concealed sub-surface designs (e.g., deriving from reuse of the painting support or revision of a composition by the artist), which include contributions from both the surface painting and the concealed features. In particular, we propose a self-supervised deep learning-based image separation approach that can be applied to the X-ray images from such paintings to separate them into two hypothetical X-ray images. One of these reconstructed images is related to the X-ray image of the concealed painting, while the second one contains only information related to the X-ray of the visible painting. The proposed separation network consists of two components: the analysis and the synthesis sub-networks. The analysis sub-network is based on learned coupled iterative shrinkage thresholding algorithms (LCISTA) designed using algorithm unrolling techniques, and the synthesis sub-network consists of several linear mappings. The learning algorithm operates in a totally self-supervised fashion without requiring a sample set that contains both the mixed X-ray images and the separated ones. The proposed method is demonstrated on a real painting with concealed content, Doña Isabel de Porcel by Francisco de Goya, to show its effectiveness.

READ FULL TEXT

page 2

page 7

page 9

page 10

page 11

page 12

page 16

page 18

research
09/16/2020

Image Separation with Side Information: A Connected Auto-Encoders Based Approach

X-radiography (X-ray imaging) is a widely used imaging technique in art ...
research
08/01/2023

DINO-CXR: A self supervised method based on vision transformer for chest X-ray classification

The limited availability of labeled chest X-ray datasets is a significan...
research
02/28/2020

Instance Separation Emerges from Inpainting

Deep neural networks trained to inpaint partially occluded images show a...
research
06/03/2016

Automatic Separation of Compound Figures in Scientific Articles

Content-based analysis and retrieval of digital images found in scientif...
research
11/06/2020

Self Supervised Learning for Object Localisation in 3D Tomographic Images

While a lot of work is dedicated to self-supervised learning, most of it...
research
05/30/2021

Prediction of Osteoarthritis using Deep Learning

The dataset consists of 1650 digital X-ray images of knee joint which ar...
research
05/01/2018

Generating Synthetic X-ray Images of a Person from the Surface Geometry

We present a novel framework that learns to predict human anatomy from b...

Please sign up or login with your details

Forgot password? Click here to reset