Multi-modal dictionary learning for image separation with application in art investigation

07/14/2016
by   Nikos Deligiannis, et al.
0

In support of art investigation, we propose a new source separation method that unmixes a single X-ray scan acquired from double-sided paintings. In this problem, the X-ray signals to be separated have similar morphological characteristics, which brings previous source separation methods to their limits. Our solution is to use photographs taken from the front and back-side of the panel to drive the separation process. The crux of our approach relies on the coupling of the two imaging modalities (photographs and X-rays) using a novel coupled dictionary learning framework able to capture both common and disparate features across the modalities using parsimonious representations; the common component models features shared by the multi-modal images, whereas the innovation component captures modality-specific information. As such, our model enables the formulation of appropriately regularized convex optimization procedures that lead to the accurate separation of the X-rays. Our dictionary learning framework can be tailored both to a single- and a multi-scale framework, with the latter leading to a significant performance improvement. Moreover, to improve further on the visual quality of the separated images, we propose to train coupled dictionaries that ignore certain parts of the painting corresponding to craquelure. Experimentation on synthetic and real data - taken from digital acquisition of the Ghent Altarpiece (1432) - confirms the superiority of our method against the state-of-the-art morphological component analysis technique that uses either fixed or trained dictionaries to perform image separation.

READ FULL TEXT

page 1

page 6

page 8

page 9

page 10

page 11

page 12

page 13

research
05/20/2016

X-ray image separation via coupled dictionary learning

In support of art investigation, we propose a new source sepa- ration me...
research
12/03/2012

Semi-blind Source Separation via Sparse Representations and Online Dictionary Learning

This work examines a semi-blind single-channel source separation problem...
research
06/26/2018

Multi-modal Image Processing based on Coupled Dictionary Learning

In real-world scenarios, many data processing problems often involve het...
research
09/16/2020

Image Separation with Side Information: A Connected Auto-Encoders Based Approach

X-radiography (X-ray imaging) is a widely used imaging technique in art ...
research
01/16/2013

Jitter-Adaptive Dictionary Learning - Application to Multi-Trial Neuroelectric Signals

Dictionary Learning has proven to be a powerful tool for many image proc...
research
02/13/2018

LSALSA: efficient sparse coding in single and multiple dictionary settings

We propose an efficient sparse coding (SC) framework for obtaining spars...
research
10/17/2019

A Novel CMB Component Separation Method: Hierarchical Generalized Morphological Component Analysis

We present a novel technique for Cosmic Microwave Background (CMB) foreg...

Please sign up or login with your details

Forgot password? Click here to reset