Insights into analysis operator learning: From patch-based sparse models to higher-order MRFs

01/13/2014
by   Yunjin Chen, et al.
0

This paper addresses a new learning algorithm for the recently introduced co-sparse analysis model. First, we give new insights into the co-sparse analysis model by establishing connections to filter-based MRF models, such as the Field of Experts (FoE) model of Roth and Black. For training, we introduce a technique called bi-level optimization to learn the analysis operators. Compared to existing analysis operator learning approaches, our training procedure has the advantage that it is unconstrained with respect to the analysis operator. We investigate the effect of different aspects of the co-sparse analysis model and show that the sparsity promoting function (also called penalty function) is the most important factor in the model. In order to demonstrate the effectiveness of our training approach, we apply our trained models to various classical image restoration problems. Numerical experiments show that our trained models clearly outperform existing analysis operator learning approaches and are on par with state-of-the-art image denoising algorithms. Our approach develops a framework that is intuitive to understand and easy to implement.

READ FULL TEXT

page 6

page 9

page 10

page 11

page 12

page 13

research
01/16/2014

Learning ℓ_1-based analysis and synthesis sparsity priors using bi-level optimization

We consider the analysis operator and synthesis dictionary learning prob...
research
03/06/2018

Learning Filter Bank Sparsifying Transforms

Data is said to follow the transform (or analysis) sparsity model if it ...
research
01/16/2014

Revisiting loss-specific training of filter-based MRFs for image restoration

It is now well known that Markov random fields (MRFs) are particularly e...
research
01/10/2020

Parameter learning and fractional differential operators: application in image regularization and decomposition

In this paper, we focus on learning optimal parameters for PDE-based ima...
research
12/05/2016

On-Demand Learning for Deep Image Restoration

While machine learning approaches to image restoration offer great promi...
research
11/09/2013

Neighborhood filters and the decreasing rearrangement

Nonlocal filters are simple and powerful techniques for image denoising....
research
03/09/2015

Learning Co-Sparse Analysis Operators with Separable Structures

In the co-sparse analysis model a set of filters is applied to a signal ...

Please sign up or login with your details

Forgot password? Click here to reset