Learning ℓ_1-based analysis and synthesis sparsity priors using bi-level optimization

01/16/2014
by   Yunjin Chen, et al.
0

We consider the analysis operator and synthesis dictionary learning problems based on the the ℓ_1 regularized sparse representation model. We reveal the internal relations between the ℓ_1-based analysis model and synthesis model. We then introduce an approach to learn both analysis operator and synthesis dictionary simultaneously by using a unified framework of bi-level optimization. Our aim is to learn a meaningful operator (dictionary) such that the minimum energy solution of the analysis (synthesis)-prior based model is as close as possible to the ground-truth. We solve the bi-level optimization problem using the implicit differentiation technique. Moreover, we demonstrate the effectiveness of our leaning approach by applying the learned analysis operator (dictionary) to the image denoising task and comparing its performance with state-of-the-art methods. Under this unified framework, we can compare the performance of the two types of priors.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/11/2021

Dictionary and prior learning with unrolled algorithms for unsupervised inverse problems

Inverse problems consist in recovering a signal given noisy observations...
research
01/13/2014

Insights into analysis operator learning: From patch-based sparse models to higher-order MRFs

This paper addresses a new learning algorithm for the recently introduce...
research
12/15/2021

Supervised learning of analysis-sparsity priors with automatic differentiation

Sparsity priors are commonly used in denoising and image reconstruction....
research
02/20/2015

Supervised Dictionary Learning and Sparse Representation-A Review

Dictionary learning and sparse representation (DLSR) is a recent and suc...
research
08/23/2016

Deep Double Sparsity Encoder: Learning to Sparsify Not Only Features But Also Parameters

This paper emphasizes the significance to jointly exploit the problem st...
research
07/05/2023

Why can big.bi be changed to bi.gbi? A mathematical model of syllabification and articulatory synthesis

A simplified model of articulatory synthesis involving four stages is pr...
research
04/15/2018

White matter fiber analysis using kernel dictionary learning and sparsity priors

Diffusion magnetic resonance imaging, a non-invasive tool to infer white...

Please sign up or login with your details

Forgot password? Click here to reset