Image denoising is a well studied problem with an extensive activity that has
spread over several decades. Despite the many available denoising algorithms,
the quest for simple, powerful and fast denoisers is still an active and
vibrant topic of research. Leading classical denoising methods are typically
designed to exploit the inner structure in images by modeling local overlapping
patches. In contrast, recent newcomers to this arena are supervised
neural-network-based methods that bypass this modeling altogether, targeting
the inference goal directly and globally, while tending to be very deep and
parameter heavy.
This work proposes a novel low-weight learnable architecture that embeds in
it several of the main concepts from the classical methods, while being trained
for best denoising performance. More specifically, our proposed network relies
on patch processing, leveraging non-local self-similarity, representation
sparsity and a multiscale treatment. The proposed architecture achieves near
state-of-the-art denoising results, while using a small fraction of the typical
number of parameters. Furthermore, we demonstrate the ability of the proposed
network to adapt itself to an incoming image by leveraging similar clean ones.
Image denoising is a well studied problem, and many successful algorithms have been developed for handling this task over the years, e.g. NLM [1], KSVD [7], BM3D [4], EPLL [37], WNNM [9] and others [25, 15, 33, 6, 21, 18, 10, 24, 29, 31, 27, 19]. These classically-oriented algorithms strongly rely on models that exploit properties of natural images, usually employed while operating on small fully overlapped patches. For example, both EPLL [37] and PLE [33]
perform denoising using Gaussian Mixture Modeling (GMM) imposed on the image patches. The K-SVD algorithm
[7] restores images using a sparse modeling of such patches. BM3D [4] exploits self-similarity by grouping similar patches to 3D blocks and filtering them jointly. The algorithms reported in [27, 19] harness a multi-scale analysis framework on top of the above-mentioned local models.
Recently, supervised deep-learning based methods entered the denoising arena, showing state-of-the-art (SOTA) results in various contexts
[2, 3, 30, 34, 16, 35, 23, 28, 14, 36, 13]. In contrast to the above-mentioned classical algorithms, deep-learning based methods tend to bypass the need for an explicit modeling of image redundancies, operating instead by directly learning the inference from the incoming images to their desired outputs. In order to obtain a non-local flavor in their treatment, as self-similarity or multi-scale methods would do, most of these algorithms ([13] being an exception) tend to increase their footprint by utilizing very deep and parameter heavy networks. These reflect badly on their memory consumption, the required amount of training images and the time for training and inference.
(a)Clean image
(b)Noisy (σ=50)
(c)Denoised (before adapting)
PSNR = 24.33dB
(d)Denoised (after adapting)
PSNR = 26.25dB
Fig. 1: Example of our adaptation approach: (a) and (b) show the clean and noisy images respectively; (c) is the denoised result by our universal architecture trained on 432 BSD500 images [17]; (d) presents our adapted result, using a single astronomical image (shown in Figure 15(a)).
An interesting recent line of work by Lefkimmiatis proposes a denoising network with a significantly reduced number of parameters, while persisting on near SOTA performance [11, 12]. This method leverages the non-local self-similarity property of images by jointly operating on groups of similar patches. The network’s architecture consists of several repeated stages, each resembling a single step of the proximal gradient descent method under sparse modeling [20]. In comparison with DnCNN [34], the work reported in [11, 12] shows a reduction by factor of 14 in the number of parameters, while achieving denoising PSNR that is only ∼0.2 dB lower.
Inspired by Lefkimmiatis’ work, in this paper we continue with his line of low-weight networks and propose a novel, easy, and learnable architecture that harnesses several main concepts from classical methods: (i) Operating on small fully overlapping patches; (ii) Exploiting non-local self-similarity; (iii) Leveraging representation sparsity; and (iv) Employing a multi-scale treatment. Our network resembles the one proposed in [11, 12], with several important differences:
We introduce a multi-scale treatment in our network that combats spatial artifacts, especially noticeable in smooth regions [27]. While this change does not reflect strongly on the PSNR results, it has a clear visual contribution;
Our network is more effective by operating in the residual domain, similar to the approach taken by [34];
Our patch fusion operator includes a spatial smoothing, which adds an extra force to our overall filtering; and
Our architecture is trained end-to-end, whereas Lefkimiatis’s scheme consists of a greedy training of the separate layers, followed by an end-to-end warm-start update.
, our proposed method operates on all the overlapping patches taken from the processed image by augmenting each with its nearest neighbors and filtering these jointly. The patch grouping stage is applied only once before any filtering, and it is not a part of the learnable architecture. Each patch group undergoes a series of trainable steps that aim to predict the noise in the candidate patch, thereby operating in the residual domain. These include several layers of the triplet (i) a linear separable transform, (ii) a ReLU on the features obtained, and (iii) an inverse transform for returning to the image domain. As already mentioned above, our scheme includes a multi-scale treatment, in which we fuse the processing of corresponding patches from different scales.
This paper has two key contributions:
The proposed architecture preserves the low-weight form of
[11, 12]
while improving on the visual and PSNR qualities of the reconstructed images.
Leveraging the low-weight nature of our network, we propose a novel ability of adapting our trained network to the content of the treated image, boosting this way its denoising performance. This is obtained by denoising the incoming image regularly, seeking few similar images to the outcome, updating the trained network to their content, and then running the denoising again. We show the tendency of this approach to lead to improved denoising performance, as demonstrated in Figure 1.
This paper is organized as follows. In section II we describe the proposed scheme and its various ingredients. Section III presents experimental results and compares our method to other recently published methods. In Section IV we introduce the ability of our low-weight network to adapt to an incoming image by finding similar ones to it, and get a boost in the denoising performance.
Section V concludes this paper and raises directions for a future work.
Ii The Proposed Denoising Scheme
Ii-a Overall Algorithm Overview
Our proposed method extracts all possible overlapping patches of size √n×√n from the processed image, and cleans each in a similar way. The final reconstructed image is obtained by combining these restored patches via averaging. The algorithm is shown schematically in Figure 2.
Fig. 2: The proposed denoising Algorithm starts by extracting all possible overlapping patches and their corresponding reduced-scale ones. Each patch is augmented with its k−1 nearest neighbors and filtered, while fusing information from both scales. The reconstructed image is obtained by combining all the filtered patches via averaging.
In order to formulate the patch extraction, combination and filtering operations, we introduce some notations. Assume that the processed image is of size M×N. We denote by Y,^Y∈RMN
the noisy and denoised images respectively, both reshaped to a 1D vector. Similarly, the corrupted and restored patches in location
i are denoted by zi,^zi∈Rn respectively, where i=1,…,MN.***
Note that we handle boundary pixels by padding the processed image using mirror reflection with
⌊√n/2⌋ pixels from each side. Thus, the number of extracted patches is equal to the number of pixels in the image.Ri denotes the matrix that extracts a patch centered at the i-th location. The patch extraction operation from the noisy image is given by zi=RiY, and the denoised image is obtained by combining the denoised patches {^zi} using weighted averaging,
^Y=(∑iwiRTiRi)−1∑iwiRTi^zi,
(1)
where smooth patches get higher weights. More precisely,
Zooming in on the local treatment, it starts by augmenting the patch zi with a group of its k−1 nearest neighbors, forming a matrix Zi of size n×k. The nearest neighbor search is done using a Euclidean metric, d(zi,zj)=∥∥zi−zj∥∥22, limited to a search window of size b×b around the center of the patch.
The matrix Zi undergoes a series of trainable operations that aim to recover a clean candidate patch ^zi
. Our filtering network consists of several blocks, each consisting of (i) a forward 2D linear transform; (ii) a non-negative thresholding (ReLU) on the obtained features; and (iii) a transform back to the image domain. All transforms operate separately in the spatial and the similarity domains. In contrast to BM3D and other methods, our filtering predicts the residual rather than the clean patches, just as done in
. This means that we estimate the noise using the network. Restored patches are obtained by subtracting the estimated noise from the corrupted patches.
Our scheme includes a multi-scale treatment and a fusion of corresponding patches from the different scales. The adopted strategy borrows its rationale from [32]
, which studied the single image super resolution task. In their algorithm, high-resolution patches and their corresponding low-resolution versions are jointly treated by assuming that they share the same sparse representation. The two resolution patches are handled by learning a pair of coupled dictionaries. In a similar fashion, we augment the corresponding patches from the two scales, and learn a joint transform for their fusion. In our experiments, the multi-scale scheme includes only two scales, but the same concept can be applied to a higher pyramid. In our notations, the 1
st scale is the original noisy image Y, and the 2nd scale images are created by convolving Y with the low-pass filter
fLP=116[121]T⋅[121]
(3)
and down-sampling the result by a factor of two. In order to synchronize between patch locations in the two scales, we create four downscaled images by sampling the convolved image at either even or odd locations:
Y(2)ee,Y(2)eo,Y(2)oe,Y(2)oo (even/odd columns & even/odd rows). For each 1st scale patch, the corresponding 2nd scale patch (of the same size √n×√n) is extracted from the appropriate down-sampled image, such that both patches are centred at the same pixel in the original image, as depicted in Figure 3.
Fig. 3: Visualization of the corresponding 1st and 2nd scale patches: Blue dots are the processed image pixels; the green square is a 1st scale patch, while the red square is its corresponding 2nd scale patch. Both are of size 7×7 pixels.
We denote the 2nd scale patch that corresponds to zi by z(2)i∈Rn. This patch is augmented with a group of its k−1 nearest neighbors, forming a matrix Z(2)i of size n×k. The nearest neighbor search is performed in the same down-scaled image from which z(2)i is taken, while limiting the search to a window of size b×b. Both matrices, {Zi} and {Z(2)i}, are fed to the filtering network, which fuses the scales using a joint transform. The architecture of this network is described next.
Ii-C The Filtering Network
We turn to present the architecture of the filtering network, starting by describing the involved building blocks and then discussing the whole scheme. A basic component within our network is the TRT (Transform–ReLU–Transform) block. This follows the classic Thresholding algorithm in sparse approximation theory [8] in which denoising is obtained by transforming the incoming signal, discarding of small entries (this way getting a sparse representation), and applying an inverse transform that returns to the signal domain. Note that the same conceptual structure is employed by the well-known BM3D algorithm [4].
In a similar fashion, our TRT block applies a learned transform, non-negative thresholding (ReLU) and another transform on the resulting matrix. Both transforms are separable and linear, denoted by the operator T and implemented using a Separable Linear (SL) layer,
T(Z)=SL(Z)=W1ZW2+B,
(4)
where W1 and W2 operate in the spatial and the similarity domains respectively. Separability of the SL layer allows a substantial reduction in the number of parameters of the network. In fact, computing W1ZW2 is equivalent to applying Wtotalz, where Wtotal=WT2⊗W1 is a Kronecker product between WT2 and W1, and z is a vectorized version of Z.
Since concatenation of two SL layers can be replaced by a single effective SL, due to their linearity, we remove one SL layer in any concatenation of two TRT-s, as shown in Figure 4.
The TRT component without the second transform is denoted by TR, and when concatenating kTRT-s, the first k−1 blocks should be replaced by TR-s. Another variant we use in our network is TBR, which is a version of TR
Fig. 4: Concatenation of two TRTs: One SL layer is removed due to linearity, converting the first TRT block into TR.
Another component of the filtering network is an Aggregation block (AGG), depicted in Figure 5.
This block imposes consistency between overlapping patches {zi} by combining them to a temporary image xtmp using plain averaging (as described in Eq. (1) but without the weights),
and extracting them back from the obtained image by Rixtmp.
Fig. 5: Aggregation (AGG) block.
The complete architecture of the filtering network is presented in Figure 6. The network receives as input two sets of matrices, {Zi} and {Z(2)i}, and its output is an array of filtered overlapping patches {^zi}. At first, each of these matrices is multiplied by a diagonal weight matrix diag(wi)Zi.
Recall that the columns of Zi (or {Z(2)i}) are image patches, where the first is the processed patch and the rest are its neighbors. The weights wi express the network’s belief regarding the relevance of each of the neighbor patches to the denoising process. These weights are calculated using an auxiliary network denoted as “weight net”, which consists of seven FC (Fully Connected) layers of size k×k with batch normalization and ReLU between each two FC’s. The network gets as input the sample variance of the processed patch and k−1 squared distances between the patch and its nearest neighbors.
TR0
TBR1
Tpre
TRpost
TBR2
TBR3
T4
TR(2)0
TBR(2)1
T(2)pre
TR(2)post
W1
49×64
64×64
64×49
49×64
64×64
64×64
64×49
W2
14×14
14×14
14×1
1×14
56×56
56×56
56×1
Fig. 6: The filtering network. The table below summarizes the sizes of the SL layers.
After multiplication by diag(wi) the Zi matrix undergoes a series of operations that include transforms, ReLUs and AGG, until it gets to the TBR2 block, as shown in Figure 6. The aggregation block imposes consistency of the {Zi} matrices, which represent overlapping patches, but also causes loss of some inf.ormation, therefore we split the flow to two branches: with and without AGG. Since the output of any TR or TBR component is in the feature domain, we wrap the AGG block with Tpre and TRpost, where Tpre transforms the features to the image domain, and TRpost transforms the AGG output back to the feature space, while imposing sparsity. The 2nd scale matrices, {Z(2)i}, undergo very similar operations as the 1st scale ones, but with different learned parameters. The only difference in the treatment of the two scales is in the functionality of the aggregation blocks. Since the AGG(2) operates on downsampled patches, combination and extraction is done with stride=2. Additionally, AGG(2) applies bilinear low-pass filter as defined in Equation (3) on the temporary image obtained after the patch combination.
The TBR2 block applies a joint transform that fuses the features coming from four origins: the 1st and 2nd scales with and without aggregation. The columns of all these matrices are concatenated together such that the same spatial transformation W1 is applied on all. Note that the network size can be reduced at the cost of a slight degradation in performance by removing the TBR1, TBR(2)1 and TBR3 components. We discuss this option in the result section.
Iii Experimental Results
This section reports the performance of the proposed scheme, with a comprehensive comparison to recent SOTA denoising algorithms. In particular, we include in these comparisons the classical BM3D [4] due to its resemblance to our network architecture, the TNRD [3], DnCNN [34] and FFDNet [35] networks, the non-local and high performance NLRN [13] architecture, and the recently published Learned K-SVD (LKSVD) [26] method. We also include comparisons to Lefkimiatis’ networks, NLNet [11] and UNLNet [12], which inspired our work. Our algorithm is denoted as Non-Local Multi-Scale (NLMS), and we present two versions of it, NLMS and NLMS-S. The second is a simplified network with slightly weaker performance (see more below).
Iii-a Denoising with Known Noise Level
We start with plain denoising experiments, in which the noise is Gaussian white of known variance. This is the common case covered by all the above mentioned methods.
Our network is trained on 432 images from the BSD500 set [17], and the evaluation uses the remaining 68 images (BSD68). The network is trained end-to-end using decreasing learning rate over batches of 4 images, using the mean-squared-error loss. We start training with the Adam optimizer with a learning rate of 10−2, and switch to SGD at the last part of the training with an initial learning rate of 10−3.
Figure 7 presents a comparison between our algorithm and leading alternative ones by presenting their PSNR performance versus their number of trained parameters. This figure exposes the fact that the performance of denoising networks is heavily influenced by their complexity. As can be seen, the various algorithms can be roughly split into two categories: low-weight architectures with a number of parameters below 100K (TNRD [3], LKSVD [26], NLNet [11] and UNLNet†††UNLNet is a blind denoising network trained for 5≤σ<30. [12]), and much larger and slightly better performing networks (DnCNN [34], FFDNet [35], and NLRN [13]) that use hundreds of thousands of parameters. As we proceed in this section, we emphasize low-weight architectures in our comparisons, a category to which our network belongs. Figure 7 shows that our networks (both NLMS and NLMS-S) achieve the best results within this low-weight category.
Fig. 7: Comparing denoising networks: PSNR performance vs. the number of trained parameters (for noise level σ=25).
Detailed quantitative denoising results per noise level are reported‡‡‡ NLNet [11] complexity and PSNR are taken from the released code. in Table I. For each noise level, the best denoising performance is marked in red, and the best performance within the low-weight category is marked in blue. Table II reports the number of trained parameters per each of the competing networks. Figures 8, 9, 10 and 11 present examples of denoising results. Since our architecture is related to both BM3D and NLNet, we focus on qualitative comparisons with these algorithms. For all noise levels our results are significantly sharper, contain less artifacts and preserve more details than those of BM3D. In comparison to NLNet, our method is significantly better in high noise levels due to our multi-scale treatment, recovering large and repeating elements, as shown in Figure 7(p). In fact our algorithm manages to recover repeating elements better than all methods presented in Figure 8 except NLRN.
In addition, in cases of high noise levels, the multi-scale treatment allows handling smooth areas with less artifacts than NLNet, as one can see from the results in Figure 8(p) and 8(o). In medium noise levels, our algorithm recovers more details, while NLNet tends to over-smooth the recovered image. For example, see the Elephant skin in Figure 10 and the mountain glacier in Figure 11.
For denoising of color images we use 3D patches of size 5×5×3 and increase the size of the matrices W1 from (49×64, 64×64, 64×49) to (75×80, 80×80, 80×75) accordingly, which increases the total number of our network’s parameters to 94K. The nearest neighbor search is done using the Luminance component, Y=0.2989R+0.5870G+0.1140B. Quantitative denoising results are reported in Table III, where our network is denoted as CNLMS (Color NLMS). As can be seen, our network is the best within the low-weight category, and gets quite close to the CDnCNN performance [34]. Figures 12 and 13 present examples of denoising results which show that CNLMS handles low frequency noise better than CBM3D and CNLNet due to its multi-scale treatment.
Blind denoising, i.e., denoising with unknown noise level, is a useful feature when it comes to neural networks. This allows using a fixed network for performing image denoising, while serving a range of noise levels. This is a more practical solution, when compared to the one discussed above, in which we have designed a series of networks, each trained for a particular σ. We report blind denoising performance of our architecture and compare to similar results by DnCNN-b [34] (a version of DnCNN that has been trained for a range of σ values) and UNLNet [12]. Our blind denoising network (denoted NLMS-b) preserves all its structure, but simply trained by mixing noise level examples in the range 10≤σ≤30. The evaluation of all three networks is performed on images with σ=[15,25]. The results of this experiment are brought in Table IV. As can be seen, our method obtains a higher PSNR than UNLNet, while being slightly weaker than DnCNN-b. Considering again the fact that our network has nearly 10% of the parameters of DnCNN-b, we can say that our approach leads to SOTA results in the low-weight category.
Our NLMS denoising network can be further simplified by removing the TBR1, TBR(2)1 and TBR3 components. The resulting smaller network, denoted by NLMS-S, contains 30% less parameters than the original NLMS architecture (see Table II), while achieving slightly weaker performance. Table V shows that for both regular and blind denoising scenarios, NLMS-S achieves an average PSNR that is only 0.05dB lower than the full-size NLMS network. Denoising examples are presented in Figure 14, showing that the visual quality gap between NLMS and NLMS-S is marginal.
Method
Noise σ
Average
15
25
50
NLMS
31.62
29.11
26.17
28.97
NLMS-S
31.57
29.08
26.13
28.93
NLMS-b
31.54
29.06
–
30.30
NLMS-S-b
31.49
29.01
–
30.25
TABLE V: Performance comparison between NLMS and its smaller version, NLMS-S.
(a)Original
(b)Noisy with σ=15
(c)NLMS
PSNR = 29.38dB
(d)NLMS-S
PSNR = 29.34dB
(e)Original
(f)Noisy with σ=25
(g)NLMS
PSNR = 28.96dB
(h)NLMS-S
PSNR = 28.89dB
Fig. 14: Comparison between full and small versions of the NLMS network.
Iv Network Adaptation for Better Denoising
A network trained on a set of general natural images might fail to obtain high quality results when applied to images that are not well represented in the training set. For example, applying our network on astronomical or text images creates pronounced artifacts, as can be seen in Figures 16(g) and 17(g), as these images contain specific structures that are atypical of natural images. The work reported in [22, 23] suggest training class-aware denoisers, showing that they lead to better performance. However, this approach requires a large amount of images for training each class (e.g. [22, 23] train their networks on 900 images per class), and holding many networks for covering the variety of classes to handle.
In this work we propose a different approach: Instead of learning class-aware denoisers, we adapt the above described universal network, which has been trained on natural images, to handle incoming images with special content. Adaptation is obtained by first denoising the input image regularly, then seeking (e.g., using Google image search) few closely related images to it, and then re-training the network on this small set of clean images. This process concludes by denoising the input image by the updated network. An advantage of low-weight schemes is their ability to be retrained on small amounts of data without overfitting. Indeed, we present experiments in which our network (NLMS) is updated with a single similar image. The training images used for our experiments are shown in Figure 16. In each experiment, except the text, the network has been trained over 500 batches of 4 cropped sub-images with random offsets, which takes about 6-7 minutes on Nvidia GeForce GTX 1080 Ti GPU. The adaptation does not require early stopping of the training, i.e. training the network over tens of thousands of batches leads to similar and even better results. Since the statistics of the text images is distant from that of natural images, the adaptation of the network takes more time. In our experiment, training has been done over 6300 batches. In accordance with the long training time, this adaptation gains more than 4dB improvement in PSNR, where improvement of 2.8dB is achieved with only 400 batches, as shown in Figure 15.
The first two experiments, presented in Figures 17 and 18, show adaptation examples for non-natural images: astronomical and text images. As can be seen in Figures 16(g), 17(g), the denoising results achieved by NLMS before adaptation are poor. However, adapting the network by training on a single similar image (different training image for each experiment) significantly improves both PSNR and the visual quality of the results. When it comes to natural images, our regular trained network usually achieves satisfactory results that are harder to improve. However, even in such cases, the denoising quality might be boosted by adapting the network using one similar image, as indeed shown in the experiments presented in Figures 19 and 20. Adapting the network leads to PSNR improvement of more than 0.25dB.
Fig. 15: PSNR vs. number of batches for the text image adaptation experiment.
(a)Astronomical (800×570)
(b)Brick house (631×650)
(c)Text (703×354)
(d)Whale shark (1101×401)
Fig. 16: Training images for the network adaptation experiments. Actual sizes of the images are included.
(a)Clean astronomical
(800×570)
(b)Noisy with σ=50
(c)Denoised
(before adaptation)
PSNR = 26.44dB
(d)Denoised
(after adaptation)
PSNR = 28.04dB
(e)Clean
(f)Noisy
(g)Denoised
(before adaptation)
(h)Denoised
(after adaptation)
Fig. 17: An example of network adaptation for astronomical images.
(a)Clean text (704×356)
(b)Noisy with σ=50
(c)Denoised
(before adaptation)
PSNR = 22.52dB
(d)Denoised
(after adaptation)
PSNR = 26.78dB
(e)Clean text
(f)Noisy
(g)Denoised
(before adaptation)
(h)Denoised
(after adaptation)
Fig. 18: An example of network adaptation for text images.
(a)Clean house
(801×701)
(b)Noisy house
with σ=50
(c)Denoised
(before adaptation)
PSNR = 27.06dB
(d)Denoised
(after adaptation)
PSNR = 27.47dB
(e)Clean text
(f)Noisy
(g)Denoised
(before adaptation)
(h)Denoised
(after adaptation)
Fig. 19: An example of network adaptation for brick house images.
(a)Clean shark
(721×670)
(b)Noisy shark
with σ=50
(c)Denoised
(before adaptation)
PSNR = 27.87dB
(d)Denoised
(after adaptation)
PSNR = 28.14dB
(e)Absolute difference between the results
Fig. 20: An example of network adaptation for whale shark images. The difference is scaled by factor 3 for better visibility.
V Conclusion
This work presents a low-weight network for supervised image denoising. Our patch-based architecture exploits non-local self-similarity and representation sparsity, augmented by a multiscale treatment. Separable linear layers, combined with non-local k neighbor search, allow capturing non-local interrelations between pixels using small number of learned parameters. The proposed network achieves SOTA results in the low-weight category, and competitive performance overall. In addition, the presented network can be adapted to incoming noisy images by a re-training on similar images, leading to boosted denoising performance. In our future work we intend to extend the algorithm to treat color images, and other noise models. In addition, we believe that the architecture composed could be found effective in more challenging inverse problems.
References
[1]A. Buades, B. Coll, and J. Morel (2005)A non-local algorithm for image denoising.
In
[2]H. C. Burger, C. J. Schuler, and S. Harmeling (2012)Image denoising: can plain neural networks compete with bm3d?.
In 2012 IEEE conference on computer vision and pattern recognition,
pp. 2392–2399.
Cited by: §I.
[3]Y. Chen, W. Yu, and T. Pock (2015)On learning optimized reaction diffusion processes for effective image restoration.
In Proceedings of the IEEE conference on computer vision and pattern recognition,
pp. 5261–5269.
Cited by: §I,
10(f),
7(f),
8(f),
9(f),
§III-A,
TABLE I,
§III.
[4]K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian (2007-08)Image denoising by sparse 3-d transform-domain collaborative filtering.
Image Processing, IEEE Transactions on16 (8), pp. 2080–2095.
External Links: Document,
ISSN 1057-7149Cited by: §I,
§II-C,
10(d),
7(d),
8(d),
9(d),
TABLE I,
§III.
[5]K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian (2007)Color image denoising via sparse 3d collaborative filtering with grouping constraint in luminance-chrominance space.
In 2007 IEEE International Conference on Image Processing,
Vol. 1, pp. I–313.
Cited by: 11(d),
12(d),
TABLE III.
[6]W. Dong, L. Zhang, G. Shi, and X. Li (2012)Nonlocally centralized sparse representation for image restoration.
IEEE transactions on Image Processing22 (4), pp. 1620–1630.
Cited by: §I.
[7]M. Elad and M. Aharon (2006-12)Image denoising via sparse and redundant representations over learned dictionaries.
Image Processing, IEEE Transactions on15 (12), pp. 3736–3745.
External Links: Document,
ISSN 1057-7149Cited by: §I.
[8]M. Elad (2010)Sparse and redundant representations: from theory to applications in signal and image processing.
Springer Science & Business Media.
Cited by: §II-C.
[9]S. Gu, L. Zhang, W. Zuo, and X. Feng (2014)Weighted nuclear norm minimization with application to image denoising.
In Proceedings of the IEEE conference on computer vision and pattern recognition,
pp. 2862–2869.
Cited by: §I.
[10]A. Kheradmand and P. Milanfar (2014-12)A general framework for regularized, similarity-based image restoration.
Image Processing, IEEE Transactions on23 (12), pp. 5136–5151.
External Links: Document,
ISSN 1057-7149Cited by: §I.
[12]S. Lefkimmiatis (2018)Universal denoising networks: a novel cnn architecture for image denoising.
In Proceedings of the IEEE conference on computer vision and pattern recognition,
pp. 3204–3213.
Cited by: item 1,
§I,
§I,
§I,
§III-A,
§III-B,
TABLE IV,
§III.
[13]D. Liu, B. Wen, Y. Fan, C. C. Loy, and T. S. Huang (2018)Non-local recurrent network for image restoration.
In Advances in Neural Information Processing Systems,
pp. 1673–1682.
Cited by: §I,
10(e),
7(e),
8(e),
9(e),
§III-A,
TABLE I,
§III.
[14]P. Liu, H. Zhang, K. Zhang, L. Lin, and W. Zuo (2018)Multi-level wavelet-cnn for image restoration.
In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops,
pp. 773–782.
Cited by: §I.
[15]J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman (2009-Sept)Non-local sparse models for image restoration.
In Computer Vision, 2009 IEEE 12th International Conference on,
pp. 2272–2279.
External Links: Document,
ISSN 1550-5499Cited by: §I.
[16]X. Mao, C. Shen, and Y. Yang (2016)Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections.
In Advances in neural information processing systems,
pp. 2802–2810.
Cited by: §I.
[17]D. Martin, C. Fowlkes, D. Tal, and J. Malik (2001-07)A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics.
In Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001,
Vol. 2, pp. 416–423 vol.2.
External Links: Document,
ISSN Cited by: Fig. 1,
§III-A.
[18]P. Milanfar (2013-01)A tour of modern image filtering: new insights and methods, both practical and theoretical.
Signal Processing Magazine, IEEE30 (1), pp. 106–128.
External Links: Document,
ISSN 1053-5888Cited by: §I.
[19]V. Papyan and M. Elad (2015)Multi-scale patch-based image restoration.
IEEE Transactions on image processing25 (1), pp. 249–261.
Cited by: §I.
[20]N. Parikh, S. Boyd, et al. (2014)Proximal algorithms.
Foundations and Trends® in Optimization1 (3), pp. 127–239.
Cited by: §I.
[21]I. Ram, M. Elad, and I. Cohen (2013-07)Image processing using smooth ordering of its patches.
Image Processing, IEEE Transactions on22 (7), pp. 2764–2774.
External Links: Document,
ISSN 1057-7149Cited by: §I.
[22]T. Remez, O. Litany, R. Giryes, and A. M. Bronstein (2017)Deep class-aware image denoising.
In 2017 international conference on sampling theory and applications (SampTA),
pp. 138–142.
Cited by: §IV.
[23]T. Remez, O. Litany, R. Giryes, and A. M. Bronstein (2018)Class-aware fully convolutional gaussian and poisson denoising.
IEEE Transactions on Image Processing27 (11), pp. 5707–5722.
Cited by: §I,
§IV.
[24]Y. Romano and M. Elad (2015)Boosting of image denoising algorithms.
SIAM Journal on Imaging Sciences8 (2), pp. 1187–1219.
Cited by: §I.
[25]S. Roth and M. J. Black (2009)Fields of experts.
International Journal of Computer Vision82 (2), pp. 205.
Cited by: §I.
[26]M. Scetbon, M. Elad, and P. Milanfar (2019)Deep k-svd denoising.
External Links: 1909.13164Cited by: §III-A,
§III.
[27]J. Sulam, B. Ophir, and M. Elad (2014)Image denoising through multi-scale learnt dictionaries.
In 2014 IEEE International Conference on Image Processing (ICIP),
pp. 808–812.
Cited by: 1st item,
§I.
[28]Y. Tai, J. Yang, X. Liu, and C. Xu (2017)Memnet: a persistent memory network for image restoration.
In Proceedings of the IEEE international conference on computer vision,
pp. 4539–4547.
Cited by: §I.
[29]G. Vaksman, M. Zibulevsky, and M. Elad (2016)Patch ordering as a regularization for inverse problems in image processing.
SIAM Journal on Imaging Sciences9 (1), pp. 287–319.
Cited by: §I.
[30]Z. Wang, D. Liu, J. Yang, W. Han, and T. Huang (2015)Deep networks for image super-resolution with sparse prior.
In Proceedings of the IEEE international conference on computer vision,
pp. 370–378.
Cited by: §I.
[31]N. Yair and T. Michaeli (2018-06)Multi-scale weighted nuclear norm image restoration.
In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR),
Cited by: §I.
[32]J. Yang, J. Wright, T.S. Huang, and Y. Ma (2010-11)Image super-resolution via sparse representation.
Image Processing, IEEE Transactions on19 (11), pp. 2861–2873.
External Links: Document,
ISSN 1057-7149Cited by: §II-B.
[33]G. Yu, G. Sapiro, and S. Mallat (2012-05)Solving inverse problems with piecewise linear estimators: from gaussian mixture models to structured sparsity.
Image Processing, IEEE Transactions on21 (5), pp. 2481–2499.
External Links: Document,
ISSN 1057-7149Cited by: §I.
[35]K. Zhang, W. Zuo, and L. Zhang (2018)FFDNet: toward a fast and flexible solution for cnn-based image denoising.
IEEE Transactions on Image Processing27 (9), pp. 4608–4622.
Cited by: §I,
11(e),
12(e),
§III-A,
TABLE III,
§III.
[36]Y. Zhang, Y. Tian, Y. Kong, B. Zhong, and Y. Fu (2018)Residual dense network for image restoration.
arXiv preprint arXiv:1812.10477.
Cited by: §I.
[37]D. Zoran and Y. Weiss (2011-11)From learning models of natural image patches to whole image restoration.
In Computer Vision (ICCV), 2011 IEEE International Conference on,
pp. 479–486.
External Links: Document,
ISSN 1550-5499Cited by: §I.
share
