Few-Shot Meta-Denoising

07/31/2019
by   Leslie Casas, et al.
2

We study the problem of learning-based denoising where the training set contains just a handful of clean and noisy samples. A solution to mitigate the small training set issue is to train a denoising model with pairs of clean and synthesized noisy signals, produced from empirical noise priors; and finally only fine-tune on the available small training set. While transfer learning suits well to this pipeline, it does not generalize with the limited amount of training data. In this work, we propose a new training approach, based on meta-learning, for few-shot learning-based denoising problems. Our model is meta-trained using known synthetic noise models, and then fine-tuned with the small training set, with the real noise, as a few-shot learning task. Learning from synthetic data during meta-training gives us the ability to generate an infinite number of training data. Our approach is empirically shown to produce more accurate denoising results than supervised learning and transfer learning in three denoising evaluations for images and 1-D signals. Interestingly, our study provides strong indications that meta-learning has the potential to become the main learning algorithm for the denoising.

READ FULL TEXT

page 5

page 7

research
11/06/2022

Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning

Recent studies have revealed the intriguing few-shot learning ability of...
research
02/26/2020

Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalization

Real-noise denoising is a challenging task because the statistics of rea...
research
07/03/2021

Learning from scarce information: using synthetic data to classify Roman fine ware pottery

In this article we consider a version of the challenging problem of lear...
research
09/14/2022

Few Clean Instances Help Denoising Distant Supervision

Existing distantly supervised relation extractors usually rely on noisy ...
research
06/25/2021

A hybrid model-based and learning-based approach for classification using limited number of training samples

The fundamental task of classification given a limited number of trainin...
research
10/16/2020

Training Data Generating Networks: Linking 3D Shapes and Few-Shot Classification

We propose a novel 3d shape representation for 3d shape reconstruction f...
research
04/15/2022

Evaluating few shot and Contrastive learning Methods for Code Clone Detection

Context: Code Clone Detection (CCD) is a software engineering task that ...

Please sign up or login with your details

Forgot password? Click here to reset