LGM-Net: Learning to Generate Matching Networks for Few-Shot Learning

05/15/2019
by   Huaiyu Li, et al.
0

In this work, we propose a novel meta-learning approach for few-shot classification, which learns transferable prior knowledge across tasks and directly produces network parameters for similar unseen tasks with training samples. Our approach, called LGM-Net, includes two key modules, namely, TargetNet and MetaNet. The TargetNet module is a neural network for solving a specific task and the MetaNet module aims at learning to generate functional weights for TargetNet by observing training samples. We also present an intertask normalization strategy for the training process to leverage common information shared across different tasks. The experimental results on Omniglot and miniImageNet datasets demonstrate that LGM-Net can effectively adapt to similar unseen tasks and achieve competitive performance, and the results on synthetic datasets show that transferable prior knowledge is learned by the MetaNet module via mapping training data to functional weights. LGM-Net enables fast learning and adaptation since no further tuning steps are required compared to other meta-learning approaches.

READ FULL TEXT
research
06/13/2019

Learning to Forget for Meta-Learning

Few-shot learning is a challenging problem where the system is required ...
research
02/27/2020

Is the Meta-Learning Idea Able to Improve the Generalization of Deep Neural Networks on the Standard Supervised Learning?

Substantial efforts have been made on improving the generalization abili...
research
04/06/2023

Learning to Learn with Indispensable Connections

Meta-learning aims to solve unseen tasks with few labelled instances. Ne...
research
06/06/2023

GSHOT: Few-shot Generative Modeling of Labeled Graphs

Deep graph generative modeling has gained enormous attraction in recent ...
research
06/18/2022

EEML: Ensemble Embedded Meta-learning

To accelerate learning process with few samples, meta-learning resorts t...
research
11/10/2020

Fast Slow Learning: Incorporating Synthetic Gradients in Neural Memory Controllers

Neural Memory Networks (NMNs) have received increased attention in recen...
research
09/02/2020

Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype Prediction

Current machine learning has made great progress on computer vision and ...

Please sign up or login with your details

Forgot password? Click here to reset