Robust Meta Learning for Image based tasks

01/30/2023
by   Penghao Jiang, et al.
0

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we learn an optimal model in training data, it could have better generalization performance in testing tasks. However, learning such a model is not possible in standard machine learning frameworks as the distribution of the test data is unknown. To tackle this challenge, we propose a novel robust meta-learning method, which is more robust to the image-based testing tasks which is unknown and has distribution shifts with training tasks. Our robust meta-learning method can provide robust optimal models even when data from each distribution are scarce. In experiments, we demonstrate that our algorithm not only has better generalization performance but also robust to different unknown testing tasks.

READ FULL TEXT
research
05/30/2019

Meta Dropout: Learning to Perturb Features for Generalization

A machine learning model that generalizes well should obtain low errors ...
research
02/13/2020

Learn to Expect the Unexpected: Probably Approximately Correct Domain Generalization

Domain generalization is the problem of machine learning when the traini...
research
06/08/2019

Using learned optimizers to make models robust to input noise

State-of-the art vision models can achieve superhuman performance on ima...
research
06/08/2021

Robust Generalization despite Distribution Shift via Minimum Discriminating Information

Training models that perform well under distribution shifts is a central...
research
03/24/2021

Meta-Learned Invariant Risk Minimization

Empirical Risk Minimization (ERM) based machine learning algorithms have...
research
04/10/2023

Meta Compositional Referring Expression Segmentation

Referring expression segmentation aims to segment an object described by...
research
03/06/2023

MetaPhysiCa: OOD Robustness in Physics-informed Machine Learning

A fundamental challenge in physics-informed machine learning (PIML) is t...

Please sign up or login with your details

Forgot password? Click here to reset