Zero-shot meta-learning for small-scale data from human subjects

03/29/2022
by   Julie Jiang, et al.
0

While developments in machine learning led to impressive performance gains on big data, many human subjects data are, in actuality, small and sparsely labeled. Existing methods applied to such data often do not easily generalize to out-of-sample subjects. Instead, models must make predictions on test data that may be drawn from a different distribution, a problem known as zero-shot learning. To address this challenge, we develop an end-to-end framework using a meta-learning approach, which enables the model to rapidly adapt to a new prediction task with limited training data for out-of-sample test data. We use three real-world small-scale human subjects datasets (two randomized control studies and one observational study), for which we predict treatment outcomes for held-out treatment groups. Our model learns the latent treatment effects of each intervention and, by design, can naturally handle multi-task predictions. We show that our model performs the best holistically for each held-out group and especially when the test group is distinctly different from the training group. Our model has implications for improved generalization of small-size human studies to the wider population.

READ FULL TEXT
research
10/20/2022

Boosting Natural Language Generation from Instructions with Meta-Learning

Recent work has shown that language models (LMs) trained with multi-task...
research
03/29/2022

Practical Aspects of Zero-Shot Learning

One of important areas of machine learning research is zero-shot learnin...
research
03/03/2021

Task Aligned Generative Meta-learning for Zero-shot Learning

Zero-shot learning (ZSL) refers to the problem of learning to classify i...
research
11/23/2022

Evolutionary Generalized Zero-Shot Learning

An open problem on the path to artificial intelligence is generalization...
research
01/24/2021

Meta-Regularization by Enforcing Mutual-Exclusiveness

Meta-learning models have two objectives. First, they need to be able to...
research
11/05/2015

Multinomial Loss on Held-out Data for the Sparse Non-negative Matrix Language Model

We describe Sparse Non-negative Matrix (SNM) language model estimation u...
research
11/24/2022

Shortcut Removal for Improved OOD-Generalization

Machine learning is a data-driven discipline, and learning success is la...

Please sign up or login with your details

Forgot password? Click here to reset