Agreement-based Learning

Model selection is a problem that has occupied machine learning researchers for a long time. Recently, its importance has become evident through applications in deep learning. We propose an agreement-based learning framework that prevents many of the pitfalls associated with model selection. It relies on coupling the training of multiple models by encouraging them to agree on their predictions while training. In contrast with other model selection and combination approaches used in machine learning, the proposed framework is inspired by human learning. We also propose a learning algorithm defined within this framework which manages to significantly outperform alternatives in practice, and whose performance improves further with the availability of unlabeled data. Finally, we describe a number of potential directions for developing more flexible agreement-based learning algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/01/2023

Subjectivity in Unsupervised Machine Learning Model Selection

Model selection is a necessary step in unsupervised machine learning. De...
research
05/01/2010

Joint Structured Models for Extraction from Overlapping Sources

We consider the problem of jointly training structured models for extrac...
research
06/15/2016

Agreement-based Learning of Parallel Lexicons and Phrases from Non-Parallel Corpora

We introduce an agreement-based approach to learning parallel lexicons a...
research
02/04/2014

Sequential Model-Based Ensemble Optimization

One of the most tedious tasks in the application of machine learning is ...
research
09/11/2019

Deep Elastic Networks with Model Selection for Multi-Task Learning

In this work, we consider the problem of instance-wise dynamic network m...
research
11/16/2021

Machine Learning-Assisted Analysis of Small Angle X-ray Scattering

Small angle X-ray scattering (SAXS) is extensively used in materials sci...

Please sign up or login with your details

Forgot password? Click here to reset