Meta Clustering for Collaborative Learning

by   Chenglong Ye, et al.

An emerging number of learning scenarios involve a set of learners/analysts each equipped with a unique dataset and algorithm, who may collaborate with each other to enhance their learning performance. From the perspective of a particular learner, a careless collaboration with task-irrelevant other learners is likely to incur modeling error. A crucial problem is to search for the most appropriate collaborators so that their data and modeling resources can be effectively leveraged. Motivated by this, we propose to study the problem of `meta clustering', where the goal is to identify subsets of relevant learners whose collaboration will improve the performance of each individual learner. In particular, we study the scenario where each learner is performing a supervised regression, and the meta clustering aims to categorize the underlying supervised relations (between responses and predictors) instead of the raw data. We propose a general method named as Select-Exchange-Cluster (SEC) for performing such a clustering. Our method is computationally efficient as it does not require each learner to exchange their raw data. We prove that the SEC method can accurately cluster the learners into appropriate collaboration sets according to their underlying regression functions. Synthetic and real data examples show the desired performance and wide applicability of SEC to a variety of learning tasks.


page 1

page 2

page 3

page 4


MxML: Mixture of Meta-Learners for Few-Shot Classification

A meta-model is trained on a distribution of similar tasks such that it ...

MTL2L: A Context Aware Neural Optimiser

Learning to learn (L2L) trains a meta-learner to assist the learning of ...

MetaKG: Meta-learning on Knowledge Graph for Cold-start Recommendation

A knowledge graph (KG) consists of a set of interconnected typed entitie...

Selecting Data Adaptive Learner from Multiple Deep Learners using Bayesian Networks

A method to predict time-series using multiple deep learners and a Bayes...

Model Linkage Selection for Cooperative Learning

Rapid developments in data collecting devices and computation platforms ...

Assisted Learning and Imitation Privacy

Motivated by the emerging needs of decentralized learners with personali...

Fostering learners' self-regulation and collaboration skills and strategies for mobile language learning beyond the classroom

Many language learners need to be supported in acquiring a second or for...