Recommending Learning Algorithms and Their Associated Hyperparameters

by   Michael R. Smith, et al.
Brigham Young University

The success of machine learning on a given task dependson, among other things, which learning algorithm is selected and its associated hyperparameters. Selecting an appropriate learning algorithm and setting its hyperparameters for a given data set can be a challenging task, especially for users who are not experts in machine learning. Previous work has examined using meta-features to predict which learning algorithm and hyperparameters should be used. However, choosing a set of meta-features that are predictive of algorithm performance is difficult. Here, we propose to apply collaborative filtering techniques to learning algorithm and hyperparameter selection, and find that doing so avoids determining which meta-features to use and outperforms traditional meta-learning approaches in many cases.


page 1

page 2


An Easy to Use Repository for Comparing and Improving Machine Learning Algorithm Usage

The results from most machine learning experiments are used for a specif...

Towards better understanding of meta-features contributions

Meta learning is a difficult problem as the expected performance of a mo...

Meta Learning by the Baldwin Effect

The scope of the Baldwin effect was recently called into question by two...

Tuning structure learning algorithms with out-of-sample and resampling strategies

One of the challenges practitioners face when applying structure learnin...

Auto-CASH: Autonomous Classification Algorithm Selection with Deep Q-Network

The great amount of datasets generated by various data sources have pose...

Learning to Tune XGBoost with XGBoost

In this short paper we investigate whether meta-learning techniques can ...

A Meta-Learning Algorithm for Interrogative Agendas

Explainability is a key challenge and a major research theme in AI resea...

Please sign up or login with your details

Forgot password? Click here to reset