Recommending Learning Algorithms and Their Associated Hyperparameters

07/07/2014
by   Michael R. Smith, et al.
0

The success of machine learning on a given task dependson, among other things, which learning algorithm is selected and its associated hyperparameters. Selecting an appropriate learning algorithm and setting its hyperparameters for a given data set can be a challenging task, especially for users who are not experts in machine learning. Previous work has examined using meta-features to predict which learning algorithm and hyperparameters should be used. However, choosing a set of meta-features that are predictive of algorithm performance is difficult. Here, we propose to apply collaborative filtering techniques to learning algorithm and hyperparameter selection, and find that doing so avoids determining which meta-features to use and outperforms traditional meta-learning approaches in many cases.

READ FULL TEXT

page 1

page 2

research
05/28/2014

An Easy to Use Repository for Comparing and Improving Machine Learning Algorithm Usage

The results from most machine learning experiments are used for a specif...
research
02/11/2020

Towards better understanding of meta-features contributions

Meta learning is a difficult problem as the expected performance of a mo...
research
06/06/2018

Meta Learning by the Baldwin Effect

The scope of the Baldwin effect was recently called into question by two...
research
06/24/2023

Tuning structure learning algorithms with out-of-sample and resampling strategies

One of the challenges practitioners face when applying structure learnin...
research
07/07/2020

Auto-CASH: Autonomous Classification Algorithm Selection with Deep Q-Network

The great amount of datasets generated by various data sources have pose...
research
09/16/2019

Learning to Tune XGBoost with XGBoost

In this short paper we investigate whether meta-learning techniques can ...
research
01/04/2023

A Meta-Learning Algorithm for Interrogative Agendas

Explainability is a key challenge and a major research theme in AI resea...

Please sign up or login with your details

Forgot password? Click here to reset