Bayesian Optimization for Selecting Efficient Machine Learning Models

08/02/2020
by   Lidan Wang, et al.
234

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal hyper-parameters during an iterative sequential process. However, most of the Bayesian Optimization algorithms are designed to select models for effectiveness only and ignore the important issue of model training efficiency. Given that both model effectiveness and training time are important for real-world applications, models selected for effectiveness may not meet the strict training time requirements necessary to deploy in a production environment. In this work, we present a unified Bayesian Optimization framework for jointly optimizing models for both prediction effectiveness and training efficiency. We propose an objective that captures the tradeoff between these two metrics and demonstrate how we can jointly optimize them in a principled Bayesian Optimization framework. Experiments on model selection for recommendation tasks indicate models selected this way significantly improves model training efficiency while maintaining strong effectiveness as compared to state-of-the-art Bayesian Optimization algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/24/2019

High Dimensional Restrictive Federated Model Selection with multi-objective Bayesian Optimization over shifted distributions

A novel machine learning optimization process coined Restrictive Federat...
research
12/06/2018

Progressive Sampling-Based Bayesian Optimization for Efficient and Automatic Machine Learning Model Selection

Purpose: Machine learning is broadly used for clinical data analysis. Be...
research
04/10/2019

ReinBo: Machine Learning pipeline search and configuration with Bayesian Optimization embedded Reinforcement Learning

Machine learning pipeline potentially consists of several stages of oper...
research
01/16/2015

Differentially Private Bayesian Optimization

Bayesian optimization is a powerful tool for fine-tuning the hyper-param...
research
05/03/2018

Graph Bayesian Optimization: Algorithms, Evaluations and Applications

Network structure optimization is a fundamental task in complex network ...
research
11/24/2019

Stage-based Hyper-parameter Optimization for Deep Learning

As deep learning techniques advance more than ever, hyper-parameter opti...
research
08/03/2021

Solving Fashion Recommendation – The Farfetch Challenge

Recommendation engines are integral to the modern e-commerce experience,...

Please sign up or login with your details

Forgot password? Click here to reset