Multi-Objective Population Based Training

06/02/2023
by   Arkadiy Dushatskiy, et al.
0

Population Based Training (PBT) is an efficient hyperparameter optimization algorithm. PBT is a single-objective algorithm, but many real-world hyperparameter optimization problems involve two or more conflicting objectives. In this work, we therefore introduce a multi-objective version of PBT, MO-PBT. Our experiments on diverse multi-objective hyperparameter optimization problems (Precision/Recall, Accuracy/Fairness, Accuracy/Adversarial Robustness) show that MO-PBT outperforms random search, single-objective PBT, and the state-of-the-art multi-objective hyperparameter optimization algorithm MO-ASHA.

READ FULL TEXT
research
09/02/2015

A hybrid COA-DEA method for solving multi-objective problems

The Cuckoo optimization algorithm (COA) is developed for solving single-...
research
05/18/2022

Fair and Green Hyperparameter Optimization via Multi-objective and Multiple Information Source Bayesian Optimization

There is a consensus that focusing only on accuracy in searching for opt...
research
05/23/2022

Bézier Flow: a Surface-wise Gradient Descent Method for Multi-objective Optimization

In this paper, we propose a strategy to construct a multi-objective opti...
research
08/28/2018

A Particle Filter based Multi-Objective Optimization Algorithm: PFOPS

This letter is concerned with a recently developed paradigm of populatio...
research
12/13/2022

Multi-objective Tree-structured Parzen Estimator Meets Meta-learning

Hyperparameter optimization (HPO) is essential for the better performanc...
research
07/29/2021

Multi-objective optimization and explanation for stroke risk assessment in Shanxi province

Stroke is the top leading causes of death in China (Zhou et al. The Lanc...
research
06/15/2022

Multi-Objective Hyperparameter Optimization – An Overview

Hyperparameter optimization constitutes a large part of typical modern m...

Please sign up or login with your details

Forgot password? Click here to reset