Multi-Task Multicriteria Hyperparameter Optimization

02/15/2020
by   Kirill Akhmetzyanov, et al.
32

We present a new method for searching optimal hyperparameters among several tasks and several criteria. Multi-Task Multi Criteria method (MTMC) provides several Pareto-optimal solutions, among which one solution is selected with given criteria significance coefficients. The article begins with a mathematical formulation of the problem of choosing optimal hyperparameters. Then, the steps of the MTMC method that solves this problem are described. The proposed method is evaluated on the image classification problem using a convolutional neural network. The article presents optimal hyperparameters for various criteria significance coefficients.

READ FULL TEXT

page 6

page 7

page 8

page 9

page 10

research
12/30/2019

Pareto Multi-Task Learning

Multi-task learning is a powerful method for solving multiple correlated...
research
04/25/2019

Method for Searching of an Optimal Scenario of Impact in Cognitive Maps during Information Operations Recognition

In this paper, we consider the problem of choosing the optimal scenario ...
research
08/25/2022

A Globally Convergent Gradient-based Bilevel Hyperparameter Optimization Method

Hyperparameter optimization in machine learning is often achieved using ...
research
10/18/2022

Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models

In Multi-Task Learning, tasks may compete and limit the performance achi...
research
05/21/2020

HyperSTAR: Task-Aware Hyperparameters for Deep Networks

While deep neural networks excel in solving visual recognition tasks, th...
research
11/07/2016

Reinforcement-based Simultaneous Algorithm and its Hyperparameters Selection

Many algorithms for data analysis exist, especially for classification p...
research
04/22/2020

Tracing locally Pareto optimal points by numerical integration

We suggest a novel approach for the efficient and reliable approximation...

Please sign up or login with your details

Forgot password? Click here to reset