Improving Pareto Front Learning via Multi-Sample Hypernetworks

12/02/2022
by   Long Phi Hoang, et al.
0

Pareto Front Learning (PFL) was recently introduced as an effective approach to obtain a mapping function from a given trade-off vector to a solution on the Pareto front, which solves the multi-objective optimization (MOO) problem. Due to the inherent trade-off between conflicting objectives, PFL offers a flexible approach in many scenarios in which the decision makers can not specify the preference of one Pareto solution over another, and must switch between them depending on the situation. However, existing PFL methods ignore the relationship between the solutions during the optimization process, which hinders the quality of the obtained front. To overcome this issue, we propose a novel PFL framework namely , which employs a hypernetwork to generate multiple solutions from a set of diverse trade-off preferences and enhance the quality of the Pareto front by maximizing the Hypervolume indicator defined by these solutions. The experimental results on several MOO machine learning tasks show that the proposed framework significantly outperforms the baselines in producing the trade-off Pareto front.

READ FULL TEXT
research
08/04/2023

Optimization on Pareto sets: On a theory of multi-objective optimization

In multi-objective optimization, a single decision vector must balance t...
research
02/08/2021

Multi-Objective Learning to Predict Pareto Fronts Using Hypervolume Maximization

Real-world problems are often multi-objective with decision-makers unabl...
research
08/29/2022

Generalization In Multi-Objective Machine Learning

Modern machine learning tasks often require considering not just one but...
research
10/08/2020

Learning the Pareto Front with Hypernetworks

Multi-objective optimization problems are prevalent in machine learning....
research
03/24/2021

Efficient Multi-Objective Optimization for Deep Learning

Multi-objective optimization (MOO) is a prevalent challenge for Deep Lea...
research
06/21/2023

Post-hoc Selection of Pareto-Optimal Solutions in Search and Recommendation

Information Retrieval (IR) and Recommender Systems (RS) tasks are moving...
research
07/18/2018

Cross-layer Optimization for High Speed Adders: A Pareto Driven Machine Learning Approach

In spite of maturity to the modern electronic design automation (EDA) to...

Please sign up or login with your details

Forgot password? Click here to reset