All unconstrained strongly convex problems are weakly simplicial

06/24/2021
by   Yusuke Mizota, et al.
0

A multi-objective optimization problem is C^r weakly simplicial if there exists a C^r surjection from a simplex onto the Pareto set/front such that the image of each subsimplex is the Pareto set/front of a subproblem, where 0≤ r≤∞. This property is helpful to compute a parametric-surface approximation of the entire Pareto set and Pareto front. It is known that all unconstrained strongly convex C^r problems are C^r-1 weakly simplicial for 1≤ r ≤∞. In this paper, we show that all unconstrained strongly convex problems are C^0 weakly simplicial. The usefulness of this theorem is demonstrated in a sparse modeling application: we reformulate the elastic net as a non-differentiable multi-objective strongly convex problem and approximate its Pareto set (the set of all trained models with different hyper-parameters) and Pareto front (the set of performance metrics of the trained models) by using a Bézier simplex fitting method, which accelerates hyper-parameter search.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/04/2023

Optimization on Pareto sets: On a theory of multi-objective optimization

In multi-objective optimization, a single decision vector must balance t...
research
04/18/2017

Simple Problems: The Simplicial Gluing Structure of Pareto Sets and Pareto Fronts

Quite a few studies on real-world applications of multi-objective optimi...
research
10/14/2022

Efficiently Controlling Multiple Risks with Pareto Testing

Machine learning applications frequently come with multiple diverse obje...
research
06/17/2019

Asymptotic Risk of Bezier Simplex Fitting

The Bezier simplex fitting is a novel data modeling technique which expl...
research
09/13/2022

Pareto Driven Surrogate (ParDen-Sur) Assisted Optimisation of Multi-period Portfolio Backtest Simulations

Portfolio management is a multi-period multi-objective optimisation prob...
research
04/10/2021

Approximate Bayesian Computation of Bézier Simplices

Bézier simplex fitting algorithms have been recently proposed to approxi...
research
12/01/2018

On Bi-Objective convex-quadratic problems

In this paper we analyze theoretical properties of bi-objective convex-q...

Please sign up or login with your details

Forgot password? Click here to reset