DeepAI AI Chat
Log In Sign Up

Learning with Fenchel-Young Losses

01/08/2019
by   Mathieu Blondel, et al.
Mathieu Blondel
Unbabel Inc.
0

Over the past decades, numerous loss functions have been been proposed for a variety of supervised learning tasks, including regression, classification, ranking, and more generally structured prediction. Understanding the core principles and theoretical properties underpinning these losses is key to choose the right loss for the right problem, as well as to create new losses which combine their strengths. In this paper, we introduce Fenchel-Young losses, a generic way to construct a convex loss function for a regularized prediction function. We provide an in-depth study of their properties in a very broad setting, covering all the aforementioned supervised learning tasks, and revealing new connections between sparsity, generalized entropies, and separation margins. We show that Fenchel-Young losses unify many well-known loss functions and allow to create useful new ones easily. Finally, we derive efficient predictive and training algorithms, making Fenchel-Young losses appealing both in theory and practice.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/24/2018

Learning Classifiers with Fenchel-Young Losses: Generalized Entropies, Margins, and Algorithms

We study in this paper Fenchel-Young losses, a generic way to construct ...
05/19/2022

Learning Energy Networks with Generalized Fenchel-Young Losses

Energy-based models, a.k.a. energy networks, perform inference by optimi...
10/24/2019

Structured Prediction with Projection Oracles

We propose in this paper a general framework for deriving loss functions...
02/10/2020

Supervised Learning: No Loss No Cry

Supervised learning requires the specification of a loss function to min...
06/08/2020

All your loss are belong to Bayes

Loss functions are a cornerstone of machine learning and the starting po...
03/10/2020

Learning State-Dependent Losses for Inverse Dynamics Learning

Being able to quickly adapt to changes in dynamics is paramount in model...
01/27/2023

LegendreTron: Uprising Proper Multiclass Loss Learning

Loss functions serve as the foundation of supervised learning and are of...

Code Repositories

fenchel-young-losses

Probabilistic classification in PyTorch/TensorFlow/scikit-learn with Fenchel-Young losses


view repo