Generalized Huber Loss for Robust Learning and its Efficient Minimization for a Robust Statistics

08/28/2021
by   Kaan Gokcesu, et al.
0

We propose a generalized formulation of the Huber loss. We show that with a suitable function of choice, specifically the log-exp transform; we can achieve a loss function which combines the desirable properties of both the absolute and the quadratic loss. We provide an algorithm to find the minimizer of such loss functions and show that finding a centralizing metric is not that much harder than the traditional mean and median.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/11/2017

A More General Robust Loss Function

We present a two-parameter loss function which can be viewed as a genera...
research
02/22/2022

Nonconvex Extension of Generalized Huber Loss for Robust Learning and Pseudo-Mode Statistics

We propose an extended generalization of the pseudo Huber loss formulati...
research
03/05/2020

Mean absolute deviations about the mean, the cut norm and taxicab correspondence analysis

Optimization has two faces, minimization of a loss function or maximizat...
research
02/05/2021

The Fourier Loss Function

This paper introduces a new loss function induced by the Fourier-based M...
research
06/21/2023

Modile as a conservative tail risk measurer: the solution of an optimisation problem with 0-1 loss function

Quantiles and expectiles, which are two important concepts and tools in ...
research
11/05/2019

An Alternative Probabilistic Interpretation of the Huber Loss

The Huber loss is a robust loss function used for a wide range of regres...
research
12/27/2019

SoftAdapt: Techniques for Adaptive Loss Weighting of Neural Networks with Multi-Part Loss Functions

Adaptive loss function formulation is an active area of research and has...

Please sign up or login with your details

Forgot password? Click here to reset