Loss Functions and Metrics in Deep Learning. A Review

07/05/2023
by   Juan Terven, et al.
0

One of the essential components of deep learning is the choice of the loss function and performance metrics used to train and evaluate models. This paper reviews the most prevalent loss functions and performance measurements in deep learning. We examine the benefits and limits of each technique and illustrate their application to various deep-learning problems. Our review aims to give a comprehensive picture of the different loss functions and performance indicators used in the most common deep learning tasks and help practitioners choose the best method for their specific task.

READ FULL TEXT
research
01/13/2023

A survey and taxonomy of loss functions in machine learning

Most state-of-the-art machine learning techniques revolve around the opt...
research
01/16/2021

DeepMI: A Mutual Information Based Framework For Unsupervised Deep Learning of Tasks

In this work, we propose an information theory based framework DeepMI to...
research
07/04/2019

Deep Saliency Models : The Quest For The Loss Function

Recent advances in deep learning have pushed the performances of visual ...
research
03/25/2021

AutoLoss-Zero: Searching Loss Functions from Scratch for Generic Tasks

Significant progress has been achieved in automating the design of vario...
research
03/27/2022

Benchmarking Deep AUROC Optimization: Loss Functions and Algorithmic Choices

The area under the ROC curve (AUROC) has been vigorously applied for imb...
research
07/23/2020

Adma: A Flexible Loss Function for Neural Networks

Highly increased interest in Artificial Neural Networks (ANNs) have resu...
research
04/30/2021

Applying physics-based loss functions to neural networks for improved generalizability in mechanics problems

Physics-Informed Machine Learning (PIML) has gained momentum in the last...

Please sign up or login with your details

Forgot password? Click here to reset