The α-divergence Improves the Entropy Production Estimation via Machine Learning

03/06/2023
by   Euijoon Kwon, et al.
0

Recent years have seen a surge of interest in the algorithmic estimation of stochastic entropy production (EP) from the trajectory data via machine learning. A crucial element of such algorithms is the identification of a loss function whose minimization guarantees the accurate EP estimation. In this study, we show that there exists a host of loss functions, namely those implementing a variational representation of the α-divergence, which can be used for the EP estimation. Among these loss functions, the one corresponding to α = -0.5 exhibits the most robust performance against strong nonequilibrium driving or slow dynamics, which adversely affects the existing method based on the Kullback-Leibler divergence (α = 0). To corroborate our findings, we present an exactly solvable simplification of the EP estimation problem, whose loss function landscape and stochastic properties demonstrate the optimality of α = -0.5.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2022

Hybridised Loss Functions for Improved Neural Network Generalisation

Loss functions play an important role in the training of artificial neur...
research
02/07/2021

Tilting the playing field: Dynamical loss functions for machine learning

We show that learning can be improved by using loss functions that evolv...
research
01/13/2023

A survey and taxonomy of loss functions in machine learning

Most state-of-the-art machine learning techniques revolve around the opt...
research
07/07/2021

On Codomain Separability and Label Inference from (Noisy) Loss Functions

Machine learning classifiers rely on loss functions for performance eval...
research
10/22/2019

Penalizing small errors using an Adaptive Logarithmic Loss

Loss functions are error metrics that quantify the difference between a ...
research
12/27/2019

SoftAdapt: Techniques for Adaptive Loss Weighting of Neural Networks with Multi-Part Loss Functions

Adaptive loss function formulation is an active area of research and has...
research
06/15/2018

On the exact minimization of saturated loss functions for robust regression and subspace estimation

This paper deals with robust regression and subspace estimation and more...

Please sign up or login with your details

Forgot password? Click here to reset