Thresholds of descending algorithms in inference problems

01/02/2020
by   Stefano Sarao Mannelli, et al.
27

We review recent works on analyzing the dynamics of gradient-based algorithms in a prototypical statistical inference problem. Using methods and insights from the physics of glassy systems, these works showed how to understand quantitatively and qualitatively the performance of gradient-based algorithms. Here we review the key results and their interpretation in non-technical terms accessible to a wide audience of physicists in the context of related works.

READ FULL TEXT

page 5

page 7

research
10/07/2020

A Robust Framework for Analyzing Gradient-Based Dynamics in Bilinear Games

In this work, we establish a frequency-domain framework for analyzing gr...
research
03/23/2017

Failures of Gradient-Based Deep Learning

In recent years, Deep Learning has become the go-to solution for a broad...
research
10/18/2017

Nonsmooth optimal value and policy functions for mechanical systems subject to unilateral constraints

State-of-the-art approaches to optimal control of contact-rich robot dyn...
research
09/26/2014

Gradient-based Taxis Algorithms for Network Robotics

Finding the physical location of a specific network node is a prototypic...
research
10/01/2022

Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition

This work analyzes the solution trajectory of gradient-based algorithms ...
research
11/08/2015

Statistical physics of inference: Thresholds and algorithms

Many questions of fundamental interest in todays science can be formulat...
research
07/19/2017

On recent advances in 2D Constrained Delaunay triangulation algorithms

In this article, recent works on 2D Constrained Delaunay triangulation(C...

Please sign up or login with your details

Forgot password? Click here to reset