Identifiability, the KL property in metric spaces, and subgradient curves

05/05/2022
by   Adrian Lewis, et al.
0

Identifiability, and the closely related idea of partial smoothness, unify classical active set methods and more general notions of solution structure. Diverse optimization algorithms generate iterates in discrete time that are eventually confined to identifiable sets. We present two fresh perspectives on identifiability. The first distills the notion to a simple metric property, applicable not just in Euclidean settings but to optimization over manifolds and beyond; the second reveals analogous continuous-time behavior for subgradient descent curves. The Kurdya-Lojasiewicz property typically governs convergence in both discrete and continuous time: we explore its interplay with identifiability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/05/2018

Continuous-time Models for Stochastic Optimization Algorithms

We propose a new continuous-time formulation for first-order stochastic ...
research
05/04/2023

The complexity of first-order optimization methods from a metric perspective

A central tool for understanding first-order optimization algorithms is ...
research
01/27/2014

A continuous-time approach to online optimization

We consider a family of learning strategies for online optimization prob...
research
01/25/2022

Jacobian Computation for Cumulative B-splines on SE(3) and Application to Continuous-Time Object Tracking

In this paper we propose a method that estimates the SE(3) continuous tr...
research
05/04/2021

Continuous indetermination and average likelihood minimization

The authors transpose a discrete notion of indetermination coupling in t...
research
12/10/2019

Accelerated Sampling on Discrete Spaces with Non-Reversible Markov Processes

We consider the task of MCMC sampling from a distribution defined on a d...
research
09/10/2019

Computer Assisted Composition in Continuous Time

We address the problem of combining sequence models of symbolic music wi...

Please sign up or login with your details

Forgot password? Click here to reset