Minimizing Dynamic Regret on Geodesic Metric Spaces

02/17/2023
by   Zihao Hu, et al.
0

In this paper, we consider the sequential decision problem where the goal is to minimize the general dynamic regret on a complete Riemannian manifold. The task of offline optimization on such a domain, also known as a geodesic metric space, has recently received significant attention. The online setting has received significantly less attention, and it has remained an open question whether the body of results that hold in the Euclidean setting can be transplanted into the land of Riemannian manifolds where new challenges (e.g., curvature) come into play. In this paper, we show how to get optimistic regret bound on manifolds with non-positive curvature whenever improper learning is allowed and propose an array of adaptive no-regret algorithms. To the best of our knowledge, this is the first work that considers general dynamic regret and develops "optimistic" online learning algorithms which can be employed on geodesic metric spaces.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/17/2021

From the Greene–Wu Convolution to Gradient Estimation over Riemannian Manifolds

Over a complete Riemannian manifold of finite dimension, Greene and Wu i...
research
11/02/2014

Geodesic Exponential Kernels: When Curvature and Linearity Conflict

We consider kernel methods on general geodesic metric spaces and provide...
research
07/06/2020

On the minmax regret for statistical manifolds: the role of curvature

Model complexity plays an essential role in its selection, namely, by ch...
research
03/26/2021

Online learning with exponential weights in metric spaces

This paper addresses the problem of online learning in metric spaces usi...
research
06/29/2023

Curvature-Independent Last-Iterate Convergence for Games on Riemannian Manifolds

Numerous applications in machine learning and data analytics can be form...
research
06/14/2012

On Local Regret

Online learning aims to perform nearly as well as the best hypothesis in...
research
05/06/2023

SINCERE: Sequential Interaction Networks representation learning on Co-Evolving RiEmannian manifolds

Sequential interaction networks (SIN) have been commonly adopted in many...

Please sign up or login with your details

Forgot password? Click here to reset