research
∙
07/13/2022
Automatic Differentiation: Theory and Practice
We present the classical coordinate-free formalism for forward and backw...
share
research
∙
03/09/2022
Geometric Optimisation on Manifolds with Applications to Deep Learning
We design and implement a Python library to help the non-expert using al...
research
∙
10/09/2020
Adaptive and Momentum Methods on Manifolds Through Trivializations
Adaptive methods do not have a direct generalization to manifolds as the...
research
∙
08/06/2020
Curvature-Dependant Global Convergence Rates for Optimization on Manifolds of Bounded Geometry
We give curvature-dependant convergence rates for the optimization of we...
research
∙
09/20/2019
Trivializations for Gradient-Based Optimization on Manifolds
We introduce a framework to study the transformation of problems with ma...
research
∙
01/24/2019
Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Group
We introduce a novel approach to perform first-order optimization with o...
research
∙
12/21/2017