Stable Neural Flows

03/18/2020
by   Stefano Massaroli, et al.
0

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on asymptotic stability of the depth-flows, leading to robustness against input perturbations and low computational burden for the numerical solver. The learning procedure is cast as an optimal control problem, and an approximate solution is proposed based on adjoint sensivity analysis. We further introduce novel regularizers designed to ease the optimization process and speed up convergence. The proposed model class is evaluated on non-linear classification and function approximation tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/05/2023

On the numerical stability of discretised Optimal Control Problems

Optimal Control Problems consist on the optimisation of an objective fun...
research
10/25/2020

ImitationFlow: Learning Deep Stable Stochastic Dynamic Systems by Normalizing Flows

We introduce ImitationFlow, a novel Deep generative model that allows le...
research
07/24/2020

High order, semi-implicit, energy stable schemes for gradient flows

We introduce a class of high order accurate, semi-implicit Runge-Kutta s...
research
02/14/2022

Input-to-State Stable Neural Ordinary Differential Equations with Applications to Transient Modeling of Circuits

This paper proposes a class of neural ordinary differential equations pa...
research
06/07/2021

Differentiable Multiple Shooting Layers

We detail a novel class of implicit neural models. Leveraging time-paral...
research
01/14/2021

Optimal Energy Shaping via Neural Approximators

We introduce optimal energy shaping as an enhancement of classical passi...
research
04/02/2019

Augmented Neural ODEs

We show that Neural Ordinary Differential Equations (ODEs) learn represe...

Please sign up or login with your details

Forgot password? Click here to reset