Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysis

10/24/2022
by   Luca Galimberti, et al.
0

Deep learning (DL) is becoming indispensable to contemporary stochastic analysis and finance; nevertheless, it is still unclear how to design a principled DL framework for approximating infinite-dimensional causal operators. This paper proposes a "geometry-aware" solution to this open problem by introducing a DL model-design framework that takes a suitable infinite-dimensional linear metric spaces as inputs and returns a universal sequential DL models adapted to these linear geometries: we call these models Causal Neural Operators (CNO). Our main result states that the models produced by our framework can uniformly approximate on compact sets and across arbitrarily finite-time horizons Hölder or smooth trace class operators which causally map sequences between given linear metric spaces. Consequentially, we deduce that a single CNO can efficiently approximate the solution operator to a broad range of SDEs, thus allowing us to simultaneously approximate predictions from families of SDE models, which is vital to computational robust finance. We deduce that the CNO can approximate the solution operator to most stochastic filtering problems, implying that a single CNO can simultaneously filter a family of partially observed stochastic volatility models.

READ FULL TEXT

page 2

page 3

research
10/03/2019

On Universal Approximation by Neural Networks with Uniform Guarantees on Approximation of Infinite Dimensional Maps

The study of universal approximation of arbitrary functions f: X→Y by ne...
research
01/31/2022

Metric Hypertransformers are Universal Adapted Maps

We introduce a universal class of geometric deep learning models, called...
research
11/15/2022

Universal Time-Uniform Trajectory Approximation for Random Dynamical Systems with Recurrent Neural Networks

The capability of recurrent neural networks to approximate trajectories ...
research
04/26/2023

The Nonlocal Neural Operator: Universal Approximation

Neural operator architectures approximate operators between infinite-dim...
research
05/26/2023

Universal Approximation and the Topological Neural Network

A topological neural network (TNN), which takes data from a Tychonoff to...
research
09/08/2023

Online Infinite-Dimensional Regression: Learning Linear Operators

We consider the problem of learning linear operators under squared loss ...
research
02/07/2023

Deep-OSG: A deep learning approach for approximating a family of operators in semigroup to model unknown autonomous systems

This paper proposes a novel deep learning approach for approximating evo...

Please sign up or login with your details

Forgot password? Click here to reset