Variational Autoencoding Neural Operators

02/20/2023
by   Jacob H. Seidman, et al.
0

Unsupervised learning with functional data is an emerging paradigm of machine learning research with applications to computer vision, climate modeling and physical systems. A natural way of modeling functional data is by learning operators between infinite dimensional spaces, leading to discretization invariant representations that scale independently of the sample grid resolution. Here we present Variational Autoencoding Neural Operators (VANO), a general strategy for making a large class of operator learning architectures act as variational autoencoders. For this purpose, we provide a novel rigorous mathematical formulation of the variational objective in function spaces for training. VANO first maps an input function to a distribution over a latent space using a parametric encoder and then decodes a sample from the latent distribution to reconstruct the input, as in classic variational autoencoders. We test VANO with different model set-ups and architecture choices for a variety of benchmarks. We start from a simple Gaussian random field where we can analytically track what the model learns and progressively transition to more challenging benchmarks including modeling phase separation in Cahn-Hilliard systems and real world satellite data for measuring Earth surface deformation.

READ FULL TEXT

page 21

page 22

page 23

page 24

page 25

page 26

page 28

page 29

research
07/16/2021

Machine-learning Kondo physics using variational autoencoders

We employ variational autoencoders to extract physical insight from a da...
research
06/09/2021

Multi-Facet Clustering Variational Autoencoders

Work in deep clustering focuses on finding a single partition of data. H...
research
04/15/2023

Learning in latent spaces improves the predictive accuracy of deep neural operators

Operator regression provides a powerful means of constructing discretiza...
research
06/07/2022

NOMAD: Nonlinear Manifold Decoders for Operator Learning

Supervised learning in function spaces is an emerging area of machine le...
research
07/25/2021

Invariance-based Multi-Clustering of Latent Space Embeddings for Equivariant Learning

Variational Autoencoders (VAEs) have been shown to be remarkably effecti...
research
12/18/2018

Sparsity in Variational Autoencoders

Working in high-dimensional latent spaces, the internal encoding of data...
research
02/07/2023

Learning bias corrections for climate models using deep neural operators

Numerical simulation for climate modeling resolving all important scales...

Please sign up or login with your details

Forgot password? Click here to reset