Adaptive Latent Space Tuning for Non-Stationary Distributions

05/08/2021

∙

Powerful deep learning tools, such as convolutional neural networks (CNN), are able to learn the input-output relationships of large complicated systems directly from data. Encoder-decoder deep CNNs are able to extract features directly from images, mix them with scalar inputs within a general low-dimensional latent space, and then generate new complex 2D outputs which represent complex physical phenomenon. One important challenge faced by deep learning methods is large non-stationary systems whose characteristics change quickly with time for which re-training is not feasible. In this paper we present a method for adaptive tuning of the low-dimensional latent space of deep encoder-decoder style CNNs based on real-time feedback to quickly compensate for unknown and fast distribution shifts. We demonstrate our approach for predicting the properties of a time-varying charged particle beam in a particle accelerator whose components (accelerating electric fields and focusing magnetic fields) are also quickly changing with time.

READ FULL TEXT

Adaptive Latent Space Tuning for Non-Stationary Distributions

Adaptive Machine Learning for Time-Varying Systems: Low Dimensional Latent Space Tuning

Interpretable Deep Learning Model for the Detection and Reconstruction of Dysarthric Speech

IntroVAC: Introspective Variational Classifiers for Learning Interpretable Latent Subspaces

A Generative deep learning approach for shape recognition of arbitrary objects from phaseless acoustic scattering data

Improving Generalization of Sequence Encoder-Decoder Networks for Inverse Imaging of Cardiac Transmembrane Potential

Analytic Manifold Learning: Unifying and Evaluating Representations for Continuous Control

Adaptive Sensing for Learning Nonstationary Environment Models

Adaptive Latent Space Tuning for Non-Stationary Distributions

Related Research

Adaptive Machine Learning for Time-Varying Systems: Low Dimensional Latent Space Tuning

Interpretable Deep Learning Model for the Detection and Reconstruction of Dysarthric Speech

IntroVAC: Introspective Variational Classifiers for Learning Interpretable Latent Subspaces

A Generative deep learning approach for shape recognition of arbitrary objects from phaseless acoustic scattering data

Improving Generalization of Sequence Encoder-Decoder Networks for Inverse Imaging of Cardiac Transmembrane Potential

Analytic Manifold Learning: Unifying and Evaluating Representations for Continuous Control

Adaptive Sensing for Learning Nonstationary Environment Models