Scalable In Situ Compression of Transient Simulation Data Using Time-Dependent Bases

by   Shaghayegh Zamani Ashtiani, et al.

Large-scale simulations of time-dependent problems generate a massive amount of data and with the explosive increase in computational resources the size of the data generated by these simulations has increased significantly. This has imposed severe limitations on the amount of data that can be stored and has elevated the issue of input/output (I/O) into one of the major bottlenecks of high-performance computing. In this work, we present an in situ compression technique to reduce the size of the data storage by orders of magnitude. This methodology is based on time-dependent subspaces and it extracts low-rank structures from multidimensional streaming data by decomposing the data into a set of time-dependent bases and a core tensor. We derive closed-form evolution equations for the core tensor as well as the time-dependent bases. The presented methodology does not require the data history and the computational cost of its extractions scales linearly with the size of data – making it suitable for large-scale streaming datasets. To control the compression error, we present an adaptive strategy to add/remove modes to maintain the reconstruction error below a given threshold. We present four demonstration cases: (i) analytical example, (ii) incompressible unsteady reactive flow, (iii) stochastic turbulent reactive flow, and (iv) three-dimensional turbulent channel flow.



There are no comments yet.


page 14


On-the-fly Reduced Order Modeling of Passive and Reactive Species via Time-Dependent Manifolds

One of the principal barriers in developing accurate and tractable predi...

Reduced order modeling with time-dependent bases for PDEs with stochastic boundary conditions

Low-rank approximation using time-dependent bases (TDBs) has proven effe...

Time integration of tree tensor networks

Dynamical low-rank approximation by tree tensor networks is studied for ...

Maximizing simulated tropical cyclone intensity with action minimization

Direct computer simulation of intense tropical cyclones (TCs) in weather...

An adaptive model hierarchy for data-augmented training of kernel models for reactive flow

We consider machine-learning of time-dependent quantities of interest de...

Analytically Integratable Zero-restlength Springs for Capturing Dynamic Modes unrepresented by Quasistatic Neural Networks

We present a novel paradigm for modeling certain types of dynamic simula...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.