Unlocking massively parallel spectral proper orthogonal decompositions in the PySPOD package

09/21/2023
by   Marcin Rogowski, et al.
0

We propose a parallel (distributed) version of the spectral proper orthogonal decomposition (SPOD) technique. The parallel SPOD algorithm distributes the spatial dimension of the dataset preserving time. This approach is adopted to preserve the non-distributed fast Fourier transform of the data in time, thereby avoiding the associated bottlenecks. The parallel SPOD algorithm is implemented in the PySPOD (https://github.com/MathEXLab/PySPOD) library and makes use of the standard message passing interface (MPI) library, implemented in Python via mpi4py (https://mpi4py.readthedocs.io/en/stable/). An extensive performance evaluation of the parallel package is provided, including strong and weak scalability analyses. The open-source library allows the analysis of large datasets of interest across the scientific community. Here, we present applications in fluid dynamics and geophysics, that are extremely difficult (if not impossible) to achieve without a parallel algorithm. This work opens the path toward modal analyses of big quasi-stationary data, helping to uncover new unexplored spatio-temporal patterns.

READ FULL TEXT

page 16

page 17

research
10/06/2003

Poster on MPI application in Computational Fluid Dynamics

Poster-presentation of the paper "Message Passing Fluids: molecules as p...
research
08/26/2022

Generalized and Multiscale Modal Analysis

This chapter describes modal decompositions in the framework of matrix f...
research
11/15/2017

Hydra: a C++11 framework for data analysis in massively parallel platforms

Hydra is a header-only, templated and C++11-compliant framework designed...
research
02/11/2016

High performance Python for direct numerical simulations of turbulent flows

Direct Numerical Simulations (DNS) of the Navier Stokes equations is an ...
research
08/19/2021

PyParSVD: A streaming, distributed and randomized singular-value-decomposition library

We introduce PyParSVD[https://github.com/Romit-Maulik/PyParSVD], a Pytho...
research
04/17/2023

MFGLib: A Library for Mean-Field Games

Mean-field games (MFGs) are limiting models to approximate N-player game...
research
11/14/2022

FLUPS – a flexible and performant massively parallel Fourier transform library

Massively parallel Fourier transforms are widely used in computational s...

Please sign up or login with your details

Forgot password? Click here to reset