Stochastic dynamical modeling of turbulent flows

by   Armin Zare, et al.
University of Southern California

Advanced measurement techniques and high performance computing have made large data sets available for a wide range of turbulent flows that arise in engineering applications. Drawing on this abundance of data, dynamical models can be constructed to reproduce structural and statistical features of turbulent flows, opening the way to the design of effective model-based flow control strategies. This review describes a framework for completing second-order statistics of turbulent flows by models that are based on the Navier-Stokes equations linearized around the turbulent mean velocity. Systems theory and convex optimization are combined to address the inherent uncertainty in the dynamics and the statistics of the flow by seeking a suitable parsimonious correction to the prior linearized model. Specifically, dynamical couplings between states of the linearized model dictate structural constraints on the statistics of flow fluctuations. Thence, colored-in-time stochastic forcing that drives the linearized model is sought to account for and reconcile dynamics with available data (i.e., partially known second order statistics). The number of dynamical degrees of freedom that are directly affected by stochastic excitation is minimized as a measure of model parsimony. The spectral content of the resulting colored-in-time stochastic contribution can alternatively be seen to arise from a low-rank structural perturbation of the linearized dynamical generator, pointing to suitable dynamical corrections that may account for the absence of the nonlinear interactions in the linearized model.



page 1

page 9

page 12

page 14

page 16

page 19

page 20


Deep Dynamical Modeling and Control of Unsteady Fluid Flows

The design of flow control systems remains a challenge due to the nonlin...

Second-order flows for computing the ground states of rotating Bose-Einstein condensates

Second-order flows in this paper refer to some artificial evolutionary d...

A Low-rank Solver for the Stochastic Unsteady Navier-Stokes Problem

We study a low-rank iterative solver for the unsteady Navier-Stokes equa...

Flow-driven spectral chaos (FSC) method for long-time integration of second-order stochastic dynamical systems

For decades, uncertainty quantification techniques based on the spectral...

A change of measure enhanced near exact Euler Maruyama scheme for the solution to nonlinear stochastic dynamical systems

The present study utilizes the Girsanov transformation based framework f...

The high-dimensional asymptotics of first order methods with random data

We study a class of deterministic flows in ℝ^d× k, parametrized by a ran...

Model-Based Learning of Turbulent Flows using Mobile Robots

In this paper we consider the problem of model-based learning of turbule...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction

Turbulent flows are at the center of many key processes in nature and in engineering applications. Energy dissipation caused by turbulent fluctuations around airplanes, ships, and submarines increases resistance to motion (i.e., skin-friction drag) and fuel consumption and compromises the performance of vehicles. This motivates the design of flow control strategies for the improved performance of air and water vehicles and other systems that involve turbulent flows [1, 2].

Models that are based on the Navier-Stokes (NS) equations capture the dynamics and statistical features of fluid flows. However, these models are given by 3D nonlinear PDEs and they involve a number of degrees of freedom that is prohibitively large for analysis and control synthesis [3, 4]. Moreover, to this day, a detailed understanding of the mechanisms responsible for the dissipation of energy in turbulent flows is missing. As a result, traditional flow control techniques are largely empirical, and they rely on physical intuition, numerical simulations, and experiments. Even though these provide invaluable insights, they are costly, time-consuming, and are not suitable for model-based controller design.

Direct numerical simulation (DNS) offers a computational approach to finding a solution to the NS equations. At moderate Reynolds numbers DNS provides important insight into structural and statistical features of turbulent flows but computational complexity increases roughly as the cube of the Reynolds number and DNS becomes prohibitively expensive in most flow regimes that are encountered in engineering practice [3]

. An alternative to DNS has been to either fully resolve large-scale 3D turbulent flow structures and to model the impact of smaller scales or to focus on statistical signatures of turbulent flows, i.e., the mean flow components and their higher-order moments. The former approach gives rise to large-eddy simulation (LES) which relies on modeling the impact of small unresolved physical scales 

[5], and the latter forms the basis for statistical theory of turbulence [6]. While LES accurately captures large-scale unsteady motions that dominate flows around air and water vehicles, its computational cost is still too high for it to be incorporated into aerodynamic design [4]. Since an exact set of dynamical equations that govern the evolution of statistics of turbulent flows does not exist, the statistical theory of turbulence aims to develop approximate mathematical models for turbulent flows [7]. Indeed, recent research suggests that conventional techniques can be significantly enhanced using low-complexity models that are convenient for real-time control design and optimization [8].

In general, modeling can be seen as an inverse problem where a search in parameter space aims to identify a parsimonious representation of data. For turbulent flows, the advent of advanced measurement techniques and high performance parallel computing has resulted in large data sets for a wide range of flow configurations and speeds. Tapping on this abundance of data, dynamical models can be constructed to reproduce structural and statistical features of turbulent flows.

The prevalence of coherent structures in turbulent wall-bounded shear flows [9, 10, 11, 12] has inspired the development of data-driven techniques for reduced-order modeling of turbulent flows [13, 14, 15, 16, 17, 18]. However, unreliable measurements and data anomalies challenge a sole reliance on data as such models are agnostic to the underlying physics. Furthermore, control actuation and sensing may significantly alter the identified modes in unpredictable ways. This compromises the performance of data-driven models in regimes that were not accounted for in the training process and introduces nontrivial challenges for model-based control design [19, 20]. A promising alternative is to leverage the underlying physics in the form of a prior model that arises from first principles, e.g., linearization of the NS equations around stable flow states. The subject of this review is to highlight recent developments in combining data-driven techniques with systems theory and optimization to enhance predictive capabilities of physics-based dynamical models.

Over the last three decades, important dynamical aspects of transitional and turbulent flows have been captured by the analysis of the linearized NS equations. Specifically, the non-normality of the linearized dynamical generator introduces interactions among exponentially decaying normal modes [21, 22]. This property has been used to explain high flow sensitivity in the early stages of transition and to identify key mechanisms for subcritical transition to turbulence; even in the absence of modal instability, bypass routes to transition can be triggered by large transient growth [23, 24, 25, 26, 27] or large amplification of deterministic and stochastic disturbances [21, 28, 29, 30, 31, 32]. Similar amplification mechanisms have been observed for the linearized NS equations around the turbulent mean velocity [30, 33, 34, 35, 36]

. Additional insights into the geometric scaling of dominant modes over various flow conditions have been provided by low-order representations resulting from singular value decomposition of the associated frequency response operator 

[36, 37, 38].

The nonlinear terms in the NS equations play an important role in the growth of flow fluctuations, transition to turbulence, and in sustaining turbulent flow. Since these terms are conservative, they do not contribute to the transfer of energy between the mean flow and velocity fluctuations, but they transfer energy between different spatio-temporal Fourier modes [39, 7]. This feature has inspired modeling the effect of nonlinearity using additive forcing to the linearized equations that govern the dynamics of fluctuations. Early efforts in this direction focused on modeling homogeneous isotropic turbulence [40, 41, 42, 43]. Stochastically-forced linearized NS equations were later used to model heat and momentum fluxes as well as spatio-temporal spectra in quasi-geostrophic turbulence [44, 45, 46], while structural features of wall-bounded turbulent flows were captured using the spatio-temporal frequency responses of the linearized NS equations [28, 29, 30, 31, 36, 47, 48, 49]. In these studies, forcing is used to model exogenous excitation sources and uncertain initial conditions, as well as to replicate the effects of the nonlinear terms in the full NS equations.

This review explains how stochastic dynamical models can enhance the linearized NS equations so as to accurately replicate observed statistical features of turbulent flows. This is accomplished by bringing together tools from systems theory and convex optimization in order to suitably shape the power spectrum of additive stochastic forcing into the dynamical equations. We focus on replicating second-order statistics and cast the corresponding model identification as a convex optimization problem. The resulting stochastic component can be linked to a structural (low-rank) perturbation of the dynamical generator suggesting suitable correction to account for the absence of the nonlinear interactions.

The review is organized as follows. In Section 2, we provide the background on the NS equations and turbulence modeling. In Section 3, we introduce the stochastically-forced linearized NS equations and describe structural constraints on admissible state covariances and input power spectra. In Section 5, we demonstrate the necessity for colored-in-time stochastic forcing and formulate a convex optimization problem aimed at matching available and completing unavailable second-order statistics of turbulent flows via low-complexity stochastic dynamical models. In Section 8, we apply the stochastic modeling approach of Section 5 to a turbulent channel flow, verify its utility in linear stochastic simulations, and examine the resulting spatio-temporal spectrum. We close the paper by discussing the outstanding research issues and provide concluding remarks in Section 9.

2 The Navier-Stokes Equations

Flows of incompressible Newtonian fluids are governed by the NS and continuity equations,



is the velocity vector which satisfies the no-slip and no-penetration boundary conditions at a stationary solid surface,

is the pressure, and are the gradient and Laplacian operators, and is the partial derivative with respect to time. The NS equations are nonlinear PDEs in spatial coordinates and time and the continuity equation reflects the static-in-time divergence-free requirement on the velocity field. The flow is parameterized by the Reynolds number which determines the ratio of inertial to viscous forces, , where and are the characteristic velocity and length of the flow and is the kinematic viscosity. Spatial coordinates in Equation 1 are non-dimensionalized by , velocity by , time by , and pressure by , where is the fluid density.

Mean flow equations and the closure problem

When the flow becomes turbulent, it reaches a statistically stationary state in which variables still vary in time but their statistics are time-independent. To analyze the statistical properties of the flow, the velocity and pressure fields are decomposed into the sum of the turbulent mean components () and fluctuations () around them,

where denotes the time-average operator, e.g.,

Averaging Equation 1 yields the Reynolds-averaged NS equations [39, 50, 51],


which govern the evolution of the turbulent mean profiles (). Relative to the NS equations 1, the mean-momentum equations 2 contain one additional term which depends on the second order moment of the velocity fluctuation vector ,

. This symmetric tensor arises from momentum transfer by the velocity fluctuations and it has profound influence on the mean flow quantities and thereby on our ability to predict the skin-friction drag 


For a three-dimensional flow, Equation 2 consists of four independent equations governing the dynamics of the mean velocity and pressure fields (). However, these equations contain more than four unknowns; in addition to and , the Reynolds stresses are also unknown. This is a consequence of a closure problem that cannot be resolved in the absence of additional information about the second-order statistics of velocity fluctuations. Since the NS equations are nonlinear, the th velocity moment depends on the th moment [39] making it challenging to determine such second-order statistics.

Statistical theories of turbulence attempt to overcome the closure problem by modeling the effect of the Reynolds stress tensor on the mean flow quantities rather than explicitly resolving the nonlinear terms [39, 50, 51]. This is typically achieved by expressing higher-order moments in terms of the lower-order moments via a combination of physical intuition and empirical observations with rigorous approximation of the flow equations; see Figure 1. For example, the turbulent viscosity hypothesis seeks approximate solutions of Equation 2 by relating turbulent stresses to mean velocity gradients via [51],

where is the turbulent viscosity and is the identity tensor. Unfortunately, a general purpose expression for does not exist and turbulence models are required to relate it to other flow quantities, e.g., second-order statistics of the velocity fluctuations.

With appropriate choices of velocity and length scales, turbulent viscosity can be expressed as [51]

where and denote the turbulent kinetic energy and its rate of dissipation and is the constant. The - model [52, 53] provides two differential transport equations for computing and and it is widely used in commercial computational fluid dynamics codes and in engineering practice. Even though these are less complex than the NS equations, they are still computationally expensive, produce reliable result only for certain flow configurations, and are not convenient for control design and optimization; see [51] for additional details. In what follows, we describe an alternative approach to turbulence modeling, which approximates the Reynolds stresses using the second-order statistics of the stochastically-forced NS equations linearized around the turbulent mean flow; see Figure 1. We also demonstrate how second-order statistics resulting from DNS and experiments can be used to refine the predictive capability of models that arise from first principles.

Figure 1: (a) Conventional turbulence models are used to compute second-order statistics which drive the mean flow equations. (b) An alternative approach utilizes stochastically-forced linearized dynamics around the turbulent mean velocity to compute the second-order statistics of velocity fluctuations.
Figure 2: (a) Geometry of a pressure-driven turbulent channel flow between two parallel infinite walls. (b) Turbulent mean velocity profile in a flow with friction Reynolds number .

3 Stochastically-Forced Linearized Navier-Stokes Equations

The dynamics of small velocity and pressure fluctuations () around the turbulent mean profile () are governed by the linearized NS and continuity equations


Here, represents an additive zero-mean stationary stochastic input that triggers a statistical response of the linearized dynamics. In what follows, we describe how available second-order statistics of turbulent channel flows can be reproduced using the stochastically-forced model represented by Equation 3 and a suitable choice of power spectrum for the input . While we focus on the turbulent channel flow, it is noteworthy that the reviewed methodology and theoretical framework are applicable to other flow configurations.

In strongly inertial regimes, all flows transition to turbulence and a channel flow, with geometry shown in Figure 2, is commonly used as a benchmark for modeling, analysis, and control of wall-bounded turbulence. As illustrated in Figure 2, the turbulent mean velocity in channel flow only contains a streamwise component , and the linearized model that governs the dynamics of velocity fluctuations , in the streamwise, , wall-normal, , and spanwise, , directions takes the form,


Here, and is the body forcing fluctuation vector. By selecting the channel half-height and the friction velocity as the proper scales, the flow is characterized by the friction Reynolds number .

The linearized dynamics in Equation 4

are time-invariant and have constant coefficients in the wall-parallel directions; thus, the Fourier transform in

and can be used to obtain a one-dimensional system of PDEs (in and ) parameterized by the horizontal wavenumbers . Furthermore, a standard conversion can be used to eliminate the pressure from the equations and bring the descriptor form in Equation 4 into the form of an evolution model in which the state is determined by the wall-normal velocity, , and vorticity, , fluctuations [54, 31] with the boundary conditions . A pseudo-spectral technique [55] with collocation points in approximates the underlying operators and a change of variables described in [56, Appendix A] is used to obtain a finite-dimensional state-space representation in which the energy of velocity fluctuations at any is determined by the Euclidean norm of the state vector ,


Here, , is the input vector, is the velocity fluctuation vector, the matrix determines dynamical interactions between the state variables, specifies the way the input enters into the evolution model, and the output matrix relates the state vector to the velocity fluctuation vector .

[] The evolution model is obtained from Equation 4 as follows. Applying the divergence operator to the linearized NS equations yields an expression for . The equation for is obtained by acting with the Laplacian on the second equation in Model 4 and utilizing the expression for to eliminate the pressure . The equation for is obtained by taking the curl of the linearized NS equations. This yields two PDEs that govern the evolution of and that involve only , , and .

[] The linearized NS equations around the turbulent mean velocity profile are stable [57, 58]

, i.e., all eigenvalues of

in Equation 5 are in the left-half of the complex plane.

3.1 Algebraic relations between input and state statistics

In channel flow, the NS equations linearized around the turbulent mean flow are stable [57, 58] and the steady-state covariance matrix of the state vector in Equation 5


satisfies the Lyapunov-like equation [59, 60]


where is the expectation operator and is complex-conjugate-transpose. For colored-in-time , is a matrix that quantifies the cross-correlation between the input and the state in Equation 5 in statistical steady-state [56, Appendix B],

When the input in Equation 5 is zero-mean and white-in-time with covariance matrix , i.e., and , simplifies to and Equation 7 reduces to the standard algebraic Lyapunov equation,


The steady-state velocity covariance matrix can be obtained from ,


Since the dynamics are parameterized by wavenumbers , the entries of determine two-point correlations of velocity fluctuations in the wall-normal direction ; see [61].

3.2 Spatio-temporal correlations

At any , the matrix determines two-point correlations in the wall-normal direction of velocity fluctuations in statistical steady-state and the lagged covariance matrix,


captures spatio-temporal correlations. Furthemore, the application of the temporal Fourier transform yields the spectral density matrix of the output ,


which parameterizes two-point velocity correlations across wavenumbers and temporal frequencies . The matrix can be expressed in terms of the spectral density matrix of the input ,

where is the spatio-temporal frequency response of the LTI system in Equation 5,


The steady-state output covariance matrix is related to the spectral density matrix via,


Finally, for white-in-time input in Equation 5, the lagged output covariance matrix can be expressed as a linear function of the steady-state covariance matrix ,



4 Admissible Covariances

The matrix is the stationary covariance matrix of the state of the LTI system in Equation 5 with controllable pair and suitable input process if and only if

or equivalently, if and only if the matrix equation

has a solution  [59, 60]. The rank condition in Equation 15a implies that any positive-definite matrix is admissible as a stationary covariance of the state of an LTI system if the input matrix is full row rank.


For the LTI dynamics in Equation 5, the algebraic constraint in Equation 7 determines admissible steady-state covariance matrices . Among all positive semi-definite matrices, this constraint identifies those that qualify as state-covariances for a state-space representation with matrices and . As shown in [59, 60], the structure of state-covariances is an inherent property of the linear dynamics. The sidebar ADMISSIBLE COVARIANCES describes necessary and sufficient conditions for a positive-definite matrix to qualify as a steady covariance matrix of the state in Equation 5. These conditions amount to the solvability of Equation 15b for the matrix or, equivalently, the rank condition in Equation 15a. We next build on such structural constraints on admissible covariances and formulate convex optimization problems for characterizing the statistical properties of stochastic excitations to LTI systems that account for partially available statistics in turbulent channel flow.

5 Completion of Partially Available Flow Statistics

The algebraic relations described in Section 3.1 can be used to compute the steady covariance matrix of the stochastically-forced LTI system in Equation 5 based on the linearized model (i.e., the matrices and ) and the input statistics. In stochastic dynamic modeling of turbulent flows, however, the converse question is of interest: starting from the covariance matrix and the dynamic matrix in Equation 5, the objective is to identify the directionality of the disturbance (i.e., the matrix in Equation 5) and the power spectrum of the stochastic input that generate such state statistics. As illustrated in Figure 3

, this amounts to designing a linear filter which is driven by white noise and produces input

that generates the desired covariance matrix for the LTI system in Equation 5. In high-Reynolds-number flows, experimental and computational limitations often lead to only partial knowledge of flow statistics. For example, in experiments, an array of probes may only provide a limited subset of spatio-temporal correlations for velocity fluctuations, and in numerical simulations, certain regions of the computational domain may be poorly resolved. In this section, we formulate the problem of completing partially known state correlations in a way that is consistent with the hypothesis that perturbations around the turbulent mean velocity are generated by the linearized NS equations. To accomplish this objective, we seek stochastic forcing models of low-complexity where complexity is quantified by the number of degrees of freedom that are directly influenced by stochastic forcing in the linearized evolution model.


Figure 3: (a) The cascade connection of the linearized dynamics with a spatio-temporal linear filter which is designed to account for partially available second-order statistics of turbulent channel flow; (b) An equivalent reduced-order representation of the cascade connection in (a).

5.1 Necessity for colored-in-time stochastic forcing

The right-hand-side of standard algebraic Lyapunov equation 8 is sign-definite, i.e., . In contrast, the right-hand-side of Lyapunov-like equation 7 is in general sign-indefinite and, unless the input in Equation 5 is white-in-time, matrix


can have both positive and negative eigenvalues. Figure 4 shows the eigenvalues of the matrix for a channel flow with and , where denotes the generator of the dynamics in Equation 5 obtained by linearization around the turbulent mean velocity profile and is the steady-state covariance matrix resulting from numerical simulations of the nonlinear NS equations. The presence of both positive and negative eigenvalues indicates that the second-order statistics of turbulent channel flow cannot be reproduced by the linearized NS equations with white-in-time stochastic excitation. The modeling and optimization framework that was recently developed in [62, 56] overcomes this limitation by departing from the white-in-time restriction on stochastic forcing.

Figure 4: Positive eigenvalues of the matrix for channel flow with and , indicate that turbulent velocity covariances cannot be reproduced by the linearized NS equations with white-in-time stochastic forcing (cf. Equation 8).

5.2 Covariance completion via convex optimization

For the dynamical generator resulting from linearization of the NS equations around the turbulent mean velocity, the steady-state covariance matrix satisfies

quantifies the contribution of stochastic excitation. For notational convenience, we omit the dependence on the wavenumber in this section. We assume that a subset of entries of the output covariance matrix , namely for a selection of indices , is available. This yields an additional set of linear constraints for the matrix ,

For example, such known entries may represent one-point correlations in the wall-normal direction; see Figure 5 for an illustration. At any , the diagonals of the submatrices , , and denote the normal Reynolds stresses in turbulent channel flow, e.g.,

and the main diagonal of the submatrices , , and denote the shear stresses, e.g., It is noteworthy that while the covariance matrix is not allowed to have negative eigenvalues, the matrix can be sign indefinite. Our objective is to identify suitable choices of and that satisfy the above constraints and yield a low-complexity model for the stochastic input that explains the observed statistics.

[] In statistical steady-state, turbulent kinetic energy is determined by the sum of traces of matrices , , and and skin-friction drag depends on the shear stress .

Figure 5: Structure of the output covariance matrix . Available one-point correlations of the velocity vector in the wall-normal direction at various wavenumbers are marked by the orange lines.

The contribution of the stochastic excitation enters through the matrix , which is of the form given by Equation 17b, where the directionality of the input and its time-correlations are reflected by the choices of matrices and . As discussed in the sidebar ADMISSIBLE COVARIANCES, when the input matrix is full rank any positive semi-definite qualifies as the steady-state covariance of stochastically-forced linearized NS equations 5. However, as demonstrated in [56], in this case a forcing model that cancels the linearized dynamics and obscures important aspects of the underlying physics becomes a viable option. It is thus important to minimize the number of degrees of freedom that can be directly influenced by stochastic forcing. This can be accomplished via suitable regularization, e.g., by minimizing rank of the matrix in Equation 17a [63, 62]. [] The rank of the matrix bounds the number of independent input channels or columns in matrix ; see [62] for details.

This gives rise to the convex optimization problem CC-1 described in the sidebar COVARIANCE COMPLETION PROBLEM. The objective function in CC-1 provides a trade-off between the solution to the maximum entropy problem and the complexity of the forcing model, where the positive regularization parameter reflects the relative weight of the nuclear norm objective. The convexity of optimization problem CC-1 follows from the convexity of the objective function and the linearity of the constraint set, thereby implying the existence of a globally optimal minimizer.


6 Covariance Completion Problem

Given matrices and , the available entries of the output covariance matrix , and positive regularization parameter , determine the Hermitian matrices and that solve convex optimization problem


The first constraint reflects the requirement that the second-order statistics are consistent with stochastically-forced linearized model and the second constraint requires that the available elements of the matrix are exactly reproduced. Minimizing the logarithmic barrier function ensures positive-definiteness of the covariance matrix  [64] and results in a maximum entropy stochastic realization [65]. On the other hand, the nuclear norm regularizer, i.e., the sum of singular values of the matrix , , is introduced to restrict the rank of  [66, 67] and thereby reduce the complexity of the forcing model.

6.0.1 Power spectrum of stochastic input and filter design

The solution of problem CC-1, i.e., the Hermitian matrices and , can be used to obtain a dynamical model for colored-in-time stochastic input to the linearized NS equations. A class of generically minimal linear filters, which have the same number of degrees of freedom as the finite-dimensional approximation of the linearized model, was recently developed in [62, 56].

Since channel flow is translationally invariant in the wall-parallel dimensions, the dynamics in Equation 5 and optimization problem CC-1 are decoupled over the wavenumbers . At each , the filter dynamics that account for are given by


where is the state of the filter and is a zero-mean white-in-time stochastic process with covariance . On the other hand,


for matrices and that correspond to the factorization ; see [62] for details. The linear filter represented by Equation 18 generates a colored-in-time stochastic input to the linearized NS equations 5 and the resulting cascade connection reproduces the available second-order statistics of turbulent flow. The spectral density of

determines the spectral content of the input to the LTI system, where

is the spatio-temporal frequency response of the linear filter in Equation 18.

6.0.2 Minimal realization

The state-space representation corresponding to the cascade connection of the linear filter in Equation 18 with the linearized NS dynamics in Equation 5 is given by


This realization has twice as many states as the spatial discretization of the linearized NS model in Equation 5, but is not controllable and therefore not minimal. As shown in [62], removal of the uncontrollable states yields the minimal realization of the mapping from the input to the output , ,




This system has the same number of degrees of freedom as the system in Equation 5 and the corresponding algebraic Lyapunov equation in conjunction with Equation 19 yield

This demonstrates that the state-space realization in Equation 18 generates a stochastic input which is consistent with the steady-state covariance matrix .

[] The effect of colored-in-time excitation is equivalent to white-in-time excitation together with a structural perturbation of the system dynamics.

Remark 1

From Equation 19 we have and substitution of this expression into Equation 7 yields the standard algebraic Lyapunov equation

Since the pair is controllable, so are and . Stability of the modified dynamical generator follows from positive semi-definiteness of via standard Lyapunov theory.

The minimal realization (given by Equation 22) of the cascade connection described by Equation 20 is advantageous from a computational standpoint and it allows for an alternative interpretation of the stochastic realization of colored-in-time forcing. First, time-domain simulations require numerical integration of the system in Equation 22, which has half the number of states as compared to the system in Equation 20, thereby offering computational speedup. On the other hand, the structure in Equation 22 suggests that the colored-in-time forcing realized by the LTI filter in Equation 18 can be equivalently interpreted as a dynamical modification to the linearized equations in the form of state-feedback interactions. This interpretation provides an alternative viewpoint that is closely related to a class stochastic control [68, 69, 70, 71]

and output covariance estimation 

[72, 73] problems; see [62, Section II.C] for details. Based on this, we next describe an alternative formulation of the covariance completion problem as a state-feedback synthesis that is optimal with respect to a different design criterion [74, 75].

6.1 Minimum-control-energy covariance completion problem

As described in [74, 75], the challenge of establishing consistency between statistical measurements and a linearized model can be alternatively cast as the problem of seeking a completion of the missing entries of a covariance matrix along with a perturbation of the system dynamics subject to white-in-time input ,

For , a covariance completion problem can be formulated as an optimal control problem aimed at designing a stabilizing state-feedback control law (Figure 6). The choice of may incorporate added insights into the strength and directionality of possible couplings between state variables. While a full-rank matrix that allows the perturbation signal to manipulate all degrees of freedom can lead to the complete cancellation of the original dynamics , it is also important to impose a penalty on the average quadratic size of signals . This gives rise to convex optimization problem CC-2 described in the sidebar MINIMUM ENERGY COVARIANCE COMPLETION PROBLEM. The objective function in CC-2 provides a trade-off between the minimum-control-energy problem and the number of feedback couplings that need to be introduced to modify the dynamical generator and achieve consistency with available data [74, 75].


7 Minimum Energy Covariance Completion Problem

Given matrices , , , , , the available entries of the output covariance matrix , and the positive regularization parameter , determine the matrices and that solve convex optimization problem


The algebraic constraint on and ensures closed-loop stability (see Remark 1) and consistency with the state covariance matrix , and the second equality constraint requires that the available elements of the matrix are exactly reproduced. The positive-definite matrix specifies a penalty on the control input while the weighted-norm regularizer promotes sparsity on the rows of the matrix . Here, are given positive weights, is the th unit vector in , and is the covariance matrix of white noise input .


Figure 6: A feedback connection of the linearized dynamics with a static gain matrix that is designed to account for the sampled steady-state covariance matrix .
Remark 2

As demonstrated in [76, 62, 75], covariance completion problems CC-1 and CC-2 can be cast as semidefinite programs. For small- and medium-size problems, these can be solved efficiently using standard solvers [77, 78, 64]. To deal with large problem dimensions that arise in fluid dynamics, customized algorithms have been developed in [62, 75].

7.1 Completion of spatio-temporal correlations

The covariance matrix provides information about spatial correlations of velocity fluctuations in statistical steady-state. As described in Section 3.2, the temporal dependence of such statistics is captured by the spectral density matrix . This matrix can be used to provide real-time estimates of the flow state [79], and recent efforts have been directed at estimating by either matching individual entries at specified temporal frequencies [80, 81, 82] or the spectral power [83], . Either way it should be independently considered whether the so-constructed colored-in-time forcing models preserve important aspects of the original linearized NS dynamics. For additional discussion on parsimonious models and how these may reflect underlying physics see Section 5.2.

8 Case Study: Turbulence Modeling in Channel Flow

In this section, we investigate the completion of partially known second-order statistics of a turbulent channel flow using the framework presented in Section 5.2. The mean velocity profile and one-point velocity correlations in the wall-normal direction at various wavenumber pairs are obtained from DNS of a turbulent channel flow with friction Reynolds number  [54, 84, 85, 86]; see Figures 2 and 5 for an illustration. We also show how the modified dynamics of Section 6.0.1 can be used as a low-dimensional model that is simulated in time to generate velocity fluctuations whose second-order statistics are consistent with numerical simulations of the nonlinear NS equations.

8.1 Reproducing available and completing unavailable second-order statistics

As demonstrated in [56], optimization problem CC-1 is feasible at all wavenumbers . Thus, regardless of the value of the regularization parameter , all available one-point correlations of turbulent channel flow can be reproduced by a stochastically-forced linearized model. Figure 7 displays perfect matching of all one-point velocity correlations that result from integration over wall-parallel wavenumbers. Since problem CC-1 is not feasible for at all , this cannot be achieved with white-in-time stochastic forcing.

Figure 7: (a) Correlation profiles of normal and (b) shear stresses resulting from DNS of turbulent channel flow with (–) and from the solution to CC-1; (), (), (), (). Profiles are integrated over the wall-parallel wavenumbers .
Figure 8: Covariance matrices resulting from DNS of turbulent channel flow with (left plots); and the solution to optimization problem CC-1 with (right plots). (a, b) Streamwise and (c,d) streamwise/wall-normal covariance matrices for . The one-point correlation profiles that are used as problem data in CC-1 are marked by black lines along the main diagonals.

In addition to matching available one-point correlations, we next demonstrate that the solution to optimization problem CC-1 also provides good recovery of two-point correlations. These are not used as problem data in CC-1 and correspond to off-diagonal entries in Figure 5. The premultiplied energy spectrum in channel flow with peaks at ; e.g., see [87, Figure 12(a)]. The left column in Figure 8 displays the streamwise and the streamwise/wall-normal covariance matrices resulting from DNS at these flow conditions. The right column in Figure 8 shows the same covariance matrices that are obtained from the solution to problem CC-1; see [56] for a detailed examination of wall-normal and spanwise covariance matrices. The quality of recovery depends on the choice of the regularization parameter and, for , approximately of the DNS-generated covariance matrix can be recovered based on a relative Frobenius norm measure, . Here, represents the two-point correlation matrix of velocity fluctuations resulting from problem CC-1. The high-quality recovery of two-point correlations is attributed to the structural constraint in Equation 17a, which keeps physics in the mix and enforces consistency between data and the linearized NS dynamics. [] While the diagonal entries of determine the kinetic energy and affect the mean momentum transfer in the turbulent flow, the off-diagonal two-point correlations are indicators of coherent flow structures that reside at various locations away from the wall [88, 11].

8.2 Stochastic linear simulations

Stochastic simulations of the modified LTI dynamics in Equation 22 can be used to verify the theoretical predictions resulting from the modeling and optimization framework of Section 5.2. For a spatial discretization with collocation points in the wall-normal direction, at each wavenumber , the LTI system in Equation 22 has states. For and , the matrix that solves optimization problem CC-1 has non-zero eigenvalues ( positive and negative); see Figure 9. As shown in [62], the maximum number of positive or negative eigenvalues of the matrix bounds the number of inputs into the linearized NS model given by Equation 5. This implies that partially available statistics can be reproduced with colored-in-time inputs and as a result, the dynamical modification in Equation 22 is of rank .

Proper comparison with DNS or experiments requires ensemble-averaging, rather than comparison at the level of individual stochastic simulations. To this end, twenty simulations with different realizations of white-in-time input in Equation 22 have been conducted. The total simulation time was viscous time units. Figure 9

shows the time evolution of the energy (variance) of velocity fluctuations resulting from these twenty simulations. The variance averaged over all simulations is marked by the thick black line. Even though the responses of individual simulations differ from each other, the average of twenty sample sets asymptotically approaches the correct value of turbulent kinetic energy in statistical steady-state,

. Figure 10 displays the normal and shear stress profiles resulting from DNS and from stochastic linear simulations. The averaged output of the twenty simulations agrees well with DNS results. This agreement can be further improved by running additional simulations and by increasing the total simulation times.

Figure 9: (a) Singular values of the solution to CC-1 in turbulent channel flow with , , and for . (b) Time evolution of fluctuation’s kinetic energy for twenty realizations of the stochastic input to the resulting modified linearized dynamics in Equation 22; the energy averaged over all simulations is marked by the thick black line.
Figure 10: Normal stress profiles in the (a) streamwise, (b) wall-normal, and (c) spanwise directions; (d) shear stress profile resulting from DNS of turbulent channel flow with at (–) and stochastic linear simulations ().
Figure 11: (a) Power spectral density resulting from DNS of turbulent channel flow with at (green), the linearized NS model in Equation 5 (black), an eddy-viscosity-enhanced linearized model (blue), and the modified LTI dynamics in Equation 22 for (red). (b) Premultiplied energy spectrum of the modified dynamics in Equation 22 for turbulent channel flow with resulting from the integration of over wavenumbers .

8.3 Spatio-temporal energy spectrum

To analyze the spatio-temporal aspect of dynamical models resulting from the framework of Section 5.2 we examine the Power Spectral Density (PSD) and the energy spectrum of velocity fluctuations. The PSD of the LTI system in Equation 22 is determined by the sum of squares of the singular values of the frequency response matrix in Equation 21,

Integration of over the temporal frequencies yields the square of the norm of the system in Equation 22 or, equivalently, the -parameterized energy spectrum [31],

For a turbulent channel flow with and , Figure 11 compares the power spectral densities of the linearized NS model given by Equation 5, the eddy-viscosity-enhanced modification of the linearized NS equations [89, 90, 91, 92, 48], and the dynamical model given by Equation 22 resulting from the framework presented in Section 5.2 with the result of DNS. For the first two models, the input matrix excites all degrees of freedom in the state equation and, for the modified dynamics, the input matrix comes from the framework presented in Section 5.2 with the regularization parameter . All three models are driven by spatially and temporally uncorrelated inputs.

The temporal frequency at which the PSD peaks is similar for the linearized NS equations and the modified dynamics () and is closer to the result of DNS () than the frequency associated with the eddy-viscosity-enhanced model (). We also see that both the eddy-viscosity enhancement and the data-driven low-rank modification attenuate the amplification of disturbances at all temporal frequencies. The uniform damping of the PSD ensures that the norm of the system in Equation 22 matches the energy spectrum of the turbulent channel flow; cf. red and green curves in Figure 11. For the modified dynamics given by Equation 22, Figure 11 shows the premultiplied spatio-temporal energy spectrum as a function of the wall-normal coordinate and temporal frequency in inner (viscous) units, i.e., and . This spectrum is computed by integrating over and is concentrated around within a frequency band , which is in agreement with the trends observed in DNS-generated energy spectra [82]. Improving the accuracy in matching the temporal correlations resulting from DNS may require closer examination of the role of parameter or the addition of extra constraints in problem CC-1 and is a subject of ongoing research.


  1. Data from numerical simulations and experiments can be used to refine the predictive power of models that arise from first principles, e.g., the linearized NS equations.

  2. White-in-time stochastic input to the linearized NS equations cannot explain second-order statistics of turbulent wall-bounded flows.

  3. Colored-in-time stochastic input that excites all degrees of freedom can completely cancel the original dynamics and yield a model that does not generalize well.

  4. A suitably regularized solution to covariance completion problems can ensure that important features of spatio-temporal responses are captured via low-complexity stochastic dynamical models.

  5. The effect of colored-in-time stochastic input can be equivalently interpreted as a structural perturbation of the linearized dynamical generator, which can be used to identify important state-feedback interactions that are lost through linearization.

  6. Combining tools and ideas from systems theory and convex optimization can pave the way for the systematic development of theory and techniques that combine data-driven with physics-based modeling.


  1. Modeling of flow disturbances plays an important role in obtaining well-possed estimation gains [93, 94]

    . Stochastic dynamical models that are obtained via covariance completion fit nicely into a Kalman filtering framework for turbulent flows and have the potential to open the door for a successful output-feedback design at higher Reynolds numbers than current feedback 

    [95, 96, 8] and sensor-free [97, 98, 99, 100, 87] strategies allow. The efficacy of such an approach and its interplay with real-time estimation and feedback control are yet to be examined.

  2. Turbulence modeling for complex fluids and flows in complex geometries [101, 102, 103, 104, 105, 106, 107, 108] requires dealing with a large number of degrees of freedom. Since improving upon current algorithms that require computations for a model with states is challenging, a possible direction is to examine physical approximations [109, 110, 111, 112] and model reduction techniques [13, 15, 16, 17].

  3. The regularization terms in problems CC-1 and CC-2 are used as convex surrogates for rank and cardinality. For problems with structural constraints such surrogates do not enjoy standard probabilistic guarantees [113], and the utility of more refined approximations techniques, e.g., manifold optimization [114], low-rank inducing norms [115, 116], and nonconvex matrix completion [117, 118, 119] in low-complexity stochastic dynamical modeling remains largely unexplored.

  4. Higher-order turbulent flow statistics often play an important role in characterizing quantities of interest in engineering applications; e.g., fourth-order statistics are relevant in acoustic source modeling for high-speed jets [120, 121]. The importance of matching higher-order statistics calls for a generalized theory for the stochastic realization of state-statistics that are currently limited to second-order correlations.

  5. The output of the stochastically-forced linear model can be used to drive the mean flow equations in time-dependent stochastic simulations. It is important to identify conditions under which the feedback interconnection in Figure 1 converges.

9 Concluding Remarks

This review discusses a framework that combines tools from systems theory and optimization to develop low-complexity models of turbulent flows that are well-suited for analysis and control synthesis. The goal is to embed partially known statistical signatures obtained via numerical simulation of the NS equations or experimental measurements into first principles models that arise from linearization around the turbulent mean velocity. This amounts to identifying the spectral content of stochastic excitation into the linearized equations such that turbulent statistics can be reproduced. The review focuses on the completion of second-order statistics and while the methodology and theoretical framework are applicable to a wide range of scenarios, a channel flow configuration is used to solidify the discussion. On par with the dramatic upswing from the fields of machine learning and optimization in leveraging big-data for modeling, the proposed methodology utilizes data to refine the predictive capability of a dynamical model that arises from first principles and it offers a new perspective on tackling issues of robustness and generalizability.

Disclosure Statement

The authors are not aware of any biases that might be perceived as affecting the objectivity of this review.


Financial support from NSF under Awards CMMI 1739243 and ECCS 1809833, and AFOSR under Awards FA9550-16-1-0009 and FA9550-18-1-0422 is gratefully acknowledged. We thank Anubhav Dwivedi for generating DNS results reported in Section 8.3.


  • [1] Joslin RD. 1998. Aircraft laminar flow control. Ann. Rev. Fluid Mech. 30:1–29
  • [2] Gad-el Hak M. 2000. Flow control: passive, active, and reactive flow management. New York: Cambridge University Press
  • [3] Choi H, Moin P. 2012. Grid-point requirements for large eddy simulation: Chapman’s estimates revisited. Phys. Fluids 24:011702
  • [4] Slotnick J, Khodadoust A, Alonso J, Darmofal D, Gropp W, et al. 2014. CFD vision 2030 study: A path to revolutionary computational aerosciences. Tech. Rep. CR-2014-218178, NASA
  • [5] Sagaut P. 2006. Large eddy simulation for incompressible flows: an introduction. Springer Science & Business Media
  • [6] Wilcox DC. 1998. Turbulence modeling for CFD, vol. 2. DCW industries La Canada, CA
  • [7] Durbin PA, Reif BAP. 2011. Statistical theory and modeling for turbulent flows. Wiley
  • [8] Kim J, Bewley TR. 2007. A linear systems approach to flow control. Annu. Rev. Fluid Mech. 39:383–417
  • [9] Robinson SK. 1991. Coherent motions in the turbulent boundary layer. Annu. Rev. Fluid Mech. 23:601–639
  • [10] Adrian RJ. 2007. Hairpin vortex organization in wall turbulence. Phys. Fluids 19:041301
  • [11] Smits AJ, McKeon BJ, Marusic I. 2011. High-Reynolds number wall turbulence. Ann. Rev. Fluid Mech. 43:353–375
  • [12] Jiménez J. 2018. Coherent structures in wall-bounded turbulence. J. Fluid Mech. 842
  • [13] Rowley CW. 2005. Model reduction for fluids using balanced proper orthogonal decomposition. Intl J. Bifurcation Chaos 15:997–1013
  • [14] Lumley JL. 2007. Stochastic tools in turbulence. Dover Publications
  • [15] Schmid PJ. 2010. Dynamic mode decomposition of numerical and experimental data. J. Fluid Mech. 656:5–28
  • [16] Jovanović MR, Schmid PJ, Nichols JW. 2014. Sparsity-promoting dynamic mode decomposition. Phys. Fluids 26:024103 (22 pages)
  • [17] Rowley CW, Dawson ST. 2017. Model reduction for flow analysis and control. Annu. Rev. Fluid Mech. 49:387–417
  • [18] Towne A, Schmidt OT, Colonius T. 2018. Spectral proper orthogonal decomposition and its relationship to dynamic mode decomposition and resolvent analysis. J. Fluid Mech. 847:821–867
  • [19] Noack BR, Morzyński M, Tadmor G. 2011. Reduced-order modelling for flow control, vol. 528 of CISM Courses and Lectures. Springer
  • [20] Tadmor G, Noack BR. 2011. Bernoulli, Bode, and Budgie [Ask the Experts]. IEEE Contr. Syst. Mag. 31:18–23
  • [21] Trefethen LN, Trefethen AE, Reddy SC, Driscoll TA. 1993. Hydrodynamic stability without eigenvalues. Science 261:578–584
  • [22] Schmid PJ. 2007. Nonmodal stability theory. Annu. Rev. Fluid Mech. 39:129–162
  • [23] Gustavsson LH. 1991. Energy growth of three-dimensional disturbances in plane Poiseuille flow. J. Fluid Mech. 98:149
  • [24] Butler KM, Farrell BF. 1992. Three-dimensional optimal perturbations in viscous shear flow. Phys. Fluids A 4:1637
  • [25] Reddy SC, Henningson DS. 1993. Energy growth in viscous channel flows. J. Fluid Mech. 252:209–238
  • [26] Henningson DS, Reddy SC. 1994. On the role of linear mechanisms in transition to turbulence. Phys. Fluids 6:1396–1398
  • [27] Schmid PJ, Henningson DS. 1994. Optimal energy density growth in Hagen-Poiseuille flow. J. Fluid Mech. 277:197–225
  • [28] Farrell BF, Ioannou PJ. 1993a. Stochastic forcing of the linearized Navier-Stokes equations. Phys. Fluids A 5:2600–2609
  • [29] Bamieh B, Dahleh M. 2001. Energy amplification in channel flows with stochastic excitation. Phys. Fluids 13:3258–3269
  • [30] Jovanović MR. 2004. Modeling, analysis, and control of spatially distributed systems. Ph.D. thesis, University of California, Santa Barbara
  • [31] Jovanović MR, Bamieh B. 2005. Componentwise energy amplification in channel flows. J. Fluid Mech. 534:145–183
  • [32] Ran W, Zare A, Hack MJP, Jovanović MR. 2019a. Stochastic receptivity analysis of boundary layer flow. Phys. Rev. Fluids Doi:10.1103/PhysRevFluids.00.003900; also arXiv:1807.07759
  • [33] Butler KM, Farrell BF. 1993. Optimal perturbations and streak spacing in wall-bounded turbulent shear flow. Phys. Fluids A 5:774–777
  • [34] Farrell BF, Ioannou PJ. 1993b. Optimal excitation of three-dimensional perturbations in viscous constant shear flow. Phys. Fluids A 5:1390–1400
  • [35] Farrell BF, Ioannou PJ. 1998. Perturbation structure and spectra in turbulent channel flow. Theoret. Comput. Fluid Dynamics 11:237–250
  • [36] McKeon BJ, Sharma AS. 2010. A critical-layer framework for turbulent pipe flow. J. Fluid Mech. 658:336–382
  • [37] Moarref R, Sharma AS, Tropp JA, McKeon BJ. 2013. Model-based scaling of the streamwise energy density in high-Reynolds-number turbulent channels. J. Fluid Mech. 734:275–316
  • [38] Moarref R, Jovanović MR, Tropp JA, Sharma AS, McKeon BJ. 2014. A low-order decomposition of turbulent channel flow via resolvent analysis and convex optimization. Phys. Fluids 26:051701 (7 pages)
  • [39] McComb WD. 1991. The physics of fluid turbulence. Oxford University Press
  • [40] Kraichnan RH. 1959. The structure of isotropic turbulence at very high Reynolds numbers. J. Fluid Mech. 5:497–543
  • [41] Kraichnan RH. 1971. An almost-Markovian Galilean-invariant turbulence model. J. Fluid Mech. 47:513–524
  • [42] Orszag SA. 1970. Analytical theories of turbulence. J. Fluid Mech. 41:363–386
  • [43] Monin AS, Yaglom AM. 1975. Statistical fluid mechanics, vol. 2. MIT Press
  • [44] Farrell BF, Ioannou PJ. 1993c. Stochastic dynamics of baroclinic waves. J. Atmos. Sci. 50:4044–4057
  • [45] Farrell BF, Ioannou PJ. 1994. A theory for the statistical equilibrium energy spectrum and heat flux produced by transient baroclinic waves. J. Atmos. Sci. 51:2685–2698
  • [46] DelSole T, Farrell BF. 1995. A stochastically excited linear system as a model for quasigeostrophic turbulence: Analytic results for one-and two-layer fluids. J. Atmos. Sci. 52:2531–2547
  • [47] Hwang Y, Cossu C. 2010a. Amplification of coherent streaks in the turbulent Couette flow: an input-output analysis at low Reynolds number. J. Fluid Mech. 643:333–348
  • [48] Hwang Y, Cossu C. 2010b. Linear non-normal energy amplification of harmonic and stochastic forcing in the turbulent channel flow. J. Fluid Mech. 664:51–73
  • [49] Jovanović MR, Bamieh B. 2001. Modelling flow statistics using the linearized Navier-Stokes equations. In Proceedings of the 40th IEEE Conference on Decision and Control
  • [50] Durbin PA, Reif BAP. 2000. Theory and modeling of turbulent flows. Wiley
  • [51] Pope SB. 2000. Turbulent flows. Cambridge University Press
  • [52] Jones W, Launder B. 1972. The prediction of laminarization with a two-equation model of turbulence. Int. J. Heat Mass Transf. 15:301–314
  • [53] Launder B, Sharma B. 1974. Application of the energy-dissipation model of turbulence to the calculation of flow near a spinning disc. Lett. Heat Mass Transf. 1:131–137
  • [54] Kim J, Moin P, Moser R. 1987. Turbulence statistics in fully developed channel flow at low Reynolds number. J. Fluid Mech. 177:133–166
  • [55] Weideman JAC, Reddy SC. 2000. A MATLAB differentiation matrix suite. ACM Trans. Math. Software 26:465–519
  • [56] Zare A, Jovanović MR, Georgiou TT. 2017. Colour of turbulence. J. Fluid Mech. 812:636–680
  • [57] Malkus WVR. 1956. Outline of a theory of turbulent shear flow. J. Fluid Mech. 1:521–539
  • [58] Reynolds WC, Tiederman WG. 1967. Stability of turbulent channel flow with application to Malkus’s theory. J. Fluid Mech. 27:253–272
  • [59] Georgiou TT. 2002a. Spectral analysis based on the state covariance: the maximum entropy spectrum and linear fractional parametrization. IEEE Trans. Autom. Control 47:1811–1823
  • [60] Georgiou TT. 2002b. The structure of state covariances and its relation to the power spectrum of the input. IEEE Trans. Autom. Control 47:1056–1066
  • [61] Moin P, Moser R. 1989. Characteristic-eddy decomposition of turbulence in a channel. J. Fluid Mech. 200:509
  • [62] Zare A, Chen Y, Jovanović MR, Georgiou TT. 2017. Low-complexity modeling of partially available second-order statistics: theory and an efficient matrix completion algorithm. IEEE Trans. Automat. Control 62:1368–1383
  • [63] Chen Y, Jovanović MR, Georgiou TT. 2013. State covariances and the matrix completion problem. In Proceedings of the 52nd IEEE Conference on Decision and Control
  • [64] Boyd S, Vandenberghe L. 2004. Convex optimization. Cambridge University Press
  • [65] Goodwin GC, Payne RL. 1977. Dynamic system identification: experiment design and data analysis. Academic press
  • [66] Fazel M. 2002. Matrix rank minimization with applications. Ph.D. thesis, Stanford University
  • [67] Recht B, Fazel M, Parrilo PA. 2010. Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization. SIAM Rev. 52:471–501
  • [68] Hotz A, Skelton RE. 1987. Covariance control theory. Int. J. Control 46:13–32
  • [69] Yasuda K, Skelton RE, Grigoriadis KM. 1993. Covariance controllers: A new parametrization of the class of all stabilizing controllers. Automatica 29:785–788
  • [70] Grigoriadis KM, Skelton RE. 1994. Alternating convex projection methods for covariance control design. Int. J. Control 60:1083–1106
  • [71]

    Chen Y, Georgiou TT, Pavon M. 2016. Optimal steering of a linear stochastic system to a final probability distribution, Part II.

    IEEE Trans. Automat. Control 61:1170–1180
  • [72] Lin F, Jovanović MR. 2009. Least-squares approximation of structured covariances. IEEE Trans. Automat. Control 54:1643–1648
  • [73] Zorzi M, Ferrante A. 2012. On the estimation of structured covariance matrices. Automatica 48:2145–2151
  • [74] Zare A, Jovanović MR, Georgiou TT. 2016. Perturbation of system dynamics and the covariance completion problem. In Proceedings of the 55th IEEE Conference on Decision and Control
  • [75] Zare A, Mohammadi H, Dhingra NK, Jovanović MR, Georgiou TT. 2018. Proximal algorithms for large-scale statistical modeling and optimal sensor/actuator selection. IEEE Trans. Automat. Control Submitted; also arXiv:1807.01739
  • [76] Zare A, Jovanović MR, Georgiou TT. 2015. Alternating direction optimization algorithms for covariance completion problems. In Proceedings of the 2015 American Control Conference
  • [77] Toh KC, Todd MJ, Tütüncü RH. 1999. SDPT3-a MATLAB software package for semidefinite programming, version 1.3. Optim. Methods Softw. 11:545–581
  • [78] Grant M, Boyd S. 2014. CVX: Matlab software for disciplined convex programming, version 2.1.
  • [79] Sasaki K, Piantanida S, Cavalieri AVG, Jordan P. 2017. Real-time modelling of wavepackets in turbulent jets. J. Fluid Mech. 821:458–481
  • [80] Beneddine S, Sipp D, Arnault A, Dandois J, Lesshafft L. 2016. Conditions for validity of mean flow stability analysis. J. Fluid Mech. 798:485–504
  • [81] Beneddine S, Yegavian R, Sipp D, Leclaire B. 2017. Unsteady flow dynamics reconstruction from mean flow and point sensors: an experimental study. J. Fluid Mech. 824:174–201
  • [82] Towne A, Lozano-Durán A, Yang X. 2019. Resolvent-based estimation of space-time flow statistics. arXiv:1901.07478
  • [83] Morra P, Semeraro O, Henningson DS, Cossu C. 2019. On the relevance of Reynolds stresses in resolvent analyses of turbulent wall-bounded flows. J. Fluid Mech. 867:969–984
  • [84] Moser RD, Kim J, Mansour NN. 1999. DNS of turbulent channel flow up to . Phys. Fluids 11:943–945
  • [85] Del Álamo JC, Jiménez J. 2003. Spectra of the very large anisotropic scales in turbulent channels. Phys. Fluids 15:41–44
  • [86] Del Álamo JC, Jiménez J, Zandonade P, Moser RD. 2004. Scaling of the energy spectra of turbulent channels. J. Fluid Mech. 500:135–144
  • [87] Moarref R, Jovanović MR. 2012. Model-based design of transverse wall oscillations for turbulent drag reduction. J. Fluid Mech. 707:205–240
  • [88] Monty JP, Stewart JA, Williams RC, Chong MS. 2007. Large-scale features in turbulent pipe and channel flows. J. Fluid Mech. 589:147–156
  • [89] Reynolds WC, Hussain AKMF. 1972. The mechanics of an organized wave in turbulent shear flow. Part 3. Theoretical models and comparisons with experiments. J. Fluid Mech. 54:263–288
  • [90] Del Álamo JC, Jiménez J. 2006. Linear energy amplification in turbulent channels. J. Fluid Mech. 559:205–213
  • [91] Cossu C, Pujals G, Depardon S. 2009. Optimal transient growth and very large-scale structures in turbulent boundary layers. J. Fluid Mech. 619:79–94
  • [92] Pujals G, García-Villalba M, Cossu C, Depardon S. 2009. A note on optimal transient growth in turbulent channel flows. Phys. Fluids 21:015109
  • [93] Hœpffner J, Chevalier M, Bewley TR, Henningson DS. 2005. State estimation in wall-bounded flow systems. Part 1. Perturbed laminar flows. J. Fluid Mech. 534:263–294
  • [94] Chevalier M, Hœpffner J, Bewley TR, Henningson DS. 2006. State estimation in wall-bounded flow systems. Part 2. Turbulent flows. J. Fluid Mech. 552:167–187
  • [95] Bewley TR, Liu S. 1998. Optimal and robust control and estimation of linear paths to transition. J. Fluid Mech. 365:305–349
  • [96] Högberg M, Bewley TR, Henningson DS. 2003. Linear feedback control and estimation of transition in plane channel flow. J. Fluid Mech. 481:149–175
  • [97] Fransson JHM, Talamelli A, Brandt L, Cossu C. 2006. Delaying transition to turbulence by a passive mechanism. Phys. Rev. Lett. 96:064501
  • [98] Jovanović MR. 2008. Turbulence suppression in channel flows by small amplitude transverse wall oscillations. Phys. Fluids 20:014101 (11 pages)
  • [99] Moarref R, Jovanović MR. 2010. Controlling the onset of turbulence by streamwise traveling waves. Part 1: Receptivity analysis. J. Fluid Mech. 663:70–99
  • [100] Lieu BK, Moarref R, Jovanović MR. 2010. Controlling the onset of turbulence by streamwise traveling waves. Part 2: Direct numerical simulations. J. Fluid Mech. 663:100–119
  • [101] Hoda N, Jovanović MR, Kumar S. 2008. Energy amplification in channel flows of viscoelastic fluids. J. Fluid Mech. 601:407–424
  • [102] Hoda N, Jovanović MR, Kumar S. 2009. Frequency responses of streamwise-constant perturbations in channel flows of Oldroyd-B fluids. J. Fluid Mech. 625:411–434
  • [103] Jovanović MR, Kumar S. 2010. Transient growth without inertia. Phys. Fluids 22:023101 (19 pages)
  • [104] Jovanović MR, Kumar S. 2011. Nonmodal amplification of stochastic disturbances in strongly elastic channel flows. J. Non-Newtonian Fluid Mech. 166:755–778
  • [105] Lieu BK, Jovanović MR, Kumar S. 2013. Worst-case amplification of disturbances in inertialess Couette flow of viscoelastic fluids. J. Fluid Mech. 723:232–263
  • [106] Jeun J, Nichols JW, Jovanović MR. 2016. Input-output analysis of high-speed axisymmetric isothermal jet noise. Phys. Fluids 28:047101 (20 pages)
  • [107] Hildebrand N, Dwivedi A, Nichols JW, Jovanović MR, Candler GV. 2018. Simulation and stability analysis of oblique shock wave/boundary layer interactions at Mach 5.92. Phys. Rev. Fluids 3:013906 (23 pages)
  • [108] Dwivedi A, Sidharth GS, Nichols JW, Candler GV, Jovanović MR. 2019. Reattachment vortices in hypersonic compression ramp flow: an input-output analysis. J. Fluid Mech. To appear; also arXiv:1811.09046
  • [109] Reed HL, Saric WS, Arnal D. 1996. Linear stability theory applied to boundary layers. Annu. Rev. Fluid Mech. 28:389–428
  • [110] Herbert T. 1997. Parabolized stability equations. Annu. Rev. Fluid Mech. 29:245–283
  • [111] Högberg M, Henningson DS. 2002. Linear optimal control applied to instabilities in spatially developing boundary layers. J. Fluid Mech. 470:151–179
  • [112] Ran W, Zare A, Hack MJP, Jovanović MR. 2019b. Modeling mode interactions in boundary layer flows via Parabolized Floquet Equations. Phys. Rev. Fluids 4:023901 (22 pages)
  • [113] Candès EJ, Recht B. 2009. Exact matrix completion via convex optimization. Found. Comput. Math. 9:717–772
  • [114] Absil PA, Mahony R, Sepulchre R. 2008. Optimization algorithms on matrix manifolds. Princeton, NJ: Princeton University Press
  • [115] Grussler C, Zare A, Jovanović MR, Rantzer A. 2016. The use of the heuristic in covariance completion problems. In Proceedings of the 55th IEEE Conference on Decision and Control
  • [116] Grussler C, Rantzer A, Giselsson P. 2018. Low-rank optimization with convex constraints. IEEE Trans. Automat. Control
  • [117] Candes EJ, Li X, Soltanolkotabi M. 2015. Phase retrieval via Wirtinger flow: Theory and algorithms. IEEE Trans. Inf. Theory 61:1985–2007
  • [118] Sun R, Luo ZQ. 2016. Guaranteed matrix completion via non-convex factorization. IEEE Trans. Inf. Theory 62:6535–6579
  • [119] Ge R, Lee JD, Ma T. 2016. Matrix completion has no spurious local minimum. In Adv. Neural Inf. Process Syst.
  • [120] Karabasov SA, Afsar MZ, Hynes TP, Dowling AP, McMullan WA, et al. 2010. Jet noise: acoustic analogy informed by large eddy simulation. AIAA Journal 48:1312–1325
  • [121] Leib SJ, Goldstein ME. 2011. Hybrid source model for predicting high-speed jet noise. AIAA Journal 49:1324–1335