Skip to main content

Metamodeling techniques for CPU-intensive simulation-based design optimization: a survey


In design optimization of complex systems, the surrogate model approach relying on progressively enriched Design of Experiments (DOE) avoids efficiency problems encountered when embedding simulation codes within optimization loops. However, an efficient a priori sampling of the design space rapidly becomes costly when using High-Fidelity (HF) simulators, especially in high dimension. On the other hand, in applications such as aeronautical design, multiple simulation tools are frequently available for the same problem, generally with a degree of precision inversely proportional to the CPU cost. Thus, the concept of multi-fidelity proposes to merge different levels of fidelity within a single model with controlled variance. Based on recent Reduced-Order Modeling (ROM) techniques, an alternative approach allows to pursue the objective of mastering the simulation budget by replacing costly models with their approximate full-field counterparts, providing additional insight to scalar surrogates built directly from the Quantities of Interest (QoI). Both approaches: multi-fidelity and ROM, may be combined, allowing for additional flexibility in choosing the degree of fidelity required in different zones of the design space. This paper reviews the strategies that seek to improve surrogate-based optimization efficiency, including ROM, multi-fidelity metamodeling, and DOE enrichment strategies.


Several computational methods with varying fidelityFootnote 1 have been developed over the past decades to simulate fluid dynamics [97]. High-fidelity (HF) simulation models such as 3D-Reynolds Averaged Navier-Stokes (RANS) and Large Eddy Simulations (LES) have reached a level of maturity that allows them to be sufficiently predictive for use in aeronautical part design optimization loops [158]. However, these imply extensive computer resource utilization ranging from hours to full days of computation on supercomputer architectures and the generation of several gigabytes of data. On the other hand, Low-Fidelity (LF) models such as simplified physics, categorization [72, 151], mesh coarsening [20, 115] or relaxed convergence criteria [52], can be used to compute fluid flow approximations using limited resources. The Multi-Fidelity (MF) optimization approach combines the LF’s and HF’s respective advantages regarding cost and precision within a common framework. The first category of MF Models (MFMs) consists of exploring the LF values to determine the most interesting zones in the design space (for example the region of interest for an optimization problem) to reduce the calls to the expensive HF solver. This type of methods is not properly referred to as MFMs, since the HF and LF levels are not merged into a single model. The MF combination techniques use most of the time a surrogate model to integrate multiple fidelity levels.

Surrogate modeling consists in building a regression modelFootnote 2 from a set of available samples obtained from a design of experiments (DOE) allowing to predict the values of the function at interesting points. It avoids repeated calls to the simulation software in the design loops. Applications are uncertainty analysis, statistical inference (data-driven) [53, 220] or multi-disciplinary [48, 50, 132, 202], shape [90, 199, 226] or topology optimization [142]. Reviews on Surrogate-Based Optimization (SBO) are provided by [73, 163, 189, 195] where references on DOE techniques, surrogate modeling, and SBO applications are detailed. Later, SBO techniques applied to the aerodynamic field were reviewed by [232], and a more general review was published by [231] on surrogates, DOE, and adaptive strategies in engineering applications. In the present review, we focus on the construction of surrogate models when multiple levels of fidelity are available, in the SBO context.

Alternatively to the SBO frameworks, the evaluation costs may be also reduced by two families of Reduced-Order Models (ROMs): the intrusive projection-based models [8, 18, 238] and Non-Intrusive ROMs (NIROMs) [65, 224]. These methods have provided important savings in the computational cost of CFD models, but also in Numerical Structural Mechanics (CSM) especially in optimization [225], Uncertainty Quantification (UQ) [43, 114] or inverse resolution [62]. Other approaches combine the MFM and ROM within a surrogate to solve costly optimization [20, 60, 103]. The use of multiple fidelities has been introduced to temper the cost of high-dimensional multi-disciplinary design breaking the ”curse of dimensionality” [189, 209]. This concept allows to predict improved design location by taking into account a large amount of LF cheap data and few expensive HF available data.

However, both ROM and MFM based SBO raise predictability issues when ROM-based surrogates rely on offline sampling, leading to costly optimization procedures [45, 82, 204]. To address this issue, offline-online strategies, also called adaptive strategies, are employed to adapt the ROM as the optimization search progresses. These approaches have recently been highlighted by [231] in its state-of-the-art paper on SBOs as one of the current solutions to the challenges of large-scale modeling. The enrichment criterion uses a merit function to predict both the improvement in accuracy and the optimization objective. The next point to be evaluated is selected to maximize this criterion iteratively until an adequate stopping condition is reached. The goal is to choose the most relevant points in order to reduce the number of calls to solvers, that would answer a given design problem. The strategies for selecting sampling points can be classified as infill sampling [82, 207] adaptive [82, 123, 219], response-based [27], a posteriori, sequential and online approaches. Contrary to the domain-based and space-filling approaches where the training database is selected according to its point-to-point distance distribution, the adaptive selection is based on the surrogate model’s information.

The solutions to the CPU challenge of repetitive costly simulations reviewed in this paper aim at reducing the training and evaluation costs of metamodels. On the one hand, the MFMs combine variable simulation costs and, on the other hand, the ROMs allow to handle high-dimensional outputs while taking into account the vector representation of the simulation data (typically the discretized solutions of fluid state variables in CFD). Compared to scalar approximation models of Quantities of Interest (QoI), they are supposed to provide better insight into the physical model [47]. Also, sampling methods can be used to minimize the number of calls to expensive solvers while maintaining sufficient representativeness of the simulated physical model.

This paper reviews scalar and full-field SBO single- and MF frameworks. “Overview on surrogate-based optimization” section presents the SBO methods. Scalar MFMs are presented in “Multi-fidelity management” section, ROMs in “Surrogate modeling for full-field computations” section, and finally, vectorial MFMs based on ROMs in “Multi-fidelity reduced-order methods” section. For each surrogate, the corresponding adaptive sampling strategies are overviewed.

Overview on surrogate-based optimization

This section presents surrogate-Based optimization (SBO). The surrogate models are presented on “Surrogate modeling” and “Off-line design of experiment” sections introduces general and non-adaptive sampling methods and “Adaptive sampling” section the adaptive sampling approaches.

In the context of industrial design, the Quantities of Interest (QoI) are used to determine whether the chosen technological solution meets the functional requirements. A performance criterion generally referred to as an objective function \(\mathcal {J}(\varvec{\chi })\) can be evaluated at the design point \({\varvec{\chi }}^T=(\chi _1\,... \,\chi _d) \), where d is the design space dimension. This function is minimized under one or more constraints to meet the design specification. The scalar QoIs (lift, drag,...) are post-processed from the simulator output \(f(\varvec{\chi })\) (velocity, pressure field,...). The classical optimization problem is defined in a design space \(\mathcal {D}\) by the objective \(\mathcal {J} \), equality and inequality constraints h and g respectively

$$\begin{aligned} \begin{array}{cl} \displaystyle \quad \varvec{\chi }^{*}=\mathop {{{\,\mathrm{\hbox {arg}\,\hbox {min}}\,}}}\limits _{\varvec{\chi } \in \mathcal {D}} &{} \mathcal {J}(f(\varvec{\chi }))\\ \text {s.t.} &{} g_{i}(f(\varvec{\chi })) \le 0,\quad i=1,...,p\\ &{} h_{j}(f(\varvec{\chi }))=0, \quad j=1,...,q\\ &{}\\ \end{array} \end{aligned}$$

where \(\varvec{\chi }\) is the design variable, \(\mathcal {D}\subset \mathbb {R}^{d}\), \(\varvec{\chi }^{*}\) is the optimum of the objective function \(\mathcal {J} \in \mathbb {R}\) subjected to the constraints g, h.

In simulation-based optimizations, the QoI are evaluated by post-processing simulation results, requiring repetitive calls to time-consuming software within the optimization loops. Therefore, the SBO consists in solving the approximate problem defined by the approximate quantities noted as \(\widetilde{\mathcal {J}}\), \(\widetilde{g}\), and \(\widetilde{h}\), respectively

$$\begin{aligned} \begin{array}{clclcl} \displaystyle \quad \varvec{\tilde{\chi }}^{*}=\mathop {{{\,\mathrm{\hbox {arg}\,\hbox {min}}\,}}}\limits _{\varvec{\chi } \in \mathcal {D}} &{} \widetilde{\mathcal {J}}(\varvec{\chi })\\ \text {s.t.} &{} \widetilde{g_{i}}(\varvec{\chi }) \le 0,\quad i=1,...,p\\ &{} \widetilde{h_{j}}(\varvec{\chi })=0, \quad j=1,...,q\\ {} &{} \\ \end{array} \end{aligned}$$

The SBO steps are illustrated in Fig. 1. First, is the off-line phase, samples are evaluated \(\varvec{X} = \{\varvec{\chi }^{(0)}\,,... \,,\varvec{\chi }^{(M)}\}\) using design of experiments (DoE) methods as reviewed by [77, 195] or, in the specific field of aerodynamic applications, by [232]. Once the simulation has evaluated the samples \(\textit{f}(\varvec{\chi }^{(i)})\) with \(i=\{1,\,... \,, M\}\), the surrogate model is built for the QoI \(\mathscr {Q} = \{\widetilde{\mathcal {J}},\widetilde{g},\widetilde{h}\}\) and the optimization is performed in the online phase.

Fig. 1
figure 1

The offline SBO strategy

Surrogate modeling

The approximated quantities are modeled with a surrogate model, or metamodels, for which common techniques include

  • polynomial regression [192, 194],

  • Gaussian Process Regression (GPR) including Kriging [55, 107, 134], developed in the geostatistical domain by [111],

  • Radial Basis Functions (RBF) [68, 81, 160],

  • Moving Least Squares (MLS) [48, 113],

  • Support Vector Regression (SVR) [201],

  • Artificial Neural Networks (ANN) [37].

Although polynomials are extensively cited in the literature, their use is mainly limited to low-dimensional, linear or quadratic cases [189]. RBF and Kriging metamodels can handle non-linear engineering approaches. While RBF imply isotropic kernels, Kriging models that are based on the optimization of anisotropic ones requiring more hyper-parameters to tune and becoming untractable for high-dimensionality [171]. Excellent reviews (see “Introduction” section) are available for response surface modeling, however, the validation of response surfaces is necessary to ensure surfaces are representative of the underlying physical model. In simulation based applications, the number of data is generally insufficient to create distinct training validation sets. Specific approaches to model validation have therefore been proposed, some of them being independent of the surrogate method at hand. In the learning phase, an error estimator is needed to optimize the hyper-parameters of the approximate model. Gaussian-processes are commonly tuned by the likelihood maximization, employing evolutionary or gradient-based algorithms [168, 213]. Methods estimating the predictor error without generating an additional set of observations, include CV [58] and the bootstrap [69]. Kohavi [109] compares bootstrap to CV and concludes to better performance for ten-fold CV, on the specific case considered. The overall surrogate error is usually validated by Cross-Validation (CV) or sensitivity estimation [73]. K-fold-CV consists in successively removing k samples from the training set and estimating the model accuracy on these experiments. Setting k=1 yields the Leave-One-Out (LOO) procedure. Such methods allow to build the validation test from available data, to quantify the overall error typically with the Mean Square Error (MSE), the Root MSE (RMSE) and the Integrated MSE (IMSE) [115]. A more local approach provides a partition of the design space using the Variable Error Value with Sampling Points (VESP) [46] assigned to different partitioned regions. Thereafter, surrogate models are built iteratively using different subsets of samples and tested on the remaining points. Local accuracy can also be quantified by the Maximum Absolute Error (MAE). The correlation between two function responses can be measured by the coefficient R [78] when the relationship between the predicted response and the actual response is linear, one can also find r, the Pearson correlation coefficient [205] or its alternatives for non-linear models [200].

Off-line design of experiment

Sampling techniques for numerical experiments can be grouped into two main categories, namely Classical DoE (CDoE) and Modern DoE (MDoE) or Design and Analysis of Computer Experiments (DACE) [129, 196]. Giunta et al. [77] presents general summaries of CDoE and MDoE methods used in aeronautics. To obtain a good quality approximation on the whole domain, the points must be distributed as evenly as possible in space. Classical DoE methods for physical (in vitro/in vivo) experiments tend to allocate the sample points in the way to minimize the effect of the random error term. They include the full factorial and the fractional factorial design [133], taking samples from regularly spaced sites. Its main limitation is that the total number of design points increases exponentially with the problem dimension [19]. The central composite [144] and the Behnken Box design [28] follow a similar principle but replicate samples are taken making these methods less interesting for computer (in silico) experiments considered as deterministic. A widely used, random sampling methods for parameter estimation, albeit costly, is the Markov chain Monte Carlo (MCMC) [151] algorithms, however the number of simulations involved rapidly becomes prohibitive since they are based on the Markov chain process which requires a very high sample size. Quasi-random methods generate well-distributed sets of points with a controlled size. Various criteria are used to fill the DoE, such as Minimax and Maximin models, Kullback–Leibler, Audze–Eglais and Maximum Entropy Sampling (MES) [190]. Another approach maximizes Euclidean distance between all points in the DoE [141]. Among the modern DoE methods, [77], one of the most commonly used is the Latin Hypercube Sampling (LHS) [135], distributing a fixed number of samples independently of the DoE dimensions. The Voronoi Latinized Centroid Tesselation is an extended version of the LHS technique [185], improving its coverage. Sampling can also be constructed after an Analysis Of VAriance (ANOVA), or using Sobol [203] and Halton [87] sequences, often used to identify the parameters that most influence the output values [98]. Above space-filling techniques attempt to distribute the sampling points evenly in the design space. However, there is no general definition of an a priori number of samples in aerodynamic problems resulting in the desired precision [232], as QoI are often non-linear or discontinuous. Therefore, adaptive sampling approaches are developped to progressively improve the quality of the surrogates.

Adaptive sampling

Sacks et al. [184] introduced sequential sampling using the model information to improve the sampling’s quality with posterior data. In the literature, a sequential strategy is said to be adaptive if it improves the DoE without considering the experiment outputs. Sample location has been found to have a significant impact on the estimated error [34, 80] and is improved when adaptive sampling methods are used to select new samples in areas of the design space where the error estimate is higher. Liu et al. [123] present a comprehensive review of global surrogate sampling, classifying the methods into one-shot, sequential, sequential adaptive, and multiple sampling categories. Another review presents methods tackling high-dimensional black-box problems by [189]. This section presents some of the existing enrichment criteria applied to the SBO framework. The objective of adaptive procedures is to find a sufficiently representative model allowing for an efficient convergence of the optimization problem.They are generally based on an infill criterion (Fig. 2), selecting new sample \(\varvec{\chi }\) to be added to the current training set \(\varvec{X} \subset \mathcal {D}\).

Fig. 2
figure 2

The adaptive SBO strategy

The most common infill sampling criteria are built from stochastic metamodels in a Bayesian scheme. Zilinskas and Brochu et al. [30, 239] select the evaluation points sequentially taking into account a compromise between exploration of high uncertainty areas and intensification to improve over the current best observation. Regarding single-objective bound-constrained optimization, the Expected Improvement (EI) was popularised by [101] in the Efficient Global Optimization (EGO) framework. Later, the EI criterion has been extended to handle constraints [149, 150] and to address multi-objective problems.Footnote 3 In the general EGO framework, [157] compared EI, Augmented EI [95] and the Weighted MSE Criterion for a noisy optimization benchmark. The weighted EI extension is proposed by [207] in order to control the balance between exploitation and exploration in a constrained optimization framework. An EGO handling constraints was also applied by [17, 156]. Scott et al. [186] generalized the EGO for multidimensional variables the Gaussian process and gradient-knowledge for noisy QoIs framework. Another variants of the EGO were proposed by [40, 118, 161]. These strategies are also categorized by the survey [123] as variance-based adaptive sampling approaches including:

  • Minimization and maximization of the predicted variance or Mean Square Error [124],

  • Lower Confidence Bounds (LCB) [30],

  • Upper Confidence Bounds (UCB) [11]

  • Gaussian Process-UCB [206],

  • EI [101],

  • Probability of Improvement (PI)[30],

  • Entropy search [93, 217].

Currin et al. [57] applied a two-stage optimal design based on the maximum entropy criterion to gain insight into a circuit-simulator example. Sacks et al. [184] used two-stages optimal design based on Integrated Mean Squared Error (IMSE) criterion for the same example. Mackman and Allen [127] compared sequential sampling methods for the generation of surrogate aerodynamic models. Regis [169] coupled the Trust Region method (TR) to the EGO and compared to the standard EI and an adaptive criterion based on the RBF [171] on several test problems including the groundwater application based on a 36-dimensional simulation concluding that the proposed strategy is most efficient in the high-dimensional configuration. Li et al. [120] developed an adaptive DOE method based on accumulative error inspired by the greedy algorithm’s principles [147, 216], and favoring regions of space where the outputs are non-linear. Continuous And Multi-Modal regions of the design space corresponding to multi-modal, noisy responses with a tendency to abrupt variation are identified and sampled until all suspected Continuous Multi-Modal regions are explored. This method was compared to the maximum entropy design and the maximum distance metric. It was concluded that it outperforms the other methods in terms of RMSE in the majority of the engineering examples presented.

Multi-fidelity management

The MF approach consists in merging Low-Fidelity (LF) with High-Fidelity (HF) data to produce surrogate models at affordable costs. A study of MF methods has been published by [151] in the context of uncertainty propagation, inference, and optimization. It was followed by an overview [75], which questions the added value of MF approaches and how they can be used most effectively. MF Models (MFMs) have been grouped by [72] into three categories, the first where only HF quantities are estimated by a surrogate model, secondly, approaches where both levels are combined within the same metamodel, and finally, the category in which LF is only an enabler of HF modeling. This last category is related to the filtering approaches as it consists in interrogating LF to decide when to use HF models. A more general review is completed by [232] on design space sampling, model selection, ROM, and assisted surrogate models in aeronautics. MF is presented as one of the recent solutions to improve simulation efficiency. This section gives an overview of the main MF approximation methods in order to determine each method’s applicability according to our knowledge of the problem at hand.

Multi-fidelty data fusion

Corrective approaches The concept of MF was originally introduced in linear additive [108] and multiplicative [36, 85] approaches used in gradient-based optimization and was applied to a high speed civil transport aircraft wing. Hutchison et al. [96] applied a polynomial correction term on aerodynamic drag approximation. The main idea is to consider the LF model as a general trend to exploit by adding approximation of the difference (or ratio) between the LF and HF quantities. The corrective methods relie on the assumption of a relationship between different levels of fidelity, allowing to better approximate a fine HF model with its associated coarse LF using additive [44, 177, 208]

$$\begin{aligned} \widetilde{\mathcal {J}}_{MF}(\varvec{\chi }) = \mathcal {J}_{LF}(\varvec{\chi }) + \widetilde{\varepsilon }(\varvec{\chi })\,, \end{aligned}$$

multiplicative [4, 15]

$$\begin{aligned} \widetilde{\mathcal {J}}_{MF}(\varvec{\chi }) = \widetilde{\beta }(\varvec{\chi }) \mathcal {J}_{LF}(\varvec{\chi }) \end{aligned}$$

or hybrid (also called comprehensive) corrections [235, 236]

$$\begin{aligned} \widetilde{\mathcal {J}}_{MF}(\varvec{\chi }) = \widetilde{\beta }(\varvec{\chi }) \mathcal {J}_{LF}(\varvec{\chi }) + \widetilde{\varepsilon }(\varvec{\chi })\,. \end{aligned}$$

where \(\mathcal {J}_{HF}, \mathcal {J}_{LF}\) and \(\widetilde{\mathcal {J}}_{MF}\) are exact HF, LF and MF objective functions, \(\widetilde{\varepsilon }(\varvec{\chi })\) and \(\widetilde{\beta }(\varvec{\chi })\) are surrogate models of the difference and ratio between \(\mathcal {J}_{HF}(\varvec{\chi })\) and \(\mathcal {J}_{LF}(\varvec{\chi })\).

Figure 3 illustrates a non-linear function form in the review of MFMs methods [75]. The comprehensive approximation is closer to the HF targeted function and appears to be the most accurate. Ng and Eldred [146] originally proposed the MF Polynomial Chaos Expansion (PCE) in the UQ field [63, 64] using an additive correction between fidelity levels. An improvement of the HK has been proposed by [148] through the use of PCE and Kriging as a HF surrogate model, then extended by additional polynomial terms to improve the accuracy within an inviscid RAE 2822 CFD application. The addition of a first order polynomial to the HK model has been shown to improve predictive performance. Lickenbrock et al. and Rumpfkeil et al. [122, 183] proposed a MF model based on a scattered PCE in the context of a CFD case illustrated in Fig. 4. This bi-fidelity CFD case demonstrated that the MF PCE was able to capture the lift coefficient trends.

Fig. 3
figure 3

Illustration of Multi-Fidelity scaling (or corrective) approaches by [75]

Fig. 4
figure 4

Baseline of an efficient supersonic air vehicle (ESAV) model [122]

Space-Mapping (SM) methods, developed by Bandler et al. in 1994 in cartography reviewed by [16] and applied to the microwave circuit design make corrections at the input of a model, rather than at its output. They are based on the assumption that the set of entry points of a HF model is a geometric transformation of the HF models [14, 119]. The main idea is to optimize the link or mapping between the spatial parameters LF and the HF model’s spatial parameters to meet optimization specifications. The parameters are obtained by minimizing the difference between the available HF values and those of the metamodel. HF points generally update this approximation. This method was coupled with the Trust Region Model Management (TRMM) by [176]. The parameters, defined on different design spaces, are linked by a corrected SM. It is used with a TRM of sequential-quadratic programming for two design optimization problems related to aerospace. These approaches allow different input dimensions [130] in the LF and HF models.

Fusion models are partly known by co-Kriging models [74, 104, 110, 143, 153, 180]. The multi-fidelity co-Kriging extension was originally based on a linear multi-fidelity regression formulation [54], that was improved by [56] through a Bayes linear formulation in a UQ framework. The co-Kriging multi-fidelity extension, introduced by [104], is based on a scaled LF objective function \(\mathcal {J}_{LF}\) with a factor \(\rho \) added to the Kriging-interpolated correction function \(\varepsilon \)

$$\begin{aligned} \mathcal {J}_{HF}(\varvec{\chi }) = \rho \mathcal {J}_{LF}(\varvec{\chi }) + \widetilde{\varepsilon }(\varvec{\chi }), \, \varvec{\chi }\in \mathcal {D} \end{aligned}$$

where \(\mathcal {J}_{HF}(\varvec{\chi })\) and \(\widetilde{\varepsilon }(\varvec{\chi })\) are respectively the exact HF objective and the interpolation of \(\varepsilon (\varvec{\chi })=\mathcal {J}_{HF}(\varvec{\chi })-\mathcal {J}_{LF}(\varvec{\chi })\).

Le Gratiet et al. [115] proposed a recursive formulation of co-Kriging to tackle the complexity reduction related to the inverse of the covariance matrices using a recursive multi-level formulation. The Hierarchical Kriging (HK) developed by [89] redefines co-Kriging considering the LF function’s Kriging as the trend of the Kriging model for the expensive HF function avoiding the difficulty associated with building cross-covariance. The complexity related to higher dimensional Kriging is typically tackled through the use of alternative metamodels such as RBF of diffuse approximation where the covariance matrice and hyperparameters are less computationally demanding. A MF extension of the RBF regression model is introduced by [173] for experimental and computational integrated data for a missile configuration, and was later applied by [175] for the surface pressure of aircraft wings. Durantin et al. [66] developed a co-RBF extension yelding an accuracy of the same order as that of co-Kriging, while reducing its training cost, especially in high dimension.

Filtering approaches

To manage MF models in the optimization context, hierarchical methods use the LF model to filter out unpromising points before evaluating the remaining points with the HF model [44, 59]. This group of methods that may be considered as filtering techniques [151] consisting in using the LF to explore the design space may also be coupled to the trust-region framework [51]. Alexandrov et al. [4] has associated a tuned LF with a numerical optimizer subject to a confidence region constraint, where the LF model is tuned using the HF model and applied to a wing design optimization problem. Giunta et al. [76] applied the MFM technique to the multidisciplinary design of high-speed civil transport where the LF is used to define a sub-region of the most likely optimal location. The HF is then applied to improve the fidelity level.

Dedicated infill

The efficiency of MFMs is conditioned by the correlation between levels of fidelity and their evaluation cost. A comparison of surrogate quality criteria [94] concludes MSE to be the most efficient in the MFM framework, followed by LOO and Predictive Estimation of Model Fidelity (PEMF) error. a MFM metamodel quality metric involving PEMF proposed by [136] chooses between multiple fidelity levels. Song et al. [205] compared the commonly used \(R^2\) metric (or performance criterion) to the Pearson Correlation Coefficient (PCC) in a context of multiple levels of fidelity in order to introduce the correlation impact on MFMs. The PCC measure between two random variables describing the correlation between HF and LF functions is defined by [212] for MFMs:

$$\begin{aligned} r^2 = \left( \frac{\sum _{i=1}^M (\mathscr {Q}_{HF}(\varvec{\chi }^{(i)}) - \bar{\mathscr {Q}}_{HF}(\varvec{\chi }^{(i)}) )(\mathscr {Q}_{LF}(\varvec{\chi }^{(i)}) - \bar{f}_{LF}(\varvec{\chi }^{(i)}) )}{\sqrt{\sum _{i=1}^M (\mathscr {Q}_{HF}(\varvec{\chi }^{(i)}) - \bar{\mathscr {Q}}_{HF}(\varvec{\chi }^{(i)}) )^2 \sqrt{\sum _{i=1}^M (\mathscr {Q}_{LF}(\varvec{\chi }^{(i)}) - \bar{\mathscr {Q}}_{LF}(\varvec{\chi }^{(i)}) )^2 }}}\right) ^2 \end{aligned}$$

where M is the number of observations of the LF and HF solvers \(\mathscr {Q}_{LF}\) and \(\mathscr {Q}_{HF}\), respectively and \(\bar{\mathscr {Q}}_{LF}\) and \(\bar{\mathscr {Q}}_{HF}\) the corresponding means. Toal [212] compares the impact of RMSE and the correlation metrics of the LF and HF functions. It has been observed that the \(r^2\) metric is better suited than RMSE to identify the LF-HF correlation. Using the correlation measures, it was shown that the amount of LF data must be greater than that of HF and the LF simulation budget must be no greater than 80% of the total simulation budget but at least higher than 10% to be worthwhile to use a MF representation. Thus, merging existing LF data with expensive HF data is not always cheaper than a single-fidelity method [75]. Correlation, cost ratio and other error metrics are crucial to measure the benefit of MF models, which depends on the context (optimization, UQ, etc.). The efficiency of MFMs depends on the trade-off between cost and accuracy [75]. Dedicated criteria are used to maximize the benefit of MF methods in the context of optimization. One concept of MF infill strategies is to establish a criteria to predict the most promising locations for new HF samples from a LF model.Other criterion use multiple fidelity levels to estimate the most promising fidelity level and location within the design space. Some of these methods take into account the HF/LF cost ratio to control the overall budget. In the following paragraphs, we provide an overview of the main adaptive approaches in these two categories.

Trust-Region MF management

Trust-Region Methods (TRMs) have been used to locate promising points in the MFM framework [1], with derivative-based infill criteria [3] and extended to be used without gradients by [130, 131] and in a multi-objective framework [61, 110]. Rodriguez et al. [178] coupled a corrected LF model with a TR constrained numerical optimizer. They proposed a MF optimization framework based on a TR algorithm, the gradient of the objective function computed using the LF model allows the solution to converge to the HF model’s optimum. The TR MFM uses a ratio between LF and HF, indicating the region of confidence [151]. The MFMs used by [151] are inspired by the approximation model management for the optimization in [2] which considers the approximation model as a level of fidelity in its own right. Corrective methods are used to evaluate the sub-models within the confidence interval at each iteration k and to improve LF QoIs

$$\begin{aligned} \mathscr {Q}_{MF}(\varvec{\chi }) = \mathscr {Q}_{LF}(\varvec{\chi })+e(\varvec{\chi }_{k})+\nabla e(\varvec{\chi }_{k})^{T}(\varvec{\chi }-\varvec{\chi }_{k}) \end{aligned}$$

where \(e(\varvec{\chi }_{k})\) is the MFM correction model at iteration k, \(\mathscr {Q}_{LF}\) and \(\mathscr {Q}_{MF}\), respectively the LF and MFM QoI.

Adaptive MF Kriging

The other way to efficiently manage the optimization in a MFM framework is the EGO (see “Adaptive sampling” section). The MF co-Kriging provides the variance that can be directly exploited to enrich the model. Le Gratiet and Le Gratiet and Grainer [115, 116] proposed a sequential version of recursive co-Kriging that uses IMSE and takes into account both the computational cost ratios between code fidelity levels and their respective contributions to the total variance. This method is used to predict a turbulence model of a particular gas composition where different refinements mesh define two levels of fidelity. The strategy, called sequential Kriging is used in an optimization framework to select new points of interest. It has been extended to parallel computing and adapted to the vectorial MF optimization application of a reservoir by [210] (see “Adaptive reduced-order models” section). In the same framework, [112] present a two-step space-filling strategy considering the information gain in the variance and the cost of each level of output fidelity. This strategy was tested with analytical MF extension of the 2D Rosenbrock function, a constrained optimization problem, and an aerodynamic optimization test case. The MFM was demonstrated more efficient than the single-fidelity EGO. The approach adopted is the merging of L fidelity levels for which the level \(l_{n+1}\) of the next simulation at design point \(\varvec{\chi }_{n+1}\) is

$$\begin{aligned} l_{n+1}=argmin_{l \in {1,...,L}} \quad \frac{C_{l}(\varvec{\chi }_{n+1})}{\bar{\sigma }_{l}^{2}(\varvec{\chi }_{n+1})-\widetilde{\sigma }_{l}^{2}(\varvec{\chi }_{n+1})}, \end{aligned}$$

where \(C_{l}(\varvec{\chi }_{n+1})\) is the evaluation of the \((n+1)^{th}\) predicted point cost with the simulator of level l, \(\bar{\sigma }_{l}^{2}(\varvec{\chi }_{n+1}) \) and \(\widetilde{\sigma }_{l}\) are respectively the mean and the variance of the MF surrogate model at \(l^{th}\) fidelity level. The objective is to find the lowest output cost with the highest information gain.

An adaptation of EI to MF is applied to HK by [234]. The HK scheme of [91] is used to choose the fidelity level at each iteration. The adapted EI expression includes the fidelity level l

$$\begin{aligned} EI_{vf}(\varvec{\chi },l) = \left\{ \begin{array}{l@{\quad }l} 0 &{} \text{ if } \quad \sigma _{l}(\varvec{\chi }) = 0, \\ (\mathscr {Q}_{best}-\widetilde{\mathscr {Q}}(\varvec{\chi }))\Phi \left( \frac{\mathscr {Q}_{best}-\widetilde{\mathscr {Q}}(\varvec{\chi })}{\sigma _{l}(\varvec{\chi })}\right) + \sigma _{l}(\varvec{\chi })\phi \left( \frac{\mathscr {Q}_{best}-\widetilde{\mathscr {Q}}(\varvec{\chi })}{\sigma _{l}(\varvec{\chi })}\right) &{} \text{ if } \quad \sigma _{l}(\varvec{\chi }) > 0, \end{array} \right. \end{aligned}$$

where \(\phi (.)\) and \(\Phi (.)\) denote respectively the standard normal probability density and distribution functions, \(\widetilde{\mathscr {Q}}(\varvec{\chi })\) the posterior mean of \(\mathscr {Q} \) and \(\sigma _{l,l\in \left[ 1,2\right] }\) is the variance of the LF and HF models respectively.

Guo et al. [80] applied \(EI_{vf}\) and observed that compared to a single-fidelity EI, the search for the optimum was made efficient by LF exploration, were fewer HF calls were needed to solve the optimization problem. Hao et al. [92] developed an extension of this \(EI_{vf}\) criterion to Gradient-Enhanced Kriging (GEK). LF sample points are first used to represent the HF function trend close to the optimal solution, then HF samples are added. It is demonstrated on analytical test functions that \(EI_{vf}\) adaptively determines both the location and the fidelity level of a new design point. Other variance-based criteria have been adapted to the variable fidelity framework. A comparative study was carried out on the LCB [99] criterion between single-fidelity, MF EI, and other EGO criteria [234]. Eight numerical examples, along with one physics-based aircraft fuselage design, resulted in 25% and 45% savings thanks to the VF-LCB criterion which showed an improved exploration/exploitation trade-off. Also, the PI criterion has been adapted to MFMs as an extended PI

$$\begin{aligned} EPI(\varvec{\chi },l) = PI_{vf}(\varvec{\chi })\times Corr(\varvec{\chi },l)\times CR(l) \times \eta (\varvec{\chi },l), \end{aligned}$$

where \(PI_{vf}\) is the PI built from the MFM co-Kriging of [181], \(l = 1,...,\, L\), is the fidelity level, \(Corr(\varvec{\chi }, l)\) denotes the posterior correlation coefficient between the HF and fidelity level l at input \(\varvec{\chi }\). CR(l) is the cost ratio between HF and \(l^{th}\) fidelity model, \(\eta (\varvec{\chi },l)\) is the sample density function adopted by [123] to avoid clustering of training data. This criterion was compared to the Augmented Expected Improvement (AEI) of [95], \(EI_{vf}\) of [234], another MF PI variant, and a standard single-fidelity PI. An application to structural design optimization of the micro-aerial vehicle fuselage and stiffened cylindrical shell was carried out and led to the conclusion that the proposed VF-PI method is most efficient when the correlation between the HF and LF models is high. In contrast, the VF-EI method is even more efficient when the correlations remain low. In the same group of sampling methods using GPs, the GP-UCB, also known as UCB in the Bayesian framework [30] was adapted to MFM by [102]. The MF adaptation uses the largest LF uncertainty to add the next sample. This criterion was compared to the single-fidelity GP-EI, GP-UCB criteria, and the algorithm MF Mutual Information Greedy (MF-MI-Greedy) proposed by [187] where fidelities are assumed independent. This algorithm maximizes the amount of mutual information in order to take advantage of LF. MFM is modeled using additive Gaussian processes based on shared relationships with the target HF function, and the variable costs of different fidelities are taken into account. The MF-MI-Greedy was demonstrated to effectively reduce the uncertainty.

Adaptive RBF models

Another extension of the EI was proposed by [152] for MF UQ and adapted to RBF surrogate modelling. The enrichment aims to minimize both the uncertainty and the objective function. Several criteria are compared, including the Maximum Uncertainty Adaptive Sampling (MUAS), evaluated from the MF metamodel and minimized, the MFEI, and Aggregate Criteria Adaptive Sampling (ACAS) consisting in minimizing the difference between the MF prediction and the associated uncertainty. Finally, Multi-Criteria Adaptive Sampling (MCAS) allows identifying new training points by minimizing the objective function constrained by a maximal prediction uncertainty. This adaptive sampling strategy was tested on a dynamic Stochastic Radial Basis Functions (SRBF) [218]. It has been observed that MUAS and MCAS were more exploratory than MFEI and ACAS, and HF evaluations were well distributed within the design space. MFEI and ACAS concentrate HF evaluations in the optimum region. The overall results lead to the conclusion that MFEI are the most efficient adaptive sampling techniques for the proposed CFD shape optimization test case of a NACA hydrofoil. Such bayesian EGO framework is used with the the Gaussian Process based model so-called Kriging because it is able to provide variance and mean values to guide the DoE search. Extension of such framework were adapted to a reduced complexity surrogate RBF by [26], allowed [66] to obtain time savings for comparable optimization results. The same conclusion was drawn by [215], following the co-RBF comparison with a Random Forest co-surrogate. Gutmann [81] used RBF metamodels in an EGO approach with a measure of interpolation error, referred to as the power function. This criterion was modified by [170] to improve its local search property. The adaptive MF Sequential Radial Basis Optimization (MFSRBO) method was developed by [174] and tested on an aerodynamic application. The compromise criterion between fidelity levels [104] of additive MF surrogate is adapted to an RBF metamodel. This scheme uses the difference between HF and l fidelity levels. The AEI criterion proposed by [95] for co-Kriging is adapted to the MF RBF at the \(l^{th}\) fidelity levels as

$$\begin{aligned} EI(\chi ,l) = EI*\alpha _{1}(\chi ,l)*\alpha _{2}(\chi ,l)*\alpha _{3}(\chi ,l), \end{aligned}$$

with \(\alpha _{1}(\chi ,l)\) a discontinuous function of the local prediction error, \(\alpha _{2}(\chi ,l)\) the relative reduction in the posterior standard deviation and \(\alpha _{3}(\chi ,l)\) is the ratio of the l fidelity to the highest HF costs \(\frac{C_{l}}{C^{HF}}. \)

Cai et al. [34] adapted the CV metric associated with the Voronoi tesselation [229] to partition the design space for RBF-based MF metamodeling. Recently, [219] proposed a MF metamodel based on the stochastic RBF (SRBF) with a MF adaptive sampling based on CV error and the Voronoi partition, sampling both LF and HF.

Surrogate modeling for full-field computations

The optimization problem formulation (2) and consequently the surrogate approaches presented in previous sections consider QoI functionals obtained by postprocessing simulation results corresponding in aerospace applications to detailed velocity, pressure, stress, or thermal fields defined on a finite element/finite volume mesh. The full-field approach consists in building a Reduced-Order Model (ROM) \(\varvec{\widetilde{f}}(\mathbf{x} ,\varvec{\chi })\) of the solver and to express, objective function and constraints in terms of the approximate field. This approach yields a better insight into detailed characteristics of the flow at every optimization iteration. The corresponding optimization problem is stated as


where \(\mathbf{x} \) is the set of points defining the space discretization \(\Omega \subset \mathbb {R}^n\) with n the number of nodes, \(\varvec{\chi }\) the design variable, \(\in \mathcal {D}\subset \mathbb {R}^{d}\), and \(\varvec{\chi }^{*}\) is the optimum configuration of the objective function \(\mathcal {J} \in \mathbb {R}\) respecting constraints \(\mathbf{g} \), \(\mathbf{h} \).

The different steps of the full-field SBO are illustrated in Fig. 5. First, the DoE \(\varvec{X} = \{\varvec{\chi }^{(0)}\,,... \,,\varvec{\chi }^{(M)}\}\) is generated in \(\mathcal {D}\) with one of the a priori sampling methods cited in “Off-line design of experiment” section. Once the fields \(\varvec{f}(\mathbf{x} ,\varvec{\chi }^{(i)})\), \(i=\{1,\,... \,, M\}\) have been computed, the ROM \(\varvec{\widetilde{f}}(\mathbf{x} ,\varvec{\chi })\) is built and the optimization is performed with the functionals \(\mathscr {Q}(\varvec{\widetilde{f}(\mathbf{x} ,\chi )})= \{\mathcal {J}(\varvec{\widetilde{f}(\mathbf{x} ,\chi )}),\varvec{g(\widetilde{f}(\mathbf{x} ,\chi ))},\varvec{h(\widetilde{f}(\mathbf{x} ,\chi ))}\}\).

Fig. 5
figure 5

The full-field SBO strategy

Reduced-order modeling” section reviews the ROM techniques; associated adaptive strategies are presented in “Adaptive reduced-order models” section.

Reduced-order modeling

While the surrogate modeling techniques cited in the previous Sections can exploit integrated quantities, ROM can capture spatial information in a model approximation by expressing the solution as a linear combination of a limited number of modes. Thus assuming that few independent modes govern the system dynamics, a significant reduction in the solution’s computational cost can be achieved [47]. Applications to the description of turbulent flow have demonstrated the capture of non-linear features. Aubry et al. [9] constructed a 5-mode system that qualitatively reproduces the turbulent boundary layer discontinuity. This approach was extended to diverse types of flows [79, 167, 214]. The ROM can be intrusive or non-intrusive (direct or indirect) depending on whether the physical model is considered as a black box or the reduced Partial Differential Equation (PDE) is solved online.

Intrusive ROM (IROM) reproduces the physical behavior of a system by approximating the governing equations and source code and is typically derived by POD and Galerkin projection. Therefore, it retains much of the physical characteristics of the original system due to its intrusive nature. Physical models and engineering problems are described by Partial Differential Equations (PDEs). These equations usually depends on a number of parameters, corresponding to physical or geometrical properties of the model as well as to initial or boundary conditions of the problem, and can be deterministic or subject to some source of uncertainty. The IROM requires code modifications seeking to reproduce these physical PDEs to approximate there solutions \(\varvec{f}(\mathbf{x} ,\mathbf{t} )\) spatial distribution \(\mathbf{x} \) at time \(\mathbf{t} \) (such as displacement or velocity spatial distribution). The PDE to approximate may be non-linear and depending on time \(\varvec{t}\), space \(\mathbf{x} \) and physical parameters \(\varvec{\chi }\). The approximated solution \(\widetilde{\varvec{f}}(\mathbf{x} ,\mathbf{t} )\) may be obtained, for example, by Galerkin projection onto a subspace spanned by a set of modes [5, 6, 227]

$$\begin{aligned} \widetilde{\varvec{f}}(\mathbf{x} ,\mathbf{t} ) = \sum _{k=1}^{m}\alpha _k (\mathbf{t} )\Phi _k (\mathbf{x} ) \end{aligned}$$

where \(\alpha _k (\mathbf{t} )\) are temporal coefficients that capture the time dynamics, \(\Phi _k (\mathbf{x} )\) are spatial modes. The modes may be obtained by Proper Orthogonal Decomposition (POD) also known as Karhunen-Loève Expansion (KLE) [126] in the field of turbulence or Principal Component Analysis (PCA) [100] in machine learning applications. The POD relies on the extraction of the reduced basis by truncated Singular Value Decomposition (SVD) of the snapshots matrix. This technique produces a low rank global basis of the most impacting modes [198] and has been shown to be appropriate for coherent flow structures that can be sorted by their energy content [25]. Intrusive POD has been applied by [121] to estimate state variables and associated variables in transonic flows in gradient-based aerodynamic shape optimization, but also in mechanical systems [125]. Other approaches are Krylov subspace [13] used on large scale systems structural dynamics or turbulence in CFD, Fourier well suited for periodic signals series as in Harmonic Balance Method (HBM) [86, 230], or Voltera Series [182] applied to structural, aeroelasticity problem, control engineering, or electrical engineering. The non-linear engineering applications were reviewed by [38], by [23] for dynamical systems projection-based approaches and by [193] for aeroelastic identification and more general detailed references about aeroelastic application [7]. IROMs may cover different kinds of separated representations of the involved unknown fields as well as different constructors able to address a variety of linear and non linear models, elliptic,parabolic, and hyperbolic. Extensions were proposed to general linear evolution schemes such as finite volume schemes for parabolic and hyperbolic evolution equations [84]. In a non-exhaustive way, one can also find Reduced-Basis Method (RBM) [179], Empirical Interpolation Method (EIM) and Discrete EIM (DEIM) [238]. The evaluation cost of the projected non-linear model is not always more interesting than that of the full model in representing non-linear dynamics. This limitation can be addressed by several existing approaches and ROM extensions, including POD-DEIM for which the linear terms may be treated in POD-Galerkin type models, an additional POD basis is introduced to represent the non-linear terms in the ROM. The location of the non-linear interpolation points are determined based on a DEIM correction algorithm, which minimizes the non-linear residuals. Three different model reduction techniques are compared by [197] the Galerkin projection onto a POD basis representing the principal variable, the Galerkin projection onto two separate POD bases, one basis for the principal variable, a second basis for the nonlinear convection term, and the DEIM for evaluating the projected nonlinear terms were applied to a mode equation and the Navier–Stokes equations. The nonlinearity arises from the convection phenomenon, the solution exhibits advection, diffusion, and instability, and the system exhibits oscillatory behavior that prevails. Provided the number of POD modes is large enough, Galerkin projections have been shown to perform better, with a reduced nonlinear term that still preserves energy. The Galerkin projection with the second basis that represents the nonlinearities also performs well, but the energy preservation criterion is significantly impaired. The DEIM model reduction technique succeeds for wind flow in the limit cycle regime, but fails for wind flow in the transient regime, producing reduced order models that exhibit a fine time singularity. Proper Generalized Decomposition (PGD) [41, 42] as well covers a variety of applications from structural optimization to CFD optimization. Under the assumption of the influence of PDE uncertainties, the polynomial chaos model (PCE) can also be used. It is a polynomial of random variables based on the homogeneous chaos theory of Wiener [106], based an expansion of chaos using Hermite polynomials. These direct approaches are closer to the behavior of the simulated system since they are directly applied to the physical equations. Nevertheless, such methods are prone to instability and non-linearity efficiency problems, and they are also difficult to implement, as they require a modification of the source code [222].

Non-intrusive ROMs

To avoid this problem, non-intrusive approaches have been introduced, such as Non-Intrusive POD (NIPOD), also known as Galerkin-free [191] or POD with Interpolation (PODI) [31]. Unlike direct ROM approaches, indirect ROMs do not require calls to the differential equation solver to perform the interpolation. As in the intrusive ROM, the POD snapshot method, developed by [198], allows to empirically build the basis vectors keeping the modes whose sum of energies represents at least 90% of the total energy, while the neglected modes represent less than 1% of the main mode’s energy. This POD technique was applied by [31] as an interpolation of known designs for inverse design purposes. Coelho et al. [47] successfully applied a two-step NIPOD on a 3D flexible wing shape optimization, involving weak code coupling between the solid and fluid models. On the one hand, the coupling variables were reduced by the POD, expressing the interface pressure as a linear combination of a few modes. On the other hand, the scalar coefficients obtained by the linear expansion of the POD modes were approximated by polynomial response surfaces and moving least squares surrogates. The idea of a Non-Intrusive POD basis in the offline phase, is to store the full-field output (pressure, velocity field, etc.) and use it to predict the vectors online. In the online phase, the solution vectors are approached with the linear combination of the basis vectors. First M vectors are sampled and stored in the so-called snapshot matrix \(\varvec{S}\). The DoE \(\mathcal {X} = \{\varvec{\chi }^{(1)},\ldots ,\varvec{\chi }^{(M)}\}\) is generated using an ad hoc sampling method (LCVT, hypercube,etc.) and \(\varvec{S}\) is constructed with the \(\varvec{f}\) function evaluating the DoE \(\varvec{\mathcal {X}}\)

$$\begin{aligned} \varvec{S} = \left[ \varvec{f}(\mathbf{x} ,\varvec{\chi }^{(1)})\, \ldots \, \varvec{f}(\mathbf{x} ,\varvec{\chi }^{(M)})\right] \end{aligned}$$

where \(\mathbf{x} \) is the discretised space vector of the size \(dim\times n\), \(dim\{1,2,3\}\) is the physical space dimension. When \(n\ge M\) is considered in the following, the snapshots matrix may be defined as the sum of the mean \(\bar{\varvec{s}}\) of all the snapshots

$$\begin{aligned} \bar{\varvec{s}} =\frac{1}{M} \sum _{i=1}^{M} \varvec{f}(\mathbf{x} ,\varvec{\chi }^{(i)}) \end{aligned}$$

and the matrix of fluctuations \(\mathcal {S}\)

$$\begin{aligned} \varvec{S}=\bar{\varvec{s}}\cdot \begin{pmatrix} 1\\ \vdots \\ 1 \end{pmatrix}^{T}_{M\times 1} + \, \mathcal {S}. \end{aligned}$$

Note the difference between \(\varvec{S}\) and \(\mathcal {S}\) symbols, denoting snapshot and fluctuation matrices, respectively. To eigen decompose the covariance matrix \(\varvec{C} = \varvec{S}\varvec{S}^T \), the SVD of a rectangular matrix \(\varvec{S}\) of the size \(n\times M\) may be considered.

$$\begin{aligned} \mathcal {S} = \varvec{\Phi } \varvec{\Sigma } \varvec{\Psi }^{T} \end{aligned}$$

where \(\varvec{\Phi }\) and \(\varvec{\Psi }^T\) matrices are respectively composed of the left and right singular vectors, of size \(n\times M\) and \(M\times n\), \(\varvec{\Sigma }\) is a diagonal matrix containing the singular values of \(\mathcal {S}\) and equivalent when squared to eigen values of the “big” \((n\times n)\) \(\varvec{C} = \mathcal {S}\mathcal {S}^T\) or “small” \(M\times M\) correlation matrix \(\varvec{c} = \mathcal {S}^T\mathcal {S}\). Note that the decomposition may be performed by different approaches, the most common being “economical” SVD. In the offline phase, this method is used to obtain the decomposition for the initial dataset, and once in the online phase, its incremental version [155] uses only the newly added points instead of the overall DoE at each iteration. Often the basis is truncated to lower the computational burden thus speed-up computation. The idea behind the truncation is to consider the most relevant modes only. The latter are determined by minimizing the relative Frobenius error norm of the difference between the original \(\varvec{S}\) and its reconstruction \(\varvec{S}_{m_l,LF}\) with \(m_l<M_l\) basis vectors

$$\begin{aligned} \varepsilon (m)=\frac{||\varvec{S} - \widetilde{\varvec{S}}_{m}||_{F}}{||\varvec{S} ||_{F}}. \end{aligned}$$

The m optimal value \(m^{*}\) is evaluated from the minimization of \(\varepsilon (m)\)

$$\begin{aligned} m^{*} = \mathop {{{\,\mathrm{\hbox {arg}\,\hbox {min}}\,}}}\limits _{m\in \{1\,,\,... \,,\, M\}}\varepsilon (m). \end{aligned}$$

Once the NIPOD basis \(\Phi \) is obtained, the snapshots matrix \(\varvec{S}\) is projected into this basis to determine the scalar coefficients \(\alpha (\varvec{\chi }^{(i)})\) for the DoE points belonging to \(\mathcal {X}\)

$$\begin{aligned} \alpha ^i(\varvec{\chi }) = \varvec{\Phi }(\mathbf{x} )^{T}(f(\mathbf{x} ,\varvec{\chi }_i)-\bar{\varvec{s}}), \,\varvec{\chi }_i \in \mathcal {X}, \, i= 1,\,...\,,\, M \end{aligned}$$

The \(\widetilde{\varvec{f}}(\mathbf{x} ,\varvec{\chi })\) can then be approximated for an arbitrary point \(\varvec{\chi }\) by

$$\begin{aligned} \widetilde{\varvec{f}}(\varvec{\chi },\mathbf{x} ) = \bar{\varvec{s}} + \varvec{\Phi }(\mathbf{x} )\widetilde{\alpha }(\varvec{\chi },\varvec{\theta }),\, \forall \varvec{\chi }\in \mathcal {D} \end{aligned}$$

with \(\widetilde{\alpha }(\varvec{\chi })\) the surrogate model of the projection coefficients \(\alpha (\varvec{\chi })\) that requires model paramaters (hyperparameters) \(\varvec{\theta }\), to be identified in the offline phase.

The obtained reduced order field is used to evaluation quantities to optimize, or used in other contexts where the calls to solver and computional ressourses demand is too high, such as UQ application. In the context of structural highly contrained optimization, the idea of CPOD has been introduced by [226, 227] in order to insure the precise estimation of the quantities of interest of all the training experiments while truncating the POD basis. This method is an extension of the POD in the context of a search for the representation of objectives and constraints, aiming to take into account constraints in the search for the optimal POD basis. The constrained orthogonal projection uses \(\Psi \) defined from the QR decomposition and the SVD. Another NIROM extension takle the local non-linearity for CFD applications, the Local Decomposition Method (LDM), is proposed by [65] as an extension of NIPOD and inspired by the mixture of experts and local reduced-order dynamic modeling. It consists in using multiple POD bases adapted to delimited regions of the design space, distinguished by the sampled snapshots features. This separation allowed one to adapt the POD approximations to each physical regime, to capture local non-linearities. Another well-known NIPOD extension is the Gappy-POD dedicated originally to human face image reconstruction from incomplete data [70]. Such an approach has been applied by [31], to fill in incomplete data fields from known snapshots. Gappy-POD has been used to reconstruct fields in fluid and structural applications where distributed sensors provide limited field measurements [49]. Another approach uses the concept of shape manifold for a reduced order representation. Meng et al. [137] reviews the shape manifold designed for ROM representation of complex shapes encountered in mechanical problems. The general idea is to define the shape space, known as POD-morphing [166], in which the structure boundary evolves. The reduced representation [164] is obtained by determining the intrinsic dimensionality of the problem, independent of the original design parameters, and by approximating a hyper surface, i.e., a shape manifold, connecting all the known admissible shapes using level set functions. Moreover, an optimal parameterization can be obtained for arbitrary shapes, where the parameters must be defined a posteriori. The family of manifold step algorithms for predictor–corrector optimization in a reduced shape space guarantees the admissibility of the solution without additional constraints. Applications include structural optimization [165, 166], springback minimization in metal forming [117], microstructural design of materials [223], and inverse problems [138].

Adaptive reduced-order models

The ROM models presented in the former section are often improved during the optimization process in an attempt to target the regions of interest more efficiently. In the ROM context, adaptive approaches can refer to the procedure of orthogonal basis adaptation with each new vector, adding as few samples as possible to build the whole basis. As for the scalar SBO, there are also approaches aiming at choosing samples to reduce the calls to expensive solvers. A range of these approaches is presented in the following paragraphs.

Trust-Region Methods Among intrusive ROMs, [24] applied POD Reduced-Order Models and TR method to minimize the mean drag under rotary control of a cylinder wake in the laminar regime reducing its relative mean drag by 30%. The Sequential sampling schemes TR used on the scalar SBO (see “Dedicated infil” section) were coupled to ROM to solve constrained and unconstrained optimization [172].

Error-based infill methods Among error-based infill methods, a LOO (see “Overview on surrogate-based optimization” section) approach for POD-based models was proposed by [29] along with an error estimate of the POD model to select new sample locations. This strategy was compared to classical a priori uniform sampling and tested on an analytical test case and the 2D turbulent flow around a RAE2822 airfoil. It was concluded that the convergence of the LOO-CV adaptive-based procedure was faster. This infill criterion was applied to the NIPOD approach by [82] where an improvement of the modal coefficients was obtained by taking into account each snapshot’s influence to represent the full-field model. Two cases based on the RAE2822 airfoil demonstrated the error control over the whole parametric space even in the non-linear transonic region.

Greedy approaches The principle of a greedy algorithm is to choose the most promising elements (or to suppress the least promising ones) iteratively to obtain the best prediction. Once the models are built in the off-line phase, the most (or least) predictive features may be selected during the online phase based on error criteria. The ROM database model’s accuracy can be adjusted in the offline phase, where a local ROM database is built by a greedy procedure [162]. The greedy algorithm is used for the selection of snapshots for the approximation of the parameterized PDE solution [147, 216] and in a non-intrusive framework [67]. Such approach was applied by [10] to time-dependent non linear problems using RBF-based NIROM. This model adaptively generates snapshots based on a greedy approach to minimize the overall computational cost.

Adaptive Gappy POD [32] use an adaptive Gappy POD (GPOD) (see “Reduced-order modeling” section) for two-dimensional airfoil inverse design. This approach aims at finding the optimal sensor locations and adaptively improve the POD basis. At each iteration, the criterion used to achieve the selection is based on the Gappy POD maximum error. The complete model information is then generated by solving the system between known, and unknown data at this position, the database is enriched using the resulting snapshot, and the reduced basis is updated. These steps are then repeated, using the updated model to calculate the reduced states at each locations around the airfoil.

Active-learning approaches The NIPOD was adapted to an active-learningFootnote 4 framework using the partitioning approach in the LDM method [65]. The experimental design is divided into several parts corresponding to values associated with a shock sensor allowing to identify the areas where discontinuous structures will likely appear. Once targeted, these regions are clustered and enriched using error, sensitivity, and global entropy metrics. The procedure’s application reveals a capacity to better take into account the regions of high gradient and discontinuity, in the case of a shock problem in a turbulent flow around the RAE2822 wing in transonic regime.

PCA-based infill Within the UQ framework, the implementation of [88] is a non-intrusive method where corrective sampling is used to improve stability and precision. PCA allows building a new basis that describes the shapes globally. The Bayesian optimization is performed in the space of reduced dimension of the active components, complemented by a random embedding in the space of the remaining components, to approach the optimization problem in reduced dimension.

Multi-fidelity reduced-order methods

Traditional multi-fidelity surrogate models are based on integrated scalar data from vector QoI. The correlation between the different levels of solvers is not always meaningful through these integrated quantities, thereby missing valuable information. This is why the approaches have recently been extended to a vector representation using ROMs. Several approaches can be distinguished between those that combine multiple level of fidelity on the ROM model, which are categorized as fusion models, and models using the MF correction approaches. The ROM methods of the last reviewed section outperform scalar approaches in complex non-linear optimizations. The MFM extension of these methods are promising, there references are presented in the present section.

Multi-fidelity vectorial modeling” section reviews the MF ROM extensions; associated adaptive strategies are presented in “Adaptive multi-fidelity vector models” section.

Multi-fidelity vectorial modeling

MF fusion

Toal [211] adapted the Gappy POD (see “Reduced-order modeling” section) to a MF surrogate-based optimization and UQ framework. A bi-variate optimization of a NACA 0012 airfoil is performed by predicting the two-dimensional HF pressure distribution from its computed LF counterpart. In such framework, [211] demonstrated better accuracy of the MF Gappy POD than the equivalent Kriging and co-Kriging models of predicting the drag polar of an airfoil over a bivariate aerodynamic design space. Improving the accuracy of the drag variation in the design space of an airfoil offers a significant improvement in optimization performance. The approach has also shown promising results in reducing the cost of predicting nodal uncertainties in a thermo-mechanical gas turbine rotor model. Mifsud et al. [139] developed a bi-fidelity POD extension using two discretization levels of numerical experiments. It consists on building an optimal set of orthogonal basis vectors from the two fidelity snapshots subsets. The set of basis are used to construct the overall response, then predict snapshots in unknown locations. This approach is tested for flow prediction using RANS at two fidelity levels of mesh refinement. The numerical examples led to the conclusion that the efficiency depends heavily on the correlation between the two fidelity levels. Inspired by the CPOD of [22, 226] developed the MFNIPOD extension based on QR decomposition allowing to build a bi-fidelity orthogonal basis. This \(\varvec{\Phi }_{MF}\) basis is constructed from the concatenation of the high and low fidelity bases \(\varvec{\Phi }_{HF}\) and \(\varvec{\Phi }_{LF}\) respectively, allowing the HF interpolation. The final interpolation of the field is obtained by projecting the MF field on a reduced MF basis \(\varvec{\Phi }_{MF}=[\varvec{\Phi }_{HF}|\varvec{\Phi }_{LF}]\). Unlike the MF NIPOD extension of [139], the MFNIPOD enriches the reduced space obtained from scarce HF information with LF related orthogonal modes, giving a hierarchical ROM. The method was compared to a model based on a single-fidelity RBF Neural Network (RBFNN) and co-Kriging on a constrained 2D analytical optimization and the 19-D optimization of an industrial compressor blade and its non-axisymmetric hub. The results show that MFNIPOD outperforms models based on co-Kriging and RBFNN in terms of costs and accuracy. Combining different data simulations from multiple fidelity snapshots presents difficulties because the two sets of fields lie most likely in different spaces. When fidelity levels are based on different mesh refinement, this problem may be tackled by projecting the LF outputs onto the finer HF grid [20]. Problems of inconsistency were also addressed by [154] who applied a MF ROM using a common subspace, to a transonic wing problem. A reduction in computational training cost between 10% and 73% was observed compared to a single-fidelity approach of comparable accuracy. In a different approach, the MFROM and MFNIPOD extensions inspired the development of a model based on MF PCA by [33]. The Shared Principal Component (SPC) MF surrogate model consists in building the POD-based model separately with the sampled HF and then LF vectors and linking them assuming that the HF variations comply with those observed on the LF functions. Consequently, LF sampled vectors are similar to the principal components of the HF samples. The separation allows having two different mesh configurations with different fidelity levels. This method allows the fusion of LF and HF samples within a common metamodel and is applied to the design of turbomachinery blades. The SPC reduced the error to about 78% with respect to single-fidelity surrogates. The Space-Mapping surrogate presented the lowest error ratio among other tested methods. SPC appeared more efficient than space mapping, co-Kriging, and MFNIPOD [22]. Yonda et al. [233] used an MF ROM extensions based on the PODI [31] and compared it to non-linear least squares ROM [83, 237]. Two level fidelity simulations of 2D and 3D turbine blades are tested and used in an optimization loop. The POD-based method directly decomposes LF flow fields into main components covering a reduced solution subspace, where HF values are interpolated. Compared to a Kriging model based on design space variables, this model is smaller in size. The POD-based method showed a faster convergence than scalar and single-fidelity optimization while reaching the same profile efficiency and similar design. Thenon [210] proposed another MF co-Kriging based on the POD equivalent approach, the Principal Component Analysis (PCA), from machine learning community. The LF sampling vectors are directly projected on the reduced basis issued from the HF vectors. The co-Kriging approximation is performed among both Low- and High-fidelity level of projected coefficients. The method was applied to pressure maps outputs of a two-level oil tank model. The MF vectorial metamodel appeared effective with a condition on the correlation between the fidelity levels of the simulation outputs. Xiao et al. [228] proposed an alternative efficient approach that deals with the dynamic outputs based on a Galerkin projection in which a weight is assigned to two and three levels of MF data constructed by varying the number of basis vectors. Numerical tests show better results for three-level MF Kriging than single and two-level Kriging models. Following an online POD based topological optimization, [227] presented a MF approach to build a POD based ROM incrementally from successive variable-fidelity approximations of the global physical equations. Considering a non-deterministic framework [39] propose a sparse non-intrusive PCE adapted to MFM. Kriging and orthogonal polynomial covariance function are used to build the full-field model and an iterative scheme detects the optimal PCE basis in each fidelity level. The Kriging POD was also adapted by [140] to two fidelity levels. In the same spirit as PCE-Kriging, the basis functions are evaluated from a stochastic field where it is not necessary to calculate the Kriging trend functions separately.

Corrective MF

Poethke et al. [159] presented a method combining MF and POD and compared it to the scalar co-Kriging and single-fidelity Kriging. Instead of using the scalar objective value, the correction to the lower fidelity model is applied to the computational domain directly prior to any form of post-processing. The comparison between Gappy POD and single-fidelity Kriging was performed through UQ application for a number of gas turbine airfoils subject to different flow regimes. Wang et al. [221] proposed a multi-fidelity ROM for the reconstruction of a steady flow field. It performs a HF-LF corrective mapping of the bi-level ROM modal coefficients separately. This approach was applied to predict the flow with shock waves of a NACA0012 airfoil achieving better accuracy than the traditional Kriging ROM. Similarly, [128] proposed a multi-fidelity POD representation by computing the coarser and finer mesh CFD solutions \(\varvec{S}_{LF}\) and \(\varvec{S}_{HF}\) respectively, and add the POD interpolated field solution difference \(\Delta \varvec{S}_{POD}\)

$$\begin{aligned} \varvec{S}_{MF} = \varvec{S}_{LF} + \Delta \varvec{S}_{POD} \end{aligned}$$

Adaptive multi-fidelity vector models

Multifidelity offers an alternative to oversampling the HF response when seeking to represent meaningful surrogates. To address this challenge, methods to reduce computational cost involve creating many low-fidelity samples to supplement the few HF samples. The LF response has some error compared to the HF response, however, the samples are obtained at a much lower computational cost. These methods have reduced the computational cost or reduced the substitution error, or both. Sampling strategies have been adapted to the MF ROM to take advantage of the reduced cost of LF sampling or to adapt the MF ROM to HF. The adaptive ROMS and MFMs have been demonstrated to be a promising perspective to MFM ROM models [22, 233]. This section explores adaptive schemes involving MFM vector models.

Error-based sampling

An extension of the DoE Voronoi cells is performed in the framework of sequential sampling by [210] selecting the points in multiple Voronoi cells associated with the highest CV errors. Then, for each level of fidelity, a point is selected iteratively from the highest to the lowest corresponding error in each cell, until the calculation’s budget is reached. The fidelity level is chosen according to the IMSE weighted by the evaluation costs. In this paper, it has been observed that the two levels of fidelity should be sufficiently correlated. Besides, the LF computational cost should be limited to increase the method’s efficiency. The method has been applied to a POD co-Kriging and is compared to a MF scalar approach. It was shown that the POD vectorial approach improved the prediction performance of scalar models even with a poor HF-LF correlation. The corrective MF approach have been coupled to Gappy POD by [211] allowing to reconstruct the HF discrete gappy dataset with LF data. Benamara et al. [21] presents a MF adaptive approach based on the Gappy POD identifying a HF subspace to be covered by the LF vectors.

MF Bayesian framework

The MFNIRB proposed by [105] as an extension to the Non-Intrusive Reduced-Basis (NIRB) method of [35] takes into account constraints and shows promising results on a 2D analytical test case [22]. The method was compared to a scalar single-fidelity Kriging and used the constrained EI [12] criterion to sample iteratively the design space. However, this attempt is based on HF sampling on low-dimensional parameter space. The EI criterion was also applied by [145] in a MF reduced-order context. The expression of the EI criterion is evaluated using the LF data variance and mean. This modified EI is used to add LF and HF data, generated from LATIN Proper Generalized Decomposition (PGD) model reduction framework [41], assisting a mechanical part optimization problem.


This paper presents a non-exhaustive review of surrogate methods that address simulation cost issues in optimizing physical systems modeled with computer codes focusing on fluid/solid mechanics in potentially multidisciplinary settings. The reviewed methods’ common feature is the construction of surrogate models based on sequentially updated Design Of Experiments. The techniques reviewed include scalar, vector, and multi-fidelity surrogates, along with their associated infill strategies. Surrogate vectorial multi-fidelity models based on reduced-order approaches appear to outperform response surface approximations and control the overall simulation budget. However, the multi-fidelity approach’s feasibility depends on the quality and cost of physical models available for a given application. The trade-off between cost and accuracy in the multi-fidelity model is conditioned by the correlation between LF (supposed cheap) and HF (supposed expensive) simulators and their CPU ratio. The development of dedicated infill techniques requires criteria allowing both for the site’s choice and the new simulation’s fidelity level under the overall simulation budget constraint.

Data Availability Statement

No datasets were generated or analyzed during the current study.


  1. The term fidelity refers here to both the time of a calculation and its accuracy [72].

  2. This study focuses on surrogate modeling using regression and interpolation. However, surrogate modeling also includes classification techniques [195, 232].

  3. See, e.g., Section 2 of [71].

  4. Active learning consists in adding as little information as possible by selecting a group of features through unidentified observations that will be labeled by an oracle (e.g., a human annotator) [188].


\({\chi }\) :

Design space parameters

\(\mathcal {D}\) :

Design space

\(\mathcal {J}\) :

Functional denoting the cost (or the objective) function of an optimization problem

d :

Dimension of the design space

f :

Functional representing the simulation

g :

Inequality constraint

h :

Equality constraint

M :

Sampling size


Augmented Expected Improvement


Computational Fluid Dynamics


Computational Structural Mechanics


Design of Experiment


Expected Improvement




Lower Confidence Bound




Multi-Fidelity Methods


Non-Intrusive Proper Orthogonal Decomposition


Non-intrusive Reduced-Order Methods


Probability of Improvement


Proper Orthogonal Decomposition


Quantities of Interest


Reynolds Averaged Navier-Stokes


Reduced-Order Methods


Surrogate-Based Optimization




Upper Confidence Bound


  1. Alexandrov N, Lewis R, Gumbert C, Alex N, Green L, Newman P. Optimization with variable-fidelity models applied to wing design. Opt Model. 2000.

    Article  Google Scholar 

  2. Alexandrov NM, Dennis JE, Lewis RM, Torczon V. A trust-region framework for managing the use of approximation models in optimization. Struct Optim. 1998;15(1):16–23.

    Article  Google Scholar 

  3. Alexandrov NM, Lewis RM. An overview of first-order model management for engineering optimization. Optimi Eng. 2001;2:413–30.

    Article  Google Scholar 

  4. Alexandrov NM, Lewis RM, Gumbert CR, Green LL, Newman PA. Approximation and model management in aerodynamic optimization with variable-fidelity models. J Aircraft. 2001;38(6):1093–101.

    Article  Google Scholar 

  5. Amabili M, Touzé C. Reduced-order models for nonlinear vibrations of fluid-filled circular cylindrical shells: Comparison of POD and asymptotic nonlinear normal modes methods. J Fluids Struct. 2007;23(6):885–903.

    Article  Google Scholar 

  6. Amsallem D, Deolalikar S, Gurrola F, Farhat C. Model Predictive Control under Coupled Fluid-Structure Constraints Using a Database of Reduced-Order Models on a Tablet. 21st AIAA Computational Fluid Dynamics Conference. 2013;

  7. Amsallem D, Farhat C. Interpolation method for adapting reduced-order models and application to aeroelasticity. AIAA J. 2008;46:1803–13.

    Article  Google Scholar 

  8. Amsallem D, Zahr MJ, Farhat C. Nonlinear model order reduction based on local reduced-order bases. Int J Numer Methods Eng. 2012;92(10):891–916.

    MathSciNet  Article  Google Scholar 

  9. Aubry N, Holmes P, Lumley J, Stone E. The dynamics of coherent structures in the wall region of a turbulent boundary layer. J Fluid Mech. 1988;192:115–73.

    MathSciNet  Article  Google Scholar 

  10. Audouze C, De Vuyst F, Nair PB. Nonintrusive reduced-order modeling of parametrized time-dependent partial differential equations. Numer Methods Part Diff Eq. 2013;29(5):1587–628.

    MathSciNet  Article  MATH  Google Scholar 

  11. Auer P. Using confidence bounds for exploitation-exploration trade-offs. J Mach Learn Res. 2002;3:397–422.

    MathSciNet  Article  MATH  Google Scholar 

  12. Bagheri S, Konen W, Allmendinger R, Branke J, Deb K, Fieldsend J, Quagliarella D, Sindhya K. Constraint handling in efficient global optimization. Proceedings of the Genetic and Evolutionary Computation Conference on - GECCO ’17, 2017;673–680.

  13. Bai Z. Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems. Appl Numer Math. 2002;43(1):9–44.

    MathSciNet  Article  MATH  Google Scholar 

  14. Bakr MH, Bandler JW, Madsen K, Søndergaard J. Review of the space mapping approach to engineering optimization and modeling. 2000. p. 36.

  15. Balabanov V, Haftka R, Grossman B, Mason W, Watson L. Multifidelity response surface model for hsct wing bending material weight. Surface. 1998.

    Article  Google Scholar 

  16. Bandler J, Cheng Q, Dakroury S, Mohamed A, Bakr M, Madsen K, Sondergaard J. Space Mapping: The State of the Art. IEEE Trans Microwave Theory Techniq. 2004;52(1):337–61.

    Article  Google Scholar 

  17. Bartoli N, Lefebvre T, Dubreuil S, Olivanti R, Priem R, Bons N, Martins JRRA, Morlier J. Adaptive modeling strategy for constrained global optimization with application to aerodynamic wing design. Aerospace Sci Technol. 2019;2:78.

    Google Scholar 

  18. Baur U, Beattie C, Benner P, Gugercin S. Interpolatory projection methods for parameterized model reduction. SIAM J Sci Computing. 2011;33(5):2489–518.

    MathSciNet  Article  MATH  Google Scholar 

  19. Ben Salem M. Model selection and adaptive sampling in surrogate modeling: Kriging and beyond. UNIVERSITE DE LYON. 2018;

  20. Benamara T. Full-field Multi-Fidelity Surrogate Models for Optimal Design of Turbomachines. 2017;

  21. Benamara T, Breitkopf P, Lepot I, Sainvitu C. Adaptive infill sampling criterion for multi-fidelity optimization based on Gappy-POD: Application to the flight domain study of a transonic airfoil. Struct Multidiscipl Optim. 2016;54(4):843–55.

    Article  Google Scholar 

  22. Benamara T, Breitkopf P, Lepot I, Sainvitu C, Villon P. Multi-fidelity POD surrogate-assisted optimization: concept and aero-design study. Struct Multidiscipl Optim. 2017;56(6):1387–412.

    Article  Google Scholar 

  23. Benner P, Gugercin S, Willcox K. A survey of projection-based model reduction methods for parametric dynamical systems. SIAM Rev. 2015;57:483–531.

    MathSciNet  Article  MATH  Google Scholar 

  24. Bergmann M, Cordier L. Contrôle optimal par réduction de modèle POD et méthode à région de confiance du sillage laminaire d’un cylindre circulaire. Mécan Ind. 2007;8(2):111–8.

    Article  Google Scholar 

  25. Berkooz G, Holmes P, Lumley J. The proper orthogonal decomposition in the analysis of turbulent flows. Ann Rev Fluid Mech. 2003;25:539–75.

    Article  Google Scholar 

  26. Bjorkman M. Global optimization of costly nonconvex functions using radial Basis functions. Optimiz Eng. 2001;25:9.

    MathSciNet  Google Scholar 

  27. Boopathy K, Rumpfkeil M. A multivariate interpolation and regression enhanced kriging surrogate model. In: 21st AIAA Computational Fluid Dynamics Conference. 2013.

  28. Box GEP, Behnken DW. Some new three level designs for the study of quantitative variables. Technometrics. 1960;2(4):455–75.

    MathSciNet  Article  Google Scholar 

  29. Braconnier T, Ferrier M, Jouhaud J-C, Montagnac M, Sagaut P. Towards an adaptive POD/SVD surrogate model for aeronautic design. Computers Fluids. 2011;40(1):195–209.

    MathSciNet  Article  MATH  Google Scholar 

  30. Brochu E, Cora VM, de Freitas N. A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning. 2010; arXiv:1012.2599 [cs].

  31. Bui-Thanh T, Damodaran M, Willcox K. Aerodynamic data reconstruction and inverse design using proper orthogonal decomposition. AIAA J. 2004;42(8):1505–16.

    Article  Google Scholar 

  32. Bui-Thanh T, Willcox K, Ghattas O. Model reduction for large-scale systems with high-dimensional parametric input space. SIAM J Sci Comput. 2008;30(6):3270–88.

    MathSciNet  Article  MATH  Google Scholar 

  33. Bunnell S, Gorrell S, Salmon J. Multi-fidelity surrogates from shared principal components: application to structural design exploration and optimization. Struct Multidiscipl Optim. 2021.

    Article  Google Scholar 

  34. Cai X, Qiu H, Gao L, Wei L, Shao X. Adaptive radial-basis-function-based multifidelity metamodeling for expensive black-box problems. AIAA J. 2017;55:1–13.

    Article  Google Scholar 

  35. Chakir R, Maday Y. Une méthode combinée d’éléments finis à deux grilles/bases réduites pour l’approximation des solutions d’une E.D.P. paramétrique. Comptes Rendus Mathematique. 2009;347(7–8):435–40.

    MathSciNet  Article  Google Scholar 

  36. Chang KJ, Haftka RT, Giles GL, Kao P-J. Sensitivity-based scaling for approximating structural response. J Aircraft. 1993;30(2):283–8.

    Article  Google Scholar 

  37. Cheng B, Titterington DM. Neural networks: A review from a statistical perspective. Stat Sci. 1994;9(1):2–30.

    MathSciNet  MATH  Google Scholar 

  38. Cheng C, Peng Z, Zhang W, Meng G. Volterra-series-based nonlinear system modeling and its engineering applications: A state-of-the-art review. Mech Syst Signal Process. 2016.

    Article  Google Scholar 

  39. Cheng K, Lu Z, Zhen Y. Multi-level multi-fidelity sparse polynomial chaos expansion based on gaussian process regression. Computer Methods Appl Mech Eng. 2019;349:360–77.

    MathSciNet  Article  MATH  Google Scholar 

  40. Chevalier C, Bect J, Ginsbourger D, Vazquez E, Picheny V, Richet Y. Fast parallel kriging-based stepwise uncertainty reduction with application to the identification of an excursion set. Technometrics. 2014;56(4):455–65.

    MathSciNet  Article  Google Scholar 

  41. Chinesta F, Ladeveze P, Cueto E. A short review on model order reduction based on proper generalized decomposition. Arch Comput Methods Eng. 2011;18(4):395–404.

    Article  Google Scholar 

  42. Chinesta F, Ladevèze P. 3 Proper generalized decomposition. De Gruyter. 2020.

    Article  MATH  Google Scholar 

  43. Chocat R, Brevault L, Balesdent M, Defoort S. Modified covariance matrix adaptation—evolution strategy algorithm for constrained optimization under uncertainty, application to rocket design. Int J Simul Multidiscip Design Optim. 2015;6:A1.

    Article  Google Scholar 

  44. Choi S, Alonso JJ, Kroo IM. Two-level multifidelity design optimization studies for supersonic jets. J Aircraft. 2009;46(3):776–90.

    Article  Google Scholar 

  45. Choi Y, Amsallem D, Farhat C. Gradient-based Constrained Optimization Using a Database of Linear Reduced-Order Models. 2015; arXiv:1506.07849.

  46. Chowdhury S, Mehmani A, Messac A. Quantifying regional error in surrogates by modeling its relationship with sample density. Molecule. 2013.

    Article  Google Scholar 

  47. Coelho R, Breitkopf P, Knopf-Lenoir C. Reduced models for coupled aerodynamic and structural optimization of a flexible wing. 2008.

  48. Coelho R, Breitkopf P, Knopf-Lenoir C, Villon P. Bi-level model reduction for coupled problems:application to a 3d wing. Struct Multidiscip Optim. 2010.

    Article  MATH  Google Scholar 

  49. Cohen K, Siegel S, McLaughlin T. A heuristic approach to effective sensor placement for modeling of a cylinder wake. Computer Fluids. 2006;35(1):103–20.

    Article  Google Scholar 

  50. Colomer J, Bartoli N, Lefebvre T, Martins J, Morlier J. An mdo-based methodology for static aeroelastic scaling of wings under non-similar flow. Struct Multidiscip Optim. 2021.

    MathSciNet  Article  Google Scholar 

  51. Conn AR, Scheinberg K, Vicente LN. Global convergence of general derivative-free trust-region algorithms to first- and second-order critical points. SIAM J Optim. 2009;20(1):387–415.

    MathSciNet  Article  MATH  Google Scholar 

  52. Courrier N, Boucard P-A, Soulier B. Variable-fidelity modeling of structural analysis of assemblies. J Glob Optim. 2016;64(3):577–613.

    MathSciNet  Article  Google Scholar 

  53. Cozad A, Sahinidis NV, Miller DC. A combined first-principles and data-driven approach to model building. Computers Chem Eng. 2015;73:116–27.

    Article  Google Scholar 

  54. Craig PS, Goldstein M, Seheult AH, Smith JA. Constructing partial prior specifications for models of complex physical systems. 1998.

  55. Cressie N. The origins of kriging. Math Geol. 1990;22(3):239–52.

    MathSciNet  Article  MATH  Google Scholar 

  56. Cumming JA, Goldstein M. Small sample bayesian designs for complex high-dimensional models based on information gained using fast approximations. Technometrics. 2009;51(4):377–88.

    MathSciNet  Article  Google Scholar 

  57. Currin C, Mitchell T, Morris M, Ylvisaker D. A bayesian approach to the design and analysis of computer experiments. 1988.

  58. Currin C, Mitchell T, Morris M, Ylvisaker D. Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J Am Stat Assoc. 1991;86(416):953–63.

    MathSciNet  Article  Google Scholar 

  59. Dalle DJ, Fidkowski K. Multifidelity airfoil shape optimization using adaptive meshing. J Aircraft. 2014;463:776–90.

    Google Scholar 

  60. De Lozzo M. Modèles de substitution spatio-temporels et multifidélité Application à l’ingénierie thermique. 2013.

  61. Demange J, Savill AM, Kipouros T. A multifidelity multiobjective optimization framework for high-lift airfoils. Multidicp. 2016.

    Article  Google Scholar 

  62. Du X, Ren J, Leifsson L. Aerodynamic inverse design using multifidelity models and manifold mapping. Aerospace Sci Technol. 2019;85:371–85.

    Article  Google Scholar 

  63. Dubreuil S, Bartoli N, Gogu C, Lefebvre T. Reduction of uncertainties in multidisciplinary analysis based on a polynomial chaos sensitivity study. Sensor. 2021.

    Article  Google Scholar 

  64. Dubreuil S, Bartoli N, Gogu C, Lefebvre T, Mas Colomer J. Extreme value oriented random field discretization based on an hybrid polynomial chaos expansion - kriging approach. Comput Methods Appl Mech Eng. 2018;332:540–71.

    MathSciNet  Article  MATH  Google Scholar 

  65. Dupuis R, Jouhaud J-C, Sagaut P. Surrogate modeling of aerodynamic simulations for multiple operating conditions using machine learning. AIAA J. 2018;56(9):3622–35.

    Article  Google Scholar 

  66. Durantin C, Rouxel J, Désidéri J-A, Glière A. Multifidelity surrogate modeling based on radial basis functions. Struct Multidiscip Optim. 2017;56(5):1061–75.

    Article  Google Scholar 

  67. Dutta S, Farthing M, Perracchione E, Savant G, Putti M. A greedy non-intrusive reduced order model for shallow water equations. In: Computational Physics; 2020.

  68. Dyn N, Levin D, Rippa S. Numerical procedures for surface fitting of scattered data by radial functions. SIAM J Sci Stat Comput. 1986.

    MathSciNet  Article  MATH  Google Scholar 

  69. Efron B. Bootstrap methods: Another look at the jackknife. Ann Stat. 1979;7(1):1–26.

    MathSciNet  Article  Google Scholar 

  70. Everson R, Sirovich L. Karhunen-loève procedure for gappy data. JOSA A. 1995;12:9.

    Article  Google Scholar 

  71. Feliot P, Bect J, Vazquez E. A bayesian approach to constrained single-and multi-objective optimization. J Glob Optim. 2017;67(1–2):97–133.

    MathSciNet  Article  Google Scholar 

  72. Fernández-Godino MG, Park C, Kim N-H, Haftka RT. Review of multi-fidelity models. Statistics. 2016;41:8.

    Google Scholar 

  73. Forrester AI, Keane AJ. Recent advances in surrogate-based optimization. Progr Aerospace Sci. 2009;45(1–3):50–79.

    Article  Google Scholar 

  74. Forrester AI, Sóbester A, Keane AJ. Multi-fidelity optimization via surrogate modelling. Proc R Soc. 2007;463(2088):3251–69.

    MathSciNet  Article  MATH  Google Scholar 

  75. Giselle Fernández-Godino M, Park C, Kim NH, Haftka RT. Issues in deciding whether to use multifidelity surrogates. AIAA J. 2019;57(5):2039–54.

    Article  Google Scholar 

  76. Giunta A, Golividov O, Knill D, Grossman B, Mason W, Watson L, Haftka R. Multidisciplinary design optimization of advanced aircraft configurations. Multidiscip Anal Design. 2007;490:14–34.

    Article  Google Scholar 

  77. Giunta A, Wojtkiewicz S, Eldred M. Overview of Modern Design of Experiments Methods for Computational Simulations (Invited). In: 41st Aerospace Sciences Meeting and Exhibit. 2003;

  78. Goel T, Haftka R, Shyy W, Queipo N. Ensemble of surrogates. Struct Multidiscip Optimiz. 2007;33:199–216.

    Article  Google Scholar 

  79. Gunes H, Liakopoulos A, Sahan R. Low-dimensional description of oscillatory thermal convection: the small prandtl number limit. Theor Comput Fluid Dyn. 1997;9:1–16.

    Article  MATH  Google Scholar 

  80. Guo Q, Hang J, Wang S, Hui W, Xie Z. Design optimization of variable stiffness composites by using multi-fidelity surrogate models. Struct Multidiscip Optim. 2021;63(1):439–61.

    MathSciNet  Article  Google Scholar 

  81. Gutmann H-M. A radial basis function method for global optimization. J Glob Optim. 2001;27:8.

    MathSciNet  MATH  Google Scholar 

  82. Guénot M, Lepot I, Sainvitu C, Goblet J, Filomeno Coelho R. Adaptive sampling strategies for non-intrusive POD-based surrogates. Eng Comput. 2013;30(4):521–47.

    Article  Google Scholar 

  83. Görtz S, Zimmermann R, Han Z-H. Variable-fidelity and reduced-order models for aero data for loads predictions. Model. 2013;123:99–112.

    Article  Google Scholar 

  84. Haasdonk B, Ohlberger M. Reduced basis method for finite volume approximations of parametrized linear evolution equations. ESAIM. 2008;42(2):277–302.

    MathSciNet  Article  MATH  Google Scholar 

  85. Haftka R. Combining global and local approximations. AIAA J. 1991;29:1523–5.

    Article  Google Scholar 

  86. Hall KC, Thomas JP, Clark WS. Computation of unsteady nonlinear flows in cascades using a harmonic balance technique. AIAA J. 2002;40(5):879–86.

    Article  Google Scholar 

  87. Halton J. On the efficiency of certain quasi-random sequences of points in evaluating multi-dimensional integrals. Numerische Mathematik. 1960;2:84–90.

    MathSciNet  Article  Google Scholar 

  88. Hampton J, Doostan A. Basis adaptive sample efficient polynomial chaos (BASE-PC). J Comput Phys. 2018;371:20–49.

    MathSciNet  Article  MATH  Google Scholar 

  89. Han Z-H, Görtz S. Hierarchical kriging model for variable-fidelity surrogate modeling. AIAA J. 2012;50(9):1885–96.

    Article  Google Scholar 

  90. Han Z-H, Xu C-Z, Liang Z, Zhang Y, Ke-Shi Z, Song W-P. Efficient aerodynamic shape optimization using variable-fidelity surrogate models and multilevel computational grids. Optim. 2020;6:9.

    Google Scholar 

  91. Han Z-H, Zhang K-S. Surrogate-based optimization. 2012. p. 21.

  92. Hao P, Feng S, Li Y, Wang B, Chen H. Adaptive infill sampling criterion for multi-fidelity gradient-enhanced kriging model. Struct Multidiscip Optimiz. 2020;62(1):353–73.

    MathSciNet  Article  Google Scholar 

  93. Hennig P, Schuler C. Entropy search for information-efficient global optimization. J Mach Learn Res. 2011;13:e23.

    MathSciNet  Google Scholar 

  94. Hu J, Yang Y, Zhou Q, Jiang P, Shao X, Shu L, Zhang Y. Comparative studies of error metrics in variable fidelity model uncertainty quantification. J Eng Design. 2018;29(8–9):512–38.

    Article  Google Scholar 

  95. Huang D, Allen TT, Notz WI, Zeng N. Global Optimization of Stochastic Black-Box Systems via Sequential Kriging Meta-Models. J Glob Optimiz. 2006;34(3):441–66.

    MathSciNet  Article  MATH  Google Scholar 

  96. Hutchison MG, Unger ER, Mason WH, Grossman B, Haftka RT. Variable-complexity aerodynamic optimization of a high-speed civil transport wing. J Aircraft. 1994;31(1):110–6.

    Article  Google Scholar 

  97. Jameson A, Martinelli L, Vassberg J. Using computational fluid dynamics for aerodynamics- a critical assessment. 2002.

  98. Janouchová E, Kučerová A. Competitive comparison of optimal designs of experiments for sampling-based sensitivity analysis. Computers Struct. 2013;124:47–60.

    Article  Google Scholar 

  99. Jiang P, Cheng J, Zhou Q, Shu L, Jiexiang H. Variable-fidelity lower confidence bounding approach for engineering optimization problems with expensive simulations. AIAA J. 2019;57:1–15.

    Article  Google Scholar 

  100. Jolliffe IT, Cadima J. Principal component analysis: a review and recent developments. Philos Trans R Soc. 2016;374(2065):20150202.

    MathSciNet  Article  MATH  Google Scholar 

  101. Jones DR, Schonlau M. Efficient global optimization of expensive black-box functions. J Glob Optim. 1998;38:9.

    MathSciNet  MATH  Google Scholar 

  102. Kandasamy K, Dasarathy G, Oliva J, Schneider J, Poczos B. Multi-fidelity gaussian process bandit optimisation. J Artif Intell Res. 2016.

    Article  MATH  Google Scholar 

  103. Kast M, Guo M, Hesthaven JS. A non-intrusive multifidelity method for the reduced order modeling of nonlinear problems. 2019.

  104. Kennedy M. Predicting the output from a complex computer code when fast approximations are available. Biometrika. 2000;87(1):1–13.

    MathSciNet  Article  MATH  Google Scholar 

  105. Khatouri H, Benamara T, Breitkopf P, Demange J, Feliot P. Constrained multi-fidelity surrogate framework using Bayesian optimization with non-intrusive reduced-order basis. 2020, p. 23.

  106. Kim K-K, Shen D, Nagy Z, Braatz R. Wiener’s polynomial chaos for the analysis and control of nonlinear dynamical systems with probabilistic uncertainties. Control Syst. 2013;33:58–67.

    MathSciNet  Article  MATH  Google Scholar 

  107. Kleijnen JP. Kriging metamodeling in simulation: a review. Eur J Operat Res. 2009;192(3):707–16.

    MathSciNet  Article  MATH  Google Scholar 

  108. Knill DL, Giunta AA, Baker CA, Grossman B, Mason WH, Haftka RT, Watson LT. Response surface models combining linear and euler aerodynamics for supersonic transport design. J Aircraft. 1999;36(1):75–86.

    Article  Google Scholar 

  109. Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. 2001. p. 14.

  110. Kontogiannis SG, Demange J, Savill AM, Kipouros T. A comparison study of two multifidelity methods for aerodynamic optimization. Aerospace Sci Technol. 2020;97:105592.

    Article  Google Scholar 

  111. Krige D. A statistical approach to some basic mine valuation problems on the witwatersand. J Chem Metallurgical Mining Soc South Africa. 1951;5:7.

    Google Scholar 

  112. Lam R, Allaire DL, Willcox KE. Multifidelity Optimization using Statistical Surrogate Modeling for Non-Hierarchical Information Sources. In: 56th AIAA/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference. 2015;

  113. Lancaster P, Salkauskas K. Surfaces generated by moving least squares methods. Math Comput. 1981;37:141–58.

    MathSciNet  Article  Google Scholar 

  114. Lataniotis C, Marelli S, Sudret B. Extending classical surrogate modeling to ultrahigh dimensional problems through supervised dimensionality reduction: a data-driven approach. Techn Rep. 2018;7:89.

    Google Scholar 

  115. Le Gratiet L. Multi-fidelity Gaussian process regression for computer experiments. 2013.

  116. Le Gratiet L, Garnier J. Recursive co-kriging model for design of computer experiments with multiple levels of fidelity. Int J Uncertainty Quant. 2014;4(5):365–86.

    MathSciNet  Article  Google Scholar 

  117. Le Quilliec G, Raghavan B, Breitkopf P. A manifold learning-based reduced order model for springback shape characterization and optimization in sheet metal forming. Computer Methods Appl Mech Eng. 2014;285:621–38.

    MathSciNet  Article  MATH  Google Scholar 

  118. Le Riche R, Picheny V. Revisiting Bayesian Optimization in the light of the COCO benchmark. Struct Multidiscip Optimiz. 2021.

    MathSciNet  Article  Google Scholar 

  119. Leifsson L, Koziel S. Aerodynamic shape optimization by variable-fidelity computational fluid dynamics models: a review of recent progress. J Comput Sci. 2015;10:45–54.

    MathSciNet  Article  Google Scholar 

  120. Li G, Aute V, Azarm S. An accumulative error based adaptive design of experiments for offline metamodeling. Struct Multidiscip Optimiz. 2010;40:137–55.

    Article  Google Scholar 

  121. Li J, Cai J, Qu K. Adjoint-based two-step optimization method using proper orthogonal decomposition and domain decomposition. AIAA J. 2018;56(3):1133–45.

    Article  Google Scholar 

  122. Lickenbrock M, Rumpfkeil M, Beran P, Kolonay R. Multi-fidelity, multidisciplinary analysis of an efficient supersonic air vehicle. Anal Discip. 2020.

    Article  Google Scholar 

  123. Liu H, Ong Y-S, Cai J. A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design. Struct Multidiscip Optimiz. 2018;57(1):393–416.

    Article  Google Scholar 

  124. Liu J. Comparison of Infill Sampling Criteria in Kriging-based Aerodynamic Optimization. 2012;10.

  125. Lu K, Jin Y, Chen Y, Yang Y, Hou L, Zhang Z, Li Z, Fu C. Review for order reduction based on proper orthogonal decomposition and outlooks of applications in mechanical systems. Mech Syst Signal Process. 2019;123:264–97.

    Article  Google Scholar 

  126. Lumley J, Yaglom A, Tartarsky VI. The structure of inhomogeneous turbulent flows. 1967. p. 166–177.

  127. Mackman TJ, Allen CB. Investigation of an adaptive sampling method for data interpolation using radial basis functions. Int J Numer Methods Eng. 2010.

    Article  MATH  Google Scholar 

  128. Malouin B, Trépanier J-Y, Gariepy M. Interpolation of transonic flows using a proper orthogonal decomposition method. Int J Aerospace Eng. 2013.

    Article  Google Scholar 

  129. Manlig F, Koblasa F. Design of simulation experiments using doe. Appl Mech Mater. 2014;693:219–24.

    Article  Google Scholar 

  130. March A, Willcox K. Multifidelity airfoil shape optimization using adaptive meshing. Struct Multidiscip Optim. 2012;461:93–109.

    Article  Google Scholar 

  131. March A, Willcox K. Multifidelity Approaches for Parallel Multidisciplinary Optimization. In: 12th AIAA Aviation Technology, Integration, and Operations (ATIO) Conference and 14th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference. 2012.

  132. Martins J, Lambe A. Multidisciplinary design optimization: A survey of architectures. AIAA J. 2013;51:2049–75.

    Article  Google Scholar 

  133. Mason RL, Gunst RF, Hess JL. Fractional Factorial Experiments, (Chapter 7, 228–270). New York: Wiley; 2003.

    Book  Google Scholar 

  134. Matheron G. Principles of geostatistics. Economic Geol. 1963;58(8):1246–66.

    Article  Google Scholar 

  135. McKay MD, Beckman RJ, Conover WJ. Comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics. 1979;21(2):239–45.

    MathSciNet  Article  MATH  Google Scholar 

  136. Mehmani A, Chowdhury S, Messac A. Predictive quantification of surrogate model fidelity based on modal variations with sample density. Struct Multidiscip Optimiz. 2015;52(2):353–73.

    Article  Google Scholar 

  137. Meng L, Breitkopf P, Le Quilliec G, Raghavan B, Villon P. Nonlinear shape-manifold learning approach: Concepts, tools and applications. Arch Comput Methods Eng. 2018;25:3.

    MathSciNet  Article  MATH  Google Scholar 

  138. Meng L, Breitkopf P, Raghavan B, Mauvoisin G, Bartier O, Hernot X. Identification of material properties using indentation test and shape manifold learning approach. Computer Methods Appl Mech Eng. 2015;297:239–57.

    MathSciNet  Article  MATH  Google Scholar 

  139. Mifsud MJ, MacManus DG, Shaw S. A variable-fidelity aerodynamic model using proper orthogonal decomposition: A Variable-Fidelity Aerodynamic Model Using POD. Int J Numer Methods Fluids. 2016;82(10):646–63.

    Article  Google Scholar 

  140. Mohammadi A, Raisee M. Stochastic field representation using bi-fidelity combination of proper orthogonal decomposition and Kriging. Computer Methods Appl Mech Eng. 2019;357:112589.

    MathSciNet  Article  MATH  Google Scholar 

  141. Morris MD, Mitchell TJ. Exploratory designs for computational experiments. 1995. p. 22.

  142. Mukherjee S, Lu D, Raghavan B, Breitkopf P, Dutta S, Xiao M, Zhang W. Accelerating large-scale topology optimization : state-of-the-art and challenges. Arch Comput Methods Eng. 2021;8:67.

    MathSciNet  Google Scholar 

  143. Myers DE. Co-Kriging-New Developments. Netherlands: Springer; 1984. p. 295–305.

    Book  Google Scholar 

  144. Myers RH, Khuri AI, Carter WH. Response surface methodology: 1966–1988. Technometrics. 1989;31(2):137–57.

    MathSciNet  MATH  Google Scholar 

  145. Nachar S, Boucard P-A, Néron D, Rey C. Multi-fidelity bayesian optimization using model-order reduction for viscoplastic structures. Finite Elements Anal Design. 2020;176:103400.

    MathSciNet  Article  Google Scholar 

  146. Ng L, Eldred M. Multifidelity uncertainty quantification using non-intrusive polynomial chaos and stochastic collocation. Model. 2012.

    Article  Google Scholar 

  147. Nguyen C, Rozza G, Phuong D, Patera A, Tenorio L, Waanders B, Mallick B, Willcox K, Biegler L, Biros G, Ghattas O, Heinkenschloss M, Keyes D. Reduced basis approximation and a posteriori error estimation for parametrized parabolic pdes; application to real-time bayesian parameter estimation. 2010.

  148. Palar P, Shimoyama K. Multi-fidelity uncertainty analysis in cfd using hierarchical kriging. Aerodynamic Design. 2017.

    Article  Google Scholar 

  149. Parr J, Keane AJ, Forrester AI, Holden CM. Infill sampling criteria for surrogate-based optimization with constraint handling. Eng Optim. 2012;44(10):1147–66.

    Article  MATH  Google Scholar 

  150. Parr JM, Holden CME, Forrester AIJ, Keane AJ. Review of efficient surrogate infill sampling criteria with constraint handling. 2010. p. 10.

  151. Peherstorfer B, Willcox K, Gunzburger M. Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization. SIAM Rev. 2018;60(3):550–91.

    MathSciNet  Article  Google Scholar 

  152. Pellegrini R, Serani A, Diez M, Wackers J, Queutey P. Adaptive sampling criteria for multi-fidelity metamodels in CFD-based shape optimization. 2018. p 11.

  153. Perdikaris P, Venturi D, Royset JO, Karniadakis GE. Multi-fidelity modelling via recursive co-kriging and Gaussian-Markov random fields. Proc R Soc. 2015;471(2179):20150018.

    Article  Google Scholar 

  154. Perron C, Rajaram D, Mavris D. Development of a multi-fidelity reduced-order model based on manifold alignment. Align. 2020.

    Article  Google Scholar 

  155. Phalippou P, Bouabdallah S, Breitkopf P, Villon P, Zarroug M. ‘On-the-fly’ snapshots selection for Proper Orthogonal Decomposition with application to nonlinear dynamics. Computer Methods Appl Mech Eng. 2020;367:113120.

    MathSciNet  Article  MATH  Google Scholar 

  156. Picheny V. A Stepwise uncertainty reduction approach to constrained global optimization. In: Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics, volume 33 of Proceedings of Machine Learning Research; 2014. p. 787–795.

  157. Picheny V, Wagner T, Ginsbourger D. A benchmark of kriging-based infill criteria for noisy optimization. Struct Multidiscip Optimiz. 2013;48(3):607–26.

    Article  Google Scholar 

  158. Pinto RN, Afzal A, D’Souza LV, Ansari Z, Mohammed Samee AD. Computational Fluid Dynamics in Turbomachinery: A Review of State of the Art. Arch Comput Methods Eng. 2017;24(3):467–79.

    MathSciNet  Article  Google Scholar 

  159. Poethke B, Völker S, Vogeler K. Aerodynamic Optimization of Turbine Airfoils Using Multi-fidelity Surrogate Models. 2019. p. 556–568.

  160. Powell M. Radial basis function methods for interpolation to function of many variables. 2001.

  161. Priem R, Bartoli N, Diouane Y, Sgueglia A. Upper trust bound feasibility criterion for mixed constrained bayesian optimization with application to aircraft design. Aerospace Sci Technol. 2020.

    Article  Google Scholar 

  162. Prud’homme C, Rovas DV, Veroy K, Machiels L, Maday Y, Patera AT, Turinici G. Reliable real-time solution of parametrized partial differential equations: reduced-basis output bound methods. J Fluids Eng. 2001;124(1):70–80.

    Article  Google Scholar 

  163. Queipo NV, Haftka RT, Shyy W, Goel T, Vaidyanathan R, Kevin Tucker P. Surrogate-based analysis and optimization. Prog Aerospace Sci. 2005;41(1):1–28.

    Article  MATH  Google Scholar 

  164. Raghavan B, Breitkopf P, Tourbier Y. Towards a space reduction approach for efficient structural shape optimization. Structural Multidisciplinary Optimization. 2013;48:987–1000.

    Article  Google Scholar 

  165. Raghavan B, Hamdaoui M, Xiao M, Breitkopf P, Villon P. A bi-level meta-modeling approach for structural optimization using modified pod bases and diffuse approximation. Comput Struct. 2012;127(C):19–28.

    Google Scholar 

  166. Raghavan B, Xiao M, Breitkopf P, Villon P. Implicit constraint handling for shape optimisation with pod-morphing. Eur J Comput Mech. 2012;21(3–6):325–36.

    Article  MATH  Google Scholar 

  167. Rajaee M, Karlsson SKF, Sirovich L. Low-dimensional description of free-shear-flow coherent structures and their dynamical behaviour. J Fluid Mech. 1994;258:1–29.

    Article  MATH  Google Scholar 

  168. Rasmussen CE, Williams CKI. Gaussian processes for machine learning (3. print ed.). Adaptive computation and machine learning. MIT Press. 2006;OCLC: 552376743.

  169. Regis R. Trust regions in kriging-based optimization with expected improvement. Eng Optimiz. 2015.

    Article  Google Scholar 

  170. Regis RG, Shoemaker CA. Improved strategies for radial basis function methods for global optimization. J Glob Optim. 2006;37(1):113–35.

    MathSciNet  Article  MATH  Google Scholar 

  171. Regis RG, Shoemaker CA. Combining radial basis function surrogates and dynamic coordinate search in high-dimensional expensive black-box optimization. Eng Optim. 2013;45(5):529–55.

    MathSciNet  Article  Google Scholar 

  172. Regis RG, Wild SM. CONORBIT: constrained optimization by radial basis function interpolation in trust regions. Optim Methods Softw. 2017;32(3):552–80.

    MathSciNet  Article  MATH  Google Scholar 

  173. Reisenthel P, Love J, Lesieutre D, Dillenius M. Innovative fusion of experiment and analysis for missile design and flight simulation. 2006.

  174. Reisenthel PH, Allen TT. Application of Multifidelity Expected Improvement Algorithms to Aeroelastic Design Optimization. In: 10th AIAA Multidisciplinary Design Optimization Conference. 2014.

  175. Rendall T, Allen C. Multidimensional aircraft data interpolation using radial basis functions. Data. 2007.

    Article  Google Scholar 

  176. Robinson T, Eldred M, Willcox K, Haimes R. Surrogate-based optimization using multifidelity models with variable parameterization and corrected space mapping. AIAA J. 2008;46:2814–22.

    Article  Google Scholar 

  177. Robinson T, Willcox K, Eldred M, Haimes R. Multifidelity Optimization for Variable-Complexity Design. In: 11th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference. 2006.

  178. Rodriguez J, Renaud J, Wujek B, Tappeta R. Trust region model management in multidisciplinary design optimization. J Comput Appl Math. 2000;124:139.

    MathSciNet  Article  MATH  Google Scholar 

  179. Rozza G, Huynh DBP, Patera AT. Reduced basis approximation and a posteriori error estimation for affinely parametrized elliptic coercive partial differential equations: application to transport and continuum mechanics. Arch Comput Methods Eng. 2008;15(3):229–75.

    MathSciNet  Article  Google Scholar 

  180. Ruan X, Jiang P, Zhou Q, Hu J, Shu L. Variable-fidelity probability of improvement method for efficient global optimization of expensive black-box problems. Struct Multidiscip Optim. 2020;62(6):3021–52.

    MathSciNet  Article  Google Scholar 

  181. Ruan X, Jiang P, Zhou Q, Yang Y. An improved co-kriging multi-fidelity surrogate modeling method for non-nested sampling data. 2019;

  182. Rugh WJ. Nonlinear system theory: The volterra / wiener approach. 1981.

  183. Rumpfkeil MP, Lickenbrock M, Beran PS, Kolonay RM. Aeroelastic analysis and optimization with control surface deflections of an efficient supersonic air vehicle. Multi-fidelity. 2021.

    Article  Google Scholar 

  184. Sacks J, Welch WJ, Mitchell TJ, Wynn HP. Design and analysis of computer experiments. Statist Sci. 1989;4(4):409–23.

    MathSciNet  Article  MATH  Google Scholar 

  185. Saka Y, Gunzburger M, Burkardt J. Latinized, improved lhs, and cvt point sets in hypercubes. 2007.

  186. Scott W, Frazier P, Powell W. The correlated knowledge gradient for simulation optimization of continuous parameters using Gaussian Process Regression. SIAM J Optimiz. 2011;21(3):996–1026.

    MathSciNet  Article  MATH  Google Scholar 

  187. Sen R, Kandasamy K, Shakkottai S. Multi-fidelity black-box optimization with hierarchical partitions. In: Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, 2018. p. 4538–4547.

  188. Settles B. Active Learning Literature Survey. 2010;67.

  189. Shan S, Wang GG. Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions. Struct Multidiscip Optimiz. 2010;41(2):219–41.

    MathSciNet  Article  MATH  Google Scholar 

  190. Shewry MC, Wynn HP. Maximum entropy sampling. J Appl Statist. 1987;14(2):165–70.

    Article  Google Scholar 

  191. Shinde V, Lacazedieu E, Baj F, Hoarau Y, Braza M. Galerkin-free model reduction for fluid-structure interaction using proper orthogonal decomposition. J Comput Phys. 2019.

    MathSciNet  Article  MATH  Google Scholar 

  192. Shoesmith E, Box G, Draper N. Empirical model-building and response surfaces. Statistician. 1987;37:82–82.

    Article  Google Scholar 

  193. Silva W. Identification of nonlinear aeroelastic systems based on the volterra theory: Progress and opportunities. Nonlinear Dyn. 2005;39:25–62.

    MathSciNet  Article  MATH  Google Scholar 

  194. Simpson T, Mauery T, Korte J, Mistree F. Comparison of response surface and kriging models for multidisciplinary design optimization. Design. 1998.

    Article  Google Scholar 

  195. Simpson T, Poplinski J, Koch PN, Allen J. Metamodels for computer-based engineering design: survey and recommendations. Eng Computers. 2001;17(2):129–50.

    Article  MATH  Google Scholar 

  196. Simpson T, Toropov V, Balabanov V, Viana F. Design and Analysis of Computer Experiments in Multidisciplinary Design Optimization: A Review of How Far We Have Come - Or Not. In: 12th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference. 2008;

  197. Sipp D, de Pando MF, Schmid PJ. Nonlinear model reduction: a comparison between pod-galerkin and pod-deim methods. 2020. arXiv:2005.03173.

  198. Sirovich L. Turbulence and the dynamics of coherent structures. i - coherent structures. ii - symmetries and transformations. iii - dynamics and scaling. Quarterly of Applied Mathematics - QUART APPL MATH, 1987;45.

  199. Skinner S, Zare-Behtash H. State-of-the-art in aerodynamic shape optimisation methods. Applied Soft Computing. 2017. p. 62.

  200. Smarandache F. Alternatives to pearson’s and spearman’s correlation coefficients. SSRN Electronic J. 2008.

    Article  MATH  Google Scholar 

  201. Smola A, Schölkopf B. A tutorial on support vector regression. Stat Comput. 2004;14:199–222.

  202. Sobieszczanski-Sobieski J, Haftka R. Multidisciplinary aerospace design optimization. Surv Recent Develop. 1996.

    Article  Google Scholar 

  203. Sobol I. On the distribution of points in a cube and the approximate evaluation of integrals. Ussr Comput Math Mathe Phys. 1967;7:86–112.

    MathSciNet  Article  Google Scholar 

  204. Song C, Yang X, Song W. Multi-infill strategy for kriging models used in variable fidelity optimization. Chin J Aeronau. 2018;31(3):448–56.

    Article  Google Scholar 

  205. Song X, Lv L, Sun W, Zhang J. A radial basis function-based multi-fidelity surrogate model: exploring correlation between high-fidelity and low-fidelity models. Struct Multidiscip Optimiz. 2019;8:1–17.

    Google Scholar 

  206. Srinivas N, Krause A, Kakade S, Seeger M. Gaussian process optimization in the bandit setting: No regret and experimental design. 2010. p. 1015–1022.

  207. Sóbester A, Leary SJ, Keane AJ. On the Design of Optimization Strategies Based on Global Response Surface Approximation Models. J Glob Optimiz. 2005;33(1):31–59.

    MathSciNet  Article  MATH  Google Scholar 

  208. Tang C, Gee K, Lawrence S. Generation of aerodynamic data using a design of experiment and data fusion approach. Dyn Res. 2005.

    Article  Google Scholar 

  209. Taylor J, Einbeck J. Challenging the curse of dimensionality in multivariate local linear regression. Comput Stat. 2013;28(3):955–76.

    MathSciNet  Article  MATH  Google Scholar 

  210. Thenon A. Utilisation de méta-modèles multi-fidélité pour l’optimisation de la production des réservoirs. 2017;

  211. Toal DJJ. On the potential of a multi-fidelity G-POD based approach for optimization and uncertainty quantification. In: Turbomachinery, V02BT45A002. 2014.

  212. Toal DJJ. Some considerations regarding the use of multi-fidelity Kriging in the construction of surrogate models. Struct Multidiscip Optim. 2015;51(6):1223–45.

    Article  Google Scholar 

  213. Toal DJJ, Bressloff NW, Keane AJ. Kriging hyperparameter tuning strategies. AIAA J. 2008;46(5):1240–52.

    Article  Google Scholar 

  214. Ukeiley L, Cordier L, Manceau R, Delville J, Glauser M, BONNET J. Examination of large-scale structures in a turbulent plane mixing layer. part 2. dynamical systems model. J Fluid Mech. 2001;441:67–108.

    Article  MATH  Google Scholar 

  215. van Rijn S, Schmitt S, Olhofer M, van Leeuwen M, Bäck T. Multi-fidelity surrogate model approach to optimization. Proceedings of the Genetic and Evolutionary Computation Conference Companion on - GECCO ’18, 2018. p. 225–226.

  216. Veroy K, Prud’homme C, Rovas D. A posteriori error bounds for reduced-basis approximation of parametrized noncoercive and nonlinear elliptic partial dierential equations. In: 16th AIAA Computational Fluid Dynamics Conference. 2003;

  217. Villemonteix J. Optimisation de fonctions coûteusesModèles gaussiens pour une utilisation efficace du budget d’évaluations: théorie et pratique industrielle. 2009; 172.

  218. Volpi S, Diez M, Gaul NJ, Song H, Iemma U, Choi KK, Campana EF, Stern F. Development and validation of a dynamic metamodel based on stochastic radial basis functions and uncertainty quantification. Struct Multidiscip Optim. 2015;51(2):347–68.

    Article  Google Scholar 

  219. Wackers J, Visonneau M, Ficini S, Pellegrini R, Serani A, Diez M. Adaptive N-Fidelity Metamodels for Noisy CFD Data. AIAA AVIATION 2020 FORUM. 2020.

  220. Wang H, Jin Y, Sun C, Doherty J. Offline Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles. IEEE Trans Evolut Comput. 2019;23(2):203–16.

    Article  Google Scholar 

  221. Wang X, Kou J, Zhang W. Multi-fidelity surrogate reduced-order modeling of steady flow estimation. Int J Numer Methods Fluids. 2020;92(12):1826–44.

    MathSciNet  Article  Google Scholar 

  222. Xia D. Non-Intrusive Reduced Oder Models and Their Applications. 2016.

  223. Xia L, Raghavan B, Breitkopf P, Zhang W. Numerical material representation using proper orthogonal decomposition and diffuse approximation. Appl Math Comput. 2013;224:450–62.

    MathSciNet  Article  MATH  Google Scholar 

  224. Xiao D. Non-intrusive reduced order models and their applications. 2016.

  225. Xiao D, Fang F, Pain C, Navon I. A parameterized non-intrusive reduced order model and error analysis for general time-dependent nonlinear partial differential equations and its applications. Computer Methods Appl Mech Eng. 2017;317:868–89.

    MathSciNet  Article  MATH  Google Scholar 

  226. Xiao M, Breitkopf P, Coelho R, Knopf-Lenoir C, Sidorkiewicz M, Villon P. Model reduction by cpod and kriging: application to the shape optimization of an intake port. Struct Multidiscip Optim. 2010.

    MathSciNet  Article  MATH  Google Scholar 

  227. Xiao M, Lu D, Breitkopf P, Raghavan B, Dutta S, Zhang W. On-the-fly model reduction for large-scale structural topology optimization using principal components analysis. Struct Multidiscip Optim. 2020.

    MathSciNet  Article  Google Scholar 

  228. Xiao M, Zhang G, Breitkopf P, Villon P, Zhang W. Extended co-kriging interpolation method based on multi-fidelity data. Appl Math Comput. 2018;323:120–31.

    Article  MATH  Google Scholar 

  229. Xu S, Liu H, Wang X, Jiang X. A robust error-pursuing sequential sampling approach for global metamodeling based on voronoi diagram and cross validation. J Mech Design. 2014;136:071009.

    Article  Google Scholar 

  230. Yao W, Jaiman RK. A harmonic balance technique for the reduced-order computation of vortex-induced vibration. J Fluids Struct. 2016;65:313–32.

    Article  Google Scholar 

  231. Ye P, Pan G. Surrogate-based global optimization methods for expensive black-box problems: Recent advances and future challenges. 2019. p. 96–100.

  232. Yondo R, Andrés E, Valero E. A review on design of experiments and surrogate models in aircraft real-time and many-query aerodynamic analyses. Progr Aerospace Sci. 2018;96:23–61.

    Article  Google Scholar 

  233. Yondo R, Bobrowski K, Andres E, Valero E. A review of surrogate modeling techniques for aerodynamic analysis and optimization. Curr Limit Fut Challenges Ind. 2019.

    Article  Google Scholar 

  234. Zhang Y, Han Z-H, Zhang K-S. Variable-fidelity expected improvement method for efficient global optimization of expensive functions. Struct Multidiscip Optim. 2018;58(4):1431–51.

    MathSciNet  Article  Google Scholar 

  235. Zheng J, Shao X, Gao L, Jiang P, Li Z. A hybrid variable-fidelity global approximation modelling method combining tuned radial basis function base and kriging correction. J Eng Design. 2013;24(8):604–22.

    Article  Google Scholar 

  236. Zhou Q, Jiang P, Shao X, Hu J, Cao L, Wan L. A variable fidelity information fusion method based on radial basis function. Adv Eng Inform. 2017;32:26–39.

    Article  Google Scholar 

  237. Zimmermann R, Görtz S. Non-linear reduced order models for steady aerodynamics. Procedia Computer Sci. 2010;1(1):165–74.

    Article  Google Scholar 

  238. Ştefănescu R, Sandu A, Navon I. POD/DEIM reduced-order strategies for efficient four dimensional variational data assimilation. J Comput Phys. 2015;295:569–95.

    MathSciNet  Article  MATH  Google Scholar 

  239. Žilinskas A. A review of statistical models for global optimization. J Glob Optimiz. 1992;2(2):145–53.

    MathSciNet  Article  MATH  Google Scholar 

Download references


The authors would like to thank Cenaero and Safran Aircraft Engines for their support and permission to publish this study, as well as Cenaero and the university of Technology of Compiegne CNRS laboratory for their support.


The present work was funded by Safran Aircraft Engines and the Association Nationale de la Recherche et Technologie.

Author information

Authors and Affiliations



SLF and CM contributed to the derivation of model equations and worked out the general concept of the proposed modeling approach. SLF conducted the specific code implementation and the shown numerical simulations. All authors contributed to the discussion of results and prepared the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Hanane Khatouri.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Khatouri, H., Benamara, T., Breitkopf, P. et al. Metamodeling techniques for CPU-intensive simulation-based design optimization: a survey. Adv. Model. and Simul. in Eng. Sci. 9, 1 (2022).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI:


  • Multi-fidelity
  • Variable complexity
  • Black-box optimization
  • Non-intrusive reduced basis
  • Bayesian optimization