 Research Article
 Open Access
 Published:
A hybrid RNNGPOD surrogate model for realtime settlement predictions in mechanised tunnelling
Advanced Modeling and Simulation in Engineering Sciences volume 3, Article number: 5 (2016)
Abstract
Realistic 3D simulations of the tunnelling process are increasingly required to investigate the interactions between machinedriven tunnel construction and the surrounding soil in order to provide reliable estimates of the expected settlements and associated risks of damage for existing structures, in particular in urban tunnelling projects. To accomplish the step from largescale computational analysis to realtime predictions of expected settlements during tunnel construction, the focus of this paper is laid on the generation of a numerically efficient hybrid surrogate modelling strategy, combining Gappy proper orthogonal decomposition (GPOD) and recurrent neural networks (RNN). In this hybrid RNNGPOD surrogate model, the RNN is employed to extrapolate the time variant settlements at several monitoring points within an investigated surface area and GPOD is utilised to predict the whole field of surface settlements based on the RNN predictions and a POD radial basis functions approximation. Both parts of the surrogate model are created based on results of finite element simulations from geotechnical and process parameters varied within the range of intervals given in the design stage of a tunnel project. In the construction stage, the hybrid surrogate model is applied for realtime reliability analyses of the mechanised tunnelling process to support the machine operator in steering the tunnel boring machine.
Background
Mechanised tunnelling is a widely used construction method for underground infrastructure in particular in urban areas due to its effectiveness in controlling the advancement process and to limit the construction induced ground deformations. This construction method is characterised by a staged procedure of soil excavation at the tunnel face and lining erection, providing at the same time a continuous support of the soil by means of supporting fluids at the tunnel face and pressurised grouting of the tail gap. The interactions between the tunnel boring machine (TBM), the support measures and the soil, including the groundwater, are the determining factors for the efficiency, the safety of the tunnel advancement and the risk of damage on the existing infrastructure. Evidently, these interactions are complex and require computational simulation methods based upon sufficiently 3D realistic numerical models for the individual components and their interactions. However, for a sufficient degree of spatial resolution of this highly nonlinear, time dependent problem, adequate simulation models are characterized by a large number of unknowns in the range of \(10^6\)–\(10^8\) unknowns.
Up to date, numerical simulations in tunnelling are restricted to the design stage of a project. The support of the steering of TBMs during construction mainly relies upon the interpretation of monitoring data during the construction by experienced experts. If results from large scale numerical models are to be used during construction to provide additional information on the potential consequences of decisions taken for the steering of the TBM (e.g., the surface settlement field ahead of the tunnel face), a realtime system response is required. However, performing large scale, computationally expensive models on site is unrealistic for realtime applications, which demand obtaining the system response in the range of seconds to minutes. To accomplish the step from largescale computational analysis to realtime predictions of expected settlements during tunnel construction, model reduction strategies are required to substitute the original numerical model by surrogate models. Recently, the authors have proposed a hybrid surrogate model [1], which employs a combination of two different techniques: recurrent neural network (RNN) and proper orthogonal decomposition (POD), aiming to exploit the advantages of both methods. While RNNs are well suited for predictions using extrapolation of data (see [2]), the POD is able to deal with high dimensional outputs, see, e.g., [3, 4].
For the specific problem at hand, two different variants of the POD method have been employed in [1]. The first one is the POD with interpolation to approximate surface settlements from previous stages of the tunnel excavation (excavation steps 1 to n). Frequently, radial basis functions (RBF) are considered as interpolation functions, resulting in the PODRBF approach, see e.g., [3–5]. The second approach is the Gappy POD (GPOD) approach, first proposed in [6] and employed to tackle the missing data problem in image processing, or to reconstruct human faces from partial data. In [1], this approach has been utilised to approximate the field of settlements from data available from a limited number of monitoring points in step \(n+1\).
To allow for a monitoring and model based support of TBM steering, supplying information in realtime to the TBM driver on the expected (i.e., future) settlements, a model reduction technique which allows extrapolation in time with multiple outputs is proposed in this paper. To this end, the hybrid surrogate modelling strategy originally proposed in [1] is extended. More precisely, strategies to improve the predictions of hybrid surrogate models by means of problem specific enhancements for their components, PODRBF and GPOD, are proposed.
For the POD using interpolation functions, the concept of RBF is replaced by an extension called Extended RBF (ERBF) [7]. This concept is capable of improving the prediction capability of the surrogate model by combining the effectiveness of the RBF and the flexibility of nonRBF approaches. This leads to a PODERBF network which has been shown to produce better prediction results as compared to the PODRBF, see [8]. In association with the PODERBF algorithm, the reconstruction accuracy of the GPOD approach can be enhanced by adopting iterative schemes (IGPOD) to derive the POD basis, e.g., [9–12]. In the GPOD approach, an incomplete data vector is reconstructed based on the assumption that the vector inherits the characteristics of the known data set. The reconstruction procedure is performed in one step based on the POD modes of the data set, e.g., [6, 9]. A more precise approach is to include this partial missing vector into the known data set and to iterate until convergence. Everson and Sirovich [6] have performed an iterative approach based on an initial guess, which is denoted as the E–S method. The E–S method depends on the initial guess and therefore may lead to less accurate solutions because it only employs a certain number of POD modes in the reconstruction procedure. Based on the E–S method, Venturi and Karniadakis [11] proposed another extension, referred to as the V–K method, which is not dependent on the initial guess and improves the accuracy significantly by gradually increasing the number of POD modes. However, using the V–K method leads to a significant increase in computation time. Therefore, in order to replace classical GPOD, the IGPOD, based upon both the E–S and the V–K scheme is investigated in this paper in regards to prediction performance and computation time.
The remainder of this paper is organised as follows. “Numerical model for mechanised tunnelling” gives a brief description of the finite element model for processoriented numerical simulations of TBM driven tunnelling. “Hybrid surrogate model” first summarises the algorithmic scheme suggested for the hybrid surrogate model and subsequently provides a synopsis of methods employed in the hybrid surrogate model: RNN, POD, PODRBF, PODERBF, GPOD and IGPOD (E–S and V–K methods). “Application to mechanised tunnelling” is devoted to applications of the proposed surrogate model in mechanised tunnelling. Based upon the developed surrogate model, a software for realtime prognosis in TBM tunnelling is finally proposed in “Realtime simulation software for TBM steering support” to enable supporting decisions during mechanised tunnel construction.
Numerical model for mechanised tunnelling
A 3D numerical model ekate (enhanced KRATOS for advanced tunnelling engineering) developed specifically for processoriented computational simulations of shield tunnelling processes at the Institute for Structural Mechanics of Ruhr University Bochum, see e.g., [13], is used in this paper. The model, which is conceptually based upon a previous model proposed by [14], has been supplemented with an automatic modeller [15], using a preprocessing procedure with a high degree of automation to generate complex 3D finite element (FE) models with small effort. The model is capable of simulating the excavation and construction procedure involved in mechanised tunnelling in soft, water saturated soils (i.e., the TBM advancement, continuous soil support, ringwise installation of the linings and the related interactions of the TBM advance with the soil and the groundwater).
The soil is modelled as a three (or two) phase material for partially (or fully) saturated soils. Two elastoplastic models are available for the consideration of the inelastic response of soft soils: the clay and sand model and the DruckerPrager model (Fig. 1(1)). The TBM is represented as a deformable body (Fig. 1(2)) moving through the soil with frictional surfacetosurface contact along the shield skin, allowing that the deformation of the soil naturally follows the real, tapered geometry of the TBM and that the effect of overcutting is captured. In order to realistically model the movement of the TBM and its interaction with the soil, an algorithm to control the individual jack thrusts is used to keep the TBM on the designed alignment path. After each TBM advance, the excavation at the cutting face, the tail void grouting and the erection of a new lining ring during standstill are taken into account by rezoning the finite element mesh and adjusting all boundary conditions to the new situation. The tail gap grouting (see Fig. 1(4)) is modelled as a fully saturated twophase material with a hydrating matrix phase, considering the temporal evolution of stiffness and permeability of the cementitious grout. In the simulation model ekate, buildings are represented by substitute models with appropriate stiffness and thickness to consider the soilstructure interaction (see Fig. 1(5)). In the presented FE formulation, isotropic shell, or, alternatively, volume elements with respective properties are adopted interacting with the soil through a mesh independent surfacetosurface contact algorithm, which prevents the penetration of the foundation of the building into the soil. For more details on the numerical model ekate and its ability to predict tunnelling induced settlements in the context of different applications we refer to [16–18].
For realtime applications during tunnel construction, the FE model must be substituted by a fast surrogate model which is able to approximate the physical behaviour of all relevant components involved in the simulation model for mechanised tunnelling. The surrogate model is developed to predict time variant settlement fields, which is realised by a mapping of time constant and time variant low dimensional inputs onto time variant high dimensional outputs. For this mapping, a hybrid surrogate modelling strategy is proposed in the next section.
Hybrid surrogate model
In this section, a hybrid surrogate model is proposed, which combines the concepts of artificial neural networks and POD for the prediction of surface settlements in TBM driven tunnel constructions. A RNN and the GPOD approach are combined to obtain a hybrid RNNGPOD surrogate model to substitute the FE model for realtime applications. The hybrid surrogate model is generated offline, during the design stage of a tunnel project, and applied online, during the construction stage, to predict the time variant settlement field. Figure 2 contains a schematic illustration of the realtime prognosis scheme including the offline and online stages. The processoriented FE model ekate described in the previous section is used to simulate the mechanised tunnelling processes with varying model and process parameters. The objective of the surrogate modelling is to predict the complete spatiotemporal field of surface settlements for further excavation steps for an arbitrary set of input parameters with similar accuracy as the original FE model. The input parameters (a mix of time variant process parameters, e.g., excavation rate, support and grouting pressures, and time constant geotechnical parameters, e.g., material parameters of the soil layers) are selected based on sensitivity analyses. In the context of realtime applications this implies, that firstly, the PODRBF network is employed to approximate the spatial field of surface displacements from time step 1 to the current time step n with the actual operational parameters obtained directly from the construction site, i.e., from the control unit of the TBM. Meanwhile, for the generation of user defined steering scenarios, the surface displacements of selected monitoring points for the subsequent time step n+1 are predicted by utilising a RNN. Finally, the GPOD approach is adopted to predict the complete field of tunnelling induced surface settlements for the set of user defined steering scenarios based on a combination of the results from the two previous methods.
The predicted results are used to support the machine driver in selecting the steering parameters for the next excavation step n + 1. Then these data, i.e., the finally selected input parameters and the corresponding settlement predictions for time step n + 1 are included into the available data set and the procedure is repeated for the subsequent excavation steps. The algorithm of the proposed RNNGPOD approach is summarised in Table 1.
It should be noted, that also monitoring data can be used to update the surrogate model, see [19]. However, the focus of this paper is on improving the prediction quality of the PODRBF and the GPOD components of the hybrid surrogate model. The individual components of the hybrid RNNGPOD surrogate model are explained below, highlighting the proposed extensions and improvements.
Recurrent neural network
Surrogate models based on artificial neural networks are widely used in civil engineering and structural mechanics, see e.g., [20] and [21] for an overview. RNN have been proposed, see e.g., [2], for the approximation of dependencies between structural processes, i.e., to predict dependencies between time variant structural actions such as mechanical and thermal loadings and time variant structural responses, e.g., displacements and structural stresses. RNNs have two advantages which are exploited in the proposed hybrid surrogate model: (1) they are able to learn dependencies between data series without considering time as an additional input parameter and (2) they allow for extrapolations to predict the future structural response. The basic architecture of RNNs is similar to feed forward neural networks. But context neurons are added to the hidden and output neurons in order to consider history dependencies in structural processes, see Fig. 3.
In each time step n, the \(j = 1,\ldots ,J\) inputs (time constant geotechnical parameters and time variant tunnelling process parameters) \({}^{\left[ n\right] }x_j\) of the RNN are processed layer by layer through the network to obtain the outputs (surface settlements at selected monitoring points) \({}^{\left[ n\right] }s_k\). The signals of neuron i in layer \(m = 2,\ldots ,M\) are computed by
Different types of activation functions \(\varphi ^{\left( m\right) }_i(.)\) (e.g., hyperbolic tangent function, logistic sigmoid function, area hyperbolic sine function, linear function) can be used to process the input signals to the corresponding output signal of neuron i. In Eq. (1), \(x^{\left( m1\right) }_h\) are the output signals of the \(h = 1,\ldots ,H\) neurons in the previous layer \((m1)\), which are multiplied by the synaptic weights \(w^{\left( m\right) }_{ih}\), \({}^{\left[ nd\right] }x^{\left( m\right) }_q\) are the \(\left[ n1\right] ,\ldots ,\left[ nD\right] \) delayed prior output signals of the \(q = 1,\ldots ,Q\) neurons in the same layer (m), which are multiplied by the context weights \({}^{d}c^{\left( m\right) }_{iq}\), and \(b^{\left( m\right) }_i\) is a bias value of neuron i. It should be noted, that the output signals of the neurons in the first layer (\(m = 1\)) are identical to the input signals of the RNN (\({}^{\left[ n\right] }x^{\left( 1\right) }_j = {}^{\left[ n\right] }x_j\)) and that the output signals of the neurons in the output layer (\(m = M\)) are identical to the output signals of the RNN (\({}^{\left[ n\right] }x^{\left( M\right) }_k = {}^{\left[ n\right] }s_k\)), see Fig. 3. For the prediction of the current structural response considering the complete structural history, a delay d of one or more time steps can be used to compute the network signals, see [21] for more details. The free network parameters (i.e., the synaptic weights \(w^{\left( m\right) }_{ih}\), the context weights \({}^{d}c^{\left( m\right) }_{iq}\) for each \(d = 1,\ldots ,D\) delayed time step and the bias values \(b^{\left( m\right) }_i\)) can be adjusted by a number of training strategies, e.g., by backpropagation algorithms or particle swarm optimisation approaches.
Proper orthogonal decomposition
POD is a mathematical procedure that allows to perform a decomposition of a large set of data to describe the original system with a much smaller number of unknowns by projecting them onto subspaces. The method was proposed under different names for applications in various fields including principal component analysis (PCA) [22] in statistics, singular value decomposition (SVD) [23] in linear algebra and Karhunen–Loeve decomposition (KLD) [24, 25] in signal processing. Nowadays the method is applied extensively in various branches of computational mechanics, such as fluid dynamics [6, 26], aerodynamics [9] and nonlinear solid mechanics [27, 28], see also [29] for a comprehensive review of POD applications.
The main idea of the POD is to find a useful set of basis vectors and the dimension of the subspace which is necessary to obtain a good approximation quality of the system. A widely used method to generate POD vectors is the method of snapshots introduced by Sirovich [30]. It is characterised by computing a set of system states or snapshots U and extracting an optimal set of basis vectors \(\varvec{\Phi }\), such that the error between the original and the projection onto subspace is minimised by
The POD basis vectors must satisfy the two following conditions. Firstly, the observed data of the snapshots can be represented exactly by the POD basis functions. In other words, the snapshots and the linear subspaces spanned by the POD basis vectors coincide exactly [26]. Secondly, the first p POD basis vectors always capture more energy on average than p vectors of any other orthonormal basis [26].
Given a collection of N snapshots of the system obtained by varying the input parameters, where each set of input parameters results in a snapshot with M output values, the data can be organised into a rectangular M by N matrix U, denoted as the snapshot matrix. The POD basis can be established by means of a SVD of the matrix U or by solving the eigenvalue problem of the sample covariance matrix \(\mathbf C = \mathbf U ^\mathrm{T} \cdot \mathbf U \). Employing the latter technique in this paper, the POD basis is expressed by a linear transformation
of the snapshots U. The coefficient matrix V satisfies the following eigenvalue problem
where \(\varvec{\Lambda }\) is a diagonal matrix storing the eigenvalues \({\lambda }_{i}\) of C. \(\varvec{\Lambda }\) can be interpreted as the variance of the data set in the direction of the corresponding POD modes. \(\varvec{\Lambda }\) also measures the energy captured by the respective POD mode. The sum of all eigenvalues defines the total energy. The relative energy captured by the ith basis vector is \(\Lambda _i / \sum ^{N}_{j = 1}\Lambda _j\). Introducing a truncated POD vector \(\overline{\varvec{\Phi }}\) approximating the exact basis vector \({\varvec{\Phi }}\), the exact and approximated predictions of the snapshot matrix U can be represented by
with K \(\ll \) N chosen according to the desired level of energy to be captured. Matrices A and \(\overline{\mathbf{A }}\) are regarded as the amplitude matrix and truncated amplitude matrix, respectively. In other words, a truncated POD matrix \(\overline{\varvec{\Phi }}\) taken from the K first columns of the full matrix \({\varvec{\Phi }}\) is used to approximate the original data matrix U.
POD with interpolation
To predict the system behaviour related to intermediate values of input parameters that are not included in the snapshot data, interpolation is performed to determine the truncated amplitude matrix \(\overline{\mathbf{A }}\), assuming that \(\overline{\mathbf{A }}\) is a smooth function of input parameters. More specifically, each amplitude vector is defined as a linear combination of a set of vectors \(\mathbf F _{i} = [f_{1}(\mathbf z ^{i}) \cdots f_{j}(\mathbf z ^{i}) \cdots f_{N}(\mathbf z ^{i}) ]^T\), with \(f_{j}(\mathbf z )\) as predefined interpolation functions of the input parameters \(\mathbf z ^i\) and an unknown coefficient matrix \(\mathbf B \).
PODRBF The choice of \(f_{j}(\mathbf z )\) can be arbitrary. A suitable strategy is to employ RBF as interpolation functions. The idea of using RBF as approximation functions was first introduced by Hardy [31] to fit irregular topographical data. Since then, RBF have been successfully applied to surrogate modelling strategies in the context of multidisciplinary design optimisation (MDO), see [32–34]. RBF are expressed in terms of the Euclidean distance r = \(\left \left zz^i\right \right \) of a point z from a given point \(z^i\), denoted as the center. Typical RBFs are:
Interpolation is also effective in inverse problems, where the objective is to find a set of parameters that produces computed results matching measured results. RBFs together with POD technique have been used in [3] and [4] to build a onceforall trained PODRBF network for solving inverse problems, choosing the inverse multiquadric function as interpolation function. Each element of the vector \(\mathbf F _{i}\) is computed according to
with c as a smoothing factor. The matrix F containing the interpolation functions can be constructed from all vectors \(\mathbf F _{i}\) of input parameters that are used to generate the snapshots. Using F, the truncated amplitude matrix \(\overline{\mathbf{A }}\) is given by
with
From Eqs. (13) and (14), the coefficient matrix B is determined. Finally, the approximation of the output system response corresponding to an arbitrary set of input parameters is obtained by
PODERBF In the context of multidisciplinary design optimisation (MDO), Mullur and Messac [7] introduced the method of extended RBFs (ERBF) by combining RBFs with nonRBFs. This allows a greater flexibility in the model generation, because the typical RBF approach provides an interpolating surface that is unique for a given set of data, i.e., it yields only a unique interpolative solution to the surrogate modelling problem. In addition, the typical RBF approach does not allow to express desirable properties of the surrogate models. Consequently, the ERBF surrogate model possesses the effectiveness of RBF together with the flexibility of nonRBFs. Recently, an approach combining ERBF and POD as a surrogate model for application in mechanised tunnelling has been proposed in [8]. This modified version of PODRBF method, which has shown improvements in prediction accuracy of the generated surrogate models for both linear and nonlinear functions in multi dimensional spaces will be utilised in this paper.
The main idea of ERBF is to supplement the RBF with a nonRBF term, which are not functions of the Euclidean distance r. Instead, they are functions of \(\xi ^i\), which is the vector pointing from the coordinate of a generic point z in the input space to a data point \(z^i\), defined as \(\xi ^i\) = \(zz^i\). Figure 4 depicts the difference between the Euclidean distance r and the relative coordinates \(\xi \) used in ERBF. The nonRBF terms \(\phi _{ij}\) for the ith data point and the jth dimension are assumed in the format:
\(\phi ^L\), \(\phi ^R\) and \( \phi ^{\beta }\) are components defined in Table 2. The parameter \(\gamma \) in Table 2 can be considered as a smoothness parameter. Figure 5 shows four distinct regions (I–IV) of nonRBF with superscripts L and R corresponding to left and right parts. More details on the design of nonRBF parameters are contained in [7, 35].
According to the PODERBF, the approximation is performed by a linear combination of radial and nonRBFs. The following equation provides the approximated amplitude value of an arbitrary point using the ERBF approach:
with S as the dimension of input parameters. The key idea of the POD with interpolation is to modify the amplitude matrix \(\overline{\mathbf{A }}\) as a smooth function. Using the ERBF approach, Eq. (7) can be rewritten in full and truncated matrix form as follows:
C and D are unknown coefficients matrices. The matrix F is generated according to Eq. (12) and the matrix G is calculated as
with
and
Considering [C D] \(=\) [Q] and [F G]\(^T\) \(=\) R such that Q R \(=\) \(\overline{\mathbf{A }}\), the unknown matrix Q can be obtained as proposed in [7]:
with [R \(^+\)] \(=\) (R \(^T\) R)\(^{1}\) R \(^T\) as the pseudoinverse of matrix R [7]. Consequently, C and D are determined from Q. Finally, the system response of an arbitrary set of input parameters \(\mathbf z _a\) in the parameter space is approximated by:
with \(\mathbf F _a\) and \(\mathbf G _a\) determined from Eq. (12) and Eqs. (21)–(24), respectively.
POD with missing data
Without any missing data, an arbitrary snapshot \(\mathbf U _j\), which belongs to a set of snapshots, can be approximated as a linear combination of the first K POD basis vectors \(\overline{\varvec{\Phi }}\) and an amplitude vector \(\overline{\mathbf{A _j}}\) as described in “Proper orthogonal decomposition”. The amplitude vector is calculated by minimising the error norm
The same least square approach can be effectively used to restore missing data of an incomplete data snapshot \(\mathbf U ^{*}\) by
However, due to missing elements, the \(L^2\) norm in Eq. (27) cannot be evaluated correctly. As a remedy, the Gappy POD procedure, introduced by Everson and Sirovich [6], employs the concept of a gappy norm based on available data. This concept was successfully applied in aerodynamics [9] for the data recovery of the flow field. The procedure is summarised below.
It is assumed, that an output system response snapshots set U, where all snapshots are completely known, together with the POD basis \(\varvec{\Phi }\) is given. \(\mathbf U ^{*}\) is another solution vector, which has some elements missing, specified by a corresponding mask vector m. The vector \(\mathbf m \) is defined to indicate the locations of missing data in the data set
The gappy norm is defined with a gappy inner product \((\cdot ,\cdot )_n\), such that
where \(\circ \) denotes pointwise multiplication. The complete (repaired) vector from \(\mathbf U ^{*}\) can be reproduced using the assumption that \(\mathbf U ^{*}\) can be characterised with the existing snapshots set U. The intermediate repaired vector \(\widetilde{\mathbf{U }}^{*}\) can be expressed in terms of the truncated POD basis vectors \(\overline{\varvec{\Phi }}\) as
By minimising the error norm \(E = {\mathbf{U }^{*}  \widetilde{\mathbf{U }}^{*}}^{2}_{n}\), the coefficient vector \(\overline{\mathbf{A }}^{*}\) can be computed. A solution to this least squares or linear regression problem is given by a linear system of equations
Herein, \(\mathbf M = ({\overline{\varvec{\Phi }}}^\mathrm{T} , \overline{\varvec{\Phi }})_n\) and \(\mathbf R = ({\overline{\varvec{\Phi }}}^\mathrm{T} , \mathbf U ^{*})_n\) are gappy inner products. Evaluating Eq. (31) with \(\overline{\mathbf{A }}^{*}\) computed from Eq. (32), the intermediate repaired vector \(\widetilde{\mathbf{U }}^{*}\) is obtained. Finally, by replacing the missing elements in \(\mathbf{U }^{*}\) by those in \(\widetilde{\mathbf{U }}^{*}\), a complete vector containing the system response is reconstructed.
Iterative GPOD In the method described above, the reconstruction procedure is accomplished in one step with the assumption that the “repaired” vector can be characterised with the already known snapshots set. This method can be extended to the case, where the missing vector itself is included into the snapshots sets. This requires an iterative procedure to construct the POD basis. Two algorithms, the E–S and the V–K method proposed in the literature, are briefly summarised below.
In the E–S method [6], initial guesses are made at missing locations, which are iteratively updated:

(a)
Use timeaverage values as initial guess at missing locations to obtain \(\widetilde{\mathbf{U }}^{*}\).

(b)
Include \(\widetilde{\mathbf{U }}^{*}\) into snapshot U to form \(\widetilde{\mathbf{U }}\).

(c)
Perform POD on \(\widetilde{\mathbf{U }}\) to obtain \(\varvec{\Phi }\).

(d)
Choose the number of modes K to be employed in the reconstruction.

(e)
Compute \(\overline{\mathbf{A }}^{*}\) from Eq. (32) with \(\mathbf M = ({\overline{\varvec{\Phi }}}^\mathrm{T} , \overline{\varvec{\Phi }})\) and \(\mathbf R = ({\overline{\varvec{\Phi }}}^\mathrm{T} , \mathbf U ^{*})\).

(f)
Compute \(\widetilde{\mathbf{U }}\) from Eq. (31) and overwrite the previous guess at missing locations.

(e)
Proceed until convergence, the eigenvalues no longer change. If no convergence is obtained, go to (b).
An extension of the E–S method, which is not dependent on an initial guess and which improves the accuracy significantly, has been proposed by Venturi and Karniadakis in [11]. The main steps of this extended procedure, referred to as the V–K method, are described below:

(a)
Perform the standard E–S procedure, but employ only \(K = 2\) modes in the reconstruction.

(b)
Take the converged result from the previous step as a new initial guess.

(c)
Perform the E–S procedure, but employ now \(K = 3\) modes in the reconstruction.

(d)
Proceed until convergence (the eigenvalues no longer change).
Application to mechanised tunnelling
In this section, the performance of the proposed hybrid surrogate model is demonstrated by means of an application concerned with the numerical simulation of the advancement process of a TBM driven tunnel. The main goal is to demonstrate the capability of the enhanced surrogate model, supplemented with ERBF and IGPOD, to provide reliable predictions of the expected settlements induced by mechanised tunnelling. To this end, the model predictions will be evaluated by comparing the predictions with results from a surrogate model proposed in [1] and with reference results obtained from the original processoriented finite element model ekate.
Figure 6 illustrates the geometry of a synthetic example of a tunnel section of 48 m length, constructed by a tunnel boring machine (TBM) and its discretisation by means of 11,072 quadrilateral twofield finite elements with quadratic approximations for the displacements and linear approximations of the water pressure. The tunnel with a diameter of 8.5 m is excavated with an overburden of 8.5 m. The tunnel lining has a thickness of 0.3 m; each lining ring has a length of 1.5 m. The effect of the stiffness of two existing buildings located at the surface is considered by placing rectangular platelike substitute models with an equivalent thickness of 5 m and a stiffness of 50 GPa at the top of the discretised soil body with a length of 48 m and a width of 170 m (Figs. 6, 7). The numerical simulation of the mechanised tunnelling process is characterised by a stepbystep procedure consisting of different phases: soil excavation at the tunnel face, application of the face support pressure, advancement of the TBM, installation of a tunnel ring and application of the tail void grouting pressure. The soil model comprises of two layers of soft cohesive soils. The tunnel is excavated completely within the top layer. The groundwater table is assumed to be situated at the ground surface. The constitutive behaviour of the soil is modelled by means of a Drucker–Prager plasticity model with the friction angle, cohesion, and Poisson’s ratio taken as 30\(^\circ \), 10 kPa and 0.3 for layer 1 and 28\(^\circ \), 50 kPa and 0.3 for layer 2, respectively. For the tunnel lining and the TBM shield, a linear elastic material law is assumed. The support pressure, which is necessary to prevent tunnel face collapse, is assumed to remain at a value of 180 kPa at the tunnel axis during the tunnel advance. In contrast, the grouting pressure filling the annular gap, which is important to avoid large settlements at the ground surface and large deformations of the surrounding soil, is considered as a time variant process parameter. Because of the fact that beyond a distance of 42 m in Ydirection from both sides of the tunnel axis the surface settlements are almost zero, an effective rectangular surface area with 105 grid points as illustrated in Fig. 7 is considered for the generation of the surrogate model.
In the present demonstration example, it is assumed that the current state of the TBM advance corresponds to the 22nd step of the excavation process and that the history of the settlements of the surface monitoring points are known. The proposed hybrid surrogate modelling approach is employed to predict the complete surface displacement field in the subsequent excavation step (step 23) from input parameter selected within a specific range. In this application example, 11 monitoring points are selected for predicting the future tunnelling induced settlements by the RNN approach. The number of monitoring points is selected to ensure that the RNN is capable to provide good predictions and to have an appropriate accuracy of the GPOD. In particular, the reconstruction quality of the GPOD would be better, if there are more available data points. However, the training and prediction of the RNN might be more complicated. In addition, the position of 11 points are chosen based on the usual position of measurement sensors on the surface in a real tunnel project. Subsequently, the complete surface displacement field will be approximated with the GPOD method.
The following steps describe how to apply the proposed strategy to mechanised tunnelling following the algorithm in Table 1.
Offline stage

In order to set up the surrogate model, 60 numerical simulations are performed to obtain data in the offline stage. Each simulation corresponds to a combination of two varying parameters: the elastic modulus \(E_{1}\) of soil layer 1 and the grouting pressure \(^{[n]}GP\).

The range of variation of these parameters are 20–110 MPa for \(E_{1}\) and 130–230 kPa for \(^{[n]}GP\), respectively. \(E_{1}\) can take 1 out of 10 particular values in the range from 20 to 110 MPa, whereas for \(^{[n]}GP\) one of the six scenarios of time varying pressures is taken, see Fig. 8.

The numerical results of 60 simulations are split randomly into two separate data sets. The first set containing results from 54 simulations is used to establish the surrogate model. In contrast, the results from six cases are stored for validation.

In addition, only the displacements of the complete surface field from time step 1–22 are kept in the first set for training and generating the surrogate model. Meanwhile, the validation set contains surface settlements from time step 1–23. The results from time step 23 are used to validate the prediction capability of the proposed surrogate modelling strategy. The performances of the PODRBF and the PODERBF networks are compared with numerical results from time step 1–22.
Online stage

An arbitrary set of input parameters within the investigated ranges is selected: a value of \(E_{1}\) in the range from 20 to 110 MPa and values of \(^{[n]}GP\) from time step 1–22 in the range of 130–230 kPa.

Approximate the complete displacement field from time step 1–22 by PODRBF based on the data of 54 numerical simulations.

With an arbitrary value of \(^{[23]}GP\) in the range of 130–230 kPa, the RNN predicts the settlements at 11 selected monitoring points of time step 23.

The complete displacement field of time step 23 is predicted using GPOD.
It should be noted that the same section of the mechanised tunnelling project has been investigated previously in [1] with a similar surrogate modelling strategy using PODRBF and GPOD. This allows to compare the PODRBF and GPOD approach with the enhanced by PODERBF and IGPOD (E–S and V–K) methods, respectively. The error between prediction and FE result is calculated as
The PODRBF network is used to approximate the surface settlements within all 105 grid points from all previous excavation steps (steps 1–22), containing a total number of 2310 settlement values. Figure 9 shows a comparison between the results from the PODERBF and the PODRBF with the FE results for all 105 surface points and all time steps 1–22 for validation case 1, i.e., the value of \(E_{1}\) is 90 MPa and \(^{[n]}GP\) is chosen according to pressure scenario 5, see Fig. 8. Table 3 shows the prediction performances of PODRBF and PODERBF of the six validation cases and the corresponding average values. Only a slight improvement of the predictions of the surface settlements is observed when employing the PODERBF instead of PODRBF. Considering all 22 steps in the evaluation of the error according to Eq. (33), the average error decreases from 1.91 to 1.46 % when using the PODERBF. A comparison between the predicted results for the surface settlements in all surface points using the GPOD and the IGPOD approaches with the reference results from the original FE simulation is presented in Table 4. As expected, the IGPOD provide better predictions with the method V–K giving the best approximation results for all validation cases. Figure 10 depicts the predicted surface settlements in comparison with the FE results for validation case 1. It can be concluded that the PODERBF and the IGPOD have the possibility to enhance the prediction performances of the corresponding components (PODRBF and GPOD) of the proposed surrogate model individually. The next paragraph investigates the consequence when integrating PODERBF and IGPOD into the hybrid surrogate model.
The investigation is carried out by combining the PODRBF and the PODERBF separately with the GPOD and the E–S and V–K enhancements, respectively. This leads to six surrogate models in total. According to Table 4 the models with the E–S method produce slightly better results compared with models employing the GPOD method. This can be explained by the fact that reconstruction results from both GPOD and E–S depends on the initial guess, see [11]. However, with errors of only 1,18 and 1,36 % as compared to error levels larger than 5 %, the best accuracy is obtained from PODRBF and PODERBF models enhanced by the V–K method. This agrees well with observations in [11], where the V–K method was also shown to produce the relative best results as it does not depend on an initial guess. The reconstruction problem is considered for a rectangular matrix (\(105\times 23\)) with 23 time steps and 105 settlement points in which all elements from column 1 to column 22 and 11 elements of column 23 are known. The 94 missing elements of time step 23 over a total of \(105\times 23 = 2415\) elements constitute a small gappiness of 4 %. This may explain, why the prediction accuracy and computation time of surrogate models in this example differ only slightly. The average computation time for one run of the hybrid surrogate model is summarised in Table 5. It is noted, that the previous approach using RBF and GPOD needs less computing time as compared to the iterative and more complex PODERBF approach in conjunction with IGPOD. However, with a maximum computing time of less than one second, the criterion for realtime application is still fulfilled. Therefore, the enhanced hybrid surrogate model will be chosen as the main ingredient for a new software tool proposed in the next section, which is targeted to on site applications to support the steering of TBMs.
Realtime simulation software for TBM steering support
Based on the enhanced IGPODERBF algorithm described in ‘Hybrid surrogate model’, a realtime simulation software is developed with the aim to support the steering of the tunnel boring machine during mechanised tunnelling. The goal of this software is to predict the system response, i.e., the surface settlements (and/or tunnel lining forces etc.), resulting from the TBMsoil interaction in realtime as the response to changes of operational parameters, such as the face pressure or the grouting pressure.
The example described in this section is similar to the application example in the previous section. However, two varying operational parameters in mechanised tunnelling are considered here. They are the support pressure \(^{[n]}SP\) and the grouting pressure \(^{[n]}GP\) which constitute the main operational parameters to control the settlements caused by the tunnel drive. The software consists of three main modules: “Overview” module, “Monitoring” module and “Prediction” module. For the prediction of time variant surface settlement fields for the next excavation step, the user has to follow the sequence of all three modules.
The “Overview” modules gives a brief description about basic parameters of the selected tunnel section of a tunnelling project, such as cover depth, tunnel radius, ring length, current position, etc. In addition, the module also allows to record the complete history of the operational parameters of the tunnel construction described above, the support pressure \(^{[n]}SP\) and the grouting pressure \(^{[n]}GP\). The offline data obtained from numerical simulations performed in the design stage are loaded to set up the surrogate model. Figure 11 shows a screenshot of the “Overview” module with two graphs representing the history of \(^{[n]}SP\) and \(^{[n]}GP\) upto the current state of the project.
The “Monitoring” module is used to store and visualise the locations of all monitoring points and the evolution of the settlements in the already constructed tunnel section, see Fig. 12. The settlement history of these monitoring points will be extrapolated with predicted values from RNN for the next time step corresponding to the chosen support pressure and grouting pressure. In practice, the predicted values from RNN are updated with real measurements at monitoring points. Nevertheless, in this example this step is skipped since there are only synthetic data from numerical simulations.
The most important part of the software is the “Prediction” module, where the user can see almost immediately the complete surface settlements of the next time step caused by changes of the grouting pressure or the face support pressure applied through movements of the corresponding sliders on the GUI. The module offers the possibility for the user to define a limit state, such as a maximum tolerated settlement in any point on the surface. Figure 13 demonstrates that by defining a limit state and varying the grouting or the face support pressure, red points appearing on the left panel may appear to indicate that in these points the tolerated displacements would be exceeded if the chosen combination of pressures would be applied. In summary, with the developed software users can obtain in realtime the surface behaviour resulting from changing the operational parameters in mechanised tunnelling. Therefore, it provides TBM drivers an assistant tool for decisionmaking during the TBM steering.
The tests presented in this paper are executed on a standard computer with IntelChip 2\(\,\times \,\)1.70 GHz, 2\(\,\times \,\)4 GB RAM. The software can run in almost every standard laptop or even tablet since it does not require any expensive hardware.
Conclusion
In this paper, a hybrid surrogate modelling strategy based upon the combination of a RNN and the GPOD has been proposed to enable realtime prognoses during mechanised tunnelling. The proposed approach is an extension of preliminary work by the authors, characterised by supplementing the previous surrogate model with Extended RBFs and an iterative Gappy POD. It was proven, that the suggested enhancements improve the prediction capability of the surrogate model. Although more complex formulations and an iterative concept are involved, the new hybrid surrogate model still provides predictions within a reasonable time in the context of applications in mechanised tunnelling, targeted to predict tunnelling induced settlements in realtime. In particular, the surrogate model combining the PODERBF and the V–K method yields the best prediction results in the presented application. The new approach has been integrated into a software which provides, in realtime, the expected tunnelling induced settlements for varying operational parameters chosen by the user and thus enables to support the steering of tunnel boring machines. The developed software provides a new option for tunnel engineers on the construction site to select the appropriate parameters such, that tolerated settlements will not be exceeded during the upcoming excavation steps.
The proposed hybrid surrogate model will be further extended to consider uncertain geotechnical parameters. First steps include interval and fuzzy data within the presented RNNGPOD approach to allow predicting time variant interval settlement fields by means of interval arithmetic operations computed in realtime. In contrast to more time consuming optimisation approaches for interval analysis with the hybrid RNNGPOD surrogate model, see [1], the problem of overestimation has to be considered within interval arithmetic. In addition, a strategy is currently developed to continuously reduce the predicted interval uncertainty by updating the settlement field with monitoring data.
References
 1.
Freitag S, Cao BT, Ninić J, Meschke G. Hybrid surrogate modelling for mechanised tunnelling simulations with uncertain data. Int J Reliab Saf. 2015;9(2/3):154–73.
 2.
Freitag S, Graf W, Kaliske M. Recurrent neural networks for fuzzy data. Integr Comput Aided Eng. 2011;18(3):265–80.
 3.
Ostrowski Z, Bialecki RA, Kassab AJ. Solving inverse heat conduction problems using trained podrbf network inverse method. Inverse Probl Sci Eng. 2008;16(1):39–54.
 4.
Buljak V, Maier G. Proper orthogonal decomposition and radial basis functions in material characterization based on instrumented indentation. Eng Struct. 2011;33:492–501.
 5.
Ostrowski Z, Bialecki RA, Kassab AJ. Estimation of constant thermal conductivity by use of proper orthogonal decomposition. Comput Mech. 2005;37:52–9.
 6.
Everson R, Sivorich L. Karhunen–Loeve procedure for gappy data. J Opt Soc Am A Opt Image Sci Vis. 1995;12(8):1657–64.
 7.
Mullur AA, Messac A. Extended radial basis functions: more flexible and effective metamodeling. AIAA J. 2005;43(6):1306–15.
 8.
Khaledi K, Miro S, König M, Schanz T. Robust and reliable metamodels for mechanized tunnel simulations. Comput Geotech. 2014;61:1–12.
 9.
BuiThanh T, Damodaran M, Willcox K. Aerodynamic data reconstruction and inverse design using proper orthogonal decomposition. AIAA J. 2004;42:1505–16.
 10.
Willcox K. Unsteady flow sensing and estimation via the gappy proper orthogonal decomposition. Comput Fluids. 2006;35(2):208–26.
 11.
Venturi D, Karniadakis GE. Gappy data and reconstruction procedures for flow past a cylinder. J Fluids Mech. 2004;519:315–36.
 12.
Gunes H, Sirisup S, Karniadakis GE. Gappy data: to krig or not to krig? J Comput Phys. 2006;212:358–82.
 13.
Nagel F, Stascheit J, Meschke G. Processoriented numerical simulation of shield tunneling in soft soils. Geomech Tunn. 2010;3(3):268–82.
 14.
Kasper T, Meschke G. A 3D finite element model for TBM tunneling in soft ground. Int J Numer Analyt Methods Geomech. 2004;28:1441–60.
 15.
Stascheit J, Nagel F, Meschke G, Stavropoulou M, Exadaktylos G. An automatic modeller for finite element simulations of shield tunnelling. In: Eberhardsteiner J, Beer G, Hellmich C, Mang HA, Meschke G, Schubert W, editors. Computational modelling in tunnelling (EURO:TUN 2007). Vienna; 2007.
 16.
Meschke G, Ninic J, Stascheit J, Alsahly A. Parallelized computational modeling of pilesoil interactions in mechanized tunneling. Eng Struct. 2013;47:35–44.
 17.
Cao BT, Chmelina K, Stascheit J, Meschke G. Enhanced monitoring and simulation assisted tunnelling (emsat). In: Meschke G, Eberhardsteiner J, Soga K, Schanz T, Thewes M, editors. Computational methods in tunnelling and subsurface engineering (EURO:TUN 2013). 2013. p. 41–50.
 18.
Ninić J, Koch C, Freitag S, Meschke G, König M. Simulation and monitoringbased steering for mechanized tunneling using project data of WehrhahnLinie. In: Proceedings of the 11th World Congress on Computational Mechanics (WCCM 2014), Barcelona; 2014 (online available).
 19.
Freitag S, Cao BT, Ninić J, Meschke G. Hybrid rnngpod surrogate model for simulation and monitoring supported tbm steering. In: Tsompanakis Y, Kruis J, Topping BHV, editors. Proceedings of the 4th International conference on soft computing technology in civil, structural and environmental engineering (CSC2015). Prague: CivilComp Press; 2015. paper 2. doi:10.4203/ccp.109.2.
 20.
Adeli H. Neural networks in civil engineering: 1989–2000. Comput Aided Civ Infrastruct Eng. 2001;16:126–42.
 21.
Freitag S. Artificial neural networks in structural mechanics. In: Tsompanakis Y, Kruis J, Topping BHV, editors. Computational technology reviews, vol. 12. Stirlingshire: SaxeCoburg Publications; 2015. p. 1–26. doi:10.4203/ctr.12.1.
 22.
Hotelling H. Analysis of a complex system of statistical variables into principal components. J Educ Psychol. 1933;24:417–441498520.
 23.
Golub GH, Reinsch C. Singular value decomposition and least squares solutions. Numer Math. 1970;14(5):403–20.
 24.
Karhunen K. Zur spektraltheorie stochastischer prozesse. Ann Acad Sci Fennicae 37. 1946.
 25.
Loeve M. Probability theory II. 4th ed. Graduate texts in mathematics, vol. 46. New York: Springer; 1978.
 26.
Holmes P, Lumley JL, Berkooz G. Turbulence, coherent structures. Dynamical systems and symmetry. New York: Cambridge University Press; 1996.
 27.
Radermacher A, Reese S. Model reduction in elastoplasticity: proper orthogonal decomposition combined with adaptive substructuring. Comput Mech. 2014;54(3):677–87.
 28.
Galland F, Gravouil A, Malvesin E, Rochette M. A global model reduction approach for 3d fatigue crack growth with confined plasticity. Comput Method Appl Mech Eng. 2011;200(5–8):699–716.
 29.
Mifsud M. Reducedorder modelling for highspped aerial weapon aerodynamics. Ph.D. Thesis. Cranfield UniversityCollege of Aeronautics; 2008.
 30.
Sirovich L. Turbulence and the dynamics of coherent structures: i, ii and iii. Q Appl Math. 1987;45:561–71.
 31.
Hardy RL. Multiquadric equations of topography and other irregular surfaces. J Geophys Res. 1971;76:1905–15.
 32.
Jin R, Chen W, Simpson T. Comparative studies of metamodelling techniques under multiple modelling criteria. Struct Multidiscip Optim. 2001;23(1):1–13.
 33.
Simpson TW, Peplinski JD, Koch PN, Allen JK. Metamodels for computerbased engineering design: survey and recommendations. Eng Comput. 2001;17:129–50.
 34.
Hussain MF, Barton RR, Joshi SB. Metamodeling: radial basis functions, versus polynomials. Eur J Oper Res. 2002;138:142–54.
 35.
Mullur AA, Messac A. Metamodeling using extended radial basis functions: a comparative approach. Eng Comput. 2006;21:203–17.
Authors’ contributions
All authors, BTC, SF and GM, participated equally in the manuscript writing. All authors read and approved the final manuscript.
Author information
Affiliations
Corresponding author
Ethics declarations
Acknowlegements
Financial support was provided by the German Research Foundation (DFG) in the framework of project C1 of the Collaborative Research Center SFB 837 “Interaction Modelling in Mechanised Tunnelling”. This support is gratefully acknowledged.
Competing interests
The authors declare that they have no competing interests.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Cao, BT., Freitag, S. & Meschke, G. A hybrid RNNGPOD surrogate model for realtime settlement predictions in mechanised tunnelling. Adv. Model. and Simul. in Eng. Sci. 3, 5 (2016). https://doi.org/10.1186/s4032301600579
Received:
Accepted:
Published:
Keywords
 Proper orthogonal decomposition
 Recurrent neural network
 Mechanised tunnelling
 Surrogate model
 Realtime application
 Computational steering