 Research article
 Open Access
 Published:
Remarks on mixedinteger formulations for hyperreduction schemes in nonlinear dynamics
Advanced Modeling and Simulation in Engineering Sciences volume 7, Article number: 36 (2020)
Abstract
The hyperreduction problem for reducedorder internal forces evaluation in transient, nonlinear, explicit dynamics is reformulated, employing MixedInteger Programming (MIP), taking into account consistency constraints. Constraint reduction is introduced. Resulting quadratures, as well as reduced runs, are compared against the standard Energy Conserving Sampling and Weighting (ECSW) scheme, on a reference example. Rather than searching for optimal performance, the goal is to provide a benchmark solution, for evaluation of heuristic hyperreduction formulations along with a nongreedy approach.
Introduction
Simulation is widely used in the industry when designing and virtually testing new products. In constant search of a better approximation of reality, Finite Element (FE) models are becoming increasingly complex. Last decade, the number of elements in models used by car manufacturers when testing new cars in crash situations had increased by orders of magnitude for, amongst others, fracture representation. Simultaneously, the need to speedup simulations has motivated the development of Model Order Reduction (MOR) methods. Projectionbased Reduced Order Modeling (PROM) approximates the unknown field variable as a linear combination of a set of global, domainspanning Reduced Basis (RB) functions. The Proper Orthogonal Decomposition (POD) [1], originating from statistical data analysis [2], postprocesses training data gathered from Full Order Model (FOM) runs to build RBs used ’online’ in reduced simulations. POD has found extensive applications in turbulent flow modeling [3,4,5,6] and computer graphics [7,8,9,10] as well as in a variety of scientific fields such as modeling of composites [11], inverse problems [12, 13] and shape optimization [14,15,16]. However, when applied to explicit nonlinear dynamics [17, 18], POD does not reduce the complexity of evaluating internal variables and entails a computational overhead in the ’online’ reduction phase due to the necessity of computing internal forces over all elements. HyperReduction (HR) methods are combined to PROM to tackle the internal forces computational complexity and achieve ’online’ speedup by selecting a representative subset of elements for internal forces approximation.
Miscellaneous HR methods exist in the literature: In the PGD context, the Reference Point Method [19] may be considered as a HR technique. The Discrete Empirical Interpolation Method (DEIM) [20,21,22] reduces the complexity of evaluating nonlinear internal variables combining projection and interpolation. DEIM originates from the Empirical Interpolation Method [23] and aims to approximate the projection of the internal forces by using only a few of their components. This method is closely related to the magic points method [24]. Other HR approaches directly approximate the projected internal forces by building a reduced spatial integration scheme. The multidimensional ’a priori’ hyperreduction (APHR) [25] creates a reduced integration domain without any knowledge from the FOM. In the present work, we consider the EnergyConserving Sampling and Weighting (ECSW) [26] formulation of an optimization problem, based on data collected from the FOM, to build a hyperreduced integration scheme whose particularity is to impose integration weights positivity ensuring energy conservation of the reduced integrator. Further evolution of this scheme introducing volume preservation is the Empirical Cubature Method(ECM) [27]. ECSW is an ’a posteriori’ method as it relies on data from fullscale simulations to train a hyperreduced integration scheme, as opposed to ’a priori’ methods which use the knowledge of the physical problem rather than training data [25]. The optimization problem that arises in the ECSW is NPhard and is in practice suboptimally solved by mean of the Sparse NonNegative Least Square (SNNLS) greedy algorithm. Similar numerical integration schemes, in which it is necessary to preserve the consistency and compatibility during the shape functions integration, arise in Galerkin meshless methods such as Diffuse Elements [28], and Element Free Galerkin [29,30,31].
Present work is motivated by the observation that, proceeding greedily by subsequent enrichments, the SNNLS algorithm becomes computationally expensive in building large hyperreduced integration schemes , and that a reference method is needed to compare performances of heuristic approaches. The ECSW optimization problem is reformulated as a linear mixed integer one solved with [32], and illustrated on a benchmark FE model. Different formulations incorporating consistency conditions and constraint reduction are tested. Resulting integration schemes are compared in terms of number and position of integration points, and error in the work of internal forces within the ’online’ reduction phase.
The paper is organized as follows. “Projected hyperreduced order model Notations” section briefly reviews PROM and ECSW methods in a nonlinear explicit structural dynamics framework. “Hyperreduced integration” section develops the theory behind the proposed linear MIP formulation, which is then tested in “Results and discussion” section on a pierced plate under uniform tension FE model. Results are then discussed, and recommendations are made regarding future developments.
Projected hyperreduced order model
Notations
Throughout this paper, curly brackets designate vectors and square brackets designate matrices. Following notations are sorted out in alphabetical order.
Projected reduced order model
We focus on semidiscretized equations used in nonlinear explicit FE solvers
where \(\{u(t)\}\in {\mathbb {R}}^N\) is the vector of nodal Degrees of Freedom (DoF), \(\{f_{int}\}\in {\mathbb {R}}^N\) is the vector of nonlinear internal forces and \(\{f_{ext}\}\in {\mathbb {R}}^N\) is the vector of external forces. N denotes the number of DoF and is referred to as the FOM size. \([{\mathbb {M}}]\in {\mathbb {R}}^{N\times N}\) is the symmetric positivedefinite mass matrix. In explicit nonlinear structural dynamics, industrial FE solvers frequently use a lumped mass approach yielding diagonal \([{\mathbb {M}}]\). Hence, inversing the mass matrix is trivial, and the computational effort concentrates on the internal and contact forces evaluation.
The explicit central difference method [33] is used for integration in time domain.
Given a RB \([\Phi ]\in {\mathbb {R}}^{N\times k}\) of size k, the ROM approximates the FOM solution \(\{u\}\) with \(\{{\tilde{u}}\}\),
Above approximation is injected into the FOM (1) which is then projected on the RB, yielding the PROM
\(\{\alpha \}\in {\mathbb {R}}^k\) is the ROM unknown and \([\tilde{{\mathbb {M}}} ] = [\Phi ]^T [{\mathbb {M}}] [\Phi ] \in {\mathbb {R}}^{k\times k}\) is the reduced mass matrix. \([\Phi ]\) is usually \([{\mathbb {M}} ]\)orthonormalized so that \([\tilde{{\mathbb {M}}}]\) is the identity matrix \([Id_k ]\in {\mathbb {R}}^{k\times k}\). The ROM is of size k, much smaller than N,
Projecting the FOM (1) employing an orthogonal matrix \([\Phi ]\) potentially increases the critical time step ensuring numerical stability. A rigorous mathematical proof of this property is provided in [34]. However, in applications to explicit structural dynamics, PROM methods generally yield a computational overhead. First, there is no real gain in reducing the model size to k when the lumped mass approach is used in the FOM (1) as a diagonal mass matrix inverse is computed with negligible computational effort. Second, internal forces have to be computed for all elements, involving the timeconsuming integration of the constitutive law, and two additional steps are required: expansion of reduced DoF \(\{ u\} = [\Phi ]\{ \alpha \}\) and contraction of internal forces \(\{ {\tilde{f}}_{int} \} = [\Phi ]^T \{ f_{int} \}\). The same goes for kinematic conditions, as well as any requested output.
However, as internal forces vector of size N is to be projected on the reduced space of size k spanned by the columns of the RB \([\Phi ]\) and \(k<<N\), it may not be necessary to compute the whole internal forces vector to have a good approximation of its projection on the reduced space, and this is where hyperreduction takes place. The following section briefly reminds the ECSW scheme motivating this work.
Energyconserving sampling and weighting (ECSW)
The Galerkin method used in FE analysis in the divide and conquer spirit successively computes internal forces \(\{f_{int}^e\}\in {\mathbb {R}}^{N}\) in each of \(n_e\) elements of the model and assembles respective contributions
In the ROM (4), internal forces are projected on \([ \Phi ] \in {\mathbb {R}}^{N \times k}\)
Hyperreduction computes internal forces only for a subset \({\mathcal {H}}\subset \llbracket 1, n_{e} \rrbracket \) of elements indexes and applies weights \(\zeta ^{*}_e\) to the elemental contributions ahead of summation and projection on the reduced space
where \(\{ \zeta \}^* = (\zeta ^{*}_1 , \zeta ^{*}_2 , \dots , \zeta ^{*}_{n_e })^T \in {\mathbb {R}}_{\ge 0}^{n_{e}} \) contains weights associated with all elements in the model. \(\zeta ^{*}_e = 0\) if and only if element e is not selected (\(e\notin {\mathcal {H}}\)). The ECSW method imposes also \(\zeta ^{*}_e > 0\) for selected elements to maintain the integrator positivity.
The hyperreduced integration scheme, given by the subset of selected elements \({\mathcal {H}}\) and associated weights \(\{\zeta ^*\}\), is obtained through optimization. Given a RB \([\Phi ]\) and unassembled internal forces \((\{ f_{int}^e (t_i) \} )_{(e,i)\in \llbracket 1,n_e \rrbracket \times \llbracket 1,n_s \rrbracket }\), the hyperreduced quadrature scheme integrates the projected unassembled internal forces training data set up, to a userdefined precision, while selecting the fewest possible elements in \({\mathcal {H}}\). First, \(n_s\) unassembled internal forces snapshots are collected at training times \(( t_i )_{i\in \llbracket 1, n_s \rrbracket }\). Without loss of generality, snapshots may as well be taken at different model parameters values. Once collected, unassembled internal forces \((\{ f^{e}_{int}(t_i ) \} )_{(e,i)\in \llbracket 1,n_e \rrbracket \times \llbracket 1,n_s \rrbracket }\subset {\mathbb {R}}^N\) are projected on the reduced space, yielding \(([\Phi ]^T \{f_{int}^e (t_i)\})_{(e,i)\in \llbracket 1,n_e \rrbracket \times \llbracket 1,n_s \rrbracket } \subset {\mathbb {R}}^k\), and are organized in the matrix
where
Using this notations, the nonreduced assembly process (5) writes
with \(\{\zeta ^*\} = \{1_{n_e}\}\) corresponding to the selection of all elements with integration weights equal to 1 and \(\{ b\}\in {\mathbb {R}}^{k*n_s }\) is the ’exact’ projection of all internal forces snapshots on \([\Phi ]\), used as reference to train the weights. Finally, given a targeted precision \(\tau \), the optimization problem of the hyperreduced integration scheme is stated as
The threshold \(\tau \) on the approximation precision constraint is imposed in the admissible space \({\mathcal {A}}_{ECSW}\) alongside weights positivity, denotes the zeronorm associating the number of its nonzero coefficients to a vector, equivalent to the number of selected finite elements, to be minimized. However, the zero norm is not differentiable, making (11) NPhard. In practice (11) is suboptimally solved with greedy algorithms such as SNNLS [26] (Algorithm 1). Alternatives such as the LASSO algorithm have been compared to SNNLS in [35]. In the present work, (11) is reformulated and solved using MIP optimization, yielding an optimal method used in this paper as a reference to assess the performances of the heuristic SNNLS procedure on an academic example.
Hyperreduced integration
MIP formulation
IBM CPLEX MIP [32] solves problems involving both integer and real variables based on a combinatorial Branch And Bound [36, 37] algorithm for integer unknowns and simplex algorithm for real variables. (11) is transformed into a problem that may be solved using MIP in the following steps. An additional boolean unknown \(\{\xi \}\in \{ 0,1 \}^{n_e}\) is introduced to take account of the elements affiliation to \({\mathcal {H}}\)
Mixed optimization variables are thus \((\{ \zeta \},\{\xi \} )\in {\mathbb {R}}_{\ge 0}^{n_{e}}\times \{0,1\}^{n_e}\). The link between the nonnegative real weights and the Boolean selectors is: if \(\xi _e = 0\) for a given element e, the element is not selected and \(\zeta _e = 0\) is imposed. A maximal value for the weights is prescribed
bounding each selected element weight with \(\zeta _{max}\) and each unselected element weight with 0 and linearizing the problem. Together with the weight nonnegativity condition, (12) ensures
Similarly, a minimal value \(\zeta _{min}\) is imposed on each selected element weight by the constraint
(13) imposed with \(\zeta _{min} = 1\) ensures that each selected element counts at least for itself while avoiding overfitting.
Additionally, defining \(\xi _{min}\) and \(\xi _{max}\), the minimal and maximal number of elements in \({\mathcal {H}}\), respectively (\(1\le \xi _{min}\le \xi _{max}\le n_e\))
allows to target prescribed intervals for the number of selected elements. In contrary to the ECSW implementation in [26], this constraint allows to directly start searching for solutions from a given \(\xi _{min}\) or assess unattainability of the targeted precision for a given \(\xi _{max}\), reducing computation time by shrinking the admissible space.
Finally, for a given threshold \(\tau \), the MIP optimization problem writes
Note, that the threshold \(\tau \) on the hyperreduced quadrature scheme precision is now imposed in \(L^{\infty }\) norm and not in \(L^2\) norm in contrary to the ECSW optimization problem (11). The linear constraint matrix is
with [G] defined by Eq. (8).
Consistency constraints
When internal forces functions are strongly varying in space and time, such as in carcrash analysis, exact domain integration may not be possible. Exactness in the projected Galerkin hyperreduced scheme is not guaranteed even if the RB functions possess sufficient completeness to represent the solution. A similar problem arises in the Element Free Galerkin context [28, 38], where the exactness in the Galerkin approximation, conditioned by the numerical verification of volume and divergence equalities, is met provided additional zero and firstorder integration constraints, respectively. The present work also investigates the impact of adding consistency conditions at training times \((t_i )_{i\in \llbracket 1, n_s \rrbracket }\) such as exact volumic and polynomial integration up to a given degree. Volume preservation writes
where \(\omega _e (t_i)\) denotes the volume of element e at training time \(t_i\), \(i\in \llbracket 1, n_s \rrbracket \), without loss of generality, sampled at the same training times as unassembled internal forces. Constraint (17) is expressed in the MIP formalism by appending \([G_v ]\) to (16)
In a similar fashion, first degree polynomials integration is imposed at training times \(t_i, \quad i\in \llbracket 1, n_s \rrbracket \)
A single integration point per element is considered at the center of element e, \(\{g^{(e)}(t_i )\} = (g^{(e)}_1 (t_i ) , g^{(e)}_2 (t_i ) , g^{(e)}_3 (t_i ))^T \) at training time \(t_i \). Constraints on first degree polynomials are prescribed by further appending the following matrix \([G_p]\) to [G]
while \(\{b\}\) in the left and right members of (15) is computed using Eq. (10) with modified [G].
Constraints reduction
Overfitting is a significant concern when training a hyperreduced integration scheme over a set of collected data. Redundant snapshots may eclipse others and result in inadequate internal forces approximation in the online reduction phase. Moreover, an excessively large data set may lead to an unnecessarily large number of linear constraints, deteriorating performances of the MIP solver. A constraint reduction in the optimization problem (15) is thus proposed to address those two issues.
In this section and the remainder of the paper, [G] dimensions are denoted \(m\times n_e\). Data is decomposed using Singular Value Decomposition (SVD). Note, that as the SVD decomposes the second dimension of the matrix and, in the present case, the constraints are to be reduced, the decomposition is performed on \([G]^T\) of a presumably lower number of lines
yielding \([\Upsilon ]\) of dimensions \(n_e \times n_e\) and \([\Pi ]\) of dimensions \(m \times n_e\) as well as \([\lambda ] = diag(\lambda _1 , \lambda _2 , ... , \lambda _{n_e} )\in {\mathbb {R}}^{n_e \times n_e}\) containing singular values \(\lambda _1 \ge \lambda _2 \ge \dots \ge \lambda _m\) arranged in descending order. Using (23), the constraint \([G ]\{ \xi \} = [G ] \{ 1_{n_e}\}\) writes
The size of \([\Upsilon ]\) makes the problem numerically nontractable. Therefore, the idea is to keep only \(l<n_e\) columns of \([\Upsilon ]\), yielding the first form of the reduced constraints,
with
Choosing l so that \(\lambda _1 \ge \dots \ge \lambda _l > 0\) ensures the kernel to be of size \(n_e l\). As a matter fo fact, \([{\tilde{\Upsilon }} ]\) has l linearly independent columns and the rank theorem yields
\(ker([{\tilde{\Upsilon }} ]^T)\) is nonempty and may be identified with QR factorization.
with \([Q_1 ]\in {\mathbb {R}}^{n_e \times l}\) and \([Q_2 ]\in {\mathbb {R}}^{n_e \times (n_e  l)}\) orthonormal matrices and \([R]\in {\mathbb {R}}^{l \times l}\) an upper triangular matrix. Constraints (25) rewrite
Substituting variable \(\{\zeta \} = \{1_{n_e}\} + \{w\}\)
and injecting QR factorization (27) yields
The final form of the unknown integration weights is
For every \(\{\chi \}\in {\mathbb {R}}^{n_e  l}\), \(\{\zeta \}\) defined by Eq. (28) verifies implicitly (25). Constraint on weights nonnegativity writes
and constraint (12) implies
Finally, the reduced optimization problem is
with the reduced constraint matrix
In this problem there are \(2n_e +1\) linear constraints and \(2n_e  l\) MIP unknowns, yielding more contraints than unknowns. Yet, depending on the value of \(\xi _{min}\), \(\xi _{max}\) and \(s_{max}\), it is not always possible to find a solution. With \((\xi _{min},\xi _{max})=(1,n_e)\) and \(s_{max}\ge 1\), a trivial solution is \(\{\chi \}=\{0 \}\) and \(\{\xi \}=\{1_{n_e}\}\). Nontrivial solutions exist for every \(\xi _{max}\) greater or equal to \((n_e l)\), \(\xi _{min}=1\). As a matter of fact, the kernel of \([{\tilde{\Upsilon }}]\), being spanned by the columns of \([Q_2 ]\) of dimension l, it is possible to satisfy the constraints by selecting less than \(n_e l\) elements.
Results and discussion
Approaches proposed in the present work are implemented in the industrial FE solver Altair Radioss [39] modified for research purposes. The mixed optimization problems are solved with CPLEX [32]. In this section, different hyperreduced integration schemes are computed with the stateoftheart SNNLS algorithm and compared with the proposed approaches in terms of numbers and positions of selected elements, offline training data, and online work of internal forces approximation errors.
The model used for comparison is presented in Fig. 1 using the unit system [T, mm, s, MPa]. The plate is of dimensions \(1000\times 2000\times 100\quad \mathrm {mm}^3\) and is composed of steel of density \(\rho = 7.89E9 \quad \mathrm {T\,mm}^{2}\) modeled with JohnsonCook elastoplastic material law. Parameters of the material law are: Young modulus \(E = 210000\) MPa, Poisson ratio \(\mu = 0.3\), yield stress \(\sigma _{Y} = 290\) MPa, hardening parameter \(b = 50\) and hardening exponent \(n = 0.25\). The plate is stretched with prescribed velocity \({\varvec{V}} = \pm 10000.\{e_x\} \quad \mathrm {mm\,s}^{1}\), progressively imposed as shown on Fig. 2. \(30\quad \mathrm {ms}\) of the phenomenon are simulated. Three planar symmetries allow simulating only an eighth of the plate using \(N=444\) degrees of freedom and \(n_e = 55\) elements. Final configuration and Von Mises constraints are represented in Fig. 3. No parametric variations are considered in this work and the training times correspond to different discrete times \(( t_{i} )_{i\in \llbracket 1, n_s \rrbracket }\) of the same simulation. In this test case, an RB \([\Phi ]\) of size eight is used, and \(n_s = 1148\) unassembled internal forces snapshots are taken at training times \((t_i)_{i\in \llbracket 1, n_s \rrbracket }\) uniformly distributed every 50 time cycle during the simulation. For consistency conditions, elements’ centers and volumes are gathered at the same simulation times as unassembled forces snapshots.
Results obtained in this example are presented in two groups. The impact of adding consistency conditions is first studied in “Consistency conditions” section while constraints reduction is tested in “Constraints reduction” section.
Consistency conditions
In this section, the following hyperreduced formulations are tested both in the offline training phase, in terms of training data approximation error at given quadratures size, and in the online reduction phase, in terms of the work of internal forces reconstruction. These tests include:

SNNLS greedy algorithm presented in Algorithm 1 solving the ECSW optimization problem (11);

MIP optimization problem (15);

MIP + V, MIP optimization problem (15) with the consistency conditions (18) on volume integration;

MIP + V + P1, MIP optimization problem (15) with the consistency conditions (18) on volume integration and (22) on first order polynomial integration;

MIP + G1, MIP optimization problem (15) with a minimal weight value \(\zeta _{min}=1\).
The reduced run using the RB \([\Phi ]\) of size eight without hyperreduction is used as reference to investigate the impact of the different hyperreduction methods.
Figure 4 shows the error on unassembled internal forces snapshots training data
Consistency constraints are not appended to [G] when computing this error for respective hyperreduced quadratures.
Figure 5 shows the approximation error of work of internal forces within the online reduction phase. The work of internal forces \(W_{int}\) is defined as the integral over the domain \(\Omega \) of the tensor dot product between the stress \(\underline{{\underline{\varepsilon }}}\) and the strain \(\underline{{\underline{\sigma }}}\) tensors
The approximation error of the work of internal forces \(\epsilon _{int}\) is defined as
with \(W_{int}\), and \({\tilde{W}}_{int}\), the work of internal forces of the reference and the hyperreduced simulations, respectively.
Element subsets \({\mathcal {H}}\) selected by the different methods are compared for hyperreduction schemes of size 7, 10, and 14 in Figs. 6, 7, and 8. On those examples, and as mentioned above, results are extended to the full pierced plate through three planar symmetries. This choice allows for a better comparison of element selection as, on a full model, hyperreduction may indiscriminately select among symmetric elements. Consequently, each selected element is represented eight times in the symmetric parts of the model.
Hyperreduced integration weights obtained with the different formulations are represented in boxplots in Fig. 9.
Figure 4 assesses the performances of the greedy SNNLS algorithm in the offline training phase. Among the hyperreduced quadratures of size seven, the SNNLS algorithm solution offers the less accurate approximation in the offline phase. However, for larger hyperreduced quadratures, proposed MIP formulations do not always offer better offline approximations than the SNNLS. This is in part due to the incapacity to express the constraints on training data integration in L2 norm in the proposed linear methods, thus, they don’t share the same admissible space with the SNNLS. Moreover, the MIP formulations do not minimize the offline training data approximation error but only keeps it under a prescribed threshold. On the other hand, quadratures obtained with the MIP approach may also be unattainable with the SNNLS algorithm due to its greedy nature. Unassembled training data approximation quality is overall quite similar between the different approaches and adding consistency constraints does not deteriorate the training data approximation at a given quadrature size.
The maximal online work of internal forces approximation error is presented in Fig. 5. While the SNNLS shows very good online performances for an heuristic approach, the proposed MIP approach offers better online work of internal forces reconstruction on the given example. Adding consistency constraints to the proposed method does not enhance online internal forces approximation, in particular, it tends to deteriorate the approximation on larger integration schemes. A good correlation between offline and online performances is observed.
SNNLS and MIP select elements in a similar pattern, as shown in Figs. 6, 7, and 8. Most selected elements are located in the necking zone near the hole and few elements, with larger integration weights, summarize internal forces behavior on the outer parts of the model. Element selection at size 7, presented in Fig. 6, is quite similar for the SNNLS and MIP methods but tends to diverge as more elements are selected. As a matter of fact, the SNNLS greedy procedure allows the deselection of one element in subsequent enrichment only if the associated weight is set to zero when computing the least feasible step (lines 15, 16 and 17 of SNNLS presented in Algorithm 1). Thus, on the three figures, elements selected by the SNNLS at a given quadrature size are still selected in larger integration schemes, which is not the case for the proposed methods.
Boxplots in Fig. 9 show that the proposed method including consistency conditions on polynomial integration suffer from weight overfitting as it consistently yield most significant integration weights. On this example, adding contraints on volume integration prevents overfitting, as observed comparing the MIP quadrature of size 16 with the MIP+V quadrature of the same size. On the other hand, weights computed with the SNNLS procedure are uniform.
The volume integration is tested for quadratures originating from the SNNLS and MIP + V on Fig. 10. In this figure, volume obtained by integrating with different quadratures is averaged over all \(n_s = 1148\) training times. Quadratures computed with the SNNLS do not preserve the volume while the proposed MIP+V formulation does independently of the number of elements. Results show that it is possible to add constraints to the hyperreduced quadrature without deteriorating offline and online performances.
Constraints reduction
In this section, results are presented for the two following formulations of the hyperreduction problem without consistency condition:

Reduced MIP optimization problem (31);

Reduced MIP + LS, optimization problem (31), the element selection \(\{\xi \}\) is kept but weights are recomputed by a single pass of the SNNLS algorithm (least squares problem on the full matrix [G] and least feasible step to ensure weight positivity).
Figure 11 plots the offline unassembled internal forces data approximation errors for hyperreduced quadratures size ranging from 6 to 17 while associated online work of reconstructed internal forces is presented in Fig. 12. Selected elements are illustrated in Figs. 13, 14 and 15 for integration schemes of size seven, ten and fourteen. Weights are represented in boxplots in Fig. 16.
While offline performances, plotted in Fig. 11, are very similar between the different methods, reducing constraints has improved online performances, except for integration schemes of size 12 to 15 for which the MIP offers better internal forces approximation, as seen on Fig. 12.
We remark that being accurate over the training data does not ensure good performances in the online reduction phase. As a matter of fact, overfitting over the training data is observed with the Reduced MIP + LS method. This phenomenon may be explained by the relatively sparse sampling of the training data, thus, even when reproducing the same test case, online results may differ. The Reduced MIP + LS is always more accurate than the Reduced MIP in the offline training phase as weights have been reoptimized on the unreduced training data. Nevertheless, it does not outperform the Reduced MIP in the online reduction phase, the latter offering better online internal forces approximation for hyperreduced quadratures of size 8, 11, 12, 13, 14, and 16.
Elements are similarly selected by the different approaches, as observed in Figs. 13, 14, and 15 where most selected elements concentrate in the necking zone around the hole. By contrast with the proposed method, the SNNLS does not deselect elements when quadrature size increases, leading to different quadratures for similar prescribed precision in the learning phase. Differences are more visible on intermediatesize quadratures. In Fig. 15, Reduced MIP and the Reduced MIP + LS did not select the same elements. Obviously, when all elements are selected, results are the same for all methods. The Reduced MIP + LS solution corresponds, in fact, to the Reduced MIP for 15 elements in which one element has been unselected by the single pass in the SNNLS algorithm.
Weights comparison in Fig. 16 indicates overfitting issues of both reduced approaches in some cases. Overfitting issue is most pronounced in quadratures of small and large sizes, while quadratures of size eleven and thirteen exhibit uniform weight repartition regardless of the method. Neither constraints reduction nor adding weights reoptimization seem to circumvent this issue. Overall, the SNNLS algorithm still provides the most homogeneous weights repartition.
Discussion
The SNNLS algorithm shows out to be an excellent heuristic to solve the optimization problem arising in the ECSW training phase. It provides good performances on the pierced plate example both in offline and online phases compared with the proposed approach.
Adding consistency conditions to the MIP formulation seems to deteriorate online performances. On the contrary, constraints reduction improved online performances.
Further testing should include the effect of the maximal weight value \(\zeta _{max}\), introduced in “Hyperreduced integration” section, on both offline and online performances.
Both offline and online accuracy of the different methods have been investigated in details. A computationally expensive method for the NPHard quadrature problem has been used to find a nearoptimal solution to be used as a reference. While the computational cost of the training phase may be considered as a secondary issue, it rapidly becomes excessive when the size of the problem increases, making a proper convergence study difficult. Concerning CPU times, the online phase depends only on the quadrature’s size, it is therefore similar for different methods. In the offline phase, further progress can be obtained by properly choosing \(\xi _{min}\) and \(\xi _{max}\) which is clearly problem dependent.
Conclusion
The contribution of this paper is the formulation of the hyperreduction problem in terms of a linear mixedinteger optimization problem, imposing a threshold on the infinity norm of the training data reconstruction error. This formulation enables optimal solution by IBM CPLEX algorithm, which is then compared to the standard SNNLS heuristic from the literature.
The impact of additional consistency constraints on volume preservation and polynomial integration is studied.
Due to high computational cost, the problem is reformulated using reduced constraints set.
All results are compared in both offline and online phases of projected Galerking ROM on an explicit nonlinear transient dynamics case.
The different methods are implemented in a research development branch of the industrial FE solver Altair Radioss [39].
The obtained results may be used as reference for evaluating different hyperreduction schemes. While the proposed MIP method remains costly for larger problems, the use of infinity norm in the offline trianing phase enhances online performances and the proposed constraints reduction allows also for further research on heuristic schemes.
This work is focused on the technical aspect of hyperreduction. Nevertheless, further research is required on the influence of hyperreduced Galerkin ROM on such topics as timestep, wave propagation, precision of acceleration.
References
 1.
Chatterjee A. An introduction to the proper orthogonal decomposition. Curr Sci. 2000:808–17.
 2.
Kosambi D. Statistics in function space. J Indian Math Soc. 1943;7:76–88.
 3.
Berkooz G, Holmes P, Lumley JL. The proper orthogonal decomposition in the analysis of turbulent flows. Ann Rev Fluid Mech. 1993;25:539–75.
 4.
Holmes P, Lumley JL, Berkooz G, Rowley CW. Turbulence, coherent structures, dynamical systems and symmetry. Cambridge: Cambridge University Press; 2012.
 5.
Sirovich L. Turbulence and the dynamics of coherent structures. i. coherent structures. Quart Appl Math. 1987;45(3):561–71.
 6.
Xiao M, Breitkopf P, Coelho RF, KnopfLenoir C, Sidorkiewicz M, Villon P. Model reduction by cpod and kriging. Struct Multidiscipl Optim. 2010;41(4):555–74.
 7.
An SS, Kim T, James DL. Optimizing cubature for efficient integration of subspace deformations. ACM Trans Graph. 2008;27:165.
 8.
Von Tycowicz C, Schulz C, Seidel HP, Hildebrandt K. An efficient construction of reduced deformable objects. ACM Trans Graph. 2013;32(6):213.
 9.
Brandt C, Eisemann E, Hildebrandt K. Hyperreduced projective dynamics. ACM Trans Graph. 2018;37(4):80.
 10.
Teng Y, Meyer M, DeRose T, Kim T. Subspace condensation: full space adaptivity for subspace deformations. ACM Trans Graph. 2015;34(4):76.
 11.
Madra A, Breitkopf P, Raghavan B, Trochu F. Diffuse manifold learning of the geometry of woven reinforcements in composites. Comptes Rendus Mécanique. 2018;346(7):532–8.
 12.
Meng L, Breitkopf P, Raghavan B, Mauvoisin G, Bartier O, Hernot X. On the study of mystical materials identified by indentation on power law and voce hardening solids. Int J Mater Form. 2018:1–16.
 13.
Meng L, Breitkopf P, Le Quilliec G, Raghavan B, Villon P. Nonlinear shapemanifold learning approach: concepts, tools and applications. Archi Comput Methods Eng. 2018;25(1):1–21.
 14.
Raghavan B, Breitkopf P, Tourbier Y, Villon P. Towards a space reduction approach for efficient structural shape optimization. Struct Multidiscipl Optim. 2013;48(5):987–1000.
 15.
Raghavan B, Hamdaoui M, Xiao M, Breitkopf P, Villon P. A bilevel metamodeling approach for structural optimization using modified pod bases and diffuse approximation. Comput Struct. 2013;127:19–28.
 16.
Raghavan B, Xiao M, Breitkopf P, Villon P. Implicit constraint handling for shape optimisation with podmorphing. Eur J Comput Mech. 2012;21(3–6):325–36.
 17.
Kerfriden P, Gosselet P, Adhikari S, Bordas SPA. Bridging proper orthogonal decomposition methods and augmented NewtonKrylov algorithms: an adaptive model order reduction for highly nonlinear mechanical problems. Comput Methods Appl Mech Eng. 2011;200(5–8):850–66.
 18.
Kerfriden P, Goury O, Rabczuk T, Bordas SPA. A partitioned model order reduction approach to rationalise computational expenses in nonlinear fracture mechanics. Comput Methods Appl Mech Eng. 2013;256:169–88.
 19.
Capaldo M, Guidault PA, Néron D, Ladevèze P. The reference point method, a “hyperreduction” technique: application to pgdbased nonlinear model reduction. Comput Methods Appl Mech Eng. 2017;322:483–514.
 20.
Chaturantabut S. Nonlinear model reduction via discrete empirical interpolation. PhD thesis, Rice University. 2011.
 21.
Dedden RJ. Model order reduction using the discrete empirical interpolation method. Master’s thesis, Delft University of Technology. 2012.
 22.
Tiso P, Dedden R, Rixen D. A modified discrete empirical interpolation method for reducing nonlinear structural finite element models. In: Proceedings of the ASME design engineering technical conference. 2013.
 23.
Barrault M, Maday Y, Nguyen NC, Patera AT. An ’empirical interpolation’ method: application to efficient reducedbasis discretization of partial differential equations. Comptes Rendus Mathematique. 2004;339(9):667–72.
 24.
Maday Y, Nguyen NC, Patera AT, Pau GS. A general, multipurpose interpolation procedure: the magic points. 2007.
 25.
Ryckelynck D, Vincent F, Cantournet S. Multidimensional a priori hyperreduction of mechanical models involving internal variables. Comput Methods Appl Mech Eng. 2012;225:28–43.
 26.
Farhat C, Avery P, Chapman T, Cortial J. Dimensional reduction of nonlinear finite element dynamic models with finite rotations and energybased mesh sampling and weighting for computational efficiency. Int J Numer Methods Eng. 2014;98(9):625–62.
 27.
Hernandez JA, Caicedo MA, Ferrer A. Dimensional hyperreduction of nonlinear finite element models via empirical cubature. Comput Methods Appl Mech Eng. 2016.
 28.
Breitkopf P, Rassineux A, Savignat JM, Villon P. Integration constraint in diffuse element method. Comput Methods Appl Mech Eng. 2004;193(12–14):1203–20.
 29.
Puso MA, Chen JS, Zywicz E, Elmer W. Meshfree and finite element nodal integration methods. Int J Numer Methods Eng. 2008;74(3):416–46.
 30.
Fougeron G, Pierrot G, Aubry D. Recovery of differentiation/integration compatibility of meshless operators via local adaptation of the point cloud in the context of nodal integration. In: Proceedings of the 7th European congress on computational methods in applied sciences and engineering. 2016.
 31.
Chen JS, Hillman M, Rüter M. An arbitrary order variationally consistent integration for galerkin meshfree methods. Int J Numer Methods Eng. 2013;95(5):387–418.
 32.
IBM: ILOG CPLEX version 12.1.7.0. 2017. https://www.ibm.com/products/ilogcplexoptimizationstudio.
 33.
Belytschko T, Lin JI, ChenShyh T. Explicit algorithms for the nonlinear dynamics of shells. Comput Methods Appl Mech Eng. 1984;42(2):225–51.
 34.
Bach C, Song L, Erhart T, Duddeck F. Stability conditions for the explicit integration of projection based nonlinear reducedorder and hyper reduced structural mechanics finite element models. arXiv preprint arXiv:1806.11404. 2018.
 35.
Chapman T, Avery P, Collins P, Farhat C. Accelerated mesh sampling for the hyper reduction for nonlinear computational models. Int J Numer Methods Eng. 2017;109(12):1623–54.
 36.
Clausen J. Branch and bound algorithmsprinciples and examples. Department of Computer Science, University of Copenhagen. 1999. p. 1–30.
 37.
De Bruin A, Kan AHR, Trienekens HW. A simulation tool for the performance evaluation of parallel branch and bound algorithms. Math Program. 1988;42(1–3):245–71.
 38.
Chen JS, Wu CT, Yoon S, You Y. A stabilized conforming nodal integration for galerkin meshfree methods. Int J Numer Methods Eng. 2001;50(2):435–66.
 39.
ALTAIR Engineering: Altair RADIOSS 2017 Reference Guide. Troy. ALTAIR Engineering. 2017.
Acknowledgements
This work is supported by the ANRT and the French car manufacturer PSA Group. ALTAIR Engineering France provided the source code of the solver, permitting implementation of our work in an industrial solver and enabling the use of post and pretreatment softwares.
Author information
Affiliations
Contributions
PP, PhD. student, did actual work including implementation and tested the proposed methods. The PhD. is supervised by PB and cosupervised by SB. PV, emeritus professor at the UTC, was consulted on the mathematical aspects of the contribution. MZ, industrial partner, proposed the problem and furnished benchmark cases. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Phalippou, P., Breitkopf, P., Bouabdallah, S. et al. Remarks on mixedinteger formulations for hyperreduction schemes in nonlinear dynamics. Adv. Model. and Simul. in Eng. Sci. 7, 36 (2020). https://doi.org/10.1186/s40323020001670
Received:
Accepted:
Published:
Keywords
 Finite element method
 Model order reduction
 Crashworthiness optimization
 Hyper reduction
 Internal forces
 SNNLS
 LASSO
 MIP