# Towards a pancreatic surgery simulator based on model order reduction

- Andrés Mena†
^{1, 3}, - David Bel†
^{1}, - Icíar Alfaro†
^{1}, - David González†
^{1}, - Elías Cueto†
^{1}Email authorView ORCID ID profile and - Francisco Chinesta†
^{2}

**2**:31

https://doi.org/10.1186/s40323-015-0049-1

© Mena et al. 2015

**Received: **14 July 2015

**Accepted: **16 October 2015

**Published: **26 November 2015

## Abstract

In this work a pancreatic surgery simulator is developed that provides the user with haptic feedback. The simulator is based on the use of model order reduction techniques, particularly Proper Generalized Decomposition methods. The just developed simulator presents some notable advancements with respect to existing works in the literature, such as the consideration of non-linear hyperelasticity for the constitutive modeling of soft tissues, an accurate description of contact between organs and momentum and energy conserving time integration schemes. Pancreas, liver, gall bladder, and duodenum are modeled in the simulator, thus providing with a very realistic and immersive perception to the user.

## Keywords

## Background

It is now well known and scientifically demonstrated that the use of surgery simulators provides the practitioner with a fast method to developed the necessary skills [1]. And this is despite the well-known limitations that nowadays surgical simulators have [2, 3]. This is due to the complexity of the problem and the need for a feedback response at some 500 Hz to 1 kHz. Indeed, the problem is highly non-linear, due to both the constitutive modeling of soft living tissues, frequently considered as hyperelastic, and the non-linear phenomena taking place at the operating room: contact, friction, cutting, etc.

All these limitations make the development of surgery simulators a delicate task that has faced important difficulties in the last decades. It has not been until very recently that truly non-linear constitutive models have been developed [4–6]. In general, they are based on the employ of explicit finite element simulations, that allow for a fast resolution, element by element, of the equations of motion. However, these explicit algorithms are not unconditionally stable, and often lack of an appropriate energy conservation.

Recently, model order reduction techniques [7–9] have opened a different way of looking at real-time simulation. These techniques that, essentially, develop models with a minimal number of degrees of freedom, seem to be very well suited for the purpose of developing a real-time simulator [5, 10–12]. However, they are not free of limitations. In particular, projection-based (a posteriori) model order reduction techniques very often lack of efficiency in non-linear problems, where the complete system of equations needs to be rebuilt in order to perform consistent linearization, thus loosing all the pretended gain. Methods as the empirical interpolation method [13] or the coupling with Asymptotic Numerical Methods [14] aim at solving these deficiencies.

Proper Generalized Decomposition (PGD) techniques [15, 16], however, operate in a slightly different way. They operate by casting the problem in a parametric way, by considering every possible parameter of the problem (the position of application of the load, material parameters, etc.) as a new dimension in the phase space, end then solving the resulting high-dimensional problem off-line, once for life. A sort of response surface is then obtained that has been coined (in opposition to traditional response surface methodologies, that need for a well-developed campaign of computer experiments) as a *computational vademecum* [17].

This work is thus aimed at developing a prototype of real-time simulator for pancreatic surgery (very few examples exist, see [18]), able of providing an immersive response for surgery training and planning. This simulator should be able to run in standard laptops, without any supercomputing facility, thus being able to be used in the operating room (OR). In this framework, ta PGD-based surgery simulator here developed is composed by the necessary number of organ vademecums (depending on the particular type of surgery considered). These organ vademecums, that provide the system with each organ response to an applied load at any point of its surface, are then assembled together by considering their relative contact, giving finally a very realistic haptic sensation and immersive feeling.

Pancreatic cancer is one of the most severe illness, with the fourth rate of fatality among all types of cancer. Every year some 233,000 new cases are diagnosed worldwide. The pancreatic cancer characterization is extremely complex, for instance, with different types of cancer such as pancreatic cystic neoplasms and pancreatic neuroendocrine tumors among them, and often the preoperative procedures do not offer a conclusive diagnostic. Therefore, it is of utmost interest to have a system able to provide the surgeon with an augmented/virtual reality-based experience that could eventually help to make a diagnosis.

*pancreatectomy*(the surgical removal of all or part of the pancreas) different surgery procedures are encompassed. In pancreaticoduodenectomy, for instance, distal segment of the stomach, the first and second portions of the duodenum, the head of the pancreas, the bile duct, and the gallbladder are removed. This gives an idea of the difficulty of simulating such a surgery, see Fig. 1, where only the liver, duodenum, gall bladder and pancreas have been represented.

In the sequel we develop models for the aforementioned organs, considered as the most representative of the type of surgery at hand. Previously, and for the sake of completeness, we recall in “A review of PGD methods appliked to real-time surgery” the basics of the PGD method applied to real-time surgery. In “Perfomance” we analyze the performance of the resulting prototype. Finally, in “Conclusion” we draw some conclusions.

## A review of PGD methods applied to real-time surgery

As mentioned before, the main novelty in PGD-based real-time simulators consist in developing a sort of *a priori* response surface, what we called a *computational vademecum* in [17]. Therefore, without any campaign of computer experiments, typical of response surface methodologies, PGD methods are able to provide in an off-line phase of the method with the expected response of the system in the form of a high-dimensional response surface or meta-model. This response surface is then able to run on-line at extremely high feedback rates.

*j*-th component of the displacement vector, \(j=1,2,3\) and functions \(\varvec{X}^k\) and \(\varvec{Y}^k\) represent the separated functions used to approximate the unknown field. To determine these functions, PGD methods proceed by first computing an admissible variation of \(\varvec{u}\), by substituting them in the weak form of the problem, and subsequently linearizing it. This is usually accomplished by employing a greedy algorithm in which one sum is computed at a time, and within each sum, each function is determined by a fixed-point, alternate directions algorithm. The interested reader can consult more details of this approach in [2].

Contact phenomena also play a crucial role in the simulation of surgery. In [21] a method based PGD was developed. In order to fully exploit the characteristics of PGD methods, one of the two candidate solids was embedded within a structured mesh in whose nodes the distance to the boundary field (i.e., a level set) was stored. The method then proceeds by checking that no boundary marker of the second solid crosses the zero-level set. Otherwise, a penalty force is applied at that point in order to prevent interpenetration. This very simple algorithm is able to run at haptic feedback rates without any problem.

### Architecture of the simulator

The PGD technique allows to exploit all the off-line effort of pre-computation and only post-process the result at extremely high feedback rates. Therefore, unlike previous examples of surgery simulators such as [22], for instance, there is no need to establish multiple threads in the simulation, nor establishing different feedback requirements for the different tasks in the simulator. In our approach, there is one single thread, see Fig. 2, and all the different procedures (contact detection among the virtual tool—assumed rigid for simplicity—and the organ(s), among the different organs themselves, displacement and strain field computation) run under the same constrain, that imposed by the haptic peripheral, a Geomagic Touch device [23] running the OpenHaptcis Toolkit in which all the system is developed.

## Models for the different organs considered in the prototype

In this section we detail the performed work in the modeling of each organ, particularly each constitutive law employed for that purpose.

### Liver

The finite element mesh of the liver, see Fig. 4 consists of 4349 nodes and 21,788 linear tetrahedral elements. The PGD modes obtained in the off-line procedure described before are shown in Fig. 5.

### Gallbladder

The gallbladder is a pressurized vesicle attached to the liver and also connected to the duodenum. It contains the bile generated by the hepatocytes [27] provides the most comprehensive constitutive modeling of gallbladder walls. Gallbladder is composed by four different layers: adventitia, muscle, mucosa and epithelium. Of course, the muscle layer is responsible of expelling the bile right after consumption of foods or drinks.

The gallbladder is subjected, in normal conditions, to an internal pressure that has been estimated in [27] on 466.6 Pa. We have assumed a wall thickness on the order of 2.5 mm, and a Young’s modulus on the order of 1.15 kPa, with \(\nu \,=\,\)0.48, and thus nearly incompressible.

In principle the gallbladder has not been considered as attached to the liver, but to the duodenum only, since during the surgery procedure it needs to be detached from it, by appropriately simulating the scratching process done by the surgeon, more properly related to continuum damage mechanics than to cutting itself. This is currently one of our lines of research.

### Pancreas and duodenum

In our model, pancreas and duodenum have been modeled as being attached to each other, see Fig. 8, since indeed they are, on one side, and most likely will be removed together, without detaching one from the other.

The two free opposite sides of the duodenum are considered clamped. In particular, the proximal one is indeed attached to the stomach, whose distal part is usually removed during this type of surgery. Therefore, in a more advanced version of the simulator, a model of the stomach should also be considered for completeness. In this proof of concept prototype, however, this simplification does not imply a loss of validity of the proposed methodology. In Fig. 9 the first four modes of the PGD approximation to the pancreatic vademecum are depicted.

## Putting it all together: simulating contact

One of the most salient advantages of the procedure described before relies precisely in its modularity. Once a vademecum is computed for each organ, the resulting simulator integrates them all by simulating the contact between them, and their boundary conditions such as attachments to ligaments, tendons, blood vessels, etc.

*voxmap pointshell*strategy [20] in which one of the solids in the model is considered the

*master*and equipped with a distance field, see Fig. 10. This distance field is stored in memory at nodal positions in a lattice that surrounds each organ. In this case, the master is the gallbladder, since it occupies a central position among the simulated organs. The rest of the organs are marked with a pointshell, in our case composed by the nodes of the boundary (although a different set may be employed depending on the required precision).

Once the collision between the pointshell(s) and the zero-level iso-surface of the distance field vademecum is detected, a penalization force \(\varvec{F}=-k_c\cdot d\cdot \varvec{n}\) is applied to both solids, so as to prevent penetration. Here, \(\varvec{n}\) represents the normal to the surface in contact and \(k_c\) a penalty parameter. Although this simple contact procedure is far from the state of the art in usual engineering practice, it must be kept in mind that the haptic feedback imposes an important bottleneck to the procedure: to avoid unphysical jumps in the response, producing a sequence of fast contact detections and loss of contact. This produces a very unphysical sensation that should be avoided. The proposed algorithm produces no unphysical sensation and no artificial jump in the haptic response could be felt. In fact, many existing simulators employ different threads for the simulation of contact and deformation, with considerably weaker requirements on the contact side see, for instance [22], among others. This is absolutely not necessary here, and a single thread is used in our architecture.

Our tests on the performance of the contact detection rendered feedback times ranging from 0.0007148 seconds as a lower bound, for the case in which no contact was detected and 0.0012811 seconds for situations in which more than 400 nodes were detected in contact with the zero-distance level set of the master surface. Both values are in good agreement with the feedback requirements imposed by the haptic device, while no artificial, unphysical jump was detected in the transmitted reaction forces, giving a smooth sensation of contact.

## Performance

The number of modes necessary for a prescribed degree of accuracy in the feedback force can be determined either via heuristic approaches, with the help of experienced surgeons, or by employing error estimators on certain quantities of interest [31]. In general, the number of terms depends on the size of the models and the desired level of accuracy, but in our experience rarely exceeds some 50 modes. Keep in mind that the usual scientific computing levels of accuracy are rarely attained nor needed in this type of applications, where the variance of properties between patients is on the order of the mean.

In Fig. 13, for instance, a plot is shown of how the proposed PGD technique converges respect the reference solution given by a full FEM model of the pancreas. Note that the comparison between reduced models and FE reference ones is made on the basis of the same mesh size. Of course a more detailed FE mesh would imply a bigger memory usage for the reduced order model, but note that the CPU cost, and therefore the feedback speed, do not depend on the number of nodes of the mesh, but on the number of modes employed in the PGD approaximation, i.e., on *n* in Eq. (2), which remains roughly constant.

Under these circumstances, the just developed simulator provided feedback responses in the range of 600 Hz to 1 kHz. As mentioned before, no parallelization was needed and the prototype ran on a HP ProBook 6470b laptop (Intel Core i7, with 8 Gb DDR3 PC3-12800 SDRAM) without any appreciable jump in the force feedback, that remained very smooth throughout the simulation.

Simulation of surgical cutting in the context of PGD deserves some very specific comments. In [32] a method based on the combination of PGD and X-FEM technique was developed that provides very realistic sensations for the cutting procedure. The integration of this or other method in the framework of our simulator is currently one of our main efforts of research.

## Conclusions

In this work a pancreatic surgery simulator has been developed by resorting to the concept of computational vademecum. A computational vademecum is a sort of computational response surface technique obtained without the need of a campaign of computer experiments. Instead, in an off-line phase, this response surface is obtained in the form of a finite sum of separable functions, typical of PGD methods.

The high-dimensional response thus obtained is exploited under severe real-time constraints in the on-line phase of the method. The method is able to generate quasi-static as well as dynamic approaches to the problem, including contact and surgical cutting. Other phenomena, such as scratching, are currently being studied and will hopefully be published elsewhere.

In any case, PGD methods provide a very appealing way of developing surgical simulators able to run is very simple platforms (typically, in a standard laptop), and even on smartphones or tablets [33]. Notably, it enables the possibility of developing surgical simulators including state of the art (usually, hyperelastic) constitutive laws and momentum and energy conserving, unconditionally stable, dynamical integrators.

The lack of suitable data for an accurate modeling of some soft living tissues (arteries are very well characterized, however, other tissues such as duodenum or pancreas very often lack of appropriate models other than linear elastic) remains, however a true limitation for the development of such a simulator. It should be compensated, for instance, by resorting to experienced surgeons that help engineers to increase the realism of the simulations.

## Notes

## Declarations

### Authors' contributions

AM segmented all organ’s anatomy. DB analysed the models by employing a code developed by DG and IA, who implemented it in Matlab. EC and FC developed the method, verified the results and wrote the manuscript. All authors read and approved the final manuscript.

### Acknowledgements

This work has been supported by the Spanish Ministry of Economy and Competitiveness through Grants number CICYT DPI2014-51844-C2-1-R and by the Regional Government of Aragon and the European Social Fund. This support is gratefully acknowledged. CIBER-BBN is an initiative funded by the VI National R\(+\)D\(+\)i Plan 2008-2011, Iniciativa Ingenio 2010, Consolider Program, CIBER Actions and financed by the Instituto de Salud Carlos III with assistance from the European Regional Development Fund. The support from Dr. J. A. Fatás, from the Royo Villlanova Hospital Surgery dept., Zaragoza, and also from E. Estopiñán and M. A. Varona, from the Aragon Institute of Engineering Research of the University of Zaragoza, who carefully developed the realistic rendering, is gratefully acknowledged.

### Competing interests

The authors declare that they have no competing interests.

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## Authors’ Affiliations

## References

- Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM. Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg. 2005;241(2):364–72. doi:10.1097/01.sla.0000151982.85062.80.View ArticleGoogle Scholar
- Cueto E, Chinesta F. Real time simulation for computational surgery: a review. Advan Model Simul Eng Sci. 2014;1(1):11. doi:10.1186/2213-7467-1-11.View ArticleGoogle Scholar
- Meier U, Lopez O, Monserrat C, Juan MC, Alcaniz M. Real-time deformable models for surgery simulation: a survey. Comp Methods Programs Biomed. 2005;77(3):183–97.View ArticleGoogle Scholar
- Taylor ZA, Cheng M, Ourselin S. High-speed nonlinear finite element analysis for surgical simulation using graphics processing units. IEEE Trans Med Imag. 2008;27(5):650–63. doi:10.1109/TMI.2007.913112.View ArticleGoogle Scholar
- Taylor ZA, Ourselin S, Crozier S. A reduced order finite element algorithm for surgical simulation. In: Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE, pp 239–242 (2010). doi:10.1109/IEMBS.2010.5627720
- Miller K, Joldes G, Lance D, Wittek A. Total lagrangian explicit dynamics finite element algorithm for computing soft tissue deformation. Commun Num Method Eng. 2007;23(2):121–34. doi:10.1002/cnm.887.MathSciNetView ArticleMATHGoogle Scholar
- Karhunen K. Uber lineare methoden in der wahrscheinlichkeitsrechnung. Annales Academiae scientiarum Fennicae. Series A. 1. Mathematica-physica; 1947. p. 1–79.Google Scholar
- Loève MM. Probability Theory. The University Series in Higher Mathematics, 3rd ed. Van Nostrand, Princeton, NJ. 1963.Google Scholar
- Ryckelynck D, Chinesta F, Cueto E, Ammar A. On the a priori model reduction: overview and recent developments. Archiv Comput Method Eng. 2006;12(1):91–128.MathSciNetView ArticleMATHGoogle Scholar
- Niroomandi S, Alfaro I, Cueto E, Chinesta F. Real-time deformable models of non-linear tissues by model reduction techniques. Comp Methods Programs Biomed. 2008;91(3):223–31. doi:10.1016/j.cmpb.2008.04.008.View ArticleGoogle Scholar
- Radermacher A, Reese S. Proper orthogonal decomposition-based model reduction for nonlinear biomechanical analysis. Int J Mat Eng Innov. 2013;4(4):149–65. doi:10.1504/IJMATEI.2013.054393.View ArticleGoogle Scholar
- Taylor ZA, Crozier S, Ourselin S. A reduced order explicit dynamic finite element algorithm for surgical simulation. IEEE Trans Med Imag. 2011;30(9):1713–21. doi:10.1109/TMI.2011.2143723.View ArticleGoogle Scholar
- Barrault M, Maday Y, Nguyen N, Patera A. An empirical interpolation method: application to efficient reduced-basis discretization of partial differential equations. Comptes Rendus Mathematique. 2004;339(9):667–72. doi:10.1016/j.crma.2004.08.00.MathSciNetView ArticleMATHGoogle Scholar
- Niroomandi S, Alfaro I, Cueto E, Chinesta F. Model order reduction for hyperelastic materials. Int J Num Methods Eng. 2010;81(9):1180–206. doi:10.1002/nme.2733.MathSciNetMATHGoogle Scholar
- Chinesta F, Ammar A, Cueto E. Recent advances in the use of the Proper Generalized Decomposition for solving multidimensional models. Archiv Comp Methods Eng. 2010;17(4):327–50.MathSciNetView ArticleMATHGoogle Scholar
- Chinesta F, Ladeveze P, Cueto E. A short review on model order reduction based on proper generalized decomposition. Archiv Comput Methods Eng. 2011;18:395–404.View ArticleGoogle Scholar
- Chinesta F, Leygue A, Bordeu F, Aguado JV, Cueto E, Gonzalez D, Alfaro I, Ammar A, Huerta A. PGD-based computational Vademecum for efficient design, optimization and control. Archiv Comput Method Eng. 2013;20(1):31–59. doi:10.1007/s11831-013-9080-x.MathSciNetView ArticleGoogle Scholar
- Kim Y, Kim L, Lee D, Shin S, Cho H, Roy F, Park S. Deformable mesh simulation for virtual laparoscopic cholecystectomy training. Vis Comput. 2015;31(4):485–95. doi:10.1007/s00371-014-0944-3.View ArticleGoogle Scholar
- The Database Center for Life Science Japan: BodyParts3D. Licensed under CC Attribution-Share Alike 2.1. 2015Google Scholar
- Gonzalez D, Cueto E, Chinesta F. Real-time direct integration of reduced solid dynamics equations. Int J Num Methods Eng. 2014;99(9):633–53.MathSciNetView ArticleGoogle Scholar
- Gonzalez D, Alfaro I, Quesada C, Cueto E, Chinesta F. Computational vademecums for the real-time simulation of haptic collision between nonlinear solids. Comp Methods Appl Mech Eng. 2015;283:210–23. doi:10.1016/j.cma.2014.09.029.View ArticleGoogle Scholar
- Jeřábková L, Kuhlen T. Stable cutting of deformable objects in virtual environments using xfem. IEEE Comput Graph Appl. 2009;29(2):61–71. doi:10.1109/MCG.2009.32.View ArticleGoogle Scholar
- Geomagic: OpenHaptics Toolkit. 3D systems—Geomagic solutions, 430 Davis Drive, Suite 300 Morrisville, NC 27560 USA. 2013.Google Scholar
- Martinez-Martinez F, Ruperez MJ, Martin-Guerrero JD, Monserrat C, Lago MA, Pareja E, Brugger S, Lopez-Andujar R. Estimation of the elastic parameters of human liver biomechanical models by means of medical images and evolutionary computation. Comp Methods Programs Biomed. 2013;111(3):537–49. doi:10.1016/j.cmpb.2013.05.005.View ArticleGoogle Scholar
- Delingette H, Ayache N. Soft tissue modeling for surgery simulation. In: Ayache N, editors. Computational Models for the Human Body. Handbook of Numerical Analysis (Ph. Ciarlet, Ed.), Elsevier. 2004. p. 453–50.Google Scholar
- Niroomandi S, González D, Alfaro I, Bordeu F, Leygue A, Cueto E, Chinesta F. Real-time simulation of biological soft tissues: a PGD approach. Int J Num Methods Biomed Eng. 2013;29(5):586–600. doi:10.1002/cnm.2544.MathSciNetView ArticleGoogle Scholar
- Li WG, Hill NA, Ogden RW, Smythe A, Majeed AW, Bird N, Luo XY. Anisotropic behaviour of human gallbladder walls. J Mech Behav Biomed Mat. 2013;20:363–75. doi:10.1016/j.jmbbm.2013.02.015.View ArticleGoogle Scholar
- Niroomandi S, Gonzalez D, Alfaro I, Cueto E, Chinesta F. Model order reduction in hyperelasticity: a proper generalized decomposition approach. Int J Num Methods Eng. 2013;96(3):129–49. doi:10.1002/nme.4531.MathSciNetGoogle Scholar
- Demirel D, Yu A, Halic T, Kockara S. Web based camera navigation for virtual pancreatic cancer surgery: Whipple surgery simulator (vpanss). In: IEEE Innovations in Technology Conference (InnoTek), 2014. p. 1–8.Google Scholar
- Shi Y, Glaser KJ, Venkatesh SK, Ben-Abraham EI, Ehman RL. Feasibility of using 3d mr elastography to determine pancreatic stiffness in healthy volunteers. J Mag Res Imaging. 2015;41(2):369–75. doi:10.1002/jmri.24572.View ArticleGoogle Scholar
- Alfaro I, Gonzalez D, Zlotnik S, Diez P, Cueto E, Chinesta F. An error estimator for real-time simulators based on model order reduction. Advan Model Simul Eng Sci. 2015.Google Scholar
- Quesada C, Gonzalez D, Alfaro I, Cueto E, Chinesta F. Computational vademecums for real-time simulation of surgical cutting in haptic environments. Comput Mech. 2015.Google Scholar
- Quesada C, González D, Alfaro I, Cueto E, Huerta A, Chinesta F. Real-time simulation techniques for augmented learning in science and engineering. Visual Comp. 2015;1–15. doi:10.1007/s00371-015-1134-7.