Computational models for image-guided robot-assisted and simulated medical interventions

Proceedings of the IEEE

Volumn 94, Issue 9, 2006, Pages 1678-1688

  Delingette, Hervé ^a   Pennec, Xavier ^a   Soler, Luc ^b   Marescaux, Jacques ^b   Ayache, Nicholas ^a  

^a INRIA   (France)

^b IRCAD   (France)

Author keywords

Anatomical models; Augmented reality; Biomechanics; Brain shift; Computational models; Medical image analysis; Medical robotics; Physiological models; Surgery simulation

Indexed keywords

BIOMECHANICS; COMPUTATIONAL METHODS; IMAGE PROCESSING; MEDICAL IMAGING; PHYSIOLOGICAL MODELS; VIRTUAL REALITY;

ANATOMICAL MODELS; BRAIN SHIFTS; COMPUTATIONAL MODELS; MEDICAL IMAGE ANALYSIS; MEDICAL ROBOTICS; SURGERY SIMULATION;

MEDICAL APPLICATIONS;

EID: 33947321561     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2006.880718     Document Type: Article

References (90)

1. N. Ayache, Ed. Computational Models for the Human Body. New York: Elsevier, 2004, ser. Handbook Numerical Analysis (P. Ciarlet series editor), 670 pages.
2. H. Delingette and N. Ayache, "Soft tissue modeling for surgery simulation," in Computational Models for the Human Body, N. Ayache, Ed. New York: Elsevier, 2004, ser. Handbook of Numerical Analysis (P. Ciarlet series editor), pp. 453-550.
3. M. J. Ackerman, "The visible human project," Proc. IEEE: Special Issue Surgery Simulation, vol. 86, no. 3, pp. 504-511, Mar. 1998.
4. E. Haug, H.-Y. Choi, S. Robin, and M. Beaugonin, "Human models for crash and impact simulation," in Computational Models for the Human Body, N. Ayache, Ed. New York: Elsevier, 2004, pp. 231-452.
5. P. Hunter and T. Borg, "Integration from proteins to organs: The physiome project," Nature Rev. Molecular Cell Biology, vol. 4, pp. 237-243, 2003.
6. D. Noble, "Modeling the heart, from genes to cells to the whole organ," Science, vol. 295, pp. 1678-1682, 2002.
7. M. Belik, T. Usyk, and A. McCulloch,. "Computational methods for cardiac electrophysiology," in Computational Models for the Human Body, N. Ayache, Ed. New York: Elsevier, 2004, pp. 129-187.
8. M. Sermesant, H. Delingette, and N. Ayache, "An electromechanical model of the heart for image analysis and simulation," IEEE Trans. Med. Imag., vol. 25, no. 5, pp. 612-625, May 2006.
9. J. Kaye, F. Primiano, and D. Metaxas, "A 3D virtual environment for modeling mechanical cardiopulmonary interactions," Medical Image Anal., vol. 2, no. 2, pp. 1-26, 1997.
10. K. Swanson, C. Bridge, J. Murray, and E. Alvord, "Virtual and real brain tumors: Using mathematical modeling to quantify glioma growth and invasion," J. Neural. Sci., vol. 216, pp. 1-10, 2003.
11. A. Quarteroni and L. Formaggia, "Mathematical modeling and numerical simulation of the cardiovascular system," in Computational Models for the Human Body, N. Ayache, Ed. New York: Elsevier, 2004, pp. 3-128.
12. J.-D. Boissonnat, R. Chaine, P. Frey, G. Malandain, F. Nicoud, S. Salmon, E. Saltel, and M. Thiriet, "From arteriographies to computational flow in saccular aneurisms: The INRIA experience," Medical Image Anal., vol. 9, no. 2, pp. 133-143, Apr. 2005.
13. P. M. Thompson, M. I. Miller, J. T. Ratnanather, R. A. Poldrack, and T. E. Nichols, "Guest editorial," NeuroImage, vol. 23, no. Supplement 1, p. S1, 2004, Special Issue: Mathematics in Brain Imaging.
14. M. I. Miller, "Computational anatomy: Shape, growth, and atrophy comparison via diffeomorphisms," NeuroImage, vol. 23, no. Supplement 1, pp. S19-S33, 2004, Special Issue: Mathematics in Brain Imaging.
15. J. G. Csernansky, L. Wang, S. C. Joshi, J. T. Ratnanather, and M. I. Miller, "Computational anatomy and neuropsychiatric disease: Probabilistic assessment of variation and statistical inference of group difference, hemispheric asymmetry, and time-dependent change," NeuroImage, vol. 23, no. Supplement 1, pp. S56-S68, 2004, Special Issue: Mathematics in Brain Imaging.
16. T. Cootes, C. Taylor, A. Lanitis, D. Cooper, and J. Graham, "Building and using flexible models incorporating grey-level information," in Proc. Int. Conf. Computer Vision, 1993, pp. 242-245.
17. J. Ryan, C. O'Sullivan, C. Bell, and R. Mooney, "A virtual reality electrocardiography teaching tool," in Proc. 2nd Int. Conf., Biomedical Eng., Innsbruck, Finland, Feb. 2004, pp. 250-253.
18. V. Moreau-Villéger, H. Delingette, M. Sermesant, H. Ashikaga, O. Faris, E, McVeigh, and N. Ayache, "Building maps of local apparent conductivity of the epicardium with a 2D electrophysiological model of the heart," IEEE Trans. Biomed. Eng., vol. 53, no. 8, pp. 1457-1466, Aug. 2006.
19. C. B. Y. Zhang, "Adaptive and quality quadrilateral/hexahedral meshing from volumetric data," in Proc. 13th Int. Meshing Roundtable, Williamsburg, VA, Sep. 2004, pp. 365-376.
20. W. Lorensen and H. Cline, "Marching cubes: A high resolution 3D surface construction algorithm," ACM Computer Graphics (SIGGRAPH), vol. 21, pp. 163-169, 1987.
21. W. J. Schroeder, J. Zarge, and W. Lorensen, "Decimation of triangles meshes," ACM Computer Graphics (SIGGRAPH). vol. 26, no. 2, Aug. 1992.
22. J. D. Boissonnat and S. Oudot, "Provably good surface sampling and approximation," in Proc. 1st Symp. Geometry Processing, Aug. 2003, pp. 9-18.
23. S. E. Benzley, E. Perry, & C. K. Merkley, and G. Sjaardema, "Comparison of all-hexabedral and all-tetrahedral finite element meshes for elastic and elasto-plastic analysis," in 4th Int. Meshing Roundtable: Sandia National Laboratories, Oct. 1995, pp. 179-191.
24. P. J. Frey and P.-L. George, Mesh Generation. New York: Hermes, 2000.
25. P. Alliez, D. Cohen-Steiner, M. Yvinec, and M. Desbrun, "Variational tetrahedral meshing," in ACM SIGGRAPH (SIGGRAPH), Los Angeles, CA, Aug. 2005.
26. M. Sermesant, C. Forest, X. Pennec, H. Delingette, and N. Ayache, "Deformable biomechanical models: Application to 4D cardiac image analysis," Medical Image Anal., vol. 7, no. 4, pp. 475-488, Dec. 2003.
27. M. Chabanas and Y. Payan, "A 3D finite element model of the face for simulation in plastic and maxillo-facial surgery," in Proc. 3rd Int. Conf. Medical Robotics, Imaging and Computer Assisted Surgery, Oct. 2000, pp. 1068-1075.
28. L. Soler, H. Delingette, G. Malandain, I. Montagnat, N. Ayache, C. Koehl, O. Dourthe, B. Malassagne, M. Smith, D. Mutter, and J. Marescaux, "Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery," Computer Aided Surgery, vol. 6, no. 3, pp. 131-342, 2001.
29. B. Reitinger, A. Bornik, R. Beichel, G. Werkgaitner, and E. Sorantin, "Tools for augmented reality based liver resection planning," in Proc. SPIE Medical Imaging 2004: Visualization, Image-Guided Procedures, and Display, San Diego, CA, Feb. 2004, pp. 88-99.
30. H. Bourquain, A. Schenk, F. Link, B. Preim, and H.-O. Peitgen, "A software assistant for preoperative planning in living-related liver transplantation and oncologic liver surgery," in Computer Assisted Radiology Surgery (CARS), Paris, Jun. 2002, pp. 341-346.
31. È. Coste-Manière, L. Adhami, F. Mourgues, and O. Bantiche, "Optimal planning of robotically assisted heart surgery: Transfer precision in the operating room," Int. J. Robot. Res., vol. 23, no. 4, pp. 539-548, May 2004.
32. S. Starkie and B. L. Davies, "Advances in active constraints and their application to minimally invasive surgery," in Proc. 4th Int. Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI'01), ser. LNCS, vol. 2208, Utrecht, Oct. 2001, pp. 1316-1321.
33. T. Buzug and T. Lueth, Eds., Perspectives in Image-Guided Surgery. Remagen, Germany: World Scientific, 2004.
34. J. Marescaux, F. Rubino, M. Arena, and L. Soler, "Augmented reality system to guide radio-frequency tumor ablation," J. Amer. Medical Assoc., vol. 18, no. 292, pp. 2214-2215, 2004.
35. R. Taylor and D. Stoianovici, "Medical robotics in computer-integrated surgery," IEEE Trans. Robot. Automat., vol. 19, no. 5, pp. 765-781, Oct. 2003.
36. W. Crimson, G. Ettinger, S. White, S. Wells, T. Lozano-Perez, and R. Kikinis, "An automatic registration method for frameless stereotaxy, image guided surgery and enhanced reality visualization," IEEE Trans. Medical Imaging, vol. 15, no. 2, pp. 129-140, Feb. 1996.
37. F. Jolesz, A. Nabavi, and R. Kikinis, "Integration of interventional MRI with computer-assisted surgery," J. Magnetic Resonance Imaging, vol. 13, no. 1, pp. 69-77, 2001.
38. P. J. Edwards, A. P. King, J. Calvin, R. Maurer, D. A. de Cunha, D. J. Hawkes, D. L. G. Hill, R. P. Gaston, M. R. Fenlon, A. Jusczyzck, A. J. Strong, C. L. Chandler, and M. Gleeson, "Design and evaluation of a system for microscope-assisted guided interventions (magi)," IEEE Trans. Pattern Anal. Machine Intelligence, vol. 19, no. 11, pp. 1082-1093, Nov. 2000.
39. M. Mitschke and N. Navab, "Recovering X-ray projection geometry for 3D tomographic reconstruction: Use of integrated camera versus external navigation system," Medical Image Analy., vol. 7, no. 1, pp. 65-78, 2003.
40. W. Chang, G. Stetten, L. Lobes, D. Shelton, and R. Tamburo, "Guidance of retrobulbar injection with real time tomographic reflection," J. Ultrasound Medicine, vol. 21, pp. 1131-1135, 2002.
41. C. Stetten, A. Cois, W. Chang, D. Shelton, R. Tamburo, J. Castellucci, and O. von Ramm, "C-mode real time tomographic reflection for a matrix array ultrasound sonic flashlight," in Proc. MICCAI 2003, ser. LNCS, vol. 2879. Springer, Nov. 2003, pp. 336-343.
42. G. Fichtinger, A. Deguet, K. Masamune, E. Fischer, G. Balogh, H. Mathieu, R. Taylor, L. Fayad, and S. Zinreich, "Needle insertion in CT scanner with image overlay - Cadaver studies," in Proc. MICCAI 2004, ser. LNCS, vol. 3217, Springer, 2004, pp. 795-803.
43. L. Soler, S. Nicolau, X. Pennec, J. Schmid, C. Koehl, N. Ayache, and J. Marescaux, "Virtual reality and augmented reality in digestive surgery," in Proc. IEEE Int. Symp. Mixed and Augmented Reality (ISMAR'04), Washington, DC, Nov. 2004, pp. 278-279.
44. P. Jannin, J. Fitzpatrick, D. Hawkes, X. Pennec, R. Shahidi, and M. Vannier, "Validation of medical image processing in image-guided therapy," IEEE Trans. Medical Imaging, vol. 21, no. 12, pp. 1445-1449, Dec. 2002.
45. X. Pennec, C. Guttmann, and J.-P. Thirion, "Feature-based registration of medical images: Estimation and validation of the pose accuracy," in Proc. MICCAI'98, ser. LNCS, vol. 1496, Oct. 1998, pp. 1107-1114.
46. S. Nicolau, X. Pennec, L. Soler, and N. Ayache, "A complete augmented reality guidance system for liver punctures: First clinical evaluation," in Proc. MICCAI 2005, ser. LNCS, Palm Springs, FL, Oct. 2005.
47. _, "An accuracy certified augmented reality system for therapy guidance," in Proc. 8th Eur. Conf. Computer Vision (ECCV 04), LNCS, vol. 3023, May 2004, pp. 79-91.
48. S. Nicolau, J. Schmid, X. Pennec, L. Soler, and N. Ayache, "An augmented reality & virtuality interface for a puncture guidance system: Design and validation on an abdominal phantom," in Proc. 2nd Int. Workshop Medical Imaging Augmented Reality, ser. LNCS, G.-Z. Yang and T. Jiang, Eds., vol. 3150. Beijing, China: Springer Verlag, Aug. 2004, pp. 302-310.
49. S. Granger and X. Pennec, "Multi-scale EM-ICP: A fast and robust approach for surface registration," in Proc. Eur. Conf. Computer Vision (ECCV 2002), ser. LNCS, A. Heyden, G. Sparr, M. Nielsen, and P. Johansen, Eds., vol. 2353. Copenhagen, Denmark: Springer, 2002, pp. 418-432.
50. R. Stefanescu, X. Pennec, and N. Ayache, "A grid service for the interactive use of a parallel non-rigid registration algorithm of medical images," Methods Inf. Medicine, vol. 44, no. 2, 2005.
51. M. Sermesant, O. Clatz, Z. Li, S. Lantéri, H. Delingette, and N. Ayache, "A parallel implementation of non-rigid registration using a volumetric biomechanical model," in Proc. Second Int. Workshop Biomedical Image Registration WBIR'03, ser. LNCS, vol. 2717, Philadelphia, PA, USA, 2003, pp. 398-407.
52. D. Hawkes, D. Barratt, J. Blackall, C. Chan, P. Edwards, K. Rhode, G. Penney, J. McClelland, and D. Hill, "Tissue deformation and shape models in image-guided interventions: A discussion paper," Medical Image Anal., vol. 9, no. 2, pp. 163-175, Apr. 2005.
53. J. Schnabel, C. Tanner, A. Castellano-Smith, A. Degenhard, M. Leach, D. Hose, D. Hill, and D. Hawkes, "Validation of non-rigid image registration using finite element methods: Application to breast MR images," IEEE Trans. Medical Imaging, vol. 22, no. 2, pp. 238-247, Feb. 2003.
54. M. K. Jain and P. D. Wolf, "A three-dimensional finite element model of radiofrequency ablation with blood flow and its experimental validation," Ann. Biomed. Eng., vol. 28, no. 9, pp. 1075-1084, 2000.
55. K. Miller, "Constitutive modelling of abdominal organs," J. Biomechanics, vol. 33, no. 3, pp. 367-373, 2000.
56. M. Miga, K. Paulsen, J. Lemry, F. Kennedy, S. Eisner, A. Hartov, and D. Roberts, "Model-updated image guidance: Initial clinical experience with gravity-induced brain deformation," IEEE Trans. Medical Imaging, vol. 18, no. 10, pp. 866-874, Oct. 1999.
57. M. Ferrant, A. Nabavi, B. Macq, P. Black, F. Jolesz, R. Kikinis, and S. Warfield, "Serial registration of intraoperative MR images of the brain," Medical Image Anal., 2002.
58. O. Skrinjar, A. Nabavi, and J. Duncan, "Model-driven brain shift compensation," Medical Image Anal., vol. 6, no. 4, pp. 361-373, 2002.
59. O. Clatz, H. Delingette, E. Bardinet, D. Dormont, and N. Ayache, "Patient specific biomechanical model of the brain: Application to parkinson's disease procedure," in Proc. Int. Symp. Surgery Simulation and Soft Tissue Modeling (IS4TM'03), N. Ayache and H. Delingette, Eds., vol. 2673. Springer-Verlag, 2003, pp. 321-331.
60. O. Clatz, H. Delingette, I.-F. Talos, A. J. Golby, R. Kikinis, F. A. Jolesz, N. Ayache, and S. K. Warfield, "Robust non-rigid registration to capture brain shift from intra-operative MRI," IEEE Trans. Med. Imag., vol. 24, no. 11, pp. 1417-1427, Nov. 2005.
61. R. Balaniuk, "Using fast local modeling to buffer haptic data," in Proc. 4th PhantoM User Group Workshop (PUG'99), Cambridge, MA, Oct. 1999, pp. 7-11.
62. C. Forest, H. Délingette, and N. Ayache, "Surface contact and reaction force models for laparoscopic simulation," in Proc. Int. Symp. Medical Simulation, ser. LNCS, vol. 3078. Springer-Verlag, Jun. 2004, pp. 168-176.
63. G. Blanchi, B. Solenthaler, G. Székely, and M. Harders, "Simultaneous topology and stiness identification for mass-spring models based on FEM reference deformations," in Proc. Medical Image Computing and Computer-Assisted intervention, C. Barillot, Ed., vol. 2. Springer, Nov. 2004, pp. 293-301.
64. S. Cotin, H. Delingette, and N. Ayache, "Real-time elastic deformations of soft tissues for surgery simulation," IEEE Trans. Visualization Comput. Graphics, vol. 5, no. 1, pp. 62-73, Jan.-Mar. 1999.
65. D. L. James and D. K. Pai, "ArtDefo accurate real time deformable objects," in Comput. Graphics, 1999, pp. 65-72.
66. S. Cotin, H. Delingette, and N. Ayache, "A hybrid elastic model allowing real-time cutting, deformations and force-feedback for surgery training and simulation," Visual Computer, vol. 16, no. 8, pp. 437-452, 2000.
67. G. Picinbono, H. Delingette, and N. Ayache, "Non-linear anisotropic elasticity for real-time surgery simulation," Graphical Models, vol. 65, no. 5, pp. 305-321, Sep. 2003.
68. G. Debunne, M. Desbrun, M.-P. Cani, and A. H. Barr, "Dynamic real-time deformations using space and time adaptive sampling," in Computer Graphics Proc., Aug. 2001.
69. M. Hauth and W. Straßer, "Corotational simulation of deformable solids," in Proc. WSCG 2004, pp. 137-145.
70. M. Mueller, B. Heidelberger, M. Teschner, and M. Gross, "Meshless deformations based on shape matching," in Proc. ACM SIGGRAPH (SIGGRAPH'2005), Los Angeles, CA, Aug. 2005.
71. I. Sakuma, Y. Nishimura, C. K. Chui, E. Kobayashi, H. Inada, X. Chen, and T. Hisada, "In vitro measurement of mechanical properties of liver tissue under compression and elongation using a new test piece holding method with surgical glue," in Proc. Int. Symp. Surgery Simulation Soft Tissue Modeling, ser. LNCS, vol. 2673, Jun. 2003, pp. 284-292.
72. M. P. Qttensmeyer, A. E. Kerdok, R. D. Howe, and S. L. Dawson, "The effects of testing environment on the viscoelastic properties of soft tissue," in Proc. Int. Symp. Medical Simulation, Jun. 2004, pp. 9-18.
73. A. Nava, E. Mazza, F. Kleinermann, N. Avis, and J. McClure, "Determination of the mechanical properties of soft human tissues through aspiration experiments," in Proc. Conf. Medical Robotics, Imaging and Computer Assisted Surgery, ser. LNCS, Montreal, Canada, Nov. 2003.
74. T. Chanthasopeephan, J. P. Desai, and A. Lau, "Measuring forces in liver cutting: New equipment and experimental results," Ann. Biomed. Eng., vol. 31, no. 11, pp. 1372-1382, 2003.
75. A. E. Kerdok, S. M. Cotin, M. P. Ottensmeyer, A. M. Galea, R. D. Howe, and S. L. Dawson, "Truth cube: Establishing physical standards for real time soft tissue simulation," Medical Image Anal., vol. 7, pp. 283-291, 2003.
76. A. Manduca, T. E. Oliphant, M. A. Dresner, J. L. Mahowald, S. A. Kruse, E. Amromin, J. P. Felmlee, J. F. Greenleaf, and R. L. Ehman, "Magnetic resonance elastography: Non-invasive mapping of tissue elasticity," Medical Image Anal., vol. 5, no. 4, pp. 237-254, Dec. 2001.
77. C. Forest, H. Delingette, and N. Ayache, "Removing tetrahedra from manifold tetrahedralisation: Application to real-time surgical simulation," Medical Image Anal., vol.9, no. 2, pp. 113-122, Apr. 2005.
78. L. France, J. Lenoir, A. Angelidis, P. Meseure, M.-P. Cani, F. Faure, and C. Chaillou, "A layered model of a virtual human intestine for surgery simulation," Medical Image Anal., vol. 9, no. 2, pp. 123-132, Apr. 2005.
79. J. Ztonyi, R. Paget, G. Székely, M. Grassi, and M. Bajka, "Real-time synthesis of bleeding for virtual hysteroscopy," Medical Image Anal., vol. 9, no. 3, pp. 255-266, Jun. 2005.
80. R. FitzHugh, "Impulses and physiological states in theoretical models of nerve membrane," Biophysical J., vol. 1, pp. 445-466, 1961.
81. R. Aliev and A. Panfilov, "A simple two-variable model of cardiac excitation," Chaos, Solitons Fractals, vol. 7, no. 3, pp. 293-301, 1996.
82. J. Bestel, F. Clément, and M. Sorine, "A biomechanical model of muscle contraction," in Proc. MICCAI'01, vol. 2208. Springer, 2001, pp. 1159-1161.
83. M. Sermesant, P. Moireau, O. Camara, J. Sainte-Marie, R. Andriantsimiavona, R. Cimrman, D. G. Hill, D. Chapelle, and R. Razavi, "Cardiac function estimation from mri using a heart model and data assimilation: Advances and difficulties," in Proc. Functional Imaging Modeling Heart (FIMH'05), 2005, pp. 325-337.
84. M. Sermesant, K. Rhode, A. Anjorin, S. Hedge, G. Sanchez-Ortiz, D. Rueckert, P. Lambiase, C. Bucknall, D. Hill, and R. Razavi, "Simulation of the electromechanical activity of the heart using xmr interventional imaging," in Proc. Third Int. Conf. Medical Robotics, Imaging and Computer Assisted Surgery, Oct. 2004, pp. 786-794.
85. R. Ginhoux, J. A. Gangloff, and M. F. de Mathelin, "Beating heart tracking in robotic surgery using 500 hz visual servoing, model predictive control and an adaptive observer," in Proc. Int. Conf. Automation Robotics (ICRA'2004), New Orleans, LA, Apr. 2004, pp. 274-279.
86. O. Clatz, P. Bondiau, H. Delingette, G. Malandain, M. Sermesant, S. K. Warfield, and N. Ayache, "In silico tumor growth: Application to glioblastomas," in Proc MICCAI 2004, ser. LNCS, vol. 3217. Springer Verlag, Sep. 2004, pp. 337-345.
87. K. Swanson, E. Alvord, and J. Murray, "Virtual brain tumours (gliomas) enhance the reality of medical imaging and highlight inadequacies of current therapy," Brit. J. Cancer, vol. 86, no. 1, pp. 14-18, 2002.
88. M. Shoham, M. Burman, E. Zehavi, L. Joskowicz, E. Batkilin, and Y. Kunicher, "Bone-mounted miniature robot for surgical procedures: Concept and clinical applications," in Proc. Internation Conf. Robotics Automation (ICRA'03), Oct. 2003, pp. 761-768.
89. C. MacAulay, P. Lane, and R. Richards-Kortum, "In vivo pathology: Microendoscopy, as a new endoscopie imaging modality," Gastrointestinal Endoscopy Clinics of North America, vol. 14, pp. 595-620, 2004.
90. G. Le Goualher, A. Perchant, M. Genet, C. Cave, B. Viellerobe, F. Berier, B. Abrat, and N. Ayache, "Towards optical biopsies with an integrated fibered confocal fluorescence microscope," in Proc. MICCAI'04, ser. LNCS, C. Barillot, D. Haynor, and P. Hellier, Eds., vol. 3217. Saint-Malo, France: Springer Verlag, Sep. 2004, pp. 761-768.