Virtual reality simulation in neurosurgery: Technologies and evolution

Neurosurgery

Volumn 72, Issue SUPPL. 1, 2013, Pages

  Chan, Sonny ^a   Conti, François ^a   Salisbury, Kenneth ^a,b   Blevins, Nikolas H ^c  

^a Stanford University   (United States)

^b STANFORD UNIVERSITY   (United States)

^c STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Anatomical modeling; Computer haptics; Interactive visualization; Medical devices; Surgical education; Surgical rehearsal; Surgical simulation

Indexed keywords

ANATOMIC MODEL; ARTICLE; CAUTERIZATION; COMPUTER ASSISTED TOMOGRAPHY; COMPUTER GRAPHICS; COST; CYTOREDUCTIVE SURGERY; DECISION MAKING; DIGITAL IMAGING; ENDOSCOPY; HAND MOVEMENT; HUMAN; HYDRODYNAMICS; LEARNING; NEUROSURGEON; NEUROSURGERY; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; ROBOTICS; SIMULATION; STEREOSCOPIC VISION; SURGICAL ANATOMY; SURGICAL ERROR; SURGICAL TECHNIQUE; SURGICAL TECHNOLOGY; SURGICAL TRAINING; TACTILE FEEDBACK; THREE DIMENSIONAL IMAGING; TRANSSPHENOIDAL HYPOPHYSECTOMY; TREATMENT PLANNING; VIRTUAL REALITY;

COMPUTER SIMULATION; COMPUTER-ASSISTED INSTRUCTION; EDUCATION, MEDICAL, GRADUATE; FEEDBACK; HUMANS; MODELS, ANATOMIC; MOTOR SKILLS; NEUROSURGERY; NEUROSURGICAL PROCEDURES; ROBOTICS; TOUCH; USER-COMPUTER INTERFACE;

EID: 84872062804     PISSN: 0148396X     EISSN: None     Source Type: Journal    
DOI: 10.1227/NEU.0b013e3182750d26     Document Type: Article

References (75)

1. Malone HR, Syed ON, Downes MS, D'Ambrosio AL, Quest DO, Kaiser MG. Simulation in neurosurgery: a review of computer-based simulation environments and their surgical applications. Neurosurgery. 2010;67(4):1105-1116.
2. Lemole G M J, Banerjee PP, Luciano C, Neckrysh S, Charbel FT. Virtual reality in neurosurgical education: part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery. 2007;61(1):142-149.
3. Bradley P. The history of simulation in medical education and possible future directions. Med Educ. 2006;40(3):254-262.
4. Brown N, Natsupakpong S, Johannsen S, et al. Virtual environment-based training simulator for endoscopic third ventriculostomy. Stud Health Technol Inform. 2006;119:73-75.
5. Luciano C, Banerjee P, Lemole GM Jr, Charbel F. Second generation haptic ventriculostomy simulator using the ImmersiveTouch system. Stud Health Technol Inform. 2006;119:343-348.
6. Çakmak H, Maaß H, Trantakis C, Strauß G, Nowatius E, Kühnapfel U. Haptic ventriculostomy simulation in a grid environment. Comput Animat Virtual Worlds. 2009;20(1):25-38.
7. Delorme S, Laroche D, Diraddo R, F Del Maestro R. NeuroTouch: a physicsbased virtual simulator for cranial microneurosurgery training. Neurosurgery. 2012;71(1 suppl operative):ons32-ons42.
8. Dunkin B, Adrales GL, Apelgren K, Mellinger JD. Surgical simulation: a current review. Surg Endosc. 2007;21(3):357-366.
9. Dimaio SP, Archip N, Hata N, et al. Image-guided neurosurgery at Brigham and Women's Hospital. IEEE Eng Med Biol Mag. 2006;25(5):67-73.
10. Stadie AT, Kockro RA, Reisch R, et al. Virtual reality system for planning minimally invasive neurosurgery: technical note. J Neurosurg. 2008;108(2):382-394. (Pubitemid 351213308)
11. Kikinis R, Gleason PL, Moriarty TM, et al. Computer-assisted interactive three-dimensional planning for neurosurgical procedures. Neurosurgery. 1996;38(4):640-651. (Pubitemid 26087869)
12. Gering DT, Nabavi A, Kikinis R, et al. An integrated visualization system for surgical planning and guidance using image fusion and an open MR. J Magn Reson Imaging. 2001;13(6):967-975. (Pubitemid 32479958)
13. Beyer J, Hadwiger M, Wolfsberger S, Bühler K. High-quality multimodal volume rendering for preoperative planning of neurosurgical interventions. IEEE Trans Vis Comput Graph. 2007;13(6):1696-1703. (Pubitemid 350076650)
14. Wong GK, Zhu CX, Ahuja AT, Poon WS. Craniotomy and clipping of intracranial aneurysm in a stereoscopic virtual reality environment. Neurosurgery. 2007;61(3):564-569.
15. Kockro RA, Hwang PY. Virtual temporal bone: an interactive 3-dimensional learning aid for cranial base surgery. Neurosurgery. 2009;64(5 suppl 2):216-229.
16. Neubauer A, Wolfsberger S, Forster MT, Mroz L, Wegenkittl R, Bühler K. Advanced virtual endoscopic pituitary surgery. IEEE Trans Vis Comput Graph. 2005;11(5):497-507.
17. Wolfsberger S, Neubauer A, Bühler K, et al. Advanced virtual endoscopy for endoscopic transsphenoidal pituitary surgery. Neurosurgery. 2006;59(5):1001-1010.
18. Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P. Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg. 2004;91(2):146-150. (Pubitemid 38233958)
19. Gurusamy K, Aggarwal R, Palanivelu L, Davidson BR. Systematic review of randomized controlled trials on the effectiveness of virtual reality training for laparoscopic surgery. Br J Surg. 2008;95(9):1088-1097.
20. Lee JY, Mucksavage P, Kerbl DC, Huynh VB, Etafy M, McDougall EM. Validation study of a virtual reality robotic simulator: role as an assessment tool? J Urol. 2012;187(3):998-1002.
21. Korets R, Mues AC, Graversen JA, et al. Validating the use of the Mimic dVtrainer for robotic surgery skill acquisition among urology residents. Urology. 2011;78(6):1326-1330.
22. McBeth PB, Louw DF, Rizun PR, Sutherland GR. Robotics in neurosurgery. Am J Surg. 2004;188(4 A suppl):68S-75S. (Pubitemid 39336476)
23. Nathoo N, Çavuşoǧlu MC, Vogelbaum MA, Barnett GH. In touch with robotics: neurosurgery for the future. Neurosurgery. 2005;56(3):421-433.
24. Pandya S, Motkoski JW, Serrano-Almeida C, Greer AD, Latour I, Sutherland GR. Advancing neurosurgery with image-guided robotics. J Neurosurg. 2009;111(6):1141-1149.
25. Spicer MA, Apuzzo ML. Virtual reality surgery: neurosurgery and the contemporary landscape. Neurosurgery. 2003;52(3):489-498.
26. Harders M. Surgical Scene Generation for Virtual Reality-based Training in Medicine. London, UK: Springer-Verlag; 2008.
27. Delingette H, Pennec X, Soler L, Marescaux J, Ayache N. Computational models for image-guided robot-assisted and simulated medical interventions. Proc IEEE. 2006;94(9):1678-1688. (Pubitemid 46438154)
28. Riener R, Harders M. Medical model generation. In. Virtual Reality in Medicine. London, UK: Springer-Verlag; 2012:225-264.
29. Niessen W. Model-based image segmentation for image-guided interventions. In. Image-Guided Interventions. New York, NY: Springer; 2008:219-239.
30. Collins DL, Holmes CJ, Peters TM. Automatic 3-D model-based neuroanatomical segmentation. Hum Brain. 1995;3(3):190-208. (Pubitemid 3036541)
31. Heimann T, Meinzer HP. Statistical shape models for 3D medical image segmentation: a review. Med Image Anal. 2009;13(4):543-563.
32. Falcão AX, Udupa JK. A 3D generalization of user-steered live-wire segmentation. Med Image Anal. 2000;4(4):389-402.
33. Poon M, Hamarneh G, Abugharbieh R. Efficient interactive 3D Livewire segmentation of complex objects with arbitrary topology. Comput Med Imaging Graph. 2008;32(8):639-650.
34. Heckel F, Konrad O, Hahn HK, Peitgen HO. Interactive 3D medical image segmentation with energy-minimizing implicit functions. Comput Graph. 2011;35:275-287.
35. Miller K. Constitutive model of brain tissue suitable for finite element analysis of surgical procedures. J Biomech. 1999;32(5):531-537. (Pubitemid 29199986)
36. Miller K, Chinzei K, Orssengo G, Bednarz P. Mechanical properties of brain tissue in-vivo: experiment and computer simulation. J Biomech. 2000;33(11):1369-1376. (Pubitemid 30625094)
37. Howard MA 3rd, Abkes BA, Ollendieck MC, Noh MD, Ritter RC, Gillies GT. Measurement of the force required to move a neurosurgical probe through in vivo human brain tissue. IEEE Trans Biomed Eng. 1999;46(7):891-894.
38. Kruse SA, Rose GH, Glaser KJ, et al. Magnetic resonance elastography of the brain. Neuroimage. 2008;39(1):231-237. (Pubitemid 350102204)
39. Svaasand LO, Ellingsen R. Optical properties of human brain. Photochem Photobiol. 1983;38(3):293-299.
40. Eggert HR, Blazek V. Optical properties of human brain tissue, meninges, and brain tumors in the spectral range of 200 to 900 nm. Neurosurgery. 1987;21(4):459-464. (Pubitemid 17154022)
41. Bevilacqua F, Piguet D, Marquet P, Gross JD, Tromberg BJ, Depeursinge C. In vivo local determination of tissue optical properties: applications to human brain. Appl Opt. 1999;38(22):4939-4950. (Pubitemid 129308138)
42. ap Cenydd L, Walter A, John NW, Bloj M, Phillips N. Realistic visualization of living brain tissue. Stud Health Technol Inform. 2011;163:105-111.
43. Levin DN, Hu XP, Tan KK, et al. The brain: integrated three-dimensional display or MR and PET images. Radiology. 1989;172(3):783-789. (Pubitemid 19211605)
44. Kratz A, Hadwiger M, Fuhrmann A. GPU-based high-quality volume rendering for virtual environments. In: Proceedings from the International Workshop on Augmented Environments for Medical Imaging Including Augmented Reality in Computer-aided Surgery (AMI-ARCS); Copenhagen, Denmark, 2006.
45. Preim B, Bartz D. Visualization in Medicine: Theory, Algorithms, and Applications. Burlington, MA: Morgan Kaufmann; 2007.
46. Jensen HW, Marschner SR, Levoy M, Hanrahan P. A practical model for subsurface light transport. In: Proceedings from the International Conference on Computer Graphics and Interactive Techniques (ACM SIGGRAPH); Los Angeles, California, 2001:511-518. (Pubitemid 33047339)
47. Chen J Y C, Thropp JE. Review of low frame rate effects on human performance. IEEE Trans Systems Man Cybernetics. 2007;37(6):1063-1076. (Pubitemid 350130844)
48. Ropinski T, Doring C, Rezk-Salama C. Interactive volumetric lighting simulating scattering and shadowing. In: Proceedings from the IEEE Pacific Visualization Symposium (PacificVis); Taipei, Taiwan, 2010:169-176.
49. Henn JS, Lemole G M J, Ferreira M A T, et al. Interactive stereoscopic virtual reality: a new tool for neurosurgical education. J Neurosurg. 2002;96(1):144-149. (Pubitemid 34230001)
50. McAllister DF. Stereo Computer Graphics and Other True 3D Technologies. Princeton, NJ: Princeton University Press; 1993.
51. Smolic A, Mueller K, Merkle P, Kauff P, Wiegand T. An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution. In: Proceedings from Picture Coding Symposiumc; Chicago, Illinois, May 6-9, 2009;1-4.
52. Forsslund J, Flodin M. Design of a sub-∈1000 stereo vision enabled co-located multi-modal display. In: Proceedings from the SIGRAD EuroGraphics Swedish Chapter; Gothenburg, Sweden, 2009.
53. Barbagli F, Salisbury K. The effect of sensor/actuator asymmetries in haptic interfaces. In: Proceedings from the IEEE Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems; Los Angeles, California, 2003:140-147.
54. McMahan W, Kuchenbecker KJ. Haptic display of realistic tool contact via dynamically compensated control of a dedicated actuator. In: Proceedings from the IEEE/RSJ International Conference on Intelligent Robots and Systems; St. Louis, Missouri, 2009:3170-3177.
55. Adams RJ, Hannaford B. Stable haptic interaction with virtual environments. IEEE Trans Robot Automat. 1999;15(3):465-474.
56. Salisbury K, Conti F, Barbagli F. Haptic rendering: introductory concepts. IEEE Comput Graph Appl. 2004;24(2):24-32.
57. Otaduy MA, Lin MC. A modular haptic rendering algorithm for stable and transparent 6-DOF manipulation. IEEE Trans Robot. 2006;22(4):751-762. (Pubitemid 44263862)
58. Ortega M, Redon S, Coquillart S. A six degree-of-freedom god-object method for haptic display of rigid bodies with surface properties. IEEE Trans Vis Comput Graph. 2007;13(3):458-469.
59. Duriez C, Dubois F, Kheddar A, Andriot C. Realistic haptic rendering of interacting deformable objects in virtual environments. IEEE Trans Vis Comput Graph. 2006;12(1):36-47. (Pubitemid 43170170)
60. Barbič J, James DL. Six-dof haptic rendering of contact between geometrically complex reduced deformable models. IEEE Trans Haptics. 2008;1(1):39-52.
61. Cotin S, Delingette H, Ayache N. Real-time elastic deformations of soft tissues for surgery simulation. IEEE Trans Vis Comput Graph. 1999;5(1):62-73.
62. James DL, Pai DK. DyRT: dynamic response textures for real time deformation simulation with graphics hardware. ACM Trans Graph. 2002;21:582-585.
63. Meier U, López O, Monserrat C, Juan MC, Alcañiz M. Real-time deformable models for surgery simulation: a survey. Comput Methods Programs Biomed. 2005;77(3):183-197. (Pubitemid 40249932)
64. Morris D, Salisbury K. Automatic preparation, calibration, and simulation of deformable objects. Comput Methods Biomech Biomed Eng. 2008;11(3):263-279.
65. Zienkiewicz OC. The Finite Element Method: Its Basis and Fundamentals. Burlington, MA: Elsevier; 2005.
66. Taylor ZA, Cheng M, Ourselin S. High-speed nonlinear finite element analysis for surgical simulation using graphics processing units. IEEE Trans Med Imaging. 2008;27(5):650-663. (Pubitemid 351634373)
67. Joldes GR, Wittek A, Miller K. Real-time nonlinear finite element computations on GPU: application to neurosurgical simulation. Comput Methods Appl Mech Eng. 2010;199(49-52):3305-3314.
68. Müller M, Schirm S, Teschner M. Interactive blood simulation for virtual surgery based on smoothed particle hydrodynamics. Technol Health Care. 2004;12(1):25-31. (Pubitemid 38580750)
69. Stam J. Stable fluids. In: Proceedings from the International Conference on Computer Graphics and Interactive Techniques (ACM SIGGRAPH); 1999:121-128.
70. Liu W, Sewell C, Blevins NH, Salisbury K, Bodin K, Hjelte N. Representing fluid with smoothed particle hydrodynamics in a cranial base simulator. Stud Health Technol Inform. 2008;132:257-259.
71. Monaghan JJ. Smoothed particle hydrodynamics. Rep Prog Phys. 2005;68:1703-1759. (Pubitemid 41016604)
72. Harada T, Koshizuka S. Smoothed particle hydrodynamics on GPUs. In: Proceedings from Computer Graphics International; Petropolis, Brazil, June 2007:1-8.
73. Goswami P, Schlegel P, Solenthaler B, Pajarola R. Interactive SPH Simulation and Rendering on the GPU. In: Proceedings from Eurographics/ACM SIGGRAPH Symposium on Computer Animation; 2010:55-64.
74. Satava RM. Virtual reality surgical simulator. The first steps. Surg Endosc. 1993;7(3):203-205.
75. Fried MP, Sadoughi B, Gibber MJ, et al. From virtual reality to the operating room: the endoscopic sinus surgery simulator experiment. Otolaryngol Head Neck Surg. 2010;142(2):202-207.