Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery

Journal of Clinical Neuroscience

Volumn 35, Issue , 2017, Pages 1-4

  Pelargos, Panayiotis E ^a   Nagasawa, Daniel T ^a   Lagman, Carlito ^a   Tenn, Stephen ^b   Demos, Joanna V ^a   Lee, Seung J ^a   Bui, Timothy T ^a   Barnette, Natalie E ^a   Bhatt, Nikhilesh S ^a   Ung, Nolan ^a   Bari, Ausaf ^a   Martin, Neil A ^a   Yang, Isaac ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Augmented reality; Education; History; Innovations; Neurosurgery; Virtual reality

Indexed keywords

AUGMENTED REALITY; CLINICAL PRACTICE; CLINICAL PROTOCOL; COMPUTER ASSISTED TOMOGRAPHY; FEEDBACK SYSTEM; INFORMATION PROCESSING; MEDICAL EDUCATION; MEDICAL LITERATURE; MOTIVATION; NEUROSURGERY; NUCLEAR MAGNETIC RESONANCE IMAGING; PRACTICE GUIDELINE; PRIORITY JOURNAL; REVIEW; SIMULATION; SOCIOECONOMICS; SYSTEMATIC REVIEW; VIRTUAL REALITY; COMPUTER INTERFACE; COMPUTER SIMULATION; EDUCATION; HUMAN;

COMPUTER SIMULATION; HUMANS; NEUROSURGERY; NEUROSURGICAL PROCEDURES; USER-COMPUTER INTERFACE;

EID: 85006058871     PISSN: 09675868     EISSN: 15322653     Source Type: Journal    
DOI: 10.1016/j.jocn.2016.09.002     Document Type: Review

References (75)

1. [1] Swan, J.E. 2nd, Jones, A., Kolstad, E., et al. Egocentric depth judgments in optical, see-through augmented reality. IEEE Trans Vis Comput Graph 13 (2007), 429–442.
2. [2] Chaer, R.D., Derubertis, B.G., Lin, S.C, et al. Simulation improves resident performance in catheter-based intervention: results of a randomized, controlled study. Ann Surg 244 (2006), 343–352.
3. [3] Gorman, P.J., Meier, A.H., Krummel, T.M., Simulation and virtual reality in surgical education: real or unreal?. Arch Surg 134 (1999), 1203–1208.
4. [4] Singh, H., Kalani, M., Acosta-Torres, S., et al. History of simulation in medicine: from Resusci Annie to the Ann Myers Medical Center. Neurosurgery 73 (2013), 9–14.
5. [5] Aoun, S.G., McClendon, J. Jr., Ganju, A., et al. The Association for Surgical Education's roadmap for research on surgical simulation. World Neurosurg 78 (2012), 4–5.
6. [6] Apuzzo, M.L., Virtual neurosurgery: forceps, scissors, and suction meet the microprocessor, rocket science, and nuclear physics. Neurosurgery, 64, 2009, 785.
7. [7] Spicer, M.A., Apuzzo, M.L., Virtual reality surgery: neurosurgery and the contemporary landscape. Neurosurgery 52 (2003), 489–497 [discussion 96–7].
8. [8] Apuzzo, M.L., Elder, J.B., Liu, C.Y., The metamorphosis of neurological surgery and the reinvention of the neurosurgeon. Neurosurgery 64 (2009), 788–794 [discussion 94–5].
9. [9] Bohm, P.E., Arnold, P.M., Simulation and resident education in spinal neurosurgery. Surg Neurol Int, 6, 2015, 33.
10. [10] Alaraj, A., Lemole, M.G., Finkle, J.H., et al. Virtual reality training in neurosurgery: review of current status and future applications. Surg Neurol Int, 2, 2011, 52.
11. [11] Gallagher, A.G., Ritter, E.M., Champion, H., et al. Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241 (2005), 364–372.
12. [12] Kapadia, M.R., DaRosa, D.A., MacRae, H.M., et al. Current assessment and future directions of surgical skills laboratories. J Surg Educ 64 (2007), 260–265.
13. [13] Ahlberg, G., Enochsson, L., Gallagher, A.G., et al. Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193 (2007), 797–804.
14. [14] Alaraj, A., Charbel, F.T., Birk, D., et al. Role of cranial and spinal virtual and augmented reality simulation using immersive touch modules in neurosurgical training. Neurosurgery 72 (2013), 115–123.
15. [15] Robison, R.A., Liu, C.Y., Apuzzo, M.L., Man, mind, and machine: the past and future of virtual reality simulation in neurologic surgery. World Neurosurg 76 (2011), 419–430.
16. [16] Lemole, M., Banerjee, P.P., Luciano, C., et al. Virtual ventriculostomy with ’shifted ventricle’: neurosurgery resident surgical skill assessment using a high-fidelity haptic/graphic virtual reality simulator. Neurol Res 31 (2009), 430–431.
17. [17] Munz, Y., Almoudaris, A.M., Moorthy, K., et al. Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: objective assessment of the transfer of skill from virtual reality to reality. Am J Surg 193 (2007), 774–783.
18. [18] Aggarwal, R., Ward, J., Balasundaram, I., et al. Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246 (2007), 771–779.
19. [19] Drummond, K.H., Houston, T., Irvine, T., et al. The rise and fall and rise of virtual reality. 2014, Vox Media.
20. [20] Virtual reality systems. 1993, Academic Press Limited, San Diego, CA.
21. [21] Merel T. The 7 drivers of the $150 billion AR/VR industry. Aol Tech; 2015.
22. [22] Sekhar, L.N., Tariq, F., Kim, L.J., et al. Commentary: virtual reality and robotics in neurosurgery. Neurosurgery 72 (2013), 1–6.
23. [23] Lewis, T.M., Aggarwal, R., Rajaretnam, N., et al. Training in surgical oncology – the role of VR simulation. Surg Oncol 20 (2011), 134–139.
24. [24] Lewis, T.A., Kwasnicki, R.M., Rajaretnam, N., et al. Can virtual reality simulation be used for advanced bariatric surgical training?. Surgery 151 (2012), 779–784.
25. [25] Thijssen, A.S., Schijven, M.P., Contemporary virtual reality laparoscopy simulators: quicksand or solid grounds for assessing surgical trainees?. Am J Surg 199 (2010), 529–541.
26. [26] Kirkman, M.A., Ahmed, M., Albert, A.F., et al. The use of simulation in neurosurgical education and training. A systematic review. J Neurosurg 121 (2014), 228–246.
27. [27] Aucar, J.A., Groch, N.R., Troxel, S.A., et al. A review of surgical simulation with attention to validation methodology. Surg Laparosc Endosc Percutan Tech 15 (2005), 82–89.
28. [28] Carter, F.J., Schijven, M.P., Aggarwal, R., et al. Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc 19 (2005), 1523–1532.
29. [29] Dalgarno, B.L., Mark, J.W., What are the learning affordances of 3-D virtual environments?. Br J Educ Technol 41 (2010), 10–32.
30. [30] Whitelock, D.B., Brna, P., Holland, S., What is the value of virtual reality for conceptual learning? Towards a theoretical framework. Brna, P.P., Paiva, A., Self, J.A., (eds.) European Conference on Artificial Intelligence in Education, 1996, Edicões Colibri, Lisbon, 136–141.
31. [31] Hedberg, J.A., Alexander, S., Virtual reality in education: defining researchable issues. Educ Media Int 31 (1994), 214–220.
32. [32] Rosseau, G., Bailes, J., del Maestro, R., et al. The development of a virtual simulator for training neurosurgeons to perform and perfect endoscopic endonasal transsphenoidal surgery. Neurosurgery 73 (2013), 85–93.
33. [33] Aggarwal, R.B., black, S.A., Hance, J.R., et al. Virtual reality simulation training can improve inexperienced surgeon's endovascular skills. Eur J Vasc Endovasc Surg 31 (2006), 588–593.
34. [34] Patel, A., Koshy, N., Ortega-Barnett, J., et al. Neurosurgical tactile discrimination training with haptic-based virtual reality simulation. Neurol Res 36 (2014), 1035–1039.
35. [35] Gasco, J., Patel, A., Ortega-Barnett, J., et al. Virtual reality spine surgery simulation: an empirical study of its usefulness. Neurol Res 36 (2014), 968–973.
36. [36] Yudkowsky, R., Luciano, C., Banerjee, P., et al. Practice on an augmented reality/haptic simulator and library of virtual brains improves residents’ ability to perform a ventriculostomy. Simul Healthc 8 (2013), 25–31.
37. [37] Alaraj, A., Luciano, C.J., Bailey, D.P., et al. Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback. Neurosurgery 11 (2015), 52–58.
38. [38] AlZhrani, G., Alotaibi, F., Azarnoush, H., et al. Proficiency performance benchmarks for removal of simulated brain tumors using a virtual reality simulator NeuroTouch. J Surg Educ, 2015.
39. [39] Schirmer, C.M., Elder, J.B., Roitberg, B., et al. Virtual reality-based simulation training for ventriculostomy: an evidence-based approach. Neurosurgery 73 (2013), 66–73.
40. [40] Ray, W.Z., Ganju, A., Harrop, J.S., et al. Developing an anterior cervical diskectomy and fusion simulator for neurosurgical resident training. Neurosurgery 73 (2013), 100–106.
41. [41] Holloway, T., Lorsch, Z.S., Chary, M.A., et al. Operator experience determines performance in a simulated computer-based brain tumor resection task. Int J Comput Assist Radiol Surg, 2015.
42. [42] Choudhury, N., Gelinas-Phaneuf, N., Delorme, S., et al. Fundamentals of neurosurgery: virtual reality tasks for training and evaluation of technical skills. World Neurosurg 80 (2013), e9–e19.
43. [43] Gelinas-Phaneuf, N., Choudhury, N., Al-Habib, A.R., et al. Assessing performance in brain tumor resection using a novel virtual reality simulator. Int J Comput Assist Radiol Surg 9 (2014), 1–9.
44. [44] Hooten, K.G., Lister, J.R., Lombard, G., et al. Mixed reality ventriculostomy simulation: experience in neurosurgical residency. Neurosurgery 10:suppl. 4 (2014), 576–581 [discussion 81].
45. [45] Alotaibi, F.E., AlZhrani, G.A., Mullah, M.A., et al. Assessing bimanual performance in brain tumor resection with NeuroTouch, a virtual reality simulator. Neurosurgery 11:suppl. 2 (2015), 89–98 [discussion].
46. [46] Alotaibi, F.E., AlZhrani, G.A., Sabbagh, A.J., et al. Neurosurgical assessment of metrics including judgment and dexterity using the virtual reality simulator NeuroTouch (NAJD Metrics). Surg Innov, 2015.
47. [47] Azarnoush, H., Alzhrani, G., Winkler-Schwartz, A., et al. Neurosurgical virtual reality simulation metrics to assess psychomotor skills during brain tumor resection. Int J Comput Assist Radiol Surg 10 (2015), 603–618.
48. [48] Ferroli, P., Tringali, G., Acerbi, F., et al. Advanced 3-dimensional planning in neurosurgery. Neurosurgery 72 (2013), 54–62.
49. [49] Clarke, D.B., D'Arcy, R.C., Delorme, S., et al. Virtual reality simulator: demonstrated use in neurosurgical oncology. Surg Innov 20 (2013), 190–197.
50. [50] Nakamoto, M.U., Ukimura, O., Gill, I.S., et al. Realtime organ tracking for endoscopic augmented reality visualization using miniature wireless magnetic tracker. Medical imaging and augmented reality 4th International Workshop, 2008, Springer-Verlag, Heidelberg, Germany, 359–366.
51. [51] Teber, D.G., Guven, S., Simpfendorfer, T., et al. Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results. Eur Urol 56 (2009), 332–338.
52. [52] Zang, X.Y., Yang, J., Weng, D., Augmented reality based surgery navigation system. SPIE Med Imag, 2009.
53. [53] Caversaccio, M., Garcia Giraldez, J., Thoranaghatte, R., et al. Augmented reality endoscopic system (ARES): preliminary results. Rhinology 46 (2008), 156–158.
54. [54] Thoranaghatte, R.U., Giraldez, J.G., Zheng, G., Landmark based augmented reality endoscope system for sinus and skull-base surgeries. Conf Proc IEEE Eng Med Biol Soc 2008 (2008), 74–77.
55. [55] Alcaniz Raya, M., Varvaro Marcinek, H., Martinez Saez, J.M., et al. Mixed reality for neurosurgery: a novel prototype. Stud Health Technol Inform 94 (2003), 11–15.
56. [56] Besharati Tabrizi, L., Mahvash, M., Augmented reality-guided neurosurgery: accuracy and intraoperative application of an image projection technique. J Neurosurg, 1–6, 2015.
57. [57] Cabrilo, I., Sarrafzadeh, A., Bijlenga, P., et al. Augmented reality-assisted skull base surgery. Neurochirurgie 60 (2014), 304–306.
58. [58] Inoue, D., Cho, B., Mori, M., et al. Preliminary study on the clinical application of augmented reality neuronavigation. J Neurol Surg A Cent Eur Neurosurg 74 (2013), 71–76.
59. [59] Azuma, R.B., Baillot, Y., Behringer, R., et al. Recent advances in augmented reality. IEEE Comput Graph Appl 21 (2001), 34–47.
60. [60] Nicolau, S., Soler, L., Mutter, D., Augmented reality in laproscocpic surgical oncology. Surg Oncol 20 (2011), 189–201.
61. [61] Aschke, M.W., Wirtz, C.R., Raczkowsky, J., Augmented reality in operating microscopes for neurosurgical interventions. IEEE EMBS Conf Neural Eng, 2003.
62. [62] Edwards, P.J., Hawkes, D.J., Hill, D.L., et al. Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. J Image Guid Surg 1 (1995), 172–178.
63. [63] Kelly, P.J., Alker, G.J. Jr., Goerss, S., Computer-assisted stereotactic microsurgery for the treatment of intracranial neoplasms. Neurosurgery 10 (1982), 324–331.
64. [64] Worn, H., Aschke, M., Kahrs, L.A., New augmented reality and robotic based methods for head-surgery. Int J Med Robot 1 (2005), 49–56.
65. [65] Cabrilo, I., Bijlenga, P., Schaller, K., Augmented reality in the surgery of cerebral arteriovenous malformations: technique assessment and considerations. Acta Neurochir 156 (2014), 1769–1774.
66. [66] Cabrilo, I., Bijlenga, P., Schaller, K., Augmented reality in the surgery of cerebral aneurysms: a technical report. Neurosurgery 10:suppl. 2 (2014), 252–260 [discussion 60–1].
67. [67] Deng, W., Li, F., Wang, M., et al. Easy-to-use augmented reality neuronavigation using a wireless tablet PC. Stereotact Funct Neurosurg 92 (2014), 17–24.
68. [68] Kockro, R.T., Tsai, Y.T., Ng, I, et al. Dex-ray: augmented reality neurosurgical navigation with a handheld video probe. Neurosurgery 65 (2009), 795–807.
69. [69] Low, D., Lee, C.K., Dip, L.L., et al. Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas. Br J Neurosurg 24 (2010), 69–74.
70. [70] Yc Goha, K., Virtual reality applications in neurosurgery. Conf Proc IEEE Eng Med Biol Soc 4 (2005), 4171–4173.
71. [71] Bambakidis, N.C., Selman, W.R., Sloan, A.E., Surgical rehearsal platform: potential uses in microsurgery. Neurosurgery 73 (2013), 122–126.
72. [72] Long, D.M., Neurosurgical training at present and in the next century. Acta Neurochir Suppl 69 (1997), 58–64.
73. [73] Reznick, R.K., MacRae, H., Teaching surgical skills – changes in the wind. N Engl J Med 355 (2006), 2664–2669.
74. [74] Willaert, W.I., Aggarwal, R., Nestel, D.F., et al. Patient-specific simulation for endovascular procedures: qualitative evaluation of the development process. Int J Med Robot 6 (2010), 202–210.
75. [75] Gurusamy, K.S., Aggarwal, R., Palanivelu, L., et al. Virtual reality training for surgical trainees in laparoscopic surgery. Cochrane Database Syst Rev, 2009 CD006575.