Training for planning tumour resection: Augmented reality and human factors

IEEE Transactions on Biomedical Engineering

Volumn 62, Issue 6, 2015, Pages 1466-1477

  Abhari, Kamyar ^a   Baxter, John S H ^a   Chen, Elvis C S ^a   Khan, Ali R ^a   Peters, Terry M ^a   De Ribaupierre, Sandrine ^b   Eagleson, Roy ^a  

^a ROBARTS RESEARCH INSTITUTE   (Canada)

^b LONDON HEALTH SCIENCES CENTRE   (Canada)

Author keywords

Augmented reality (AR); Human factors; Neurosurgical planning; Neurosurgical training; Tumour resection; User study; Virtual reality (VR)

Indexed keywords

AUGMENTED REALITY; BRAIN; HUMAN ENGINEERING; MEDICAL IMAGING; TUMORS;

COGNITIVE DEMANDS; MIXED REALITY SYSTEMS; REFERENCE FRAME; SPATIAL REASONING; SPATIAL REFERENCE; SURGICAL INTERVENTIONS; TRADITIONAL APPROACHES; USER STUDY;

VIRTUAL REALITY;

ACCOMMODATION; ANATOMICAL CONCEPTS; ARTICLE; BRAIN TUMOR; CANCER SURGERY; COMPUTER ASSISTED SURGERY; EYE TRACKING; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INTUITION; MENTAL FUNCTION; NORMAL HUMAN; OPERATING ROOM; OPERATION DURATION; ORIENTATION; PERCEPTION; PERSONAL EXPERIENCE; PHANTOM; PROCESS MODEL; PROFESSIONAL COMPETENCE; RESIDENT; SENSORIMOTOR FUNCTION; SKILL; SURGICAL APPROACH; SURGICAL ERROR; SURGICAL TRAINING; TASK PERFORMANCE; TRACTOGRAPHY; TREATMENT PLANNING; VIRTUAL REALITY; BIOENGINEERING; COMPUTER INTERFACE; EDUCATION; FEMALE; HEAD; IMAGING PHANTOM; MALE; NEUROSURGERY; PROCEDURES; SURGERY; THREE DIMENSIONAL IMAGING;

FEMALE; HEAD; HUMAN ENGINEERING; HUMANS; IMAGING, THREE-DIMENSIONAL; MALE; NEUROSURGICAL PROCEDURES; PHANTOMS, IMAGING; SURGERY, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 84930507925     PISSN: 00189294     EISSN: 15582531     Source Type: Journal    
DOI: 10.1109/TBME.2014.2385874     Document Type: Article

References (51)

1. Canadian cancer statistics. (2013). Canadian Cancer Society, Public Health Agency of Canada. [Online]. Available: http://goo.gl/hkiWep
2. Cancer facts and figures 2013. (2013). American Cancer Society. [Online]. Available: http://goo.gl/z3vHVc
3. Primary brain and central nervous system tumors diagnosed in the united states in 2004-2008. (2012). Central Brain Tumor Registry of the United States. [Online]. Available: http://goo.gl/mM3Pgd
4. A. Quinones-Hinojosa, Schmidek and Sweet: Operative Neurosurgical Techniques: Indications, Methods and Results (Expert Consult-Online and Print). Philadelphia, PA, USA: Elsevier Health Sciences, 2012. [Online]. Available: http://books.google.ca/books?id=4sKQSY-zdvgC
5. D. Reisberg, The Oxford Handbook of Cognitive Psychology. London, U. K: Oxford Univ. Press, 2013.
6. T. M. Peters, "Image-guidance for surgical procedures", Phys. Med. Biol., vol. 51, no. 14, pp. R505-R540, 2006.
7. P. Milgram and F. Kishino, "A taxonomy ofmixed reality visual displays", IEICE Trans. Inf. Syst., vol. 77, no. 12, pp. 1321-1329, 1994.
8. H. L. Layer, "Sensorama simulator", U. S. Patent 3 050 870, Aug. 28, 1962. [Online]. Available: https://www.google.com/patents/US3050870
9. J. H. Shuhaiber, "Augmented reality in surgery", Arch. Surg., vol. 139, no. 2, pp. 170-174, 2004.
10. R. T. Azuma et al., "A survey of augmented reality", Presence, vol. 6, no. 4, pp. 355-385, 1997.
11. T. Sielhorst et al., "Advanced medical displays: A literature review of augmented reality", Disp. Technol. J., vol. 4, no. 4, pp. 451-467, 2008.
12. M. Kersten-Oertel et al., "DVV: A taxonomy for mixed reality visualization in image guided surgery", IEEE Trans. Vis. Comput. Graph., vol. 18, no. 2, pp. 332-352, Feb. 2012.
13. C. A. Linte et al., "On mixed reality environments for minimally invasive therapy guidance: Systems architecture, successes and challenges in their implementation from laboratory to clinic", Comput. Med. Imag. Graph., vol. 37, no. 2, pp. 83-97, 2013.
14. T. Poston and L. Serra, "The virtual workbench: Dextrous VR", in Proc. Conf. Virtual Reality Softw. Technol., 1994, pp. 111-121.
15. A. T. Stadie et al., "Virtual reality system for planning minimally invasive neurosurgery", Neurosurgery, vol. 108, pp. 382-394, 2008.
16. C. Luciano et al., "Design of the immersivetouch: A high-performance haptic augmented virtual reality system", presented at the 11th Int. Conf. Human-Comput. Interact., Las Vegas, NV, USA, 2005.
17. K. Hinckley et al., "The props-based interface for neurosurgical visualization", Stud. Health Technol. Informat., vol. 39, pp. 552-562, 1997.
18. R. R. Shamir et al., "Reduced risk trajectory planning in image-guided keyhole neurosurgery", Med. Phys., vol. 39, no. 5, pp. 2885-2895, 2012.
19. R. R. Shamir et al., "Trajectory planning with augmented reality for improved risk assessment in image-guided keyhole neurosurgery", in Proc. IEEE Int. Symp. Biomed. Imag., Nano Macro, 2011, pp. 1873-1876.
20. W. Grimson et al., "Image-guided surgery", Sci. Amer., vol. 280, no. 6, pp. 54-61, 1999.
21. R. A. Kockro et al., "Dex-ray: Augmented reality neurosurgical navigation with a handheld video probe", Neurosurgery, vol. 65, no. 4, pp. 795-808, 2009.
22. P. J. Edwards et al., "Design and evaluation of a system for microscopeassisted guided interventions (MAGI)", IEEE Trans. Med. Imag., vol. 19, no. 11, pp. 1082-1093, Nov. 2000.
23. R. Shahidi et al., "Implementation, calibration and accuracy testing of an image-enhanced endoscopy system", IEEE Trans. Med. Imag., vol. 21, no. 12, pp. 1524-1535, Dec. 2002.
24. C. Bichlmeier et al., "The virtual mirror: A new interaction paradigm for augmented reality environments", IEEE Trans. Med. Imag., vol. 28, no. 9, pp. 1498-1510, Sep. 2009.
25. C. R. Maurer, Jr., et al., "Augmented-reality visualization of brain structures with stereo and kinetic depth cues: System description and initial evaluation with head phantom", Med. Imag. Int. Soc. Opt. Photon., vol. 445, pp. 445-456, 2001.
26. M. Lerotic et al., "Pq-space based non-photorealistic rendering for augmented reality", in Proc. Med. Image Comput. Comput.-Assisted Intervention Conf., 2007, pp. 102-109.
27. P. Paul, "Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neurosurgery: Methods and performance evaluation", IEEE Trans. Med. Imag., vol. 24, no. 11, pp. 1500-1511, Nov. 2005.
28. R. Eagleson, "Perceptual capacitites and constraints in augmented reality biomedical displays", presented at the Innovations Patient Care, Eng. Phys. Sci. Med. Aust. Biomed. Eng. Conf., Christchurch, New Zealand, 2008.
29. E. C. Chen, "An augmented reality platform for planning of minimally invasive cardiac surgeries", Proc. SPIE, Med. Imag., Int. Soc. Opt. Photon., vol. 8316, pp. 831617-831617, 2012.
30. J. S. Baxter et al., "A unified framework for voxel classification and triangulation", Proc. SPIE, Med. Imag., Int. Soc. Opt. Photon., vol. 7964, pp. 796436-796436, 2011.
31. C. Ware, Information Visualization: Perception for Design. New York, NY, USA: Elsevier, 2012.
32. E. Kruijff et al., "Perceptual issues in augmented reality revisited", in Proc. IEEE 9th Int. Symp. Mixed Augmented Reality, 2010, vol. 9, pp. 3-12.
33. D. Drascic and P. Milgram, "Perceptual issues in augmented reality", Proc. Electron. Imag, Sci. Technol., Int. Soc. Opt. Photon., vol. 2653, pp. 123-134, 1996.
34. M. Mon-Williams and J. R. Tresilian, "Ordinal depth information from accommodation?" Ergonomics, vol. 43, no. 3, pp. 391-404, 2000.
35. S. Nagata, "How to reinforce perception of depth in single two-dimensional pictures", Proc. Soc. Inf. Disp., vol. 25, no. 3, pp. 239-246, 1984.
36. K. Abhari et al., "Perceptual enhancement of arteriovenous malformation in MRI angiography displays", Proc. SPIE, Med. Imag., Int. Soc. Opt. Photon., vol. 8318, pp. 831809-831809, 2012.
37. K. Abhari et al., "Visual enhancement of MR angiography images to facilitate planning of arteriovenous malformation interventions", ACM Trans. Appl. Percept., submitted for publication, 2014
38. O. Kutter et al., "Real-time volume rendering for high quality visualization in augmented reality", presented at the Int. Workshop Augmented Environ. Med. Imag., Augmented Reality Comput.-Aided Surg., New York, NY, USA, 2008.
39. B. Rogers et al., "Motion parallax as an independent cue for depth perception", Perception, vol. 8, no. 2, pp. 125-134, 1979.
40. H. Ono and M. J. Steinbach, "Monocular stereopsis with and without head movement", Percept. Psychophys., vol. 48, no. 2, pp. 179-187, 1990.
41. V. Cornilleau-Peres and J. Droulez, "The visual perception of three-dimensional shape from self-motion and object-motion", Vis. Res., vol. 34, no. 18, pp. 2331-2336, 1994.
42. M. R. Mine et al., "Moving objects in space: Exploiting proprioception in virtual-environment interaction", in Proc. 24th Annu. Conf. Comput. Graph. Interacti. Techn., 1997, pp. 19-26.
43. L. J. Williams, "Tunnel vision induced by a foveal load manipulation", Human Factors, J. Human Factors Ergonom. Soc., vol. 27, no. 2, pp. 221-227, 1985.
44. M. Bajura et al., "Merging virtual objects with the real world: Seeing ultrasound imagery within the patient", ACM SIGGRAPH Comput. Graph., vol. 26, no. 2, pp. 203-210, 1992.
45. C. Bichlmeier et al., "Contextual anatomic mimesis hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality", in Proc. IEEE 6th Int. Symp. Mixed Augmented Reality, 2007, pp. 129-138.
46. L. T. De Paolis et al., "Augmented visualization of the patient's organs through a slidingwindow", presented at the Workshop Vis. Model. Vis., Braunschweig, Germany, 2009.
47. S. Mann and S. M. Nnlf, "Mediated reality", 1994.
48. R. Rosenholtz et al., "Measuring visual clutter", J. Vis., vol. 7, no. 2, p. 17, 2007.
49. K. Abhari et al., "Use of a mixed-reality system to improve the planning of brain tumour resections: Preliminary results", in Augmented Environments for Computer-Assisted Interventions, New York, NY, USA: Springer, 2013, pp. 55-66.
50. K. Abhari et al., "The role of augmented reality in training the planning of brain tumor resection", in Augmented Reality Environments for Medical Imaging and Computer-Assisted Interventions, New York, NY, USA: Springer, 2013, pp. 241-248.
51. P. M. Fitts, "The information capacity of the human motor system in controlling the amplitude of movement." J. Exp. Psychol., vol. 47, no. 6, pp. 381-391, 1954.