Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neurosurgery: Methods and performance evaluation

IEEE Transactions on Medical Imaging

Volumn 24, Issue 11, 2005, Pages 1500-1511

  Paul, Perrine ^b   Fleig, Oliver ^b,c   Jannin, Pierre ^a,b  

^a IEEE   (France)

^b Inst de Rech Contre le Cancer IRCC   (France)

^c BRAINLAB AG   (Germany)

Author keywords

Image guided neurosurgery; Neuronavigation; Performance evaluation; Preoperative and intraoperative multimodal images; Stereopsis

Indexed keywords

IMAGE-GUIDED NEUROSURGERY; NEURONAVIGATION; PERFORMANCE EVALUATION; PREOPERATIVE AND INTRAOPERATIVE MULTIMODAL IMAGES; STEREOPSIS;

COMPUTER VISION; ERROR ANALYSIS; IMAGE RECONSTRUCTION; MATHEMATICAL TRANSFORMATIONS; NEUROSURGERY;

VIRTUAL REALITY;

ALGORITHM; ARTICLE; COMPUTER ASSISTED DIAGNOSIS; COMPUTER ASSISTED SURGERY; COMPUTER INTERFACE; EVALUATION; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; METHODOLOGY; MICROSCOPY; MICROSURGERY; NEURONAVIGATION; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOGRAPHY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING;

ALGORITHMS; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MAGNETIC RESONANCE IMAGING; MICROSCOPY; MICROSURGERY; NEURONAVIGATION; PHOTOGRAMMETRY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE; SURGERY, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 27744437712     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2005.857029     Document Type: Article

References (25)

1. M. Schulder, J. Maldjian, W. Liu, A. Holodny, A. Kalnin, I. Mun, and P. Carmel, "Functional image-guided surgery of intracranial tumors located in or near the sensorimotor cortex," J. Neumsurg., vol. 89, no. 3, pp. 412-418, 1998.
2. O. Ganslandt, R. Fahlbusch, C. Nimsky, H. Kober, M. Möller, R. Steinmeier, J. Romstöck, and J. Vieth, "Functional neuronavigation with magnetoencephalography: Outcome in 50 patients with lesions around the motor cortex," J. Neumsurg., vol. 91, no. 1, pp. 73-79, 1999.
3. P. Jannin, O. Fleig, E. Seigneuret, C. Grova, X. Morandi, and J.-M. Scarabin, "A data fusion environment for multimodal and multi-informational neuronavigation," Comput. Aided Surg., vol. 5, no. 1, pp. 1-10, 2000.
4. P. Jannin, X. Morandi, O. Fleig, E. Le Rumeur, P. Toulouse, B. Gibaud, and J.-M. Scarabin, "Integration of sulcal and functional information for multimodal neuronavigation," J. Neumsurg., vol. 96, no. 4, pp. 713-723, 2002.
5. J. Luber and A. Mackevics, "Multiple coordinate manipulator (mkm). A computer-assisted microscope," in Proc. Computed Assisted Radiology (CAR'95), H. Lemke, K. Inamura, and C. C. Jaffe, Eds., Berlin, Germany, 1995, pp. 1121-1125.
6. P. Edwards, A. King, C. J. Maurer, D. de Cunha, D. Hawkes, D. Hill, R. Gaston, M. Fenlon, A. Jusczyzck, A. Strong, C. Chandler, and M. Gleeson, "Design and evaluation of a system for microscope-assisted guided interventions (MAGI)," IEEE Trans. Med. Imag., vol. 19, no. 11, pp. 1082-1093, Nov. 2000.
7. W. Birkfellner, M. Figl, C. Matula, J. Hummel, R. Hanel, H. Imhof, F. Wanschitz, A. Wagner, F. Watzinger, and H. Bergmann, "Computer-enhanced stereoscopic vision in a head-mounted operating binocular," Phys Med Biol, vol. 48, no. 3, pp. 49-57, 2003.
8. G. Stetten and V. Chib, "Overlaying ultrasonographic images on direct vision," J. Ultrasound Med., vol. 20, no. 3, pp. 235-240, 2001.
9. H. Liao, N. Hata, S. Nakajima, M. Iwahara, I. Sakuma, and T. Dohi, "Surgical navigation by autostereoscopic image overlay of integral videography," IEEE Trans. Inform. Technol. Biomed., vol. 8, no. 2, pp. 114-121, Jun. 2004.
10. W. Grimson, G. Ettinger, S. White, T. Lozano-Pérez, W. Wells, and R. Kikinis, "An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization," IEEE Trans. Med. Imag., vol. 15, no. 2, pp. 129-140, Apr. 1996.
11. A. Colchester, J. Zhao, K. Holton-Tainter, C. Henri, N. Maitland, P. Roberts, C. Harris, and R. Evans, "Development and preliminary evaluation of vislan, a surgical planning and guidance system using intra-operative video imaging," Med. Image Anal., vol. 1,no. 1,pp. 73-90, 1996.
12. P. Milgram and F. Kishino, "A taxonomy of mixed reality visual display," IEICE Trans, Inform. Syst. (Special Issue on Networked Reality), vol. 77-D, no. 12, pp. 1321-1329, 1994.
13. D. Dey, D. G. Gobbi, P. J. Slomka, K. J. Surry, and T. M. Peters, "Automatic fusion of freehand endoscopic brain images to three-dimensional surfaces: Creating stereoscopic panoramas," IEEE Trans. Med. Imag., vol. 21, no. 1, pp. 23-30, Jan. 2002.
14. P. Jannin, A. Bouliou, E. Journet, and J.-M. Scarabin, "A ray-traced texture mapping for enhanced virtuality in image-guided neurosurgery," Stud. Health Technol. Inform., vol. 29, pp. 553-563, 1996.
15. O. Skrinjar, H. Tagare, and J. Duncan, "Surface growing from stereo images," in Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'00), Hilton Head Island, SC, Jun. 2000, pp. 571-576.
16. H. Sun, H. Farid, K. Rick, A. Hartov, D. Roberts, and K. Paulsen, "Estimating cortical surface motion using stereopsis for brain deformation models," in Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, Nov. 2003, vol. 2878, Proc. Medical Image Computing and Computer-Assisted Intervention (MICCAT03), pp. 794-801.
17. W. Schroeder, K. Martin, and B. Lorensen, "The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics," Kitware, 3rd. ed. [Pnline]. Available: http://www.vtk.org ed., 1993.
18. R. Y. Tsai, "A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE J. Robot. Automat., vol. RA-3, no. 4, pp. 323-344, 1987.
19. F. Devernay and O. Faugeras. (1994) Computing Differential Properties of 3-D Shapes From Stereoscopic Images Without 3-D Models. INRIA, Sophia Antipolis. [Online]. Available: ftp://ftp.inria.fr/INRIA/tech-reports/RR/RR-2304.ps.gz
20. P. Paul, O. Fleig, S. Tranchant, and P. Jannin, "Performance evaluation of a stereoscopic based 3d surface localizer for image-guided neurosurgery," in Proc. Medical Image Computing and Computer-Assisted Intervention (MICCAI'04), vol. 3217, C. Barillot, D. R. Haynor, and P. Hellier, Eds., 2004, pp. 510-517.
21. P. Jannin, M. Fitzpatrick, D. Hawkes, X. Pennec, R. Shahidi, and M. Vannier, "Validation of medical image processing in image-guided therapy," IEEE Trans. Med. Imag., vol. 21, no. 11, pp. 1445-1449, Nov. 2002.
22. J. Fitzpatrick, J. West, and C. Maurer, "Predicting error in rigid-body, point-based registration," IEEE Trans. Med. Imag., vol. 17, no. 5, pp. 694-702, Oct. 1998.
23. C. Maurer, R. Maciunas, and J. Fitzpatrick, "Registration of head CT images to physical space using a weighted combination of points and surfaces," IEEE Trans. Med. Imag., vol. 17, no. 5, pp. 753-761, Oct. 1998.
24. C. Maurer, D. Hill, A. Martin, H. Liu, M. McCue, D. Rueckert, D. Lloret, W. Hall, R. Maxwell, D. Hawkes, and C. Truwit, "Investigation of intraoperative brain deformation using a 1.5-T interventional MR system: Preliminary results," IEEE Trans. Med. Imag., vol. 17, no. 5, pp. 817-825, Oct. 1998.
25. T. Hartkens, D. Hill, A. Castellano-Smith, D. Hawkes, C. Maurer, A. Martin, W. Hall, H. Liu, and C. Truwit, "Measurement and analysis of brain deformation during neurosurgery," IEEE Trans. Med. Imag., vol. 22, no. 1, pp. 88-92, Jan. 2003.