Surgical navigation by autostereoscopic image overlay of integral videography

IEEE Transactions on Information Technology in Biomedicine

Volumn 8, Issue 2, 2004, Pages 114-121

  Liao, Hongen ^a   Hata, Nobuhiko ^a   Nakajima, Susumu ^a   Iwahara, Makoto ^a   Sakuma, Ichiro ^a   Dohi, Takeyoshi ^a  

^a UNIVERSITY OF TOKYO   (Japan)

Author keywords

Image overlay; Integral photography (IP); Integral videography (IV); Registration; Surgical navigation; Three dimensional (3 D) image

Indexed keywords

COMPUTERIZED TOMOGRAPHY; IMAGE QUALITY; IMAGE RECONSTRUCTION; MAGNETIC RESONANCE IMAGING; PHOTOGRAPHY;

AUTOSTEREOSCOPIC IMAGE OVERLAY TECHNIQUE; INTEGRAL PHOTOGRAPHY; INTEGRAL VIDEOGRAPHY; PATIENT-IMAGE REGISTRATION METHOD; SURGICAL NAVIGATION SYSTEMS; THREE-DIMENSIONAL IMAGE;

SURGERY;

ARTICLE; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER ASSISTED SURGERY; COMPUTER INTERFACE; DEPTH PERCEPTION; EQUIPMENT; EQUIPMENT DESIGN; EVALUATION; HUMAN; IMAGE ENHANCEMENT; IMAGE QUALITY; IMAGE SUBTRACTION; INSTRUMENTATION; METHODOLOGY; ONLINE SYSTEM; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SYSTEM ANALYSIS; THREE DIMENSIONAL IMAGING; VALIDATION STUDY; VIDEORECORDING;

DEPTH PERCEPTION; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; ONLINE SYSTEMS; PHANTOMS, IMAGING; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE; SURGERY, COMPUTER-ASSISTED; SYSTEMS INTEGRATION; USER-COMPUTER INTERFACE; VIDEO RECORDING;

EID: 3042595728     PISSN: 10897771     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITB.2004.826734     Document Type: Article

References (29)

1. F. Langlotz, "State-of-the-art in orthopaedic surgical navigation with a focus on medical image modalities," J. Vis. Comput. Animation, vol. 13, pp. 77-83, Feb. 2002.
2. T. Kawamata, H. Iseki, T. Shibasaki, and T. Hori, "Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: Technical note," Neurosurgery, vol. 50, pp. 1393-1397, June 2002.
3. M. Siessegger, R. A. Mischkowski, B. T. Schneider, B. Krug, B. Klesper, and J. E. Zoller, "Image guided surgical navigation for removal of foreign bodies in the head and neck," J. Cranio. Maxill. Surg., vol. 29, pp. 321-325, Dec. 2001.
4. P. Breedveld and M. Wentink, "Eye-hand coordination in laparoscopy - An overview of experiments and supporting aids," Minim. Invasiv. Ther., vol. 10, no. 3, pp. 155-162, 2001.
5. E. Kobayashi, K. Masamune, I. Sakuma, T. Dohi, and D. Hashimoto, "A new safe laparoscopic manipulator system with a five-bar linkage mechanism and an optical zoom," Comput. Aided Surgery, vol. 4, pp. 182-192, Nov. 1999.
6. P. Breedveld, H. G. Stassen, D. W. Meijer, and L. P. S. Stassen, "Theoretical background and conceptual solution for depth perception and eye-hand coordination problems in laparoscopic surgery," Minim. Invasiv. Ther., vol. 8, pp. 227-234, Aug. 1999.
7. K. Masamune, Y. Masutani, S. Nakajima, I. Sakuma, T. Dohi, H. Iseki, and K. Takakura, "Three-Dimensional slice image overlay system with accurate depth perception for surgery," in Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2000. Berlin: Springer, 2000, vol. 1935, LNCS, pp. 393-402.
8. G. D. Stetten and V. S. Clib, "Overlaying ultrasonographic images on direct vision," J. Ultrasound Med., vol. 20, pp. 235-240, 2001.
9. M. Rosenthal, A. State, J. Lee, G. Hirota, J. Ackerman, K. Keller, E. D. Pisano, M. Jiroutek, K. Muller, and H. Fuchs, "Augmented reality guidance for needle biopsies: An initial randomized, controlled trial in phantoms," Med. Image Analysis, vol. 6, pp. 313-320, 2002.
10. J. W. Berger and D. S. Shin, "Computer-vision-enabled augmented reality fundus biomicroscopy," Ophthalmology, vol. 106, pp. 1935-1941, Oct. 1999.
11. P. J. Edwards, A. P. King, C. R. Maurer Jr, D. A. Cunha, D. J. Hawkes, D. L. G. Hill, R. P. Gaston, M. R. Fenlon, A. Jusczyzck, A. J. Strong, C. L. Chandler, and M. J. Gleeson, "Design and evaluation of a system for microscope-assisted guided interventions (MAGI)," IEEE Trans. Med. Imag., vol. 19, pp. 1082-1093, Nov. 2000.
12. R. Shahidi, M. R. Bax, C. R. Maurer, J. A. Johnson, E. P. Wilkinson, B. Wang, J. B. West, M. J. Citardi, K. H. Manwaring, and R. Khadem, "Implementation, calibration and accuracy testing of an image-enhanced endoscopy system," IEEE Trans. Med. Imag., vol. 21, pp. 1524-1535, Dec. 2002.
13. H. Fuchs, M. A. Livingston, R. Raskar, D. Colucci, K. Keller, A. State, J. R. Crawford, P. Rademacher, S. H. Drake, and A. A. Meyer, "Augmented reality visualization for laparoscopic surgery," in Medical Image Computing and Computer-Assisted Intervention (MICCAI) 1998. Berlin: Springer, 1998, vol. 1496, LNCS, pp. 934-943.
14. W. Birkfellner, M. Figl, K. Huber, F. Watzinger, F. Wanschitz, J. Hummel, R. Hanel, W. Greimel, P. Homolka, R. Ewers, and H. Bergmann, "A head-mounted operating binocular for augmented reality visualization in medicine - Design and initial evaluation," IEEE Trans. Med. Imag., vol. 21, pp. 991-997, Aug. 2002.
15. C. R. Maurer, F. Sauer, B. Hu, B. Bascle, B. Geiger, F. Wenzel, F. Recchi, T. Rohlfing, C. Brown, R. J. Bakos, R. J. Maciunas, and A. R. Bani-Hashemi, "Augmented reality visualization of brain structures with stereo and kinetic depth cues: System description and initial evaluation with head phantom," in Medical Imaging 2001: Visualization, Display, and Image-Guided Procedures, vol. 4319, Proc. SPIE, 2001, pp. 445-456.
16. F. Sauer, A. Khamene, B. Bascle, and G. J. Rubino, "A head-mounted display system for augmented reality image guidance: Toward clinical evaluation for iMRI-guided neurosurgery," in Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2001. Berlin: Springer, 2001, vol. 2208, LNCS, pp. 707-716.
17. M. Blackwell, C. Nikou, A. M. Digioia, and T. Kanade, "An image overlay system for medical data visualization," Med. Image Analysis, vol. 4, pp. 67-72, 2000.
18. B. T. Backus, M. S. Banks, R. van Ee, and J. A. Crowell, "Horizontal and vertical disparity, eye position, and stereoscopic slant perception," Vision Res., vol. 39, pp. 1143-1170, 1999.
19. N. A. Dodgson, J. R. Moore, S. R. Lang, G. Martin, and P. Canepa, "A 50″ time-multiplexed autostereoscopic display," Proc. SPIE, vol. 3957, pp. 177-183, 2000.
20. M. G. Lippmann, "Epreuves reversibles donnant la sensation du relief," J. de Phys., ser. 4th, vol. 7, pp. 821-825, 1908.
21. Y. Masutani, M. Iwahara, O. Samuta, Y. Nishi, N. Suzuki, M. Suzuki, T. Dohi, H. Iseki, and T. Takakura, "Development of integral photography-based enhanced reality visualization system for surgical support," in Proc. ISCAS'95, 1995, pp. 16-17.
22. S. Nakajima, K. Nakamura, K. Masamune, I. Sakuma, and T. Dohi, "Three-dimensional medical display with computer-generated integral photography," Computerized Med. Imag. Graphics, vol. 25, pp. 235-241, 2001.
23. J. T. Lewis, R. L. Galloway Jr, and S. Schreiner, "An ultrasonic approach to localization of fiducial markers for interactive, image-guided neurosurgery - Part I: Principles," IEEE Trans. Biomed. Eng., vol. 45, pp. 621-630, 1998.
24. N. Pagoulatos, W. S. Edwards, D. R. Haynor, and Y. Kim, "Interactive 3D registration of ultrasound and magnetic resonance images based on a magnetic position sensor," IEEE Trans. Inform. Technol. Biomed., vol. 3, pp. 278-288, Dec. 1999.
25. C. R. Maurer Jr, J. M. Fitzpatrick, M. Y. Wang, R. L. Galloway Jr, R. J. Maciunas, and G. S. Allen, "Registration of head volume images using implantable fiducial markers," IEEE Trans. Med. Imag., vol. 16, pp. 447-462, Aug. 1997.
26. C. Kresmer, C. Planger, R. Bosecke, A. Pallua, F. Aichner, and S. R. Felber, "Image registration of MR and CT images using a frameless fiducial marker system," Mag. Resonance Imag., vol. 15, pp. 579-585, 1997.
27. K. S. Arun, T. S. Huang, and S. D. Blostern, "Least-square fitting of two 3-D point sets," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, pp. 698-700, Sept. 1987.
28. H. Liao, N. Hata, M. Iwahara, S. Nakajima, I. Sakuma, and T. Dohi, "High-resolution stereoscopic surgical display using parallel integral videography and multi-projector," in Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2002. Berlin: Springer, 2002, vol. 2489, LNCS, pp. 85-92.
29. C. R. Maurer Jr, D. L. G. Hill, A. J. Martin, H. Liu, M. McCue, D. Rueckert, D. Lloret, W. A. Hall, R. E. Maxwell, D. J. Hawkes, and C. L. Truwit, "Investigation of intraoperative brain deformation using a 1.5-T interventional MR system: Preliminary results," IEEE Trans. Med. Imag., vol. 17, pp. 817-825, Oct. 1998.