Implementation, calibration and accuracy testing of an image-enhanced endoscopy system

IEEE Transactions on Medical Imaging

Volumn 21, Issue 12, 2002, Pages 1524-1535

  Shahidi, Ramin ^a   Bax, Michael R ^a   Maurer Jr , Calvin R ^a   Johnson, Jeremy A ^a   Wilkinson, Eric P ^b   Wang, Bai ^c   West, Jay B ^c   Citardi, Martin J ^d   Manwaring, Kim H ^e   Khadem, Rasool ^c  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF IOWA   (United States)

^c CBYON Inc   (United States)

^d LERNER RESEARCH INSTITUTE   (United States)

^e PHOENIX CHILDREN'S HOSPITAL   (United States)

Author keywords

Camera calibration; Image guided surgery; Lens distortion correction; Minimally invasive therapy; Perspective volume rendering; Virtual endoscopy

Indexed keywords

CALIBRATION; CAMERAS; CHARGE COUPLED DEVICES; ENDOSCOPY; IMAGE ENHANCEMENT; OPTICAL SENSORS; SURGERY;

CAMERA CALIBRATION; IMAGE ENHANCED ENDOSCOPY; IMAGE GUIDED SURGERY; LENS DISTORTION CORRECTION; MINIMALLY INVASIVE THERAPY; PERSPECTIVE VOLUME RENDERING; VIRTUAL ENDOSCOPY;

MEDICAL IMAGING;

ADOLESCENT; ALGORITHM; ANASTOMOSIS; ARTICLE; CALIBRATION; COMPARATIVE STUDY; COMPUTER ASSISTED SURGERY; ENDOSCOPE; ENDOSCOPY; EQUIPMENT DESIGN; EVALUATION; FEASIBILITY STUDY; FEMALE; HUMAN; HYDROCEPHALUS; IMAGE ENHANCEMENT; IMAGE QUALITY; IMAGE SUBTRACTION; INSTRUMENTATION; METHODOLOGY; NON-PROGRAMMATIC; QUALITY CONTROL; REPRODUCIBILITY; RHINITIS; SENSITIVITY AND SPECIFICITY; SINUSITIS; THREE DIMENSIONAL IMAGING; VALIDATION STUDY;

NON-PROGRAMMATIC;

ADOLESCENT; ALGORITHMS; CALIBRATION; ENDOSCOPES; ENDOSCOPY; EQUIPMENT DESIGN; FEASIBILITY STUDIES; FEMALE; HUMANS; HYDROCEPHALUS; IMAGE ENHANCEMENT; IMAGING, THREE-DIMENSIONAL; PHANTOMS, IMAGING; QUALITY CONTROL; REPRODUCIBILITY OF RESULTS; RHINITIS; SENSITIVITY AND SPECIFICITY; SINUSITIS; SUBTRACTION TECHNIQUE; SURGERY, COMPUTER-ASSISTED; VENTRICULOSTOMY;

EID: 0037001791     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2002.806597     Document Type: Article

References (41)

1. K. V. Asari, S. Kumar, and D. Radhakrishnan, "A new approach for non-linear distortion correction in endoscopic images based on least squares estimation," IEEE Trans. Med. Imag., vol. 18, pp. 345-354, Apr. 1999.
2. M. R. Bax, R. Khadem, J. A. Johnson, E. P. Wilkinson, and R. Shahidi. "Image-enhanced endoscopy calibration and image registration accuracy testing," Proc. SPIE, vol. 4681, 2002, to be published
3. W. Birkfellner, M. Figl, K. Huber, F. Watzinger, F. Wanschitz, J. Hummel, R. Hanel, W. Greimel, P. Homolka, R. Ewers, and H. Bergmann, "A head-mounted operating binocular for augmented reality visualization in medicine-Design and initial evaluation," IEEE Trans. Med. Imag., vol. 21, pp. 991-997, Aug. 2002.
4. M. J. Clarkson, D. Rueckert, D. L. G. Hill, and D. J. Hawkes, "Using photo-consistency to register 2-D optical images of the human face to a 3-D surface model," IEEE Trans. Pattern Anal. Machine Intell., vol. 23, pp. 1266-1280, Nov. 2001.
5. D. Dey, D. G. Gobbi, P. J. Slomka, K. J. M. Surry, and T. M. Peters, "Automatic fusion of freehand endoscopic brain images to three-dimensional surfaces: Creating stereoscopic panoramas," IEEE Trans. Med. Imag., vol. 21, pp. 23-30, Jan. 2002.
6. P. J. Edwards, A. P. King, C. R. Maurer, Jr, D. A. de Cunha, D. J. Hawkes, D. L. G. Hill, R. P. Gaston, M. R. Fenlon, A. Jusczyzck, A. J. Strong, C. L. Chandler, and M. J. Gleeson, "Design and evaluation of a system for microscope-assisted guided interventions (MAGI)," IEEE Trans. Med. Imag., vol. 19, pp. 1082-1093, Nov. 2000.
7. J. M. Fitzpatrick D. L. G. Hill, and C. R. Maurer, Jr.: "Image registration," in Handbook of Medical Imaging, Volume 2: Medical Image Processing and Analysis, M. Sonka and J. M. Fitzpatrick, Eds. Bellingham, WA: SPIE, 2000, pp. 447-513.
8. J. M. Fitzpatrick, J. B. West, and C. R. Maurer, Jr., "Predicting error in rigid-body, point-based registration," IEEE Trans. Med. Imag., vol. 17, pp. 694-702, Oct. 1998.
9. E. M. Friets, J. W. Strohbehn, J. F. Hatch, and D. W. Roberts, "A frame-less stereotaxic operating microscope for neurosurgery," IEEE Trans. Biomed. Eng., vol. 36, pp. 608-617, Jan. 1989.
10. I. M. Germano, Advanced Techniques in Image-Guided Brain and Spine Surgery. New York: Thieme. 2002.
11. W. E. L. Grimson, G. J. Ettinger, S. J. White, T. Lozano-Perez, W. M. Wells, III, and R. Kikinis, "An automatic registration method for frame-less stereotaxy, image guided surgery, and enhanced reality visualization," IEEE Trans. Med. Imag., vol. 15, pp. 129-140, Apr. 1996.
12. H. Haneishi, Y. Yagihashi, and Y. Miyake, "A new method for distortion correction of electronic endoscope images," IEEE Trans. Med. Imag., vol. 14, pp. 548-555, Sept. 1995.
13. E. F. Haponik, S. L. Aquino, and D. J. Vining, "Virtual bronchoscopy," Clin. Chest Med., vol. 20, pp. 201-217, 1999.
14. J. P. Helferty, A. J. Sherbondy, E. A. Hoffman, G. McLennan, and W. E. Higgins, "Experiments in virtual-endoscopy guidance of bronchoscopy," Proc. SPIE, vol. 4321, pp. 111-121, 2001.
15. J. P. Helferty, C. Zhang, G. McLennan, and W. E. Higgins, "Videoendoscopic distortion correction and its application to virtual guidance of endoscopy," IEEE Trans. Med. Imag., vol. 20, pp. 605-617, July 2001.
16. W. E. Higgins, K. Ramaswamy, R. D. Swift, G. McLennan, and E. A. Hoffman, "Virtual bronchoscopy for three-dimensional pulmonary image assessment: State of the art and future needs," Radiographics, vol. 18, pp. 761-778. 1998.
17. D.L.G. Hill, C. R. Maurer, Jr., R. J. Maciunas, J. A. Barwise, J. M. Fitzpatrick, and M. Y. Wang, "Measurement of intraoperative brain surface deformation under a craniotomy," Neurosurgery, vol. 43, pp. 514-526. 1998.
18. P. Jannin, A. Bouliou, J. M. Scarabin, C. Barillot, and J. Luber, "Visual matching between real and virtual images in image guided neurosurgery," Proc. SPIE, vol. 3031, pp. 518-526, 1997.
19. R. Khadem, M. R. Bax, J. A. Johnson, E. P. Wilkinson, and R. Shahidi, "Endoscope calibration and accuracy testing for 3D/2D image registration," in Medical Imaging Computing and Computer-Assisted Intervention (MICCAI) 2001, W. J. Niessen and M. A. Viergever, Eds, Berlin, Germany: Springer-Verlag, 2001, pp. 1361-1362.
20. P. Lacroute and M. Levoy, "Fast volume rendering using a shear-warp factorization of the viewing transformation," in Proc. SIGGRAPH '94, pp. 451-458.
21. D. Laur and P. Hanharan, "Hierarchical splatting: A progressive refinement algorithm for volume rendering," in Comput. Graph. (SIGGRAPH '91), vol. 25, 1991, pp. 285-288.
22. C. R. Maurer, Jr., J. M. Fitzpatrick, M. Y. Wang, R. L. Galloway, Jr., R. J. Maciunas, and G. S. Allen, "Registration of head volume images using implantable fiducial markers," IEEE Trans. Med. Imag., vol. 16, pp. 447-462, Aug. 1997.
23. C. R. Maurer, Jr., D. L. G. Hill, A. J. Martin, H. Liu, M. McCue, D. Rueckert, D. Lloret, W. A. Hall, R. E. Maxwell, D. J. Hawkes, and C. L. Truwit, "Investigation of intraoperative brain deformation using a 1.5 Tesla interventional MR system: Preliminary results," IEEE Trans. Med. Imag., vol. 17, pp. 817-825, Oct. 1998.
24. C. R. Maurer, Jr, T. Rohlfing, D. Dean, J. B. West, D. Rueckert, K. Mori, R. Shahidi, D. P. Martin, M. P. Heilbrun, and R. J. Maciunas, "Sources of error in image registration for cranial image-guided surgery," in Advanced Techniques in Image-Guided Brain and Spine Surgery, I. M. Germano, ed. New York: Thieme, 2002, pp. 10-36.
25. C. R. Maurer, Jr., F. Sauer, B. Bascle, B. Geiger, F. Wenzel, F. Recchi, T. Rohlfing, C. M. Brown, R. S. Bakos, R. J. Maciunas, and A. Bani-Hashemi, "Augmented reality visualization of brain structures with stereo and kinetic depth cues: System description and initial evaluation with head phantom," in Proc. SPIE, vol. 4319, Medical Imaging 2001: Visualization, Display, and Image-Guided Procedures, 2001, pp. 445-456.
26. K. Mori, D. Deguchi, J. Sugiyama, Y. Suenaga, J. Toriwaki, C. R. Maurer, Jr., H. Takabatake, and H. Natori, "A method for camera motion tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images," Med. Image Anal., 2002, to be published.
27. K. Mori, Y. Suenaga, and J. Toriwaki, "Fast volume rendering based on software optimization using multimedia instructions on PC platforms," in Computer Assisted Radiology and Surgery (CARS) 2002, H. U. Lemke, M. W. Vannier, K. Inamura, A. G. Farman, K. Doi, and J. H. C. Reiber, Eds. Berlin: Springer-Verlag, 2002, pp. 467-472.
28. A. Raabe, R. Krishnan, R. Wolff, E. Hermann, M. Zimmermann, and V. Seifert, "Laser surface scanning for patient registration in intracranial image-guided surgery," Neurosurgery, vol. 50, pp. 797-803, 2002.
29. G. D. Rubin, C. F. Beaulieu, V. Argiro, H. Ringl, A. M. Norbash, J. F. Feller, M. D. Dake, R. B. Jeffrey, and S. Napel, "Perspective volume rendering of CT and MR images: Applications for endoscopic imaging," Radiology, vol. 199, pp. 321-330, 1996.
30. W. Schroeder, K. Martin, and W. Lorensen, The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 1998.
31. R. Shahidi, R. Mezrich, and D. Silver, "Proposed simulation of volumetric image navigation using a surgical microscope," J. Image Guid. Surg. (now Comput. Aided Surg.), vol. 1, pp, 249-265, 1995.
32. R. Shahidi, R. Tombropoulos, and R. P. Grzeszczuk, "Clinical applications of three-dimensional rendering of medical data sets," Proc. IEEE, vol. 86, pp. 555-568, 1998.
33. R. Shahidi, B. Wang, M. Epitaux, R. Grzeszczuk, and J. R. Adler, "Volumetric image guidance via a stereotactic endoscope," in Medical Imaging Computing and Computer-Assisted Intervention (MICCAI) 1998, W. M. Wells, III, A. C. F. Colchester, and S. L. Delp, Eds. Berlin, Germany: Springer-Verlag, 1998, pp. 241-252.
34. R. Sibson, "Studies in the robustness of multidimensional scaling: Perturbational analysis of classical scaling," J. Roy. Statist. Soc. B, vol. 41, pp. 217-229, 1979.
35. W. E. Smith, N. Vakil, and S. A. Maislin, "Correction of distortion in endoscope images," IEEE Trans. Med. Imag., vol. 11, pp. 117-122 May 1992.
36. M. Sramek and A. Kaufman, "Fast ray-tracing of rectilinear volume data using distance transforms," IEEE Trans. Visualization Comput. Graph., vol. 6, pp. 236-252, July 2000.
37. J. D. Stefansic, A. J. Herline, Y. Shyr, W. C. Chapman, J. M. Fitzpatrick, B. M. Dawant, and R. L. Galloway, Jr., "Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery," IEEE Trans. Med. Imag., vol. 19, pp. 1012-1023, Oct. 2000.
38. T. Totsuka, and M. Levoy, "Frequency domain volume rendering," in Comput. Graph. (SIGGRAPH '93), vol. 27, 1993, pp. 271-278.
39. R. Y. Tsai, "A versatile camera calibration technique for high-accuracy 3-D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE Trans. Robot. Automat., vol. RA-3, pp. 323-344, Aug. 1987.
40. D. J. Vining, K. Liu, R. H. Choplin, and E. F. Haponik, "Virtual bronchoscopy: Relationships of virtual reality endobronchial simulations to actual bronchoscopic findings," Chest, vol. 109, pp. 549-553, 1996.
41. P. Viola and W. M. Wells, III, "Alignment by maximization of mutual information," Int. J. Comput. Vis., vol. 24, pp. 137-154, 1997.