A system for video-Based navigation for endoscopic endonasal skull base surgery

IEEE Transactions on Medical Imaging

Volumn 31, Issue 4, 2012, Pages 963-976

  Mirota, Daniel J ^a   Wang, Hanzi ^b   Taylor, Russell H ^a   Ishii, Masaru ^c   Gallia, Gary L ^c   Hager, Gregory D ^a  

^a Johns Hopkins University   (United States)

^b XIAMEN UNIVERSITY   (China)

^c DEPARTMENT OF PATHOLOGY   (United States)

Author keywords

Endoscopy; image guided treatment; registration; surgical guidance navigation

Indexed keywords

COMPUTED TOMOGRAPHY; IMAGE FEATURES; IMAGE-GUIDED; POINT CLOUD; REGISTRATION; SKULL BASE; SKULL BASE SURGERY; SUBMILLIMETERS; SURGICAL GUIDANCE; SYSTEM TRACKS; TARGET REGISTRATION ERRORS; VIDEO DATA;

CAMERAS; COMPUTERIZED TOMOGRAPHY; NAVIGATION SYSTEMS; SURGERY; THREE DIMENSIONAL;

ENDOSCOPY;

ALGORITHM; ARTICLE; COMPUTER ASSISTED THERAPY; COMPUTER ASSISTED TOMOGRAPHY; COMPUTER SIMULATION; HUMAN; IMAGE QUALITY; METHODOLOGY; NATURAL ORIFICE TRANSLUMINAL ENDOSCOPIC SURGERY; NOSE CAVITY; REPRODUCIBILITY; SKULL BASE; VIDEORECORDING;

ALGORITHMS; COMPUTER SIMULATION; HUMANS; NASAL CAVITY; NATURAL ORIFICE ENDOSCOPIC SURGERY; PHANTOMS, IMAGING; REPRODUCIBILITY OF RESULTS; SKULL BASE; THERAPY, COMPUTER-ASSISTED; TOMOGRAPHY, X-RAY COMPUTED; VIDEO RECORDING;

EID: 84859762430     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2011.2176500     Document Type: Article

References (44)

1. S. S. Nasseri, J. L. Kasperbauer, S. E. Strome, T. V. McCaffrey, J. L. Atkinson, and F. B. Meyer, "Endoscopic transnasal pituitary surgery: Report on 180 cases," Am. J. Rhinol., vol. 15, no. 4, pp. 281-287, Jul.-Aug. 2001. (Pubitemid 33695071)
2. F. Chassat and S. Lavalle, "Experimental protocol of accuracy evaluation of 6-d localizers for computer-integrated surgery: Application to four optical localizers," in Med. Image Computing Computer-Assisted Intervent. (MICCAI98), 1998, pp. 277-284. (Pubitemid 128152671)
3. R. Shahidi, M. Bax, C. Maurer, Jr., J. Johnson, E.Wilkinson, B.Wang, J. West, M. Citardi, K. Manwaring, and R. Khadem, "Implementation, calibration and accuracy testing of an image-enhanced endoscopy system," IEEE Trans. Med. Imag., vol. 21, no. 12, pp. 1524-1535, Dec. 2002.
4. R. Lapeer,M. S. Chen, G. Gonzalez, A. Linney, and G. Alusi, "Imageenhanced surgical navigation for endoscopic sinus surgery: Evaluating calibration, registration and tracking," Int. J. Med. Robot. Comput. Assist. Surg. vol. 4, no. 1, pp. 32-45, 2008. (Pubitemid 351428330)
5. W. Konen, S. Tombrock, and M. Scholz, "Robust registration procedures for endoscopic imaging," Med. Image Anal. vol. 11, no. 6, pp. 526-539, 2007. (Pubitemid 47629801)
6. C. Winne, M. Khan, F. Stopp, E. Jank, and E. Keeve, "Overlay visualization in endoscopic ENT surgery," Int. J. Comput. Assist. Radiol. Surg. pp. 1-6, 2010.
7. F. Schulze, K. Bhler, A. Neubauer, A. Kanitsar, L. Holton, and S. Wolfsberger, "Intra-operative virtual endoscopy for image guided endonasal transsphenoidal pituitary surgery," Int. J. Comput. Assist. Radiol. Surg. vol. 5, pp. 143-154, 2010.
8. M. J. Daly, H. Chan, E. Prisman, A. Vescan, S. Nithiananthan, J. Qiu, R.Weersink, J. C. Irish, and J. H. Siewerdsen, "Fusion of intraoperative cone-beam CT and endoscopic video for image-guided procedures," in Med. Imag. 2010: Visualizat., Image-Guided Procedures, Model., K. H. Wong and M. I. Miga, Eds., 2010, vol. 7625, no. 1, p. 762503.
9. J. P. Helferty, E. A. Hoffman, G. McLennan, and W. E. Higgins, "CTvideo registration accuracy for virtual guidance of bronchoscopy," in SPIE Med. Imag. 2004: Physiol., Function, Structure Med. Images, A. Amini and A. Manduca, Eds., 2004, vol. 5369.
10. D. Burschka, M. Li, M. Ishii, R. H. Taylor, and G. D. Hager, "Scaleinvariant registration of monocular endoscopic images to CT-scans for sinus surgery," Med. Image Anal. vol. 9, pp. 413-426, October 2005. (Pubitemid 41179339)
11. B. Allain, M. Hu, L. Lovat, R. Cook, S. Ourselin, and D. Hawkes, "Biopsy site re-localisation based on the computation of epipolar lines from two previous endoscopic images," in Medical Image Computing and Computer-Assisted Intervention MICCAI 2009, ser. Lecture Notes in Computer Science, G.-Z. Yang, D. Hawkes, D. Rueckert, A. Noble, and C. Taylor, Eds. New York: Springer, 2009, vol. 5761, pp. 491-498.
12. E. Delponte, F. Isgr, F. Odone, and A. Verri, "SVD-matching using sift features," in Proc. Int. Conf. Vis., Video Graphics, Jul. 2005, pp. 125-132.
13. H.Wang, D. Mirota, and G. D. Hager, "A generalized kernel consensus based robust estimator," IEEE Trans. Pattern Anal. Mach. Intell. vol. 32, no. 1, pp. 178-184, Jan. 2010.
14. K. Mori, D. Deguchi, J. Sugiyama, Y. Suenaga, J. Toriwaki, C. R. M. , Jr., H. Takabatake, and H. Natori, "Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images," Med. Image Anal. vol. 6, pp. 321-336, 2002. (Pubitemid 35282837)
15. X. Luó, M. Feuerstein, D. Deguchi, T. Kitasaka, H. Takabatake, and K. Mori, "Development and comparison of new hybrid motion tracking for bronchoscopic navigation," Med. Image Anal. 2011.
16. D. Mirota, R. H. Taylor, M. Ishii, and G. D. Hager, "Direct endoscopic video registration for sinus surgery," in Proc. SPIE Med. Imag. 2009: Visualizat., Image-Guided Procedures Model. , Feb. 2009, vol. 7261, pp. 72 612K-1-72 612K-8.
17. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis. vol. 60, pp. 91-110, 2004.
18. A. Vedaldi, An implementation of sift detector and descriptor [Online]. Available: http://vision.ucla.edu/~vedaldi/code/sift/sift.html 2006
19. P. Mountney, B. Lo, S. Thiemjarus, D. Stoyanov, and G. Zhong-Yang, "A probabilistic framework for tracking deformable soft tissue in minimally invasive surgery," in Medical Image Computing and Computer-Assisted Intervention MICCAI 2007, ser. Lecture Notes in Computer Science, N. Ayache, S. Ourselin, and A. Maeder, Eds. New York: Springer, 2007, vol. 4792, pp. 34-41.
20. G. L. Scott and H. C. Longuet-Higgins, "An algorithm for associating the features of two images," Proc. Biol. Sci. vol. 244, no. 1309, pp. 21-26, 1991.
21. D. Mirota, H. Wang, R. H. Taylor, M. Ishii, and G. D. Hager, "Toward video-based navigation for endoscopic endonasal skull base surgery," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2009, ser. Lecture Notes in Computer Science, G.-Z. Yang, D. Hawkes, D. Rueckert, A. Noble, and C. Taylor, Eds. New York: Springer, 2009, vol. 5761, pp. 91-99.
22. H. Wang, D. Mirota, M. Ishii, and G. D. Hager, "Robust motion estimation and structure recovery from endoscopic image sequences with an adaptive scale kernel consensus estimator," in IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR 2008), Jun. 2008, pp. 1-7.
23. R. I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 2004, pp. 238-324, 0521540518.
24. D. Nister, "An efficient solution to the five-point relative pose problem," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 6, pp. 756-770, Jun. 2004.
25. Y. Ma, S. Soatto, J. Kosecka, and S. Sastry, An Invitation to 3-D Vision. New York: Springer Verlag, 2004, pp. 107-227.
26. J.-Y. Bouget, The Matlab Camera Calibration Toolkit Jul. 2010 [Online]. Available: http://www.vision.caltech.edu/bouguetj/calib-doc/
27. D. Abretske, D. Mirota, G. Hager, and M. Ishii, "Intelligent frame selection for anatomic reconstruction from endoscopic video," in Workshop Appl. Comput. Vis. (WACV), Dec. 2009, pp. 1-5.
28. K.-M. Lee, P. Meer, and R.-H. Park, "Robust adaptive segmentation of range images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 2, pp. 200-205, Feb. 1998. (Pubitemid 128743514)
29. T. S. Newman and H. Yi, "A survey of the marching cubes algorithm," Computers Graphics vol. 30, no. 5, pp. 854-879, 2006. (Pubitemid 44573407)
30. D. Chetverikov, D. Svirko, D. Stepanov, and P. Krsek, "The trimmed iterative closest point algorithm," in Proc. 16th Int. Conf. Pattern Recognit., 2002, vol. 3, pp. 545-548. (Pubitemid 44844547)
31. S. Du, N. Zheng, S. Ying, Q. You, and Y.Wu, "An extension of the ICP algorithm considering scale factor," in IEEE Int. Conf. Image Process. (ICIP 2007), 2007, vol. 5, pp. 193-196.
32. P. Besl and H. McKay, "A method for registration of 3-D shapes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 239-256, Feb. 1992.
33. E. E. Catmull, "A subdivision algorithm for computer display of curved surfaces," Ph.D. dissertation, Univ. Utah, Salt Lake City, 1974.
34. C.-P. Lu, G. Hager, and E. Mjolsness, "Fast and globally convergent pose estimation from video images," , IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 6, pp. 610-622, Jun. 2000.
35. A. Uneri, S. Schafer, D.Mirota, S. Nithiananthan, Y. Otake, R. Taylor, and J. Siewerdsen, "Trek: An integrated system architecture for intraoperative cone-beam CT-guided surgery," Int. J. Comput. Assist. Radiol. Surg. pp. 1-15, 2011.
36. Python Python Software Foundation [Online]. Available: http://www. python.org/
37. A. Schmolck and V. Rathod, mlabwrap Oct. 2009 [Online]. Available: http://mlabwrap.sourceforge.net/
38. S. Pieper, B. Lorensen, W. Schroeder, and R. Kikinis, "The NA-MIC kit: ITK, VTK, pipelines, grids and 3D slicer as an open platform for the medical image computing community," in Proc. 3rd IEEE Int. Symp. Biomed. Imag.: Nano Macro, Apr. 2006, pp. 698-701. (Pubitemid 44732412)
39. A. Deguet, R. Kumar, R. Taylor, and P. Kazanzides, "The CISST libraries for computer assisted intervention systems," in MIDAS J.-Syst. Architectures Comput. Assist. Intervent. (MICCAI 2008 Workshop), 2008.
40. K. H. Strobl, W. Sepp, S. Fuchs, C. Paredes, and K. Arbter, 2010, DLR CalDe and DLR CalLab [Online]. Available: http://www.robotic. dlr.de/callab/Inst. Robot. Mechatron., German Aerospace Center (DLR), . Oberpfaffenhofen, Germany
41. J. Fitzpatrick and J. West, "The distribution of target registration error in rigid-body point-based registration," IEEE Trans. Med. Imag., vol. 20, no. 9, pp. 917-927, Sep. 2001. (Pubitemid 32992594)
42. D. J. Mirota, A. Uneri, S. Schafer, S. Nithiananthan, D. D. Reh, G. L. Gallia, R. H. Taylor, G. D. Hager, and J. H. Siewerdsen, "High-accuracy 3d image-based registration of endoscopic video to c-arm cone-beam CT for image-guided skull base surgery," in Medical Imaging 2011: Visualization, Image-Guided Procedures, and Modeling. Bellingham , WA: SPIE, 2011, vol. 7964, pp. 79 640J-1-79 640J-10.
43. R. Newcombe and A. Davison, "Live dense reconstruction with a single moving camera," in IEEE Conf.n Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 1498-1505.
44. J. H. Siewerdsen, M. J. Daly, H. Chan, S. Nithiananthan, N. Hamming, K. K. Brock, and J. C. Irish, "High-performance intraoperative conebeam CT on a mobile c-arm: An integrated system for guidance of head and neck surgery," in SPIE Medical Imaging. Bellingham,WA: SPIE, 2009, vol. 7261, p. 72610J.