Robust 3-D airway tree segmentation for image-guided peripheral bronchoscopy

IEEE Transactions on Medical Imaging

Volumn 29, Issue 4, 2010, Pages 982-997

  Graham, Michael W ^a   Gibbs, Jason D ^b   Cornish, Duane C ^c   Higgins, William E ^d  

^a GOOGLE INC   (United States)

^b Broncus Technologies Inc   (United States)

^c The Pennsylvania State University   (United States)

^d PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Airway tree segmentation; Image guided intervention; Lung cancer; Multidetector computed tomography (MDCT); Three dimensional (3 D) pulmonary imaging; Virtual bronchoscopy

Indexed keywords

AIRWAY TREE SEGMENTATION; IMAGE-GUIDED INTERVENTION; LUNG CANCER; MULTIDETECTOR COMPUTED TOMOGRAPHY; PULMONARY IMAGING; VIRTUAL BRONCHOSCOPY;

ABERRATIONS; BIOLOGICAL ORGANS; COMPUTERIZED TOMOGRAPHY; ENDOSCOPY; IMAGE SEGMENTATION;

THREE DIMENSIONAL;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; BRONCHOSCOPY; BRONCHUS; COMPUTER ASSISTED DIAGNOSIS; COMPUTER ASSISTED SURGERY; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BRONCHI; BRONCHOSCOPY; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MODELS, BIOLOGICAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SURGERY, COMPUTER-ASSISTED;

EID: 77950385866     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2009.2035813     Document Type: Article

References (51)

1. J. Ueno, T. Murase, K. Yoneda, T. Tsujikawa, S. Sakiyama, and K. Kondoh, "Three-dimensional imaging of thoracic diseases with multi-detector row CT," J. Med. Invest., vol. 51, no. 3/4, pp. 163-170, Aug. 2004. (Pubitemid 39610910)
2. N. C. Dalrymple,S. R. Prasad,M. W.Freckleton, and K.N.Chintapalli, "Introduction to the language of three-dimensional imaging with mul-tidetector CT," Radiographics, vol.25, no.5, pp. 1409-1428, Sep./Oct. 2005.
3. G. D. Rubin, "MDCT: A new era in imaging," Eur. Radiol. Suppl., vol.16, no.4, pp. D3-D10, Aug. 2006.
4. F. Asano, Y. Matsuno, N. Shinagawa, K. Yamazaki, T. Suzuki, and H. Moriya, "A virtual bronchoscopic navigation system for pulmonary peripheral lesions," Chest, vol.130, no.2, pp. 559-566, Aug. 2006. (Pubitemid 44267027)
5. N. Shinagawa et al., "Factors related to diagnostic sensitivity using an ultrathin bronchoscope under CT guidance," Chest, vol.131, no.2, pp. 549-553, Feb. 2007. (Pubitemid 46280418)
6. N. Shinagawa et al., "Virtual bronchoscopic navigation system shortens the examination time: Feasibility study of virtual broncho-scopic navigation system," Lung Cancer, vol.56, no.2, pp. 201-206, May 2007. (Pubitemid 46590483)
7. F. Asano et al., "Diagnosis of peripheral pulmonary lesions using a bronchoscope insertion guidance system combined with endobronchial ultrasonography with a guide sheath," Lung Cancer, vol.60, no.3, pp. 366-373, Jun. 2008. (Pubitemid 351726355)
8. T. R. Gildea, P. J. Mazzone, D. Karnak, M. Meziane, and A. C. Mehta, "Electromagnetic navigation diagnostic bronchoscopy: A prospective study," Amer. J. Resp. Crit. Care Med., vol.174, no.9, pp. 982-989, Nov. 2006. (Pubitemid 44684446)
9. S. L. Wood, "Visualization and modeling of 3-D structures," IEEE Eng. Med. Biol. Soc. Mag., vol.11, no.2, pp. 72-79, Jun. 1992.
10. P. Santago and H. D. Gage, "Statistical models of partial volume ef-fect," IEEE Trans. Image Process., vol.4, no.11, pp. 1531-1540, Nov. 1995.
11. M. S. Brown, M. F. McNitt-Gray, N. J. Mankovich, J. G. Goldin, J. Hiller, L. S. Wilson, and D. R. Aberle, "Method for segmenting chest CT image data using an anatomical model: Preliminary results," IEEE Trans. Med. Imag., vol.16, no.6, pp. 828-839, Dec. 1997. (Pubitemid 127770442)
12. K. Mori, J. Hasegawa, J. Toriwaki, H. Anno, and K. Katada, "Recog-nition of bronchus in three dimensional X-ray CT images with application to virtualized bronchoscopy system," in Proc. 13th Int. Conf. Pattern Recognit., Aug. 1996, vol. III, no. 4, pp. 528-532.
13. A. P. Kiraly, W. E. Higgins, E. A. Hoffman, G. McLennan, and J. M. Reinhardt, "3-D human airway segmentation methods for virtual bron-choscopy," Acad. Radiol., vol.9, no.10, pp. 1153-1168, Oct. 2002.
14. J. Tschirren, E. A. Hoffman, G. McLennan, and M. Sonka, "Intratho-racic airway trees: Segmentation and airway morphology analysis from low-dose CT scans," IEEE Trans. Med. Imag., vol.24, no.12, pp. 1529-1539, Dec. 2005. (Pubitemid 41812021)
15. R. M. Summers, D. H. Feng, S. M. Holland, M. C. Sneller, and J. H. Shelhamer, "Virtual bronchoscopy: Segmentation method for real-time display," Radiology, vol.200, no.3, pp. 857-862, Sep. 1996. (Pubitemid 26282293)
16. K. Mori, J. Hasegawa, Y. Suenaga, and J. Toriwaki, "Automated anatomical labeling of the bronchial branch and its application to the virtual bronchoscopy system," IEEE Trans. Med. Imag., vol.19, no.2, pp. 103-114, Feb. 2000. (Pubitemid 30594810)
17. T. Tozaki et al., "Pulmonary organs analysis for differential diagnosis based on thoracic thin-section CT images," IEEE Trans. Nucl. Sci., vol.45, no.6, pp. 3075-3082, Dec. 1998. (Pubitemid 128741103)
18. T. Tozaki, Y. Kawata, N. Niki, and H. Ohmatsu, "Extraction and clas-sification of pulmonary organs based on thoracic 3-D CT images," Syst. Comput. Jpn., vol.32, no.9, pp. 42-53, Aug. 2001. (Pubitemid 32828592)
19. T. Y. Law and P. A. Heng, K. M. Hanson, Ed., "Automated extrac-tion of bronchus from 3-D CT images of lung based on genetic algo-rithm and 3-D region growing," in Proc. SPIE Med. Imag. 2000, Image Process., vol.3979, pp. 906-916.
20. M. Suter, J. Tschirren, J. Reinhardt, M. Sonka, E. Hoffman, W. Hig-gins, and G. McLennan, "Evaluation of the human airway with multi-detector X-ray-computed tomography and optical imaging," Physiol. Meas., vol.25, pp. 837-847, Aug. 2004. (Pubitemid 39121168)
21. C. Pisupati, L. Wolff, W. Mitzner, and E. Zerhouni, "Segmentation of 3-D pulmonary trees using mathematical morphology," in Proc. Math. Morphol. Appl. Image Signal Process., May 1996, pp. 409-416.
22. F. Prêteux, C. Fetita, P. Grenier, and A. Capderou, "Modeling, seg-mentation and caliber estimation of bronchi in high-resolution com-puterized tomography," J. Electron. Imag., vol.8, no.1, pp. 36-45, Jan. 1999. (Pubitemid 129595412)
23. C. Fetita, F. Preteux, C. Beigelman-Aubry, and P. Grenier, "Pulmonary airways: 3-D reconstruction from multislice CT and clinical investiga-tion," IEEE Trans. Med. Imag., vol.23, no.11, pp. 1353-1364, Nov. 2004.
24. D. Aykac, E. A. Hoffman, G. McLennan, and J. M. Reinhardt, "Seg-mentation and analysis of the human airway tree from three-dimen-sional X-ray CT images," IEEE Trans. Med. Imag., vol.22, no.8, pp. 940-950, Aug. 2003.
25. R. D. Swift, A. P. Kiraly, A. J. Sherbondy, A. L. Austin, E. A. Hoffman, G. McLennan, and W. E. Higgins, "Automatic axes-generation for virtual bronchoscopic assessment of major airway obstructions," Comput. Med. Imag. Graph., vol.26, no.2, pp. 103-118, Mar./Apr. 2002. (Pubitemid 34119115)
26. T. Schlathoelter, C. Lorenz, I. C. Carlsen, and S. Renisch, M. Sonka and J. M. Fitzpatrick, Eds., "Simultaneous segmentation and tree re-construction of the airways for virtual bronchoscopy," in Proc. SPIE Med. Imag. 2002, Image Process., 2002, vol.4684, pp. 103-113. (Pubitemid 35237249)
27. D. Mayer, D. Bartz, J. Fischer, S. Ley, and A. del Río, "Hybrid segmen-tation and virtual bronchoscopy based on CT images," Acad. Radiol., vol.11, no.5, pp. 551-565, May 2004. (Pubitemid 38533859)
28. M. Sonka, W. Park, and E. A. Hoffman, "Rule-based detection of in-trathoracic airway trees," IEEE Trans. Med. Imag., vol.15, no.3, pp. 314-326, Jun. 1996. (Pubitemid 126780322)
29. W. Park, E. A. Hoffman, and M. Sonka, "Segmentation of intrathoratic airway trees: A fuzzy logic approach," IEEE Trans. Med. Imag., vol.17, no.4, pp. 489-497, Aug. 1998. (Pubitemid 128747705)
30. S. A. Merritt, J. D. Gibbs, K. C. Yu, V. Patel, L. Rai, D. C. Cornish, R. Bascom, and W. E. Higgins, "Real-time image-guided bronchoscopy for peripheral lung lesions: A phantom study," Chest, vol.134, no.5, pp. 1017-1026, Nov. 2008.
31. J. D. Gibbs, M. W. Graham, and W. E. Higgins, "3-D MDCT-based system for planning peripheral bronchoscopic procedures," Comput. Biol. Med., vol.39, no.3, pp. 266-279, Mar. 2009.
32. M. W. Graham, J. D. Gibbs, D. C. Cornish, M. Khan, R. Bascom, and W. E. Higgins, "Image-based guidance for bronchoscopy to the pe-riphery," Chest, submitted for publication.
33. G. N. Hounsfield, "Computerized transverse axial scanning (tomog-raphy) 1. Description of system," Brit. J. Radiol., vol.46, no.552, pp. 1016-1022, Dec. 1973.
34. W. Kalender, Computed Tomography: Fundamentals, System Technology, Image Quality, Applications. Munich, Germany: Publicis MCD Verlag, 2000.
35. J. M. Reinhardt, N. D. D'Souza, and E. A. Hoffman, "Accurate mea-surement of intrathoracic airways," IEEE Trans. Med. Imag., vol.16, no.6, pp. 820-827, Dec. 1997.
36. W. E. Higgins, J. P. Helferty, K. Lu, S. A. Merritt, L. Rai, and K. C. Yu, "3-D CT-video fusion for image-guided bronchoscopy," Comput. Med. Imag. Graph., vol.32, no.3, pp. 159-173, Apr. 2008.
37. R. M. Haralick and L. G. Shapiro, Computer and Robot Vision. Boston, MA: Addison-Wesley/Longman, 1992, vol.I.
38. D. E. Knuth, Art of Computer Programming, Volume 3: Sorting and Searching, 2nd ed. Reading, MA: Addison-Wesley, 1998.
39. T. Cormen, C. Leiserson, and R. Rivest, Introduction to Algorithms. Cambridge, MA: MIT Press, 1990.
40. D. H. Ballard and C. M. Brown, Computer Vision. Englewood Cliffs, NJ: Prentice-Hall, 1982.
41. D. Hearn and M. P. Baker, Computer Graphics With OpenGL, 3rd ed. Upper Saddle River, NJ: Prentice-Hall, 2004.
42. J. Tschirren, G. McLennan, K. Palagyi, E. A. Hoffman, and M. Sonka, "Matching and anatomical labeling of human airway tree,"IEEE Trans. Med. Imag., vol.24, no.12, pp. 1540-1547, Dec. 2005. (Pubitemid 41812022)
43. D. S. Johnson and K. A. Niemi, "On knapsacks, partitions, and a new dynamic programming technique for trees," Math. Oper. Res., vol.8, no.1, pp. 1-14, Feb. 1983.
44. X. Dong and G. C. Shaw, "The critical-item, upper bounds, and a branch-and-bound algorithm for the tree knapsack problem," Networks, vol.31, no.4, pp. 205-216, Apr. 1998. (Pubitemid 128096271)
45. M. W. Graham, "Robust methods for human airway tree segmentation and anatomical-tree matching," Ph.D. dissertation, Pennsylvania State Univ., University Park, Aug. 2008.
46. K. Lu and W. E. Higgins, "Interactive segmentation based on the live wire for 3-D CT chest image analysis," Int. J. Comput. Assist. Radiol. Surg., vol. 2, no. 3/4, pp. 151-167, Dec. 2007.
47. F. H. Netter, Atlas of Human Anatomy, 4th ed. Philadelphia, PA: Saunders, 2006.
48. K. C. Yu, J. D. Gibbs, M. W. Graham, andW. E.Higgins, "Image-based reporting for bronchoscopy," J. Digit. Imag., vol.23, no.1, pp. 39-50, Feb. 2010.
49. K. Lu, S. A. Merritt, and W. E. Higgins, M. L. Giger and N. Karsse-meijer, Eds., "Extraction and visualization of the central chest lymph-node stations," in Proc. SPIE Med. Imag. 2008, Comput.-Aided Diagnosis, Apr., vol.6915, pp. 69 151B-1-69 151B-15.
50. K. Lu, W. E. Higgins, R. Bascom, and R. P. Mahraj, N. Karssemeijer and M.L. Giger, Eds., "Quantitative analysis of the central-chest lymph nodes based on 3-D MDCT image data," in Proc. SPIE Med. Imag. 2009, Comput.-Aided Diagnosis, Mar., vol.7260, pp. 72 600U-1-72 600U-9.
51. M. W. Graham, J. D. Gibbs, and W. E. Higgins, J. P. W. Pluim and J. M. Reinhardt, Eds., "A robust system for human airway tree segmen-tation," in Proc. SPIE Med. Imag. 2008, Image Process., vol.6914, pp. 69 141J-1-69 141J-18