Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms

Medical Image Analysis

Volumn 13, Issue 5, 2009, Pages 701-714

  Schaap, Michiel ^a   Metz, Coert T ^a   van Walsum, Theo ^a   van der Giessen, Alina G ^a   Weustink, Annick C ^a   Mollet, Nico R ^a   Bauer, Christian ^b   Bogunović, Hrvoje ^c,d   Castro, Carlos ^m,n   Deng, Xiang ^e   Dikici, Engin ^f   O'Donnell, Thomas ^e   Frenay, Michel ^g   Friman, Ola ^h   Hoyos, Marcela Hernández ⁱ   Kitslaar, Pieter H ^g,j   Krissian, Karl ^k   Kühnel, Caroline ^h   Luengo Oroz, Miguel A ^m,n   Orkisz, Maciej ^l   Smedby, Örjan ^o   Styner, Martin ^p   Szymczak, Andrzej ^q   Tek, Hüseyin ^e   Wang, Chunliang ^o   Warfield, Simon K ^r   Zambal, Sebastian ^s   Zhang, Yong ^t   Krestin, Gabriel P ^a   Niessen, Wiro J ^a,u   more..

^a ERASMUS MEDICAL CENTER   (Netherlands)

^b GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

^c Center for Computational Imaging and Simulation Technologies in Biomedicine (CISTIB)   (Spain)

^d UNIVERSITAT POMPEU FABRA   (Spain)

^e SIEMENS CORPORATE RESEARCH   (United States)

^f UNIVERSITY OF FLORIDA COLLEGE OF MEDICINE   (United States)

^g LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

^h FRAUNHOFER MEVIS   (Germany)

ⁱ UNIVERSIDAD DE LOS ANDES   (Colombia)

^j Medis Medical Imaging Systems bv   (Netherlands)

^k UNIVERSITY OF LAS PALMAS DE GRAN CANARIA   (Spain)

^l UNIVERSITÉ LYON 1   (France)

^m UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

ⁿ BIOMATERIALES Y NANOMEDICINA CIBER BBN   (Spain)

^o LINKÖPING UNIVERSITY   (Sweden)

^p UNIVERSITY OF NORTH CAROLINA SCHOOL OF MEDICINE   (United States)

^q Department of Geology and Geological Engineering   (United States)

^r BOSTON CHILDREN S HOSPITAL   (United States)

^s FEDERAL RESEARCH AND TRAINING CENTRE FOR FORESTS   (Austria)

^t HOUSTON METHODIST RESEARCH INSTITUTE   (United States)

^u DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

more..

Author keywords

Centerline extraction; Computed tomography; Coronaries; Standardized evaluation; Tracking

Indexed keywords

COMPUTERIZED TOMOGRAPHY; DATABASE SYSTEMS; EXTRACTION; MEDICAL IMAGING; SURFACE DISCHARGES;

CENTERLINE EXTRACTION; COMPUTED TOMOGRAPHY ANGIOGRAPHY; CORONARIES; EVALUATION FRAMEWORK; EVALUATION METHODOLOGIES; QUANTITATIVE EVALUATION; REFERENCE DATABASE; STANDARDIZED EVALUATION;

HEART;

ACCURACY; ALGORITHM; ARTICLE; BIOMEDICAL TECHNOLOGY ASSESSMENT; CALCULATION; COMPUTED TOMOGRAPHIC ANGIOGRAPHY; COMPUTER INTERFACE; COMPUTER PREDICTION; COMPUTER PROGRAM; CORONARY ARTERY; IMAGE ANALYSIS; IMAGE QUALITY; INFORMATION PROCESSING; INFORMATION RETRIEVAL; INTERMETHOD COMPARISON; ONLINE SYSTEM; PRIORITY JOURNAL; REFERENCE DATABASE; RELIABILITY; WEB BROWSER;

ALGORITHMS; CORONARY ANGIOGRAPHY; HUMANS; NETHERLANDS; PATTERN RECOGNITION, AUTOMATED; RADIOGRAPHIC IMAGE ENHANCEMENT; RADIOGRAPHIC IMAGE INTERPRETATION, COMPUTER-ASSISTED; REFERENCE VALUES; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SOFTWARE; SOFTWARE VALIDATION; TOMOGRAPHY, X-RAY COMPUTED;

EID: 68949196294     PISSN: 13618415     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.media.2009.06.003     Document Type: Article

References (75)

1. Armato S.G., McLennan G., McNitt-Gray M.F., Meyer C.R., Yankelevitz D., Aberle D.R., Henschke C.I., Hoffman E.A., Kazerooni E.A., MacMahon H., Reeves A.P., Croft B.Y., Clarke L.P., and L.I.D.C.R. Group. Lung image database consortium: developing a resource for the medical imaging research community. Radiology 232 3 (2004) 739-748
2. Bartz, D., Lakare, S., 2005. Scaffolding-based segmentation of coronary vascular structures. In: Proc. of Fourth International Workshop on Volume Graphics, pp. 47-54.
3. Bauer, C., Bischof, H., 2008. Edge based tube detection for coronary artery centerline extraction. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
4. Bauer, C., Bischof, H., 2008. A novel approach for detection of tubular objects and its application to medical image analysis. In: Proc. of DAGM, pp. 163-172.
5. Bauer, C., Bischof, H., 2008. Extracting curve skeletons from gray value images for virtual endoscopy. In: Proc. of MIAR, pp. 393-402.
6. Bouraoui, B., Ronse, C., Baruthio, J., Passat, N., Germain, P., 2008. Fully automatic 3D segmentation of coronary arteries based on mathematical morphology. In: Proc. of IEEE ISBI, pp. 1059-1062.
7. Bülow, T., Lorenz, C., Renisch, S., 2004. A general framework for tree segmentation and reconstruction from medical volume data. In: Proc. of MICCAI. Lecture Notes in Computer Science, vol. 3216, pp. 533-540.
8. Busch S., Johnson T.R.C., Nikolaou K., von Ziegler F., Knez A., Reiser M.F., and Becker C.R. Visual and automatic grading of coronary artery stenoses with 64-slice ct angiography in reference to invasive angiography. Eur. Radiol. 17 6 (2007) 1445-1451
9. Cademartiri F., Grutta L.L., Palumbo A., Malagutti P., Pugliese F., Meijboom W.B., Baks T., Mollet N.R., Bruining N., Hamers R., and de Feyter P.J. Non-invasive visualization of coronary atherosclerosis: state-of-art. J. Cardiovasc. Med. 8 3 (2007) 129-137
10. Carrillo J., Hoyos M., Davila E., and Orkisz M. Recursive tracking of vascular tree axes in 3d medical images. Int. J. Comput. Assist. Radiol. Surg. 1 6 (2007) 331-339
11. Castro, C., Luengo-Oroz, M.A., Santos, A., Ledesma-Carbayo, M.J., 2008. Coronary artery tracking in 3D cardiac CT images using local morphological reconstruction operators. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
12. Dewey M., Schnapauff D., Laule M., Lembcke A., Borges A.C., Rutsch W., Hamm B., and Rogalla P. Multislice CT coronary angiography: evaluation of an automatic vessel detection tool. Rofo 176 4 (2004) 478-483
13. Dikici, E., O'Donnell, T., Grady, L., Setser, R., White, R., 2008. Coronary artery centerline tracking using axial symmetries. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
14. Einstein A.J., Moser K.W., Thompson R.C., Cerqueira M.D., and Henzlova M.J. Radiation dose to patients from cardiac diagnostic imaging. Circulation 116 11 (2007) 1290-1305
15. Florin, C., Moreau-Gobard, R., Williams, J., 2004. Automatic heart peripheral vessels segmentation based on normal MIP ray casting technique. In: Proc. of MICCAI. Lecture Notes in Computer Science, vol. 3217, pp. 483-490.
16. Florin, C., Paragios, N., Williams, J., 2006. Globally optimal active contours, sequential Monte Carlo and on-line learning for vessel segmentation. In: Proc. of ECCV. Lecture Notes in Computer Science, vol. 3954, pp. 476-489.
17. Frangi, A.F., Niessen, W.J., Vincken, K.L., Viergever, M.A., 1998. Multiscale vessel enhancement filtering. In: Proc. of MICCAI. Lecture Notes in Compter Science, vol. 1496, pp. 130-137.
18. Friman, O., Kühnel, C., Peitgen, H.-O., 2008. Coronary artery centerline extraction using multiple hypothesis tracking and minimal paths. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
19. Gulsun, M.A., Tek, H., 2008. Robust tree modeling. In: Proc. of MICCAI, vol. 5241, pp. 602-611.
20. Hecht H.S. Applications of multislice coronary computed tomographic angiography to percutaneous coronary intervention: how did we ever do without it?. Catheter. Cardiovasc. Interv. 71 4 (2008) 490-503
21. Hennemuth A., Bock S., Boskamp T., Fritz D., Kühnel C., Rinck D., Scheuering M., and Peitgen H.O. One-click coronary tree segmentation in CT angiographic images. Comput. Assist. Radiol. Surg. 1 (2005) 317-321
22. Hernández Hoyos M., Orkisz M., Douek P.C., and Magnin I.E. Assessment of carotid artery stenoses in 3D contrast-enhanced magnetic resonance angiography, based on improved generation of the centerline. Mach. Graph. Vision 14 4 (2005) 349-378
23. Hong M.-K., Mintz G.S., Lee C.W., Lee B.-K., Yang T.-H., Kim Y.-H., Song J.-M., Han K.-H., Kang D.-H., Cheong S.-S., Song J.-K., Kim J.-J., Park S.-W., and Park S.-J. The site of plaque rupture in native coronary arteries: a three-vessel intravascular ultrasound analysis. J. Am. Coll. Cardiol. 46 2 (2005) 261-265
24. Hoover A., Jean-Baptiste G., Jiang X., Flynn P., Bunke H., Goldgof D., Bowyer K., Eggert D., Fitzgibbon A., and Fisher R. An experimental comparison of range image segmentation algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 18 7 (1996) 673-689
25. Hernández Hoyos, M., Zuluaga, M.A., Lozano, M., Prieto, J.C., Douek, P.C., Magnin, I.E., Orkisz, M., 2008. Coronary centerline tracking in CT images with use of an elastic model and image moments. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
26. Kanitsar, A., Fleischmann, D., Wegenkittl, R., Felkel, P., Grller, M.E., 2002. CPR - Curved Planar Reformation. In: Proc. of IEEE Visualization.
27. Khan M.F., Wesarg S., Gurung J., Dogan S., Maataoui A., Brehmer B., Herzog C., Ackermann H., Assmus B., and Vogl T.J. Facilitating coronary artery evaluation in MDCT using a 3D automatic vessel segmentation tool. Eur. Radiol. 16 8 (2006) 1789-1795
28. Kitslaar, P., Frenay, M., Oost, E., Dijkstra, J., Stoel, B., Reiber, J.H., 2008. Connected component and morpholgy based extraction of arterial centerlines of the heart (CocomoBeach). The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
29. Krissian, K., Bogunovic, H., Pozo, J., Villa-Uriol, M., Frangi, A., 2008. Minimally interactive knowledge-based coronary tracking in CTA using a minimal cost path. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
30. Larralde, A., Boldak, C., Garreau, M., Toumoulin, C., Boulmier, D., Rolland, Y., 2003. Evaluation of a 3D segmentation software for the coronary characterization in multi-slice computed tomography. In: Proc. of Functional Imaging and Modeling of the Heart, pp. 1005-1005.
31. Lavi, G., Lessick, J., Johnson, P., Khullar, D., 2004. Single-seeded coronary artery tracking in CT angiography. In: Proc. of IEEE Nuclear Science Symposium Conference Record, vol. 5, pp. 3308-3311.
32. Leber A.W., Becker A., Knez A., von Ziegler F., Sirol M., Nikolaou K., Ohnesorge B., Fayad Z.A., Becker C.R., Reiser M., Steinbeck G., and Boekstegers P. Accuracy of 64-slice computed tomography to classify and quantify plaque volumes in the proximal coronary system: a comparative study using intravascular ultrasound. J. Am. Coll. Cardiol. 47 3 (2006) 672-677
33. Lesage, D., Angelini, E., Bloch, I., Funka-Lea, G., 2008. Medial-based Bayesian tracking for vascular segmentation: application to coronary arteries in 3D CT angiography. In: Proc. of IEEE ISBI, pp. 268-271.
34. Leschka S., Alkadhi H., Plass A., Desbiolles L., Grünenfelder J., Marincek B., and Wildermuth S. Accuracy of MSCT coronary angiography with 64-slice technology: first experience. Eur. Heart J. 26 15 (2005) 1482-1487
35. Li H., and Yezzi A. Vessels as 4-D curves: global minimal 4-D paths to extract 3-D tubular surfaces and centerlines. IEEE Trans. Med. Imaging 26 (2007) 1213-1223
36. Lorenz C., and von Berg J. A comprehensive shape model of the heart. Med. Image Anal. 10 4 (2006) 657-670
37. Lorenz, C., Renisch, S., Schlathoelter, T., Buelow, T., 2003. Simultaneous segmentation and tree reconstruction of the coronary arteries in MSCT images. In: Proc. of SPIE: Medical Imaging, vol. 5031, pp. 167-177.
38. Luengo-Oroz, M.A., Ledesma-Carbayo, M.J., Gómez-Diego, J.J., Garci{dotless}́a-Fernández, M.A., Desco, M., Santos, A., 2007. Extraction of the coronary artery tree in cardiac computer tomographic images using morphological operators. In: Functional Imaging and Modeling of the Heart, Lecture Notes in Computer Science, vol. 4466. Springer, pp. 424-432.
39. Marquering H.A., Dijkstra J., de Koning P.J.H., Stoel B.C., and Reiber J.H.C. Towards quantitative analysis of coronary CTA. Int. J. Cardiovasc. Imaging 21 1 (2005) 73-84
40. Martin, D., Fowlkes, C., Tal, D., Malik, J., 2001. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proc. of ICCV 2001, vol. 2. pp. 416-423.
41. Metz, C., Schaap, M., van der Giessen, A., van Walsum, T., Niessen, W., 2007. Semi-automatic coronary artery centerline extraction in computed tomography angiography data. In: Proc. of IEEE ISBI, pp. 856-859.
42. Metz, C., Schaap, M., van Walsum, T., van der Giessen, A., Weustink, A., Mollet, N., Krestin, G., Niessen, W., 2008. 3D segmentation in the clinic: a grand challenge II - coronary artery tracking. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
43. Metz, C., Schaap, M., van Walsum, T., Niessen, W., 2008. Two point minimum cost path approach for CTA coronary centerline extraction. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
44. Mowatt G., Cummins E., Waugh N., Walker S., Cook J., Jia X., Hillis G.S., and Fraser C. Systematic review of the clinical effectiveness and cost-effectiveness of 64-slice or higher computed tomography angiography as an alternative to invasive coronary angiography in the investigation of coronary artery disease. Health Technol. Assess. 12 17 (2008) iii-iv, ix-143
45. Nain, D., Yezzi, A., Turk, G., 2004. Vessel segmentation using a shape driven flow. In: Proc. of MICCAI. Lecture Notes in Computer Science, vol. 4191, pp. 51-59.
46. Olabarriaga S., Breeuwer M., and Niessen W. Minimum cost path algorithm for coronary artery central axis tracking in CT images. Proc. of MICCAI. Lecture Notes in Computer Science vol. 2879 (2003), Springer 687-694
47. Ramcharitar S., Pugliese F., Schultz C., Ligthart J., de Feyter P., Li H., Mollet N., van de Ent M., Serruys P.W., and van Geuns R.J. Integration of multislice computed tomography with magnetic navigation facilitates percutaneous coronary interventions without additional contrast agents. J. Am. Coll. Cardiol. 53 9 (2009) 741-746
48. Renard, F., Yang, Y., 2008. Image analysis for detection of coronary artery soft plaques in MDCT images. In: Proc. of IEEE ISBI, pp. 25-28.
49. Ropers D., Rixe J., Anders K., Küttner A., Baum U., Bautz W., Daniel W.G., and Achenbach S. Usefulness of multidetector row spiral computed tomography with 64 × 0.6 mm collimation and 330-ms rotation for the noninvasive detection of significant coronary artery stenoses. Am. J. Cardiol. 97 3 (2006) 343-348
50. Rosamond W., Flegal K., Furie K., Go A., Greenlund K., Haase N., Hailpern S.M., Ho M., Howard V., Kissela B., Kittner S., Lloyd-Jones D., McDermott M., Meigs J., Moy C., Nichol G., O'Donnell C., Roger V., Sorlie P., Steinberger J., Thom T., Wilson M., Hong Y., Committee A.H.A.S., and Subcommittee S.S. Heart Disease and Stroke Statistics-2008 Update: A report from the American Heart Association Statistics Committee and Stroke Statistics Subcommittee. Circulation 117 4 (2008) 25-146
51. Schaap, M., Smal, I., Metz, C., van Walsum, T., Niessen, W., 2007. Bayesian tracking of elongated structures in 3D images. In: Proc. of IPMI. Lecture Notes in Computer Science, vol. 4584, pp. 74-85.
52. Scharstein D., and Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vision 47 (2002) 7-42
53. Staal J., Abramoff M., Niemeijer M., Viergever M., and van Ginneken B. Ridge based vessel segmentation in color images of the retina. IEEE Trans. Med. Imaging 23 4 (2004) 501-509
54. Szymczak, A., 2008. Vessel tracking by connecting the dots. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
55. Szymczak A., Stillman A., Tannenbaum A., and Mischaikow K. Coronary vessel trees from 3D imagery: a topological approach. Med. Image Anal. 10 4 (2006) 548-559
56. Tek, H., Gulsun, M.A., Laguitton, S., Grady, L., Lesage, D., Funka-Lea, G., 2008. Automatic coronary tree modeling. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
57. van Ginneken, B., Heimann, T., Styner, M., 2007. 3D Segmentation in the clinic: a grand challenge. In: 3D Segmentation in the Clinic: A Grand Challenge, pp. 7-15.
58. van Walsum, T., Schaap, M., Metz, C.T., van der Giessen, A.G., Niessen, W.J., 2008. Averaging centerlines: mean shift on paths. In: Proc. of MICCAI, vol. 11 (Pt 1), pp. 900-907.
59. Wang, C., Smedby, O., 2008. An automatic seeding method for coronary artery segmentation and skeletonization in CTA. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
60. Wang J.C., Normand S.-L.T., Mauri L., and Kuntz R.E. Coronary artery spatial distribution of acute myocardial infarction occlusions. Circulation 110 3 (2004) 278-284
61. Wang, C., Smedby, O., 2007. Coronary artery segmentation and skeletonization based on competing fuzzy connectedness tree. In: Proc. of MICCAI. Lecture Notes in Computer Science, vol. 4791, pp. 311-318.
62. Warfield S., Zou K., and Wells W. Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans. Med. Imaging 23 7 (2004) 903-921
63. Wesarg, S., Firle, E., 2004. Segmentation of vessels: the corkscrew algorithm. In: Proc. of SPIE: Medical Imaging, vol. 9, p. 10.
64. Wesarg S., Khan M.F., and Firle E.A. Localizing calcifications in cardiac CT data sets using a new vessel segmentation approach. J. Digit. Imaging 19 3 (2006) 249-257
65. West J., Fitzpatrick J.M., Wang M.Y., Dawant B.M., Maurer C.R., Kessler R.M., Maciunas R.J., Barillot C., Lemoine D., Collignon A., Maes F., Suetens P., Vandermeulen D., van den Elsen P.A., Napel S., Sumanaweera T.S., Harkness B., Hemler P.F., Hill D.L., Hawkes D.J., Studholme C., Maintz J.B., Viergever M.A., Malandain G., and Woods R.P. Comparison and evaluation of retrospective intermodality brain image registration techniques. J. Comput. Assist. Tomogr. 21 4 (1997) 554-566
66. Weustink A.C., Mollet N.R., Pugliese F., Meijboom W.B., Nieman K., Heijenbrok-Kal M.H., Flohr T.G., Neefjes L.A.E., Cademartiri F., de Feyter P.J., and Krestin G.P. Optimal electrocardiographic pulsing windows and heart rate: effect on image quality and radiation exposure at dual-source coronary CT angiography. Radiology 248 3 (2008) 792-798
67. World Health Organization (WHO), The top ten causes of death - Fact sheet N310, October 2008.
68. Xu C., and Prince J.L. Snakes, shapes, and gradient vector flow. IEEE Trans. Image Process. 7 3 (1998) 359-369
69. Yang, Y., Zhu, L., Haker, S., Tannenbaum, A.R., Giddens, D.P., 2005. Harmonic skeleton guided evaluation of stenoses in human coronary arteries. In: Proc. of MICCAI, vol. 8, pp. 490-497.
70. Yang, G., Bousse, A., Toumoulin, C., Shu, H., 2006. A multiscale tracking algorithm for the coronary extraction in MSCT angiography. In: Proc. of IEEE Engineering in Medicine and Biology Society, vol. 1, pp. 3066-3069.
71. Yang, Y., Tannenbaum, A., Giddens, D., Stillman, A., 2007. Automatic segmentation of coronary arteries using Bayesian driven implicit surfaces. In: Proc. of IEEE ISBI, pp. 189-192.
72. Zambal, S., Hladuvka, J., Kanitsar, A., Bühler, K., 2008. Shape and appearance models for automatic coronary artery tracking. The Midas Journal. In: MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
73. Zanzonico P., Rothenberg L.N., and Strauss H.W. Radiation exposure of computed tomography and direct intracoronary angiography: risk has its reward. J. Am. Coll. Cardiol. 47 9 (2006) 1846-1849
74. Zhang, Y., Chen, K., Wong, S., 2008. 3D interactive centerline extraction. The Midas Journal. In: 2008 MICCAI Workshop - Grand Challenge Coronary Artery Tracking. .
75. Zhu, H., Ding, Z., Piana, R.N., Gehrig, T.R., Friedman, M.H. Cataloguing the geometry of the human coronary arteries: a potential tool for predicting risk of coronary artery disease. Int. J. Cardiol.