An evaluation of automatic coronary artery calcium scoring methods with cardiac CT using the orCaScore framework

Medical Physics

Volumn 43, Issue 5, 2016, Pages 2361-2373

  Wolterink, Jelmer M ^a   Leiner, Tim ^b   De Vos, Bob D ^c   Coatrieux, Jean Louis ^d   Kelm, B Michael ^e   Kondo, Satoshi ^f   Salgado, Rodrigo A ^g   Shahzad, Rahil ^h   Shu, Huazhong ⁱ   Snoeren, Miranda ^j   Takx, Richard A P ^k   Van Vliet, Lucas J ^l   Van Walsum, Theo ^m   Willems, Tineke P ⁿ   Yang, Guanyu ^k   Zheng, Yefeng ^m   Viergever, Max A ^a   Išgum, Ivana ^a  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^c UNIVERSITÉ DE RENNES 1   (France)

^d SIEMENS AG   (Germany)

^e Konica Corporation   (Japan)

^f ANTWERP UNIVERSITY HOSPITAL   (Belgium)

^g LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

^h Centre de Recherche en Information Biomedicale Sino Francais CRIBs   (China)

ⁱ RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

^j DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^k ERASMUS MEDICAL CENTER   (Netherlands)

^l UNIVERSITY MEDICAL CENTER GRONINGEN   (Netherlands)

^m South East University   (China)

ⁿ SIEMENS CORPORATE RESEARCH   (United States)

more..

Author keywords

automatic coronary calcium scoring; cardiac CT; cardiovascular disease risk; coronary artery calcification; evaluation framework; independent method comparison

Indexed keywords

AUTOMATION; BIOMINERALIZATION; BLOOD VESSELS; BONE; CARDIOLOGY; COMPUTERIZED TOMOGRAPHY; DISEASES; HEART;

AUTOMATIC CORONARY CALCIUM SCORING; CARDIAC CSCT; CARDIOVASCULAR DISEASE; CARDIOVASCULAR DISEASE RISK; CORONARY ARTERY CALCIFICATION; CORONARY CALCIUM; DISEASE RISKS; EVALUATION FRAMEWORK; INDEPENDENT METHOD COMPARISON; METHOD COMPARISON;

CALCIUM;

ARTERY CALCIFICATION; ARTICLE; CARDIAC IMAGING; CARDIOVASCULAR RISK; CLINICAL PROTOCOL; COMPUTED TOMOGRAPHIC ANGIOGRAPHY; COMPUTED TOMOGRAPHY SCANNER; COMPUTER ASSISTED TOMOGRAPHY; CORONARY ARTERY CALCIUM SCORE; DISEASE CLASSIFICATION; EVALUATION STUDY; FALSE POSITIVE RESULT; HUMAN; MAJOR CLINICAL STUDY; PREDICTIVE VALUE; SENSITIVITY ANALYSIS; AUTOMATED PATTERN RECOGNITION; BLOOD VESSEL CALCIFICATION; CORONARY ANGIOGRAPHY; CORONARY ARTERY DISEASE; CORONARY BLOOD VESSEL; DEVICES; DIAGNOSTIC IMAGING; FEMALE; MALE; METABOLISM; PROCEDURES; RISK FACTOR; SENSITIVITY AND SPECIFICITY; X-RAY COMPUTED TOMOGRAPHY;

CALCIUM;

CALCIUM; CORONARY ANGIOGRAPHY; CORONARY ARTERY DISEASE; CORONARY VESSELS; FEMALE; HUMANS; MALE; PATTERN RECOGNITION, AUTOMATED; RISK FACTORS; SENSITIVITY AND SPECIFICITY; TOMOGRAPHY, X-RAY COMPUTED; VASCULAR CALCIFICATION;

EID: 84966332536     PISSN: 00942405     EISSN: 24734209     Source Type: Journal    
DOI: 10.1118/1.4945696     Document Type: Article

References (43)

1. World Health Organization, WHO Fact Sheet N17: Cardiovascular Diseases, 2013.
2. R. Detrano et al., " Coronary calcium as a predictor of coronary events in four racial or ethnic groups," N. Engl. J. Med. 358, 1336-1345 (2008). 10.1056/NEJMoa072100
3. J. Yeboah, R. L. McClelland, T. S. Polonsky, G. L. Burke, C. T. Sibley, D. O'Leary, J. J. Carr, D. C. Goff, P. Greenland, and D. M. Herrington, " Comparison of novel risk markers for improvement in cardiovascular risk assessment in intermediate-risk individuals," JAMA 308, 788-795 (2012). 10.1001/jama.2012.9624
4. A. Becker, A. Leber, C. Becker, and A. Knez, " Predictive value of coronary calcifications for future cardiac events in asymptomatic individuals," A. Heart J. 155, 154-160 (2008). 10.1016/j.ahj.2007.08.024
5. J. A. Rumberger, B. H. Brundage, D. J. Rader, and G. Kondos, " Electron beam computed tomographic coronary calcium scanning: A review and guidelines for use in asymptomatic persons," Mayo Clin. Proc. 74, 243-252 (1999). 10.4065/74.3.243
6. K. Nasir and M. Clouse, " Role of nonenhanced multidetector CT coronary artery calcium testing in asymptomatic and symptomatic individuals," Radiology 264, 637-649 (2012). 10.1148/radiol.12110810
7. D. C. Goff, D. M. Lloyd-Jones, G. Bennett, S. Coady, R. B. D'Agostino, R. Gibbons, P. Greenland, D. T. Lackland, D. Levy, C. J. O'Donnell, J. G. Robinson, J. S. Schwartz, S. T. Shero, S. C. Smith, P. Sorlie, N. J. Stone, and P. W. F. Wilson, " 2013 ACC/AHA guideline on the assessment ofcardiovascular risk: A report of the American College of Cardiology/American Heart Association task force on practice guidelines," J. Am. Coll. Cardiol. 63, 2935-2959 (2014). 10.1016/j.jacc.2013.11.005
8. A. Schuhbaeck, Y. Otaki, S. Achenbach, C. Schneider, P. Slomka, D. S Berman, and D. Dey, " Coronary calcium scoring from contrast coronary CT angiography using a semiautomated standardized method," J. Cardiovasc. Comput. Tomogr. 9, 446-453 (2015). 10.1016/j.jcct.2015.06.001
9. J. M. Wolterink, T. Leiner, M. A. Viergever, and I. Isgum, " Automatic coronary calcium scoring in cardiac ct angiography using convolutional neural networks," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015, Lecture Notes in Computer Science, edited by N. Navab, J. Hornegger, W. M. Wells, and A. F. Frangi (Springer International, Switzerland, 2015), pp. 589-596.
10. J. M. Wolterink, T. Leiner, R. A. P. Takx, M. A. Viergever, and I. Isgum, " Automatic coronary calcium scoring in non-contrast-enhanced ECG-triggered cardiac CT with ambiguity detection," IEEE Trans. Med. Imaging 34, 1867-1878 (2015). 10.1109/TMI.2015.2412651
11. X. Ding, P. J. Slomka, M. Diaz-Zamudio, G. Germano, D. S. Berman, D. Terzopoulos, and D. Dey, " Automated coronary artery calcium scoring from non-contrast CT using a patient-specific algorithm," Proc. SPIE 9413, 94132U (2015). 10.1117/12.2081633
12. W. Ahmed, M. A. de Graaf, A. Broersen, P. H. Kitslaar, E. Oost, J. Dijkstra, J. J. Bax, J. H. C. Reiber, and A. J. Scholte, " Automatic detection and quantification of the Agatston coronary artery calcium score on contrast computed tomography angiography," Int. J. Cardiovasc. Imaging 31, 151-161 (2014). 10.1007/s10554-014-0519-4
13. Y. Xie, M. D. Cham, C. Henschke, D. Yankelevitz, and A. P. Reeves, " Automated coronary artery calcification detection on low-dose chest CT images," Proc. SPIE 9035, 90350F (2014). 10.1117/12.2043840
14. D. Eilot and R. Goldenberg, " Fully automatic model-based calcium segmentation and scoring in coronary CT angiography," Int. J. Comput. Assisted Radiol. Surg. 9, 595-608 (2014). 10.1007/s11548-013-0955-y
15. R. A. P. Takx, P. A. De Jong, T. Leiner, M. Oudkerk, H. J. De Koning, C. P. Mol, M. A. Viergever, and I. Išgum, " Automated coronary artery calcification scoring in non-gated chest CT: Agreement and reliability," PLoS One 9, e91239 (2014). 10.1371/journal.pone.0091239
16. R. Shahzad, T. van Walsum, M. Schaap, A. Rossi, S. Klein, A. C. Weustink, P. J. de Feyter, L. J. van Vliet, and W. J. Niessen, " Vessel specific coronary artery calcium scoring: An automatic system," Acad. Radiol. 20, 1-9 (2013). 10.1016/j.acra.2012.07.018
17. J. Wu, G. Ferns, J. Giles, and E. Lewis, " A fully automated multi-modal computer aided diagnosis approach to coronary calcium scoring of MSCT images," Proc. SPIE 8315, 83152I (2012). 10.1117/12.904053
18. B. A. Arnold, P. Xiang, M. J. Budoff, and S. S. Mao, " Very small calcifications are detected and scored in the coronary arteries from small voxel MDCT images using a new automated/calibrated scoring method with statistical and patient specific plaque definitions," Int. J. Cardiovasc. Imaging 28, 1193-1204 (2012). 10.1007/s10554-011-9914-2
19. S. Mittal, Y. Zheng, B. Georgescu, F. Vega-Higuera, S. K. Zhou, P. Meer, and D. Comaniciu, " Fast automatic detection of calcified coronary lesions in 3D cardiac CT images," in Machine Learning in Medical Imaging, Lecture Notes in Computer Science, edited by F. Wang, P. Yan, K. Suzuki, and D. Shen (Springer, Berlin, Heidelberg, 2010), pp. 1-9.
20. U. Kurkure, D. R. Chittajallu, G. Brunner, Y. H. Le, and I. A. Kakadiaris, " A supervised classification-based method for coronary calcium detection in non-contrast CT," Int. J. Cardiovasc. Imaging 26, 817-828 (2010). 10.1007/s10554-010-9607-2
21. G. Brunner, D. R. Chittajallu, U. Kurkure, and I. A. Kakadiaris, " Toward the automatic detection of coronary artery calcification in non-contrast computed tomography data," Int. J. Cardiovasc. Imaging 26, 829-838 (2010). 10.1007/s10554-010-9608-1
22. S. C. Saur, H. Alkadhi, L. Desbiolles, G. Szekely, and P. C. Cattin, " Automatic detection of calcified coronary plaques in computed tomography data sets," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2008, Lecture Notes in Computer Science, edited by D. Metaxas, L. Axel, G. Fichtinger, and G. Szekely (Springer, Berlin, Heidelberg, 2008), pp. 170-177.
23. I. Isgum, A. Rutten, M. Prokop, and B. van Ginneken, " Detection of coronary calcifications from computed tomography scans for automated risk assessment of coronary artery disease," Med. Phys. 34, 1450-1461 (2007). 10.1118/1.2710548
24. S. Wesarg, M. F. Khan, and E. A. Firle, " Localizing calcifications in cardiac CT data sets using a new vessel segmentation approach," J. Digital Imaging 19, 249-257 (2006). 10.1007/s10278-006-9947-6
25. D. Dey, V. Y. Cheng, P. J. Slomka, R. Nakazato, A. Ramesh, S. Gurudevan, G. Germano, and D. S. Berman, " Automated 3-dimensional quantification of noncalcified and calcified coronary plaque from coronary CT angiography," J. Cardiovasc. Comput. Tomogr. 3, 372-382 (2009). 10.1016/j.jcct.2009.09.004
26. I. Isgum, M. Prokop, M. Niemeijer, M. A. Viergever, and B. van Ginneken, " Automatic coronary calcium scoring in low-dose chest computed tomography," IEEE Trans. Med. Imaging 31, 2322-2334 (2012). 10.1109/TMI.2012.2216889
27. http://orcascore.isi.uu.nl/.
28. S. Klein, M. Staring, K. Murphy, M. A. Viergever, and J. P. W. Pluim, " Elastix: A toolbox for intensity-based medical image registration," IEEE Trans. Med. Imaging 29, 196-205 (2010). 10.1109/TMI.2009.2035616
29. A. F. Frangi, W. J. Niessen, K. L. Vincken, and M. A. Viergever, " Multiscale vessel enhancement filtering," in Medical Image Computing and Computer-Assisted Interventation (Springer, Berlin, Heidelberg, 1998), pp. 130-137.
30. G. Yang, P. Kitslaar, M. Frenay, A. Broersen, M. J. Boogers, J. J. Bax, J. H. C. Reiber, and J. Dijkstra, " Automatic centerline extraction of coronary arteries in coronary computed tomographic angiography," Int. J. Cardiovasc. Imaging 28, 921-933 (2012). 10.1007/s10554-011-9894-2
31. Y. Zheng, A. Barbu, B. Georgescu, M. Scheuering, and D. Comaniciu, " Four-chamber heart modeling and automatic segmentation for 3-D cardiac CT volumes using marginal space learning and steerable features," IEEE Trans. Med. Imaging 27, 1668-1681 (2008). 10.1109/TMI.2008.2004421
32. Y. Zheng, H. Tek, and G. Funka-Lea, " Robust and accurate coronary artery centerline extraction in CTA by combining model-driven and data-driven approaches," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2013, Lecture Notes in Computer Science, edited by K. Mori, I. Sakuma, Y. Sato, C. Barillot, and N. Navab (Springer, Berlin, Heidelberg, 2013), pp. 74-81.
33. S. L. Salzberg, " On comparing classifiers: Pitfalls to avoid and a recommended approach," Data Min. Knowl. Discovery 1, 317-328 (1997). 10.1023/A:1009752403260
34. A. S. Agatston, W. R. Janowitz, F. J. Hildner, N. R. Zusmer, M. Viamonte, and R. Detrano, " Quantification of coronary artery calcium using ultrafast computed tomography," J. Am. Coll. Cardiol. 15, 827-832 (1990). 10.1016/0735-1097(90)90282-T
35. I. Zeb, N. Abbas, K. Nasir, and M. J. Budoff, " Coronary computed tomography as a cost-effective test strategy for coronary artery disease assessment: A systematic review," Atherosclerosis 234, 426-435 (2014). 10.1016/j.atherosclerosis.2014.02.011
36. G. Gitsioudis, W. Hosch, J. Iwan, A. Voss, E. Atsiatorme, N. P. Hofmann, S. J. Buss, S. Siebert, H.-U. Kauczor, and E. Giannitsis, " When do we really need coronary calcium scoring prior to contrast-enhanced coronary computed tomography angiography? Analysis by age, gender and coronary risk factors," PLoS One 9, e92396 (2014). 10.1371/journal.pone.0092396
37. R. Tota-Maharaj, M. H. Al-Mallah, K. Nasir, W. T. Qureshi, R. Blumenthal, and M. J. Blaha, " Improving the relationship between coronary artery calcium score and coronary plaque burden: Addition of regional measures of coronary artery calcium distribution," Atherosclerosis 238, 126-131 (2014). 10.1016/j.atherosclerosis.2014.11.008
38. E. R. Brown, R. A. Kronmal, D. A. Bluemke, A. D. Guerci, J. J. Carr, J. Goldin, and R. Detrano, " Coronary calcium coverage score: Determination, correlates, and predictive accuracy in the multi-ethnic study of atherosclerosis," Radiology 247, 669-675 (2008). 10.1148/radiol.2473071469
39. M. G. Silverman, J. R. Harkness, R. Blankstein, M. J. Budoff, A. S. Agatston, J. J. Carr, J. A. Lima, R. S. Blumenthal, K. Nasir, and M. J. Blaha, " Baseline subclinical atherosclerosis burden and distribution are associated with frequency and mode of future coronary revascularization: Multi-ethnic study of atherosclerosis," JACC: Cardiovasc. Imaging 7, 476-486 (2014). 10.1016/j.jcmg.2014.03.005
40. M. Schaap et al., " Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms," Med. Image Anal. 13, 701-714 (2009). 10.1016/j.media.2009.06.003
41. C. H. McCollough, S. Ulzheimer, S. S. Halliburton, K. Shanneik, R. D. White, and W. A. Kalender, " Coronary artery calcium: A multi-institutional, multimanufacturer international standard for quantification at cardiac CT," Radiology 243, 527-538 (2007). 10.1148/radiol.2432050808
42. M. J. Willemink, R. Vliegenthart, R. A. P. Takx, T. Leiner, R. P. J. Budde, R. L. A. W. Bleys, M. Das, J. E. Wildberger, M. Prokop, and N. Buls, " Coronary artery calcification scoring with state-of-the-art CT scanners from different vendors has substantial effect on risk classification," Radiology 273, 695-702 (2014). 10.1148/radiol.14140066
43. P. H. Joshi, M. J. Blaha, R. S. Blumenthal, R. Blankstein, and M. P. H. Khurram Nasir MD, " What is the role of calcium scoring in the age of coronary computed tomographic angiography?," J. Nucl. Cardiol. 19, 1226-1235 (2012). 10.1007/s12350-012-9626-6