Automatic coronary artery calcium scoring in cardiac CT angiography using paired convolutional neural networks

Medical Image Analysis

Volumn 34, Issue , 2016, Pages 123-136

  Wolterink, Jelmer M ^a   Leiner, Tim ^b   de Vos, Bob D ^a   van Hamersvelt, Robbert W ^b   Viergever, Max A ^a   Išgum, Ivana ^a  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

Author keywords

Automatic calcium scoring; Cardiac CT angiography; Convolutional neural network; Coronary artery calcifications

Indexed keywords

ANGIOGRAPHY; BIOMINERALIZATION; BONE; CALCIUM; CLASSIFICATION (OF INFORMATION); CONVOLUTION; HEART; NEURAL NETWORKS; PATTERN RECOGNITION; THREE DIMENSIONAL COMPUTER GRAPHICS;

AUTOMATIC CALCIUM SCORING; BOUNDING BOX DETECTIONS; CARDIAC CT; CONVOLUTIONAL NEURAL NETWORK; CORONARY ARTERY CALCIFICATION; CORONARY ARTERY CALCIUMS; INDEPENDENT PREDICTORS; PATTERN RECOGNITION METHOD;

COMPUTERIZED TOMOGRAPHY;

ADIPOSE TISSUE; AGATSTON SCORE; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOANALYSIS; CARDIOVASCULAR RISK; COMPARATIVE STUDY; COMPUTED TOMOGRAPHIC ANGIOGRAPHY; COMPUTED TOMOGRAPHY SCANNER; CONTROLLED STUDY; CORONARY ANGIOGRAPHY; CORONARY ARTERY CALCIUM SCORE; HUMAN; IMAGE RECONSTRUCTION; LUNG PARENCHYMA; MAJOR CLINICAL STUDY; PRIORITY JOURNAL; ALGORITHM; CORONARY ARTERY DISEASE; DIAGNOSTIC IMAGING; METABOLISM; PROCEDURES; REPRODUCIBILITY; RISK FACTOR; SENSITIVITY AND SPECIFICITY;

CALCIUM;

ALGORITHMS; CALCIUM; COMPUTED TOMOGRAPHY ANGIOGRAPHY; CORONARY ARTERY DISEASE; HUMANS; NEURAL NETWORKS (COMPUTER); REPRODUCIBILITY OF RESULTS; RISK FACTORS; SENSITIVITY AND SPECIFICITY;

EID: 84975747881     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2016.04.004     Document Type: Article

References (50)

1. Agatston, A.S., Janowitz, W.R., Hildner, F.J., Zusmer, N.R., Viamonte, M., Detrano, R., Quantification of coronary artery calcium using ultrafast computed tomography. J. Am. Coll. Cardiol. 15:4 (1990), 827–832.
2. Ahmed, W., de Graaf, M.A., Broersen, A., Kitslaar, P.H., Oost, E., Dijkstra, J., Bax, J.J., Reiber, J.H., Scholte, A.J., Automatic detection and quantification of the Agatston coronary artery calcium score on contrast computed tomography angiography. Int. J. Cardiovasc. Imag. 31:1 (2014), 151–161.
3. Al-Mallah, M.H., Aljizeeri, A., Alharthi, M., Alsaileek, A., Routine low-radiation-dose coronary computed tomography angiography. Eur. Heart J. Suppl. 16:suppl B (2014), B12–B16.
4. Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I. J., Bergeron, A., Bouchard, N., Bengio, Y., 2012. Theano: new features and speed improvements. Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop.
5. van der Bijl, N., Joemai, R.M., Geleijns, J., Bax, J.J., Schuijf, J.D., de Roos, A., Kroft, L.J., Assessment of Agatston coronary artery calcium score using contrast-enhanced CT coronary angiography. AJR Am. J. Roentgenol. 195:6 (2010), 1299–1305.
6. Brown, E.R., Kronmal, R.A., Bluemke, D.A., Guerci, A.D., Carr, J.J., Goldin, J., Detrano, R., Coronary calcium coverage score: determination, correlates, and predictive accuracy in the multi-ethnic study of atherosclerosis. Radiology 247:3 (2008), 669–675.
7. Ciompi, F., de Hoop, B., van Riel, S.J., Chung, K., Scholten, E.T., Oudkerk, M., de Jong, P.A., Prokop, M., van Ginneken, B., Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box. Med. Imag. Anal. 26:1 (2015), 195–202.
8. de Vos, B.D., Wolterink, J.M., De Jong, P.A., Viergever, M.A., Isgum, I., 2D image classification for 3D anatomy localization; employing deep convolutional neural networks. SPIE Medical Imaging, 9784, 2016, International Society for Optics and Photonics, 97841Y.
9. Ding, X., Slomka, P.J., Diaz-Zamudio, M., Germano, G., Berman, D.S., Terzopoulos, D., Dey, D., Automated coronary artery calcium scoring from non-contrast ct using a patient-specific algorithm. SPIE Medical Imaging, 2015, International Society for Optics and Photonics, 94132U.
10. Dodge, J., Brown, B.G., Bolson, E.L., Dodge, H.T., Lumen diameter of normal human coronary arteries. influence of age, sex, anatomic variation, and left ventricular hypertrophy or dilation. Circulation 86:1 (1992), 232–246.
11. Eilot, D., Goldenberg, R., Fully automatic model-based calcium segmentation and scoring in coronary CT angiography. Int. J. Comput. Assist. Radiol. Surg. 9:4 (2014), 595–608.
12. Farabet, C., Couprie, C., Najman, L., LeCun, Y., Scene parsing with multiscale feature learning, purity trees, and optimal covers. Proceedings of the International Conference on Machine Learning (ICML'12), 2012.
13. Funka-Lea, G., Boykov, Y., Florin, C., Jolly, M.-P., Moreau-Gobard, R., Ramaraj, R., Rinck, D., Automatic heart isolation for CT coronary visualization using graph-cuts. IEEE International Symposium on Biomedical Imaging (ISBI), 2006, IEEE, 614–617.
14. Glodny, B., Helmel, B., Trieb, T., Schenk, C., Taferner, B., Unterholzner, V., Strasak, A., Petersen, J., A method for calcium quantification by means of CT coronary angiography using 64-multidetector CT: very high correlation with Agatston and volume scores. Eur. Radiol. 19:7 (2009), 1661–1668.
15. Glorot, X., Bengio, Y., Understanding the difficulty of training deep feedforward neural networks. Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 2010, 249–256.
16. Glorot, X., Bordes, A., Bengio, Y., Deep sparse rectifier networks. Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, 15, 2011, 315–323.
17. Hecht, H.S., Coronary artery calcium scanning: Past, present, and future. JACC: cardiovasc. Imag. 8:5 (2015), 579–596.
18. Hoffmann, U., Siebert, U., Bull-Stewart, A., Achenbach, S., Ferencik, M., Moselewski, F., Brady, T.J., Massaro, J.M., ODonnell, C.J., Evidence for lower variability of coronary artery calcium mineral mass measurements by multi-detector computed tomography in a community-based cohort - consequences for progression studies. Eur. J. Radiol. 57:3 (2006), 396–402.
19. Hong, C., Becker, C.R., Schoepf, U.J., Ohnesorge, B., Bruening, R., Reiser, M.F., Coronary artery calcium: absolute quantification in nonenhanced and contrast-enhanced multi–detector row CT studies. Radiology 223:2 (2002), 474–480.
20. Isgum, I., Prokop, M., Niemeijer, M., Viergever, M.A., van Ginneken, B., Automatic coronary calcium scoring in low-dose chest computed tomography. IEEE Trans. Med. Imaging 31:12 (2012), 2322–2334.
21. Išgum, I., Rutten, A., Prokop, M., van Ginneken, B., Detection of coronary calcifications from computed tomography scans for automated risk assessment of coronary artery disease. Medical physics 34:4 (2007), 1450–1461.
22. Joshi, P.H., Blaha, M.J., Blumenthal, R.S., Blankstein, R., Nasir, K., What is the role of calcium scoring in the age of coronary computed tomographic angiography?. J. Nucl. Cardiol. 19:6 (2012), 1226–1235.
23. Krizhevsky, A., Sutskever, I., Hinton, G.E., Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 2012, 1097–1105.
24. Kurkure, U., Chittajallu, D.R., Brunner, G., Le, Y.H., Kakadiaris, I.A., A supervised classification-based method for coronary calcium detection in non-contrast CT. Int. J. Cardiovasc. Imag. 26:7 (2010), 817–828.
25. Long, J., Shelhamer, E., Darrell, T., Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, 3431–3440.
26. McCollough, C.H., Ulzheimer, S., Halliburton, S.S., Shanneik, K., White, R.D., Kalender, W.A., Coronary artery calcium: A multi-institutional, multimanufacturer international standard for quantification at cardiac ct. Radiology 243:2 (2007), 527–538.
27. Messenger, B., Li, D., Nasir, K., Carr, J.J., Blankstein, R., Budoff, M.J., Coronary calcium scans and radiation exposure in the multi-ethnic study of atherosclerosis. Int. J. Cardiovasc. Imag., 2015, 1–5.
28. Mittal, S., Zheng, Y., Georgescu, B., Vega-Higuera, F., Zhou, S.K., Meer, P., Comaniciu, D., Fast automatic detection of calcified coronary lesions in 3D cardiac CT images. Wang, F., Yan, P., Suzuki, K., Shen, D., (eds.) Machine Learning in Medical Imaging Lecture Notes in Computer Science, 6357, 2010, Springer Berlin Heidelberg, 1–9.
29. Mylonas, I., Alam, M., Amily, N., Small, G., Chen, L., Yam, Y., Hibbert, B., Chow, B.J., Quantifying coronary artery calcification from a contrast-enhanced cardiac computed tomography angiography study. Eur. Heart J. Cardiovasc. Imag. 15:2 (2014), 210–215.
30. Otton, J.M., Lønborg, J.T., Boshell, D., Feneley, M., Hayen, A., Sammel, N., Sesel, K., Bester, L., McCrohon, J., A method for coronary artery calcium scoring using contrast-enhanced computed tomography. J. Cardiovasc. Comput. Tomogr. 6:1 (2012), 37–44.
31. Pavitt, C.W., Harron, K., Lindsay, A.C., Ray, R., Zielke, S., Gordon, D., Rubens, M.B., Padley, S.P., Nicol, E.D., Deriving coronary artery calcium scores from CT coronary angiography: a proposed algorithm for evaluating stable chest pain. Int. J. Cardiovasc. Imag. 30:6 (2014), 1135–1143.
32. Prasoon, A., Petersen, K., Igel, C., Lauze, F., Dam, E., Nielsen, M., Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N., (eds.) Medical Image Computing and Computer-Assisted Intervention - MICCAI 2013 Lecture Notes in Computer Science, 8150, 2013, Springer Berlin Heidelberg, 246–253.
33. Raff, G.L., Chinnaiyan, K.M., Cury, R.C., Garcia, M.T., Hecht, H.S., Hollander, J.E., O'Neil, B., Taylor, A.J., Hoffmann, U., SCCT guidelines on the use of coronary computed tomographic angiography for patients presenting with acute chest pain to the emergency department: a report of the Society of Cardiovascular Computed Tomography Guidelines Committee. J. Cardiovasc. Comput. Tomogr. 8:4 (2014), 254–271.
34. Roth, H.R., Lu, L., Seff, A., Cherry, K.M., Hoffman, J., Wang, S., Liu, J., Turkbey, E., Summers, R.M., A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations. Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R., (eds.) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2014 Lecture Notes in Computer Science, 8673, 2014, Springer International Publishing, 520–527.
35. Schaap, M., Metz, C.T., van Walsum, T., van der Giessen, A.G., Weustink, A.C., Mollet, N.R., Bauer, C., Bogunović, H., Castro, C., Deng, X., et al. Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms. Med. Imag. Anal. 13:5 (2009), 701–714.
36. Schuhbaeck, A., Otaki, Y., Achenbach, S., Schneider, C., Slomka, P., Berman, D.S., Dey, D., Coronary calcium scoring from contrast coronary CT angiography using a semiautomated standardized method. J. Cardiovasc. Comput. Tomogr. 9:5 (2015), 446–453.
37. Setio, A.A.A., Ciompi, F., Litjens, G., Gerke, P., Jacobs, C., van Riel, S., Wille, M.W., Naqibullah, M., Sanchez, C., van Ginneken, B., Pulmonary nodule detection in ct images: false positive reduction using multi-view convolutional networks. IEEE Trans. Med. Imag., PP(99), 2016, 10.1109/TMI.2016.2536809 1–1.
38. Shahzad, R., van Walsum, T., Schaap, M., Rossi, A., Klein, S., Weustink, A.C., de Feyter, P.J., van Vliet, L.J., Niessen, W.J., Vessel specific coronary artery calcium scoring: An automatic system. Acad. Radiol. 20:1 (2013), 1–9.
39. Simonyan, K., Zisserman, A., Very deep convolutional networks for large-scale image recognition. International Conference on Learning Representations, 2015.
40. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R., Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15:1 (2014), 1929–1958.
41. Stollenga, M.F., Byeon, W., Liwicki, M., Schmidhuber, J., Parallel multi-dimensional LSTM, with application to fast biomedical volumetric image segmentation. Advances in Neural Information Processing Systems, 2015, 2980–2988.
42. Teßmann, M., Vega-Higuera, F., Bischoff, B., Hausleiter, J., Greiner, G., Automatic detection and quantification of coronary calcium on 3D CT angiography data. CSRDC 26:1 (2011), 117–124.
43. Voros, S., Qian, Z., Agatston score tried and true: by contrast, can we quantify calcium on CTA?. J. Cardiovasc. Comput. Tomogr. 6:1 (2012), 45–47.
44. Wesarg, S., Khan, M.F., Firle, E.A., Localizing calcifications in cardiac CT data sets using a new vessel segmentation approach. J. Digit. Imaging. 19:3 (2006), 249–257.
45. Wolterink, J.M., Leiner, T., Takx, R.A.P., Viergever, M.A., Isgum, I., Automatic coronary calcium scoring in non-contrast-enhanced ECG-triggered cardiac CT with ambiguity detection. IEEE Trans. Med. Imag. 34:9 (2015), 1867–1878.
46. Wolterink, J.M., Leiner, T., Viergever, M.A., Isgum, I., Automatic coronary calcium scoring in cardiac CT angiography using convolutional neural networks. Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F., (eds.) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 Lecture Notes in Computer Science, 9349, 2015, Springer International Publishing, 589–596.
47. Wolterink, J. M., Leiner, T., de Vos, B. D., Coatrieux, J.-L., Kelm, B. M., Kondo, S., Salgado, R. A., Shahzad, R., Shu, H., Snoeren, M., Takx, R. A. P., van Vliet, L. J., van Walsum, T., Willems, T. P., Yang, G., Zheng, Y., Viergever, M. A., Išgum, I., An evaluation of automatic coronary artery calcium scoring methods with cardiac CT using the orCaScore framework. Medical Phys. doi: 10.1118/1.4945696.
48. Yeboah, J., McClelland, R.L., Polonsky, T.S., Burke, G.L., Sibley, C.T., OLeary, D., Carr, J.J., Goff, D.C., Greenland, P., Herrington, D.M., Comparison of novel risk markers for improvement in cardiovascular risk assessment in intermediate-risk individuals. JAMA 308:8 (2012), 788–795.
49. Zheng, Y., Liu, D., Georgescu, B., Nguyen, H., Comaniciu, D., 3D deep learning for efficient and robust landmark detection in volumetric data. Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F., (eds.) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 Lecture Notes in Computer Science, 9349, 2015, Springer International Publishing, 565–572.
50. Zhuang, X., Bai, W., Song, J., Zhan, S., Qian, X., Shi, W., Lian, Y., Rueckert, D., Multiatlas whole heart segmentation of CT data using conditional entropy for atlas ranking and selection. Medical Phys. 42:7 (2015), 3822–3833.