Fully automated echocardiogram interpretation in clinical practice: Feasibility and diagnostic accuracy

Circulation

Volumn 138, Issue 16, 2018, Pages 1623-1635

  Zhang, Jeffrey ^a,f   Gajjala, Sravani ^a   Agrawal, Pulkit ^f   Tison, Geoffrey H ^b   Hallock, Laura A ^f   Beussink Nelson, Lauren ^g   Lassen, Mats H ^b   Fan, Eugene ^b   Aras, Mandar A ^b   Jordan, Cha Randle ^b   Fleischmann, Kirsten E ^b   Melisko, Michelle ^g   Qasim, Atif ^g   Shah, Sanjiv J ^g   Bajcsy, Ruzena ^f   Deo, Rahul C ^a,b,c,d,e,h  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Department of Medicine ^*  (United States)

^c Institute for Human Genetics   (United States)

^d UCSF Institute for Health and Aging   (United States)

^e Center for Care Innovations   (United States)

^f UNIVERSITY OF CALIFORNIA   (United States)

^g NORTHWESTERN UNIVERSITY   (United States)

^h UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

diagnosis; echocardiography; machine learning

Indexed keywords

CYCLOPHOSPHAMIDE; DOXORUBICIN; TRASTUZUMAB;

ADULT; ALGORITHM; ARCHITECTURE; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATION; CARDIOTOXICITY; CHEMOTHERAPY; CLINICAL PRACTICE; COHORT ANALYSIS; DEFIBRILLATION; DIAGNOSTIC ACCURACY; ECHOCARDIOGRAPHY; FEASIBILITY STUDY; FEMALE; HEART AMYLOIDOSIS; HEART DISEASE; HEART FUNCTION; HEART LEFT VENTRICLE EJECTION FRACTION; HEART LEFT VENTRICLE ENDDIASTOLIC VOLUME; HEART LEFT VENTRICLE ENDSYSTOLIC VOLUME; HEART LEFT VENTRICLE MASS; HEART RATE; HEART VENTRICLE HYPERTROPHY; HUMAN; HYPERTROPHIC CARDIOMYOPATHY; IMAGE ANALYSIS; IMAGE SEGMENTATION; LUNG PRESSURE; MAJOR CLINICAL STUDY; MALE; PRIORITY JOURNAL; PULMONARY HYPERTENSION; RECEIVER OPERATING CHARACTERISTIC; AMYLOIDOSIS; COMPUTER ASSISTED DIAGNOSIS; DIAGNOSTIC IMAGING; HEART LEFT VENTRICLE FUNCTION; HEART STROKE VOLUME; PATHOPHYSIOLOGY; PREDICTIVE VALUE; PROCEDURES; REPRODUCIBILITY; VALIDATION STUDY;

AMYLOIDOSIS; AUTOMATION; CARDIOMYOPATHY, HYPERTROPHIC; DEEP LEARNING; ECHOCARDIOGRAPHY; HUMANS; HYPERTENSION, PULMONARY; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PREDICTIVE VALUE OF TESTS; REPRODUCIBILITY OF RESULTS; STROKE VOLUME; VENTRICULAR FUNCTION, LEFT;

EID: 85055611001     PISSN: 00097322     EISSN: 15244539     Source Type: Journal    
DOI: 10.1161/CIRCULATIONAHA.118.034338     Document Type: Article

References (27)

1. Hill JA, Olson EN. Cardiac plasticity. N Engl J Med. 2008;358:1370-1380. doi: 10.1056/NEJMra072139
2. Ishizu T, Seo Y, Kameda Y, Kawamura R, Kimura T, Shimojo N, Xu D, Murakoshi N, Aonuma K. Left ventricular strain and transmural distribution of structural remodeling in hypertensive heart disease. Hypertension. 2014;63:500-506. doi: 10.1161/HYPERTENSIONAHA.113.02149
3. Neskovic AN, Edvardsen T, Galderisi M, Garbi M, Gullace G, Jurcut R, Dalen H, Hagendorff A, Lancellotti P, Popescu BA, Sicari R, Stefanidis A; European Association of Cardiovascular Imaging Document Reviewers:. Focus cardiac ultrasound: The European Association of Cardiovascular Imaging viewpoint. Eur Heart J Cardiovasc Imaging. 2014;15:956-960. doi: 10.1093/ehjci/jeu081
4. Andrus BW, Welch HG. Medicare services provided by cardiologists in the United States: 1999-2008. Circ Cardiovasc Qual Outcomes. 2012;5:31-36. doi: 10.1161/CIRCOUTCOMES.111.961813
5. Szeliski R. Computer Vision: Algorithms and Applications. London: Springer-Verlag; 2011.
6. Bajcsy R, Kovačič S. Multiresolution elastic matching. Computer Vision, Graphics, and Image Processing. 1989;46:1-21.
7. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, Venugopalan S, Widner K, Madams T, Cuadros J, Kim R, Raman R, Nelson PC, Mega JL, Webster DR. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316:2402-2410. doi: 10.1001/jama.2016.17216
8. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542:115-118. doi: 10.1038/nature21056
9. Gersh BJ, Maron BJ, Bonow RO, Dearani JA, Fifer MA, Link MS, Naidu SS, Nishimura RA, Ommen SR, Rakowski H, Seidman CE, Towbin JA, Udelson JE, Yancy CW; American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. 2011 ACCF/AHA Guideline for the Diagnosis and Treatment of Hypertrophic Cardiomyopathy: A report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. Developed in collaboration with the American Association for Thoracic Surgery, American Society of Echocardiography, American Society of Nuclear Cardiology, Heart Failure Society of America, Heart Rhythm Society, Society for Cardiovascular Angiography and Interventions, and Society of Thoracic Surgeons. J Am Coll Cardiol. 2011;58:e212-e260. doi: 10.1016/j.jacc.2011.06.011
10. LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521:436-444. doi: 10.1038/nature14539
11. Maaten L, Hinton G. Visualizing data using t-SNE. J Mach Learn Res. 2008;9:2579-2605.
12. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay É. Scikit-learn: Machine learning in Python. J Mach Learn Res. 2011;12:2825-2830.
13. Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L, Flachskampf FA, Foster E, Goldstein SA, Kuznetsova T, Lancellotti P, Muraru D, Picard MH, Rietzschel ER, Rudski L, Spencer KT, Tsang W, Voigt JU. Recommendations for cardiac chamber quantification by echocardiography in adults: An update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr. 2015;28:1.e14-39.e14. doi: 10.1016/j.echo.2014.10.003
14. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307-310.
15. Milan A, Caserta MA, Dematteis A, Naso D, Pertusio A, Magnino C, Puglisi E, Rabbia F, Pandian NG, Mulatero P, Veglio F. Blood pressure levels, left ventricular mass and function are correlated with left atrial volume in mild to moderate hypertensive patients. J Hum Hypertens. 2009;23:743-750. doi: 10.1038/jhh.2009.15
16. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics. 1988;44:837-845.
17. Abadi M, Agarwal A, Barham P, Chen J, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, Kudlur M, Levenberg J, Monga R, Moore S, Murray DG, Steiner B, Tucker P, Vasudevan V, Warden P, Wicke M, Yu Y, Zheng X. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. OSDI. 2016;16:265-283.
18. van der Walt S, Schönberger JL, Nunez-Iglesias J, Boulogne F, Warner JD, Yager N, Gouillart E, Yu T; scikit-image contributors. scikit-image: Image processing in Python. PeerJ. 2014;2:e453. doi: 10.7717/peerj.453
19. Khamis H, Zurakhov G, Azar V, Raz A, Friedman Z, Adam D. Automatic apical view classification of echocardiograms using a discriminative learning dictionary. Med Image Anal. 2017;36:15-21. doi: 10.1016/j. media.2016.10.007
20. Gao X, Li W, Loomes M, Lianyi W. A fused deep learning architecture for viewpoint classification of echocardiography. Inf Fusion. 2017;36:103-113.
21. Madani A, Arnaout R, Mofrad M, Arnaout R. Fast and accurate view classification of echocardiograms using deep learning. NPJ Digit Med. 2018; 6:1-8.
22. Narayan HK, Finkelman B, French B, Plappert T, Hyman D, Smith AM, Margulies KB, Ky B. Detailed echocardiographic phenotyping in breast cancer patients: Associations with ejection fraction decline, recovery, and heart failure symptoms over 3 years of follow-up. Circulation. 2017;135:1397-1412. doi: 10.1161/CIRCULATIONAHA.116.023463
23. Falk RH. Cardiac amyloidosis: A treatable disease, often overlooked. Circulation. 2011;124:1079-1085. doi: 10.1161/CIRCULATIONAHA.110.010447
24. Bosch JG, Mitchell SC, Lelieveldt BP, Nijland F, Kamp O, Sonka M, Reiber JH. Automatic segmentation of echocardiographic sequences by active appearance motion models. IEEE Trans Med Imaging. 2002;21:1374-1383. doi: 10.1109/TMI.2002.806427
25. Smistad E, Ostvik A, Haugen BO, Lovstakken L. 2D left ventricle segmentation using deep learning. 2017 IEEE International Ultrasonics Symposium (IUS);2017:1-4.
26. Koh HK. Improving health and health care in the United States: Toward a state of complete well-being. JAMA. 2016;316:1679-1681. doi: 10.1001/ jama.2016.12414
27. Braunwald E. The war against heart failure: The Lancet lecture. Lancet. 2015;385:812-824. doi: 10.1016/S0140-6736(14)61889-4