Mid-level image representations for real-time heart view plane classification of echocardiograms

Computers in Biology and Medicine

Volumn 66, Issue , 2015, Pages 66-81

  Penatti, Otávio A B ^a,b   Werneck, Rafael de O ^a   de Almeida, Waldir R ^a   Stein, Bernardo V ^a   Pazinato, Daniel V ^a   Mendes Júnior, Pedro R ^a   Torres, Ricardo da S ^a   Rocha, Anderson ^a  

^a UNIVERSITY OF CAMPINAS   (Brazil)

^b Advanced Technologies Group   (Brazil)

Author keywords

Echocardiography; Feature extraction; Image classification; Pattern analysis; Real time systems

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); COMPUTER VISION; ECHOCARDIOGRAPHY; EXTRACTION; FEATURE EXTRACTION; IMAGE PROCESSING; IMPORTANCE SAMPLING; INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS; REAL TIME SYSTEMS;

CHARACTERIZATION PROCEDURES; CLASSIFICATION ACCURACY; IMAGE REPRESENTATIONS; IMAGE TRANSFORMATIONS; PATTERN ANALYSIS; ULTRASOUND IMAGES; VISION COMMUNITIES; VISUAL RECOGNITION;

IMAGE CLASSIFICATION;

ARTICLE; DIAGNOSTIC ACCURACY; ECHOCARDIOGRAPHY; HEART; HEART LEFT VENTRICLE; HUMAN; IMAGE ANALYSIS; IMAGE QUALITY; MACHINE LEARNING; PRIORITY JOURNAL; RANDOM FOREST; REAL TIME ECHOGRAPHY; REAL TIME ULTRASOUND SCANNER; SIGNAL NOISE RATIO; SUPPORT VECTOR MACHINE; VISUAL MEMORY; ALGORITHM; AUTOMATED PATTERN RECOGNITION; CARDIAC MUSCLE; IMAGE PROCESSING; PATHOLOGY; PHYSIOLOGY; PROCEDURES; RECEIVER OPERATING CHARACTERISTIC; REPRODUCIBILITY; STATISTICAL MODEL;

ALGORITHMS; ECHOCARDIOGRAPHY; HEART; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MACHINE LEARNING; MODELS, STATISTICAL; MYOCARDIUM; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; ROC CURVE;

EID: 84941619213     PISSN: 00104825     EISSN: 18790534     Source Type: Journal    
DOI: 10.1016/j.compbiomed.2015.08.004     Document Type: Article

References (47)

1. S. Ebadollahi, S.-F. Chang, H. Wu, Automatic view recognition in echocardiogram videos using parts-based representation, in: Conference on Computer Vision and Pattern Recognition, vol. 2, 2004, pp. II-2-II-9, http://dx.doi.org/10.1109/CVPR.2004.1315137.
2. Aschkenasy S.V., Jansen C., Osterwalder R., Linka A., Unser M., Marsch S., Hunziker P. Unsupervised image classification of medical ultrasound data by multiresolution elastic registration. Ultrasound Med. Biol. 2006, 32(7):1047-1054. 10.1016/j.ultrasmedbio.2006.03.010.
3. M. E. Otey, J. Bi, S. Krishnan, B. Rao, J. Stoeckel, A. Katz, J. Han, S. Parthasarathy, Automatic view recognition for cardiac ultrasound images, in: International Workshop on Computer Vision for Intravascular and Intracardiac Imaging, 2006, pp. 187-194.
4. J. H. Park, S. Zhou, C. Simopoulos, J. Otsuki, D. Comaniciu, Automatic cardiac view classification of echocardiogram, in: International Conference on Computer Vision, 2007, pp. 1-8, http://dx.doi.org/10.1109/ICCV.2007.4408867.
5. S. R. Snare, S. A. Aase, O. C. Mjlstad, H. Dalen, F. Orderud, H. Torp, Automatic real-time view detection, in: International Ultrasonics Symposium, 2009, pp. 2304-2307, http://dx.doi.org/10.1109/ULTSYM.2009.5441530.
6. R. Kumar, F. Wang, D. Beymer, T. Syeda-Mahmood, Echocardiogram view classification using edge filtered scale-invariant motion features, in: Conference on Computer Vision and Pattern Recognition, 2009, pp. 723-730, http://dx.doi.org/10.1109/CVPR.2009.5206838.
7. D. Agarwal, K.S. Shriram, N. Subramanian, Automatic view classification of echocardiograms using histogram of oriented gradients, in: International Symposium on Biomedical Imaging, 2013, pp. 1368-1371, http://dx.doi.org/10.1109/ISBI.2013.6556787.
8. H. Wu, D.M. Bowers, T.T. Huynh, R. Souvenir, Echocardiogram view classification using low-level features, in: International Symposium on Biomedical Imaging, 2013, pp. 752-755, http://dx.doi.org/10.1109/ISBI.2013.6556584.
9. Y. Qian, L. Wang, C. Wang, X. Gao, The synergy of 3d sift and sparse codes for classification of viewpoints from echocardiogram videos, in: Medical Content-Based Retrieval for Clinical Decision Support, vol. 7723, Springer, Berlin, Heidelberg, 2013, pp. 68-79, http://dx.doi.org/10.1007/978-3-642-36678-9_7.
10. K. Chykeyuk, M. Yaqub, J. Alison Noble, Class-specific regression random forest for accurate extraction of standard planes from 3d echocardiography, in: Medical Computer Vision. Large Data in Medical Imaging, Springer International Publishing, Springer 2014, pp. 53-62, http://dx.doi.org/10.1007/978-3-319-05530-5_6.
11. Ribeiro M.X., Bugatti P.H., Jr.C.T., Marques P.M.A., Rosa N.A., Traina A.J.M. Supporting content-based image retrieval and computer-aided diagnosis systems with association rule-based techniques. Data Knowl. Eng. 2009, 68(12):1370-1382. 10.1016/j.datak.2009.07.002.
12. J. C. Felipe, A.J.M. Traina, C.T. Jr., Retrieval by content of medical images using texture for tissue identification, in: IEEE Symposium on Computer Medical System, 2003, pp. 175-180.
13. Lang R.M., Bierig M., Devereux R.B., Flachskampf F.A., Foster E., Pellikka P.A., Picard M.H., Roman M.J., Seward J., Shanewise J., Solomon S., Spencer K.T., St John Sutton M., Stewart W. Recommendations for chamber quantification. Eur. Hear. J.-Cardiovasc. Imaging 2006, 7(2):79-108. 10.1016/j.euje.2005.12.014.
14. van de Sande K.E.A., Gevers T., Snoek C.G.M. Empowering visual categorization with the gpu. IEEE Trans. Multimed. 2011, 13(1):60-70. 10.1109/TMM.2010.2091400.
15. Y.-L. Boureau, F. Bach, Y. LeCun, J. Ponce, Learning mid-level features for recognition, in: Conference on Computer Vision and Pattern Recognition, 2010, pp. 2559-2566, http://dx.doi.org/10.1109/CVPR.2010.5539963.
16. van Gemert J.C., Veenman C.J., Smeulders A.W.M., Geusebroek J.-M. Visual word ambiguity. Trans. Pattern Anal. Mach. Intell. 2010, 32(7):1271-1283. 10.1109/TPAMI.2009.132.
17. W. F. Armstrong, T. Ryan, H. Feigenbaum, Feigenbaum's Echocardiography, M - Medicine Series, Wolters Kluwer Health/Lippincott Williams & Wilkins, 2010, http://dx.doi.org/10.1111/j.1747-0803.2010.00450.x.
18. S. Zhou, J.H. Park, B. Georgescu, D. Comaniciu, C. Simopoulos, J. Otsuki, Image-based multiclass boosting and echocardiographic view classification, in: Conference on Computer Vision and Pattern Recognition, Vol. 2, 2006, pp. 1559-1565, http://dx.doi.org/10.1109/CVPR.2006.146.
19. Roy A., Sural S., Mukherjee J., Majumdar A. State-based modeling and object extraction from echocardiogram video. Trans. Inf. Technol. Biomed. 2008, 12(3):366-376. 10.1109/TITB.2007.910352.
20. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: Conference on Computer Vision and Pattern Recognition, vol. 1, 2005, pp. 886-893, http://dx.doi.org/10.1109/CVPR.2005.177.
21. Oliva A., Torralba A. Modeling the shape of the scene. a holistic representation of the spatial envelope. Int. J. Comput. Vis. 2001, 42(3):145-175. 10.1023/A:1011139631724.
22. Penatti O.A.B., Valle E., Torres R.da S. Comparative study of global color and texture descriptors for web image retrieval. J. Vis. Commun. Image Represent. 2012, 23(2):359-380. 10.1016/j.jvcir.2011.11.002.
23. Çarkacioğlu A., Yarman-Vural F. Sasi: a generic texture descriptor for image retrieval. Pattern Recognit 2003, 36(11):2615-2633. 10.1016/S0031-3203(03)00171-7.
24. Tao B., Dickinson B.W. Texture recognition and image retrieval using gradient indexing. J. Vis. Commun. Image Represent. 2000, 11(3):327-342. 10.1006/jvci.2000.0448.
25. Unser M. Sum and difference histograms for texture classification. Trans. Pattern Anal. Mach. Intell. 1986, 8(1):118-125. 10.1109/TPAMI.1986.4767760.
26. M. Douze, H. Jégou, H. Sandhawalia, L. Amsaleg, C. Schmid, Evaluation of gist descriptors for web-scale image search, in: International Conference on Image and Video Retrieval, 2009, pp. 19:1-19:8, http://dx.doi.org/10.1145/1646396.1646421.
27. Mikolajczyk K., Schmid C. A performance evaluation of local descriptors. Trans. Pattern Anal. Mach. Intell 2005, 27(10):1615-1630. 10.1109/TPAMI.2005.188.
28. S. Lazebnik, C. Schmid, J. Ponce, Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories, in: Conference on Computer Vision and Pattern Recognition, vol. 2, 2006, pp. 2169-2178, http://dx.doi.org/10.1109/CVPR.2006.68.
29. Penatti O.A.B., Silva F.B., Valle E., Gouet-Brunet V., da R., Torres S. Visual word spatial arrangement for image retrieval and classification. Pattern Recognit. 2014, 47(2):705-720. 10.1016/j.patcog.2013.08.012.
30. Schölkopf B., Smola A.J. Learning with Kernels. Support Vector Machines, Regularization, Optimization and beyond 2002, The MIT Press, London.
31. Chang C.-C., Lin C.-J. LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2(3):1-27.
32. Fernández-Delgado M., Cernadas E., Barro S., Amorim D. Do we need hundreds of classifiers to solve real world classification problems?. J. Mach. Learn. Res. 2014, 15:3133-3181.
33. Mikolajczyk K., Tuytelaars T., Schmid C., Zisserman A., Matas J., Schaffalitzky F., Kadir T., Gool L. A comparison of affine region detectors. Int. J. Comput. Vis. 2005, 65(1-2):43-72. 10.1007/s11263-005-3848-x.
34. Lowe D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis 2004, 60(2):91-110. 10.1023/B:VISI.0000029664.99615.94.
35. H. Bay, T. Tuytelaars, L. Gool, Surf: Speeded up robust features, in: European Conference on Computer Vision, vol. 3951, Springer, Graz, Austria, 2006, pp. 404-417, http://dx.doi.org/10.1007/11744023_32.
36. Viitaniemi V., Laaksonen J. Experiments on selection of codebooks for local image feature histograms. Visual Information Systems: Web-Based Visual Information Search and Management 2008, 126-137. Springer, Salerno, Italy. 10.1007/978-3-540-85891-1_16.
37. F. Jurie, B. Triggs, Creating efficient codebooks for visual recognition, in: International Conference on Computer Vision, vol. 1, 2005, pp. 604-610, http://dx.doi.org/10.1109/ICCV.2005.66.
38. J. Philbin, O. Chum, M. Isard, J. Sivic, A. Zisserman, Lost in quantization: improving particular object retrieval in large scale image databases, in: Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8, http://dx.doi.org/10.1109/CVPR.2008.4587635.
39. L. Liu, L. Wang, X. Liu, In defense of soft-assignment coding, in: International Conference on Computer Vision, 2011, pp. 2486-2493, http://dx.doi.org/10.1109/ICCV.2011.6126534.
40. A. Vedaldi, B. Fulkerson, VLFeat: An Open and Portable Library of Computer Vision Algorithms, 〈〉, 2008. http://www.vlfeat.org/.
41. Rocha A., Klein Goldenstein S. Multiclass from binary. expanding one-versus-all, one-versus-one and ecoc-based approaches. Trans. Neural Net. Learn. Syst. 2014, 25(2):289-302.
42. F. Perronnin, Z. Akata, Z. Harchaoui, C. Schmid, Towards good practice in large-scale learning for image classification, in: Conference on Computer Vision and Pattern Recognition, 2012, pp. 3482-3489, http://dx.doi.org/10.1109/CVPR.2012.6248090.
43. Finn S., Glavin M., Jones E. Echocardiographic speckle reduction comparison. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 2011, 58(1):82-101. 10.1109/TUFFC.2011.1776.
44. Z. Shi, K. Fung, A comparison of digital speckle filters, in: IEEE International Geoscience and Remote Sensing Symposium, vol. 4, 1994, pp. 2129-2133, http://dx.doi.org/10.1109/IGARSS.1994.399671.
45. Frost V.S., Stiles J.A., Shanmugan K.S., Holtzman J. A model for radar images and its application to adaptive digital filtering of multiplicative noise. Trans. Pattern Anal. Mach. Intell. 1982, 4(2):157-166. 10.1109/TPAMI.1982.4767223.
46. Kuan D.T., Sawchuk A.A., Strand T.C., Chavel P. Adaptive noise smoothing filter for images with signal-dependent noise. Trans. Pattern Anal. Mach. Intell. 1985, 7(2):165-177. 10.1109/TPAMI.1985.4767641.
47. Lee J.-S. Digital image enhancement and noise filtering by use of local statistics. Trans. Pattern Anal. Mach. Intell. 1980, 2(2):165-168. 10.1109/TPAMI.1980.4766994.