Predicting radiological panel opinions using a panel of machine learning classifiers

Algorithms

Volumn 2, Issue 4, 2009, Pages 1473-1502

  Zinovev, Dmitriy ^a   Raicu, Daniela ^a   Furst, Jacob ^a   Armato, Samuel G ^b  

^a DEPAUL UNIVERSITY   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

Author keywords

Ensemble learning; LIDC; Lung nodule classification

Indexed keywords

EID: 79551679105     PISSN: None     EISSN: 19994893     Source Type: Journal    
DOI: 10.3390/a2041473     Document Type: Article

References (42)

1. Armato, S.G.; McLennan G.; McNitt-Gray, M.F.; Meyer, C.R.; Yankelevitz, D.; Aberle, D.R.; Henschke, C.I.; Hoffman, E.A.; Kazerooni, E.A.; MacMahon, H.; Reeves, A.P.; Croft, B.Y.; Clarke, L.P. Lung Image Database Consortium Research Group. Lung image database consortium: Developing a resource for the medical imaging research community. Radiology 2004, 232, 739-748.
2. Raicu, D.; Zinovev, D.; Furst, J.; Varutbangkul, E. Semi-supervised learning approaches for predicting lung nodules semantic characteristics. Intell. Decis. Technol. 2009, 3, No. 2.
3. Chapelle, O.; Schölkopf, B.; Zien, A. Semi-Supervised Learning; MIT: Cambridge, MA, USA, 2006.
4. Cohen, J. Weighted kappa; nominal scale agreement with provision for scaled disagreement or partial credit. Psychol. Bull. 1968, 70, 213-220.
5. McNitt-Gray, M.F.; Hart, E.M.; Wyckoff, N.; Sayre, J.W.; Goldin, J.G.; Aberle, D.R. A pattern classification approach to characterizing solitary pulmonary nodules imaged on high resolution CT: Preliminary results. Med. Phys. 1999, 26, 880-888.
6. McNitt-Gray, M.F.; Wyckoff, N.; Sayre, J.W.; Goldin, J.G.; Aberle, D.R. The effects of co-occurrence matrix based texture parameters on the classification of solitary pulmonary nodules imaged on computed tomography. Comput. Med. Imaging Graph.1999, 23, 339-348.
7. Lo, S.C.B.; Hsu, L.Y.; Freedman, M.T.; Lure, Y.M.F.; Zhao, H. Classification of lung nodules in diagnostic CT: An approach based on 3-D vascular features, nodule density distributions, and shape features. In Proceedings of SPIE Medical Imaging Conference, San Diego, CA, USA, February, 2003; pp. 183-189.
8. Armato, S.G., III; Altman, M.B.; Wilkie, J.; Sone, S.; Li, F.; Doi, K.; Roy, A.S. Automated lung nodule classification following automated nodule detection on CT: A serial approach. Med. Phys. 2003, 30, 1188-1197.
9. Takashima, S.; Sone, S.; Li, F.; Maruyama, Y.; Hasegawa, M.; Kadoya, M. Indeterminate solitary pulmonary nodules revealed at population-based CT screening of the lung: using first follow-up diagnostic CT to differentiate benign and malignant lesions. Am. J. Roentgenol. 2003, 180, 1255-1263.
10. Takashima, S.; Sone, S.; Li, F.; Maruyama, Y.; Hasegawa, M.; Matsushita, T.; Takayama, F.; Kadoya, M. Small solitary pulmonary nodules (<1 cm) detected at population-based CT screening for lung cancer: reliable high-resolution CT features of benign lesions. Am. J. Roentgenol. 2003, 180, 955-964.
11. Shah, S.; McNitt-Gray, M.; Rogers, S.; Goldin, J.; Aberle, D.; Suh, R.; DeZoysa, K.; Brown, M. Computer-aided lung nodule diagnosis using a simple classifier. Int. Congr. Ser. 2004, 6, 952-955.
12. Holte, R.C. Very simple classification rules perform well on most commonly used datasets. Mach. Learning 1993, 11, 63-91.
13. Samuel, C.C.; Saravanan, V.; Vimala, D.M.R. Lung nodule diagnosis from CT images using fuzzy logic. In Proceedings of International Conference on Computational Intelligence and Multimedia Applications, Sivakasi, Tamilnadu, India, December 13-15, 2007; pp. 159-163.
14. Sluimer, I.; Schilham, A.; Prokop, M.; Ginneken, B. Computer analysis of computed tomography scans of the Lung: A survey. IEEE Trans. Med. Imaging 2006, 4, 385-405.
15. Goldin, J.G.; Brown, M.S.; Petkovska, I. Computer-aided diagnosis in lung nodule assessment. J. Thoracic Imaging 2008, 23, 97-104.
16. Gurney, J. Determining the likelihood of malignancy in solitary pulmonary nodules with Bayesian analysis. Part I. Theory. Radiology 1993, 186, 405-413.
17. Gurney, J.; Lyddon, D.; McKay, J. Determining the likelihood of malignancy in solitary pulmonary nodules with Bayesian analysis. Part II. Application. Radiology 1993, 186, 415-422.
18. Matsuki, Y.; Nakamura, K.; Watanabe, H.; Aoki, T.; Nakata, H.; Katsuragawa, S.; Doi, K. Usefulness of an artificial neural network for differentiating benign from malignant pulmonary nodules on high-resolution CT: Evaluation with receiver operating characteristic analysis. Am. J. Roentgenol. 2002, 178, 657-663.
19. Aoyama, M.; Li, Q.; Katsuragawa, S.; Li, F.; Sone, S.; Doi, K. Computerized scheme for determination of the likelihood measure of malignancy for pulmonary nodules on low-dose CT images. Med. Phys. 2003, 30, 387-394.
20. Kahn, C.; Channin, D.; Rubin, D. An ontology for PACS integration. J. Digital Imaging 2006, 12, 316-327.
21. Barb, A.S.; Shyu, C.R.; Sethi, Y.P. Knowledge representation and sharing using visual semantic modeling for diagnostic medical image databases. IEEE Trans. Inf. Technol. Biomed. 2005, 9, 538-553.
22. Ebadollahi, S.; Coden, A.; Tanenblatt, M.A.; Chang, S.F.; Syeda-Mahmood, T.F.; Amir, A. Concept-based electronic health records: Opportunities and challenges. ACM Multimed. 2006, 997-1006.
23. Ebadollahi, S.; Johnson, D.E.; Diao, M. Retrieving clinical cases through a concept space representation of text and images. SPIE Med. Imaging Symp. 2008, (submitted).
24. Nie, K.; Chen, J.H.; Yu, H.J.; Chu, Y.; Nalcioglu, O.; Su, M.Y. Quantitative analysis of lesion morphology and texture features for diagnostic prediction in breast MRI. Acad. Radiol. 2008, 15, 1513-1525.
25. Liney, G.P.; Sreenivas, M.; Gibbs, P.; Garcia-Alvarez, R.; Turnbull, L.W. Breast lesion analysis of shape technique: Semi-automated vs. Manual morphological description. J. Magn. Reson. Imaging 2006, 23, 493-498.
26. Raicu, D.S.; Varutbangkul, E.; Cisneros, J.G.; Furst, J.D.; Channin, D.S.; Armato, S.G., III. Semantics and image content integration for pulmonary nodule interpretation in thoracic computed tomography. In Proceedings of SPIE Medical Imaging Conference, San Diego, CA, USA, February, 2007.
27. Raicu, D.S.; Varutbangkul, E.; Furst, J.D.; Armato, S.G., III. Modeling semantics from image data: opportunities from LIDC. Int. J. Biomed. Eng. Technol. 2008, 1-22.
28. Opulencia, P.; Channin, D.S.; Raicu, D.S.; Furst, J.D. Mapping LIDC, RadLex, and Lung nodule image features. J. Digital Imaging 2009, (in press).
29. Cohen, J. A coefficient of agreement for nominal scale. Educat. Psychol. Measure. 1960, 20, 37-46.
30. Fleiss, J.L. Measuring nominal scale agreement among many raters. Psychol. Bull. 1971, 76, 378-382.
31. Landis, J.R.; Koch, G.G. An application of hierarchical Kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 1977, 33, 363-374.
32. Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159-174.
33. Kraemer, H.C. Extension of the kappa coefficient. Biometrics 1980 36, 207-216
34. Fleiss, J.L. Measuring nominal scale agreement among many raters. Psychol. Bull. 1971, 76, 378-382.
35. Viera, A.J.; Garrett, J.M. Understanding interobserver agreement: The Kappa statistic. Fam Med. 2005, 5, 360-363.
36. McNitt-Gray, M.F.; Armato, S.G., III.; Meyer, C.R.; Reeves, A.P.; McLennan, G.; Pais, R.C.; Freymann, J.; Brown, M.S.; Engelmann, R.M.; Bland, P.H.; Laderach, G.E.; Piker, C.; Guo, J.; Towfic, Z.; Qing, D.P.; Yankelevitz, D.F.; Aberle, D.R.; van Beek, E.J.; MacMahon. H.; Kazerooni, E.A.; Croft, B.Y.; Clarke, L.P. The Lung image database consortium (LIDC) data collection process for nodule detection and annotation. Acad. Radiol. 2007, 12, 1464-1474.
37. Philips, C.; Li, D.; Furst, J.; Raicu, D. An analysis of Co-occurrence and gabor texture classification in 2D and 3D. In Proceedings of CARS, Barcelona, Spain, 2008.
38. Melville, P.; Mooney, R. Constructing diverse classifier ensembles using artificial training examples. In Proceedings of 18th International Joint Conference on Artificial Intelligence, Acapulco, Mexico, 2003; pp. 505-510.
39. Melville, P.; Mooney, R. Diverse ensembles for active learning. In Proceedings of International Conference on Machine Learning, Banff, Alberta, Canada, July, 2004; pp. 584-591.
40. Weka 3 - Data Mining with Open Source Machine Learning Software in Java; Available online: http://www.cs.waikato.ac.nz/ml/weka/(accessed December 30, 2008).
41. Mitchell, T.M. Machine Learning; McGraw-Hill: New York, NY, USA, 1997.
42. Siena, S, Zinoveva, O., Raicu, D.; Furst J. Area and shape-dependent variability metric for evaluating panel segmentations of lung nodules in LIDC data. In Proceedings of SPIE Medical Imaging Conference, San Francisco, CA, USA, February, 2010, (accepted).