Improve computer-aided diagnosis with machine learning techniques using undiagnosed samples

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 37, Issue 6, 2007, Pages 1088-1098

  Li, Ming ^a   Zhou, Zhi Hua ^a  

^a NANJING UNIVERSITY   (China)

Author keywords

CAD; Co training; Computer aided diagnosis (CAD); Ensemble learning; Learning (artificial intelligence); Machine learning; Microcalcification cluster detection; Patient diagnosis; Random forest; Semisupervised learning

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER AIDED DIAGNOSIS; LEARNING ALGORITHMS; LEARNING SYSTEMS; ONCOLOGY; RANDOM PROCESSES;

ENSEMBLE LEARNING; MICROCALCIFICATION CLUSTER DETECTION; PATIENT DIAGNOSIS; SEMISUPERVISED LEARNING;

BIOMEDICAL ENGINEERING;

EID: 36249007597     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2007.904745     Document Type: Article

References (47)

1. D. Angluin and P. Laird, "Learning from noisy examples," Mach. Learn., vol. 2, no. 4, pp. 343-370, Apr. 1988.
2. C. Blake, E. Keogh, and C. J. Merz, UCI Repository of Machine Learning Databases. Irvine, CA: Dept. Inf. and Comput. Sci., Univ. California, 1998. [Online]. Available: http://www.ics.uci.edu/~mlearn/ MLRepository.htm
3. A. Blum and S. Chawla, "Learning from labeled and unlabeled data using graph mincuts," in Proc. 18th Int. Conf. Mach. Learn., Williamstown, MA, 2001, pp. 19-26.
4. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. 11th Annu. Conf. Comput. Learn. Theory, Madison, WI, 1998, pp. 92-100.
5. L. Breiman, "Bagging predictors," Mach. Learn., vol. 24, no. 2, pp. 123-140, Aug. 1996.
6. L. Brennan, "Bias, variance, and arcing classifiers," Univ. California, Berkeley, 1996. Tech. Rep.
7. L. Breiman, "Random forests," Mach. Learn., vol. 45, no. 1, pp. 5-32, Oct. 2001.
8. O. Chappelle, B. Schölkopf, and A. Zien, Eds., Semi-Supervised Learning. Cambridge, MA: MIT Press, 2006.
9. D. A. Cohn, Z. Ghahramani, and M. I. Jordan, "Active learning with statistical models," J. Artif. Intell. Res., vol. 4, pp. 129-145, 1996.
10. P. Cunningham, J. Carney, and S. Jacob, "Stability problems with artificial neural networks and the ensemble solution," Artif. Intell. Med., vol. 20, no. 3, pp. 217-225, Nov. 2000.
11. S. Dasgupta, M. Littman, and D. McAllester, "PAC generalization bounds for co-training," in Advances in Neural Information Processing Systems 14, T. G. Dietterich, S. Becker, and Z. Ghahramani, Eds. Cambridge, MA: MIT Press, 2002, pp. 375-382.
12. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Stat. Soc. B, vol. 39, no. 1, pp. 1-38, 1977.
13. T. G. Dietterich, "Ensemble learning," in The Handbook of Brain Theory and Neural Networks, 2nd ed., M. A. Arbib, Ed. Cambridge, MA: MIT Press, 2002.
14. B. Efron and R. Tibshirani, An Introduction to the Bootstrap. New York: Chapman & Hall, 1993.
15. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of online learning and an application to boosting," in Proc. 2nd Eur Conf. Comput. Learn. Theory, Barcelona, Spain, 1995, pp. 23-37.
16. J. Friedman, T. Hastie, and R. Tibshirani, "Additive logistic regression: A statistical view of boosting," Ann. Stat., vol. 28, no. 2, pp. 337-407, 2000.
17. S. Goldman and Y. Zhou, "Enhancing supervised learning with unlabeled data," in Proc. 17th Int. Conf. Mach. Learn., San Francisco, CA, 2000, pp. 327-334.
18. L. Hansen and P. Salamon, "Neural network ensemble," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 10, pp. 993-1001, Oct. 1990.
19. T. K. Ho, "The random subspace method for constructing decision forests," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 8, pp. 832-844, Aug. 1998.
20. T. Hothorn and B. Lausen, "Bagging tree classifiers for laser scanning images: A data- and simulation-based strategy," Artif. Intell. Med. vol. 27, no. 1, pp. 65-79, Jan. 2003.
21. R. Hwa, M. Osborne, A. Sarkar, and M. Steedman, "Corrected co-training for statistical parsers," in Proc. Work. Notes ICML Workshop Continuum Labeled Unlabeled Data Mach. Learn. Data Mining, Washington, DC, 2003, pp. 95-102.
22. X. Jia, Z. Wang, S. Chen, N. Li, and Z.-H. Zhou, "Fast screen out true negative regions for microcalcification detection in digital mammograms," Nanjing Univ. Aeronaut. Astronaut., Nanjing, China, 2005. Tech. Rep.
23. T. Joachims, "Transductive inference for text classification using support vector machines," in Proc. 16th Int. Conf. Mach. Learn., Bled, Slovenia, 1999, pp. 200-209.
24. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," in Advances in Neural Information Processing Systems 7, G. Tesauro, D. S. Touretzky, and T. K. Leen, Eds. Cambridge, MA: MIT Press, 1995, pp. 231-238.
25. A. Levin, P. Viola, and Y. Freund, "Unsupervised improvement of visual detectors using co-training," in Proc. 9th IEEE Int. Conf. Comput. Vis., Nice, France, 2003, pp. 626-633.
26. D. J. Miller and H. S. Uyar, "A mixture of experts classifier with learning based on both labelled and unlabelled data," in Advances in Neural Information Processing Systems 9, M. Mozer, M. I. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press, 1997, pp. 571-577.
27. K. Nigam and R. Ghani, "Analyzing the effectiveness and applicability of co-training," in Proc. 9th ACM Int. Conf. Inf. Knowl. Manage., McLean, VA, 2000, pp. 86-93.
28. K. Nigam, A. K. McCallum, S. Thrun, and T. Mitchell, "Text classification from labeled and unlabeled documents using EM," Mach. Learn., vol. 39, no. 2/3, pp. 103-134, May/Jun. 2000.
29. D. Pierce and C. Cardie, "Limitations of co-training for natural language learning from large data sets," in Proc. 6th Conf. Empirical Methods Natural Language Process., Pittsburgh, PA, 2001, pp. 1-9.
30. A. Sarkar, "Applying co-training methods to statistical parsing," in Proc. 2nd Annu. Meeting North Amer. Chapter Assoc. Comput. Linguistics, Pittsburgh, PA, 2001, pp. 95-102.
31. A. Sboner, C. Eccher, E. Blanzieri, P. Bauer, M. Cristofolini, G. Zuniani, and S. Forti, "A multiple classifier system for early melanoma diagnosis," Artif. Intell. Med., vol. 27, no. 1, pp. 29-44, Jan. 2003.
32. M. Seeger, "Learning with labeled and unlabeled data," Univ. Edinburgh, Edinburgh, U.K., 2001. Tech. Rep.
33. H. Seung, M. Opper, and H. Sompolinsky, "Query by committee," in Proc. 5th ACM Workshop Comput. Learn. Theory, Pittsburgh, PA, 1992, pp. 287-294.
34. B. Shahshahani and D. Landgrebe, "The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenon," IEEE Trans. Geosci. Remote Sens., vol. 32, no. 5, pp. 1087-1095, Sep. 1994.
35. A. Sharkey, N. Sharkey, and S. Cross, "Adapting an ensemble approach for the diagnosis of breast cancer," in Proc. 6th Int. Conf. Artif. Neural Netw., Skövd, Sweden, 1998, pp. 281-286.
36. M. Steedman, M. Osborne, A. Sarkar, S. Clark, R. Hwa, J. Hockenmaier, P. Ruhlen, S. Baker, and J. Crim, "Bootstrapping statistical parsers from small data sets," in Proc. 10th Conf. Eur. Chapter Assoc. Comput. Linguistics, Budapest, Hungary, 2003, pp. 331-338.
37. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques With Java Implementations. San Francisco, CA: Morgan Kaufmann, 2000.
38. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Advances in Neural Information Processing Systems 16, S. Thrun, L. K. Saul, and B. Schölkopf, Eds. Cambridge, MA: MIT Press, 2003, pp. 1633-1640.
39. Y. Zhou and S. Goldman, "Democratic co-learning," in Proc. 16th IEEE Int. Conf. Tools Artif. Intell., Boca Raton, FL, 2004, pp. 594-602.
40. Z.-H. Zhou, K.-J. Chen, and H.-B. Dai, "Enhancing relevance feedback in image retrieval using unlabeled data," ACM Trans. Inf. Syst., vol. 24, no. 2, pp. 219-244, Apr. 2006.
41. Z.-H. Zhou and Y. Jiang, "Medical diagnosis with C4.5 rule preceded by artificial neural network ensemble," IEEE Trans. Inf. Technol. Biomed., vol. 7, no. 1, pp. 37-42, Mar. 2003.
42. Z.-H. Zhou, Y. Jiang, Y.-B. Yang, and S.-F. Chen, "Lung cancer cell identification based on artificial neural network ensembles," Artif. Intell. Med., vol. 24, no. 1, pp. 25-36, Jan. 2002.
43. Z.-H. Zhou and M. Li, "Tri-training: Exploiting unlabeled data using three classifiers," IEEE Trans. Knowl. Data Eng., vol. 17, no. 11, pp. 1529-1541, Nov. 2005.
44. Z.-H. Zhou and M. Li, "Semi-supervised regression with cotraining," in Proc. 19th Int. Joint Conf. Artif. Intell., Edinburgh, U.K., 2005, pp. 908-913.
45. Z.-H. Zhou, J. Wu, and W. Tang, "Ensembling neural networks: Many could be better than all," Artif. Intell., vol. 137, no. 1/2, pp. 239-263, May 2002.
46. X. Zhu, "Semi-supervised learning literature survey," Comput. Sci. Dept., Univ. Wisconsin-Madison, Madison, WI, Tech. Rep. 1530, 2005.
47. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning using Gaussian fields and harmonic functions," in Proc. 20th Int. Conf. Mach. Learn., Washington, DC, 2003, pp. 912-919.