Semi-supervised learning for tree-structured ensembles of RBF networks with Co-Training

Neural Networks

Volumn 23, Issue 4, 2010, Pages 497-509

  Abdel Hady, Mohamed Farouk ^a   Schwenker, Friedhelm ^a   Palm, Günther ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

Binary hierarchical classifier; Co Training; Data mining; Dempster Shafer theory of evidence; Multi view learning; Output space decomposition; Radial basis function networks; Semi supervised learning; Visual object recognition

Indexed keywords

BINARY HIERARCHICAL CLASSIFIERS; CO-TRAINING; DEMPSTER-SHAFER THEORY OF EVIDENCE; MULTI-VIEW LEARNING; SEMI-SUPERVISED LEARNING; SPACE DECOMPOSITION; VISUAL OBJECT RECOGNITION;

ATTITUDE CONTROL; CLASSIFIERS; FORMAL LOGIC; OBJECT RECOGNITION; SUPERVISED LEARNING;

RADIAL BASIS FUNCTION NETWORKS;

ACCURACY; ALGORITHM; ARTICLE; CLASSIFICATION; CLASSIFIER; DATA ANALYSIS; LEARNING STYLE; MACHINE LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL PARAMETERS; PRIORITY JOURNAL; PROBABILITY; STATISTICAL ANALYSIS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DATA MINING; HUMANS; LEARNING; PATTERN RECOGNITION, AUTOMATED; PATTERN RECOGNITION, VISUAL; USER-COMPUTER INTERFACE;

EID: 77950296222     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2009.09.001     Document Type: Article

References (40)

1. Abdel Hady M.F., Palm G., Schwenker F. Multi-view forests of radial basis function networks based on Dempster-Shafer evidence theory. Proceedings of the 16th European symposium on artificial neural networks 2008, 307-312. d-side Publications, Bruges, Belgium. M. Verleysen (Ed.).
2. Abdel Hady M.F., Schwenker F. Decision templates based RBF network for tree-structured multiple classifier fusion. LNCS 2009, Vol. 5519:92-101. Springer-Verlag, Reykjavik, Iceland. J.A. Benediktsson, J. Kittler, F. Roli (Eds.).
3. Abdel Hady M.F., Schwenker F., Palm G. Multi-view forests based on Dempster-Shafer evidence theory: A new classifier ensemble method. Proceedings of the 5th IASTED conference on signal processing, pattern recognition and applications 2008, 18-23. ACTA Press, Innsbruck, Austria. R. Sablatnig, O. Scherzer (Eds.).
4. Abdel Hady M.F., Schwenker F., Palm G. Semi-supervised learning of tree-structured RBF networks using Co-Training. LNCS 2008, Vol. 5163:79-88. Springer-Verlag, Prague, Czech Republic. V. Kurkova, R. Neruda, J. Koutnik (Eds.).
5. Abdel Hady M.F., Schwenker F., Palm G. Semi-supervised learning for regression with co-training by committee. LNCS 2009, Vol. 5768:121-130. Springer-Verlag, Limassol, Cyprus.
6. Basu, S., Banerjee, A., & Mooney, R. J. (2002). Semi-supervised clustering by seeding. In Proceedings of the 19th international conference on machine learning (pp. 19-26).
7. Blum A., Mitchell T. Combining labeled and unlabeled data with co-training. Proceedings of the 11th annual conference on computational learning theory 1998, 92-100. Morgan Kaufmann Publishers.
8. Dempster A., Laird N., Rubin D. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society 1977, 39(1):1-38.
9. Dempster A.P. A generalization of Bayesian inference. Journal of the Royal Statistical Society 1968, 205-247.
10. Dietterich T.G., Bakiri G. Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research 1995, 2(1):263-286.
11. Fay, R. (2007). Feature selection and information fusion in hierarchical neural networks for iterative 3D-object recognition. Ph.D. thesis. Germany: Ulm University.
12. Fay R., Schwenker F., Thiel C., Palm G. Hierarchical neural networks utilising Dempster-Shafer evidence theory. LNAI 2006, Vol. 4087:198-209. Springer-Verlag. F. Schwenker, S. Marinai (Eds.).
13. Freund Y., Seung H., Shamir E., Tishby N. Selective sampling using the query by committee algorithm. Machine Learning 1997, 28(2-3):133-168.
14. Ghani R. Combining labeled and unlabeled data for text classification with a large number of categories. Proceedings of the first IEEE conference on data mining 2001, 597-598. IEEE Computer Society.
15. Gupta, A., & Dasgupta, S. (2005). Hybrid hierarchical clustering: Forming a tree from multiple views. In Proceedings of the workshop on learning with multiple views at the 22nd international conference on machine learning (pp. 35-42).
16. Hrycej T. Modular learning in neural networks: A modularized approach to neural network classification 1992, John Wiley & Sons, Inc, NY, USA.
17. Jun G., Ghosh J. Hybrid hierarchical classifiers for hyperspectral data analysis. LNCS 2009, Vol. 5519:42-51. Springer-Verlag, Reykjavik, Iceland. J.A. Benediktsson, J. Kittler, F. Roli (Eds.).
18. Jun G., Ghosh J. Multi-class boosting with class hierarchies. LNCS 2009, Vol. 5519:32-41. Springer-Verlag, Reykjavik, Iceland. J.A. Benediktsson, J. Kittler, F. Roli (Eds.).
19. Kahsay L., Schwenker F., Palm G. Comparison of multiclass SVM decomposition schemes for visual object recognition. LNCS 2005, Vol. 3663:334-341. Springer-Verlag, Munich, Germany.
20. Kiritchenko S., Matwin S. Email classification with Co-Training. Proceedings of the 2001 conference of the centre for advanced studies on collaborative research 2001, 8-19. IBM Press.
21. Kumar, S. (2000). Modular learning through output space decomposition. Ph.D. thesis. Austin, TX: The University of Texas at Austin.
22. Kumar S., Ghosh J., Crawford M. A hierarchical multiclassifier system for hyperspectral data analysis. LNCS 2000, Vol. 1857:270-279. Springer-Verlag, Cagliari, Italy. J. Kittler, F. Roli (Eds.).
23. Kumar S., Ghosh J., Crawford M. Hierarchical fusion of multiple classifiers for hyperspectral data analysis. International Journal on Pattern Analysis & Applications 2002, 5(2):210-220.
24. Li M., Zhou Z.-H. Improve computer-aided diagnosis with machine learning techniques using undiagnosed samples. IEEE Transaction on Systems, Man and Cybernetics - Part A: Systems and Humans 2007, 37(6):1088-1098.
25. MacQueen, J. (1967). Some methods for classification and analysis of multivariate observations. In Proceedings of 5th Berkeley symposium on mathematical statistics and probability (pp. 281-297).
26. Muslea, I., Minton, S., & Knoblock, C. A. (2000). Selective sampling with redundant views. In Proceedings of the seventeenth national conference on artificial intelligence and twelfth conference on innovative applications of artificial intelligence (pp. 621-626).
27. Nadeau C., Bengio Y. Inference for the generalization error. Machine Learning 2003, 62:239-281.
28. Nene, S., Nayar, S., & Murase, H. (1996). Columbia object image library: COIL. URL: http://citeseer.ist.psu.edu/article/nene96columbia.html.
29. Nigam, K., & Ghani, R. (2000). Analyzing the effectiveness and applicability of Co-Training. In Proceedings of the 9th international conference on information and knowledge management (pp. 86-93).
30. Nigam K., McCallum A., Thrun S., Mitchell T. Text classification from labeled and unlabeled documents using EM. Machine Learning 2000, 39(2-3):103-134.
31. Platt J.C., Cristianini N., Shawe-Taylor J. Large margin DAGs for multiclass classification. Advances in neural information processing systems 2000, 547-553. MIT Press.
32. Rajan S., Ghosh J. An empirical comparison of hierarchical vs. two-level approaches to multiclass problems. LNCS 2004, Vol. 3077:283-292. Springer-Verlag, Cagliari, Italy.
33. Wagstaff, S. R. K., & Schroedl, C. C. (2001). Constrained k-means clustering with background knowledge. In Proceedings of the 18th international conference on machine learning (pp. 577-584).
34. Schwenker F., Kestler H., Palm G. Three learning phases for radial basis function networks. Neural Networks 2001, 14:439-458.
35. Shafer G. A mathematical theory of evidence 1976, Princeton University Press, Princeton, NJ.
36. Tibshirani R., Hastie T. Margin trees for high-dimensional classification. Journal of Machine Learning Research 2007, 8:637-652.
37. Witten I.H., Frank E. Data mining: Practical machine learning tools and techniques with java implementations 1999, Morgan Kaufmann.
38. Zhou, Z.-H., & Li, M. (2005). Semi-supervised regression with Co-Training. In Proceedings of the 19th international joint conference on artificial intelligence (pp. 908-913).
39. Zhou, Z.-H., Zhang, D., & Chen, S. (2007). Semi-supervised dimensionality reduction. In Proceedings of the 7th siam international conference on data mining (pp. 629-634).
40. Zhu, X. (2008). Semi-supervised learning literature survey, Technical report, tr 1530.