Hybrid classification ensemble using topology-preserving clustering

New Generation Computing

Volumn 29, Issue 3, 2011, Pages 329-344

  Baruque, Bruno ^a   Porras, Santiago ^a   Corchado, Emilio ^b  

^a UNIVERSITY OF BURGOS   (Spain)

^b UNIVERSITY OF SALAMANCA   (Spain)

Author keywords

Ensemble learning; Self organizing map; Supervised learning; Unsupervised learning

Indexed keywords

CLASSIFICATION METHODS; COLLABORATIVE SYSTEMS; COMPARATIVE STUDIES; DATA SETS; DATA SPACE; ENSEMBLE LEARNING; HYBRID CLASSIFICATION; HYBRID INTELLIGENT SYSTEM; INPUT DATAS; INPUT SPACE; REAL DATA SETS; SELF ORGANIZING; TWO STAGE;

CONFORMAL MAPPING; HYBRID SYSTEMS; INPUT OUTPUT PROGRAMS; INTELLIGENT SYSTEMS; SUPERVISED LEARNING; UNSUPERVISED LEARNING;

CLASSIFICATION (OF INFORMATION);

EID: 80053917912     PISSN: 02883635     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00354-011-0306-x     Document Type: Article

References (37)

1. Mitchell, T., Machine Learning, McGraw Hill, 1997.
2. Witten, I. H. and Frank, E., Data mining: practical machine learning tools and techniques, Morgan Kaufmann, 2005.
3. Geman, S., Bienenstock, E. and Doursat, R., "Neural networks and the bias/variance dilemma, " Neural Computation, 4, pp. 1-58, 1992.
4. Dietterich, T. G., "Ensemble methods in machine learning, " in MCS '00: Proc of the First International Workshop on Multiple Classifier Systems, pp. 1-15, Springer-Verlag, (London, UK), 2000.
5. Sharkey, A. and Sharkey, N., "Diversity, selection and ensembles of artificial neural nets, " in Third International Conference on Neural Networks and their Applications, IUSPIM, pp. 205-212, 1997.
6. Bakker, B. and Heskes, T., "Clustering ensembles of neural network models, " Neural Networks, 16, 2, pp. 261-269, 2003.
7. Kuncheva, L. I., Combining Pattern Classifiers: Methods and Algorithms, Wiley-Interscience, 2004.
8. Polikar, R., "Ensemble based systems in decision making, " IEEE Circuits and Systems Magazine, 6, 3, pp. 21-45, 2006.
9. Breiman, L., "Bagging predictors, " Machine Learning, 24, 2, pp. 123-140, 1996.
10. Freund, Y. and Schapire, R. E., "Experiments with a new boosting algorithm, " in International Conference on Machine Learning, pp. 148-156, 1996.
11. Kuncheva, L. I., Skurichina, M. and Duin, R. P. W., "An experimental study on diversity for bagging and boosting with linear classifiers, " Information Fusion, 3, 4, pp. 245-258, 2002.
12. Sharkey, A. and Sharkey, N., "Combining diverse neural nets, " Knowledge Engineering Review, 12, 3, pp. 1-17, 1997.
13. Ruta, D. and Gabrys, B., "A theoretical analysis of the limits of majority voting errors for multiple classifier systems, " Pattern Analysis and Applications, 5, 4, pp. 333-350, 2002.
14. Jacobs, R., Jordan, M. I.,N. S. J., and Hinton, G. E., "Adaptive mixtures of local experts, " Neural Computation, 3, pp. 79-87, 1991.
15. Kuncheva, L. I., "Clustering-and-selection model for classifier combination, " in KES, pp. 185-188, 2000.
16. Liu, R. and Yuan, B., "Multiple classifiers combination by clustering and selection, " Information Fusion, pp. 163-168, 2001.
17. Jackowski, K. and Wozniak, M., "Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas, " Pattern Analysis and Applications, 12, 4, pp. 415-425, 2009.
18. Dara, R., Kremer, S. C. and Stacey, D. A., "Clustering unlabelled data with SOMs improves classification of labeled real-world data, " in Proc. IEEE World Congress on Computational Intelligence, pp. 2237-2242, May 2002.
19. Baruque, B. and Corchado, E., "A weighted voting summarization of SOM ensembles, " Data Mining and Knowledge Discovery, 21, pp. 398-426, 2010. 10.1007/s10618-009-0160-3.
20. Corchado, E. and Baruque, B., "WeVoS-ViSOM: An ensemble summarization algorithm for enhanced data visualization, " Neurocomputing in press, 2011.
21. Kuncheva, L., Bezdek, J. C. and Duin, R. P. W., "Decision templates for multiple classifier fusion: an experimental comparison, " Pattern Recognition, 34, 2, pp. 299-314, 2001.
22. Stepenosky, N., Green, D., Kounios, J., Clark, C. and Polikar, R., "Majority vote and decision template based ensemble classifiers trained on event related potentials for early diagnosis of alzheimer's disease, " in Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proc. 2006 IEEE International Conference on, 5, p. V, May 2006.
23. Kohonen, T., Self-Organizing Maps, 30, Springer, Berlin, Germany, 1995.
24. Kohonen, T., "The self-organizing map, " Neurocomputing, 21, 1-3, pp. 1-6, 1998.
25. Kohonen, T., Lehtio, P., Rovamo, J., Hyvarinen, J., Bry, K. and Vainio, L., "A principle of neural associative memory, " Neuroscience, 2, 6, pp. 1065-1076, 1977.
26. Lampinen, J. and Oja, E., "Clustering properties of hierarchical self-organizing maps, " Journal of Mathematical Imaging and Vision, 2, pp. 261-272, 1992.
27. Ultsch, A., "Self-organizing neural networks for visualization and classification, " in Proc. Conf. Soc. for Information and Classification, 1992.
28. Ultsch, A., "U*-matrix: A tool to visualize clusters in high dimensional data, " Tech. rep., Department of Computer Science, University of Marburg, 2003.
29. Beyer, K., Goldstein, J., Ramakrishnan, R. and Shaft, U., "When is nearest neighbor meaningful?, " in Computer Science Database Theory - ICDT'99, LNCS 1540, pp. 217-235, Springer, 1999.
30. Topchy, A., Minaei-Bidgoli, B., Jain, A. K. and Punch, W. F., "Adaptive clustering ensembles, " Pattern Recognition, 2004, ICPR 2004, Proc. of the 17th International Conference on, pp. 272-275, 1, 1, 2004.
31. Asuncion, A. and Newman, D. J., UCI machine learning repository, 2007.
32. Kuncheva, L., Whitaker, C., Shipp, C. and Duin, R., "Limits on the majority vote accuracy in classifier fusion, " Pattern Analysis and Applications, 6, pp. 22-31, 2003.
33. Goebel, K. and Yan, W., "Choosing classifier for decision fusion, " in Proc. of the 7th International Conference on Information Fusion (Stockholm, Sweden), pp. 562-568, 2004.
34. Erp, M. V., Vuurpijl, L. and Schomaker, L., "An overview and comparison of voting methods for pattern recognition, " in Proc. of the 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR.8) (Niagaraonthe-Lake, Canada), pp. 195-200, 2002.
35. Apache Software Foundation, Spamassasin public corpus, 2006.
36. Yin, H., "ViSOM - a novel method for multivariate data projection and structure visualization, " Neural Networks, IEEE Transactions on, 13, 1, pp. 237-243, 2002.
37. Corchado, E. and Fyfe, C., "The scale invariant map and maximum likelihood hebbian learning, " International Conference on Knowledge-Based & Intelligent Information & Engineering System, pp. 245-249, 82, 2002.