Improving multiclass pattern recognition with a co-evolutionary RBFNN

Pattern Recognition Letters

Volumn 29, Issue 4, 2008, Pages 392-406

  Li, Minqiang ^a   Tian, Jin ^a   Chen, Fuzan ^a  

^a TIANJIN UNIVERSITY   (China)

Author keywords

Co operative co evolutionary algorithms; K means clustering; Multiclass classification; RBFNN

Indexed keywords

CLUSTERING ALGORITHMS; EVOLUTIONARY ALGORITHMS; PARAMETER ESTIMATION; PATTERN RECOGNITION; PROBLEM SOLVING;

COOPERATIVE COEVOLUTIONARY ALGORITHMS; DECAYING RADIUS SELECTION CLUSTERING (DRSC); K MEANS CLUSTERING; MULTICLASS CLASSIFICATION; MUTATION OPERATORS; STRUCTURAL PARAMETERS;

RADIAL BASIS FUNCTION NETWORKS;

EID: 38349047621     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2007.10.019     Document Type: Article

References (55)

1. Annalisa, A., Michelangelo, C., Simon, R., Peter, F., 2004. Redundant feature elimination for multi-class problems. In: Russ, G., Dale, S. (Eds.), Proc. of the 21st Internat. Conf. on Machine Learning (ICML 2004), vol. 69, pp. 33-40.
2. Asim R., Sandeep G., and Raymond M. An algorithm to generate radial basis function (RBF)-like nets for classification problem. Neural Networks 8 2 (1995) 179-201
3. Barreto A.M.S., Barbosa H.J.C., and Ebecken N.F.F. GOLS-Genetic orthogonal least squares algorithm for training RBF networks. Neurocomputing 69 16-18 (2006) 2041-2064
4. Berthold M.R., and Diamond J. Boosting the performance of RBF networks with dynamic decay adjustment. In: Tesauro G., Touretzky D.S., and Leen T.K. (Eds). Advances in Neural Information Processing Systems vol. 7 (1995), MIT Press, Denver, Colorado 12-528
5. Blanco A., Delgado M., and Pegalajar M.C. A real-coded genetic algorithm for training recurrent neural networks. Neural Networks 14 (2001) 93-105
6. Cantú-Paz E., and Kamath C. Inducing oblique decision trees with evolutionary algorithms. IEEE Trans. Evolution. Comput. 7 (2003) 54-68
7. Casasent D., and Chen X.W. Radial basis function neural networks for nonlinear fisher discrimination and Neyman-Pearson classification. Neural Networks 16 (2003) 529-535
8. Chen S., Wu Y., and Luk B.L. Combined genetic algorithm optimization and regularized orthogonal least square learning for radial basis function networks. IEEE Trans. Neural Networks 10 5 (1999) 1239-1243
9. Dietterich T.G. An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization. Machine Learning 40 (2000) 139-157
10. Dietterich T.G., and Bakiri G. Solving multiclass learning problems via error-correcting output codes. J. Artif. Intell. Res. 2 (1995) 263-286
11. Draghici S. The constraint based decomposition (CBD) training architecture. Neural Networks 14 (2001) 527-550
12. Eibl G., and Pfeiffer K.P. Multiclass boosting for weak classifiers. J. Machine Learning Res. 6 (2005) 189-210
13. Eklund, W.P., Hoang, A., 1999. Comparative study of public-domain supervised machine-learning accuracy on the UCI database. In: Belur, V.D. (Ed.), Proceedings of SPIE, Data Mining and Knowledge Discovery: Theory, Tools, and Technology. vol. 3695, pp. 39-50.
14. Elisseeff A., and Weston J. A kernel method for multi-labelled classification. In: Dietterich T.G., Becker S., and Ghahramani Z. (Eds). Advances in Neural Information Processing Systems vol. 14 (2002), MIT Press, Cambridge, MA 81-687
15. Eriksson R., and Olsson B. Cooperative coevolution in inventory control optimisation. In: Smith G.D., Steele N.C., and Albrecht R.F. (Eds). Proc. Third Internat. Conf. on Artificial Neural Networks and Genetic Algorithms (1997), Springer-Verlag, Berlin, Germany 83-587
16. Frank E., and Pfahringer B. Improving on bagging with input smearing. PAKDD, Lect. Notes Artif. Intell. 3918 (2006) 97-106
17. Frank E., and Witten I.H. Generating accurate rule sets without global optimization. In: Shavlik J.W. (Ed). Proc. Fifteenth Internat. Conf. on Machine Learning (1998), Morgan Kaufmann, San Francisco CA 44-151
18. Frank E., Wang Y., Inglis S., et al. Using model trees for classification. Machine Learning 32 (1998) 63-76
19. Freund Y., and Mason L. The Alternating decision tree learning algorithm. Proc. 16th Internat. Conf. on Machine Learning (1999), Bled, Slovenia 124-133
20. Freund Y., and Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci. 55 1 (1997) 119-139
21. Friedman N., Geiger D., and Goldszmidt M. Bayesian network classifiers. Machine Learning 19 4 (1997) 131-163
22. Friedman J., Hastie T., and Tibshirani R. Additive logistic regression: a statistical view of boosting. Ann. Statist. 28 (2000) 337-407
23. Fu X.J., and Wang L.P. Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance. IEEE Trans. System Man Cybernet.-Part B 33 3 (2003) 399-409
24. Furnkranz J. Round robin classification. J. Machine Learning Res. 2 (2002) 721-747
25. Gao, D.Q., Yang, G.X., 2002. Adaptive RBF neural networks for pattern classifications. In: Proc. 2002 Internat. Joint Conf. on Neural Networks (IJCNN '02), vol. 1, pp. 846-851.
26. García-Pedrajas, N., Fyfe, C., 2006. Immune network based ensembles. In: European Symposium on Artificial Neural Networks, Bruges (Belgium), pp. 437-442.
27. García-Pedrajas N., and Ortiz-Boyer D. Improving multiclass pattern recognition by the combination of two strategies. IEEE Trans. Pattern Anal. Machine Intell. 28 (2006) 1001-1006
28. García-Pedrajas N., Hervás-Martínez C., and Ortiz-Boyer D. Cooperative coevolution of artificial neural network ensembles for pattern classification. IEEE Trans. Evolution. Comput. 9 (2005) 271-302
29. George H.J., and Langley P. Estimating continuous distributions in Bayesian classifiers. Proc. Eleventh Conf. on Uncertainty in Artificial Intelligence (1995), Morgan Kaufmann Publishers, San Mateo 338-345
30. Holmes G., and Trigg L.A. diagnostic tool for tree based supervised classification learning algorithms. Proc. Sixth Internat. Conf. on Neural Information Processing (ICONIP'99) vol. II (1999), Perth, Western Australia 514-519
31. Iorio A., and Li X. Parameter control within a co-operative co-evolutionary genetic algorithm. In: Merelo Guervós J.J., Adamidis P., Beyer H.-G., Fernández-Villacañas J.-L., and Schwefel H.-P. (Eds). Proc. Seventh Conf. on Parallel Problem Solving From Nature. Lecture Notes in Computer Science vol. 2439 (2002), Springer-Verlag, Berlin, Germany 247-256
32. Jing, Y., Pavlovic, V., Rehg, J.M. 2005. Efficient discriminative learning of Bayesian network classifiers via boosted augmented naive bayes. In: Proc. 22nd Internat. Conf. on Machine Learning. ACM International Conference Proceeding Series, vol. 119, pp. 369-376.
33. Kazawa H., Izumitani T., Taira H., and Maeda E. Maximal margin labeling for multi-topic text categorization. In: Saul L.K., Weiss Y., and Bottou L. (Eds). Advances in Neural Information Processing Systems vol. 17 (2005), MIT Press, Cambridge, MA 649-656
34. Keerthi S.S., Shevade S.K., Bhattacharyya C., and Murthy K.R.K. Improvements to Platt's SMO algorithm for SVM classifier design. Neural Comput. 13 3 (2001) 637-649
35. Kim H.C., and Ghahramani Z. Bayesian Gaussian process classification with the EM-EP algorithm. IEEE Trans. Pattern Anal. Machine Intell. 28 12 (2006) 1948-1959
36. Kohavi, R., Becker, B., Sommerfield, D. 1997. Improving simple Bayes. In: Proc. European Conf. on Machine Learning.
37. Leonardis A., and Bischof H. An Efficient MDL Based Construction of RBF Networks. Neural Networks 11 (1998) 963-973
38. Li M.Q., Kou J.S., et al. The Basic Theories and Applications in GA (2002), Science Press, Beijing
39. Liu Y., Yao X., and Higuchi T. Evolutionary Ensembles with Negative Correlation Learning. IEEE Trans. Evolution. Comput. 4 (2000) 380-387
40. McCallum, A., 1999. Multi-label text classification with a mixture model trained by EM. In: Working Notes of the AAAI'99 Workshop on Text Learning, Orlando, FL.
41. Merz C.J. Using Correspondence Analysis to Combine Classifiers. Machine Learning 36 (1999) 33-58
42. Mitchell T.M. Machine Learning (2003), China Machine Press, Beijing
43. Oyang, Y.J., Hwang, S.C., Ou, Y.Y., Chen, C.Y., Chen, Z.W., 2002. A novel learning algorithm for data classification with radial basis function networks. In: Proc. 9th Internat. Conf. on Neural Information Processing (ICONIP-2002), Singapore, pp. 1021-1026.
44. Platt J.C. Fast training of support vector machines using sequential minimal optimization. Source Advances in Kernel Methods: Support Vector Learning Table of Contents (1999), MIT Press, Cambridge, MA, USA pp. 185-208
45. Potter, M., De Jong, K. 1998. The coevolution of antibodies for concept learning. In: Eiben, A.E., Bck, T., Schoenauer, M., Schwefel, H.-P. (Eds.), Proc. Fifth Internat. Conf. on Parallel Problem Solving from Nature. Lecture Notes in Computer Science, vol. 1498, pp. 530-539.
46. Potter M., and De Jong K. Cooperative coevolution: An architecture for evolving coadapted subcomponents. Evolution. Comput. 8 (2000) 1-29
47. Schapire R.E., and Singer Y. Boostexter: a boosting-based system for text categorization. Machine Learning 39 2-3 (2000) 135-168
48. Tian J., Li M.Q., and Chen F.Z. GA-RBFNN learning algorithm for complex classifications. J. System Eng. 21 (2006) 163-170
49. Webb G.I. Multiboosting: A technique for combining boosting and wagging. Machine Learning 40 (2000) 159-196
50. Xu Y., Zhang D., and Jin Z. A fast kernel-based nonlinear discriminant analysis for multi-class problems. Pattern Recognition 39 (2006) 1026-1033
51. Yang J., Parekh R., and Honavar V. DistAI: An inter-pattern distance-based constructive learning algorithm. Intell. Data Anal. 3 (1999) 55-73
52. Zhang M.L., and Zhou Z.H. Multi-label neural networks with applications to functional genomics and text categorization. IEEE Trans. Knowl. Data Eng. 18 (2006) 1338-1351
53. Zhao Q.F., and Higuchi T. Evolutionary learning of nearest neighbor MLP. IEEE Trans. Neural Networks 7 (1996) 762-767
54. Zhao W.X., and Wu L.D. RBFN structure determination strategy based on PLS and Gas. J. Software 13 (2002) 1450-1455
55. Zhu Q., Cai Y., and Liu L. A global learning algorithm for a RBF Network. Neural Networks 12 (1999) 527-540