Multilogistic regression by means of evolutionary product-unit neural networks

Neural Networks

Volumn 21, Issue 7, 2008, Pages 951-961

  Hervas Martinez C ^a   Martinez Estudillo F J ^b   Carbonero Ruz, M ^b  

^a UNIVERSITY OF CÓRDOBA   (Spain)

^b UNIVERSIDAD LOYOLA ANDALUCÍA   (Spain)

Author keywords

Evolutionary neural networks; Multi class classification; Multilogistic regression

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); COMPUTER NETWORKS; MATERIALS HANDLING; MAXIMUM LIKELIHOOD ESTIMATION; STATISTICAL TESTS; VEGETATION;

BASIS FUNCTIONS; EVOLUTIONARY NEURAL NETWORKS; MULTI-CLASS CLASSIFICATION; MULTILOGISTIC REGRESSION;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER MODEL; EVOLUTIONARY ALGORITHM; INTERMETHOD COMPARISON; LEARNING ALGORITHM; MULTIVARIATE LOGISTIC REGRESSION ANALYSIS; NETWORK LEARNING; PRIORITY JOURNAL; STATISTICAL MODEL;

ALGORITHMS; ANIMALS; EVOLUTION; HUMANS; INFORMATION STORAGE AND RETRIEVAL; LEARNING; LIKELIHOOD FUNCTIONS; LOGISTIC MODELS; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 51049123604     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2007.12.052     Document Type: Article

References (47)

1. Angeline P.J., Saunders G.M., and Pollack J.B. An evolutionary algorithm that constructs recurrent neural networks. IEEE Transactions on Neural Networks 5 1 (1994) 54-65
2. Athanaselis T., et al. ASR for emotional speech: Clarifying the issues and enhancing performance. Neural Networks 18 4 (2005) 437-444
3. Bishop M. Neural networks for pattern recognition (1995), Oxford University Press
4. Blake, C., & Merz, C.J. (1998). UCI repository of machine learning data bases. www.ics.uci.edu/mlearn/MLRepository.thml
5. Bose S. Classification using splines. Computational Statistics & Data Analysis 22 (1996) 505-525
6. Bose S. Multilayer statistical classifiers. Computational Statistics & Data Analysis 42 (2003) 685-701
7. Breiman L., et al. Classification and regression trees (1984), Wadsworth, Belmont, CA
8. Chiang J.-H. A hybrid neural network model in handwritten word recognition. Neural Networks 11 2 (1998) 337-346
9. Durbin R., and Rumelhart D. Products units: A computationally powerful and biologically plausible extension to backpropagation networks. Neural Computation 1 (1989) 133-142
10. Fogel D.B. Using evolutionary programming to greater neural networks that are capable of playing Tic-Tac-Toe. International conference on neural networks (1993), IEEE Press, San Francisco, CA
11. Freund Y., and Shapire R. Experiments with a new boosting algorithm. Machine learning: Proceedings of the thirteenth international conference (1996), Morgan Kauffman, San Francisco
12. Friedman J. Multivariate adaptive regression splines (with discussion). The Annals of Statistics 19 (1991) 1-141
13. Friedman, J., Hastie, T., & Tibshirani, R. (1998). Additive logistic regression: A statistical view of boosting. Dept. of Statistics, Standford University
14. Friedman J., and Stuetzle W. Proyection pursuit regression. Journal of the American Statistical Association 76 376 (1981) 817-823
15. Gama J. Functional trees. Machine Learning 55 3 (2004) 219-250
16. García-Pedrajas N., Hervás-Martínez C., and Muñoz-Pérez J. Multiobjetive cooperative coevolution of artificial neural networks. Neural Networks 15 10 (2002) 1255-1274
17. Hastie T.J., and Tibshirani R.J. Generalized additive models (1990), Chapman & Hall, London
18. Hastie T., Tibshirani R.J., and Friedman J. The elements of statistical learning. Data mining, inference and prediction (2001), Springer
19. Hervás C., and Martínez-Estudillo F.J. Logistic regression using covariates obtained by product-unit neural network models. Pattern Recognition 40 (2007) 52-64
20. Hochberg Y., and Tamhane A.C. Multiple comparison procedures (1987), John Wiley and Sons
21. Ismail, A., & Engelbrecht, A. P. (2000). Global optimization algorithms for training product units neural networks. In International joint conference on neural networks
22. Janson D.J., and Frenzel J.F. Training product unit neural networks with genetic algorithms. IEEE Expert 8 5 (1993) 26-33
23. Kasobov N.K. Evolving connectionist systems 'the knowledge engineering approach' (2006), Springer-Verlag, London
24. Kirkpatric S., Gellat C.D.J., and Vecchi M.P. Optimization by simulated annealing. Science 220 (1983) 671-680
25. Kooperberg C., Bose S., and Stone C.J. Polychotomous regression. Journal of the American Statistical Association 92 (1997) 117-127
26. Landwehr N., Hall M., and Eibe F. Logistic model trees. Machine Learning 59 (2005) 161-205
27. Lebanon, G., & Lafferty, J. (2002). Boosting and maximun likelihood for exponential models. In Proc. NIPS
28. Leerink L.R., et al. Learning with products units. Advances in Neural Networks Processing Systems 7 (1995) 537-544
29. Mahony S., et al. Self-organizing neural networks to support the discovery of DNA-binding motifs. Advances in self organising maps - WSOM'05. Neural Networks 19 6-7 (2006) 950-962
30. Martínez-Estudillo A.C., et al. Hybridation of evolutionary algorithms and local search by means of a clustering method. IEEE Transactions on Systems, Man and Cybernetics, Part. B: Cybernetics 36 3 (2006) 534-546
31. Martínez-Estudillo A.C., et al. Evolutionary product unit based neural networks for regression. Neural Networks 19 (2006) 477-486
32. Massey L. On the quality of ART1 text clustering. Advances in neural networks research: IJCNN '03. Neural Networks 16 5-6 (2003) 771-778
33. Miller G.F., Todd P.M., and Hedge S.U. Designing neural networks using genetic algorithms. Proc. 3rd int. conf. genetic algorithms and their applications (1989), Morgan Kaufmann, San Mateo, CA
34. Minka, T. (2003). A comparison of numerical optimizers for logistic regression. Dept. of Statistics, Carnegie Mellon Univ
35. In: Nikolaev N.Y., and Iba H. (Eds). Backpropagation and Bayesian methods, adaptive learning of polynomial networks: Genetic programming (2006), Springer, New York
36. Nikolaev N.Y., and Iba H. Learning polynomial feedforward neural networks by genetic programming and backpropagation. IEEE Transactions on Neural Networks 14 1 (2003) 337-350
37. Quinlan R. C4.5: Programs for machine learning (1993), Morgan Kauffman
38. Rechenberg I. Evolutionstrategie: Optimierung technischer Systeme nach Prinzipien der Biologischen Evolution (1975), Stuttgart Framman-Holzboog Verlag
39. Saito K., and Nakano R. Extracting regression rules from neural networks. Neural Networks 15 (2002) 1279-1288
40. Schmitt M. On the complexity of computing and learning with multiplicative neural networks. Neural Computation 14 (2001) 241-301
41. Schumacher M., Robner R., and Vach W. Neural networks and logistic regression: Part I. Computational Statistics & Data Analysis 21 (1996) 661-682
42. Song Q., et al. Integrating regression formulas and kernel functions into locally adaptive knowledge-based networks: A case study on renal function evaluation. Artificial Intelligence in Medicine 36 (2006) 235-244
43. Vach W., Robner R., and Schumacher M. Neural networks and logistic regression: Part II. Computational Statistics & Data Analysis 21 (1996) 683-701
44. In: Vapnik V. (Ed). The nature of statistical learning theory (1999), Springer
45. Wang, Y., & Witten, I. (1997). Inducing model trees for continuous classes. In Proceedings of poster papers, European conference on machine learning
46. Yao X. Evolving artificial neural network. Proceedings of the IEEE 9 87 (1999) 1423-1447
47. Yao X., and Liu Y. A new evolutionary system for evolving artificial neural networks. IEEE Transactions on Neural Networks 8 3 (1997) 694-713