Training of radial basis function classifiers with resilient propagation and variational Bayesian inference

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2009, Pages 838-847

  Fisch, Dominik ^a   Sick, Bernhard ^a  

^a UNIVERSITY OF PASSAU   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION TASKS; DATA SETS; DISCRIMINATIVE CLASSIFIERS; GAUSSIAN BASIS FUNCTIONS; HIDDEN NEURONS; LOSS FUNCTIONS; ON THE FLIES; POSTERIOR PROBABILITY; PROBABILISTIC INTERPRETATION; RADIAL BASIS FUNCTION CLASSIFIERS; RESILIENT PROPAGATION; TRAINING TECHNIQUES; VARIATIONAL BAYESIAN;

ATTITUDE CONTROL; BAYESIAN NETWORKS; INFERENCE ENGINES; LEARNING SYSTEMS; NEURAL NETWORKS; NEURONS; RADIAL BASIS FUNCTION NETWORKS;

CLASSIFIERS;

EID: 70449437193     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2009.5178699     Document Type: Conference Paper

References (34)

1. T. Poggio and F. Girosi, "A theory of networks for approximation and learning, " Massachusetts Institute of Technology - Artificial Intelligence Laboratory &Center for Biological Information Processing - Whitaker College, A. I. Memo No. 1140, C. B. I. P. Paper No. 31, 1989.
2. D. S. Broomhead and D. Lowe, "Multivariate functional interpolation and adaptive networks, " Complex Systems, vol. 2, pp. 321-355, 1988.
3. C. M. Bishop, Pattern Recognition and Machine Learning. Springer, New York NY, 2006.
4. D. Fisch, B. Kühbeck, B. Sick, and S. J. Ovaska, "Hard computing and soft computing in classification: Bridging the gap, " Information Sciences, 2008, (under review).
5. C. M. Bishop, Neural Networks for Pattern Recognition. Clarendon Press, Oxford, U. K., 1995.
6. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. John Wiley &Sons, Chichester, NY, 2001.
7. A. Zell, Simulation Neuronaler Netze. Addison-Wesley Publishing, Bonn, Germany, 1994.
8. M. Riedmiller and H. Braun, "A direct method for faster backpropagation learning: The RPROP algorithm, " in Proceedings of the 1993 IEEE International Conference on Neural Networks (ICNN '93), vol. 1, San Francisco, CA, 1993, pp. 586 - 591.
9. M. F Moller, "A scaled conjugate algorithm for fast supervised learning, " Neural Networks, vol. 6, no. 1, pp. 525 - 533, 1993.
10. A. J. Shepherd, Second Order Methods for Neural Networks - Fast and Reliable Training Methods for Multi-Layer Perceptrons. Springer, London, U. K., 1997.
11. O. Buchtala, M. Klimek, and B. Sick, "Evolutionary optimization of radial basis function classifiers for data mining applications, " IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, vol. 35, no. 5, pp. 928 - 947, 2005.
12. J. Gonzalez, I. Rojas, J. Ortega, H. Pomares, F Fernández, and A. F Diaz, "Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation, " IEEE Transactions on Neural Networks, vol. 14, no. 6, pp. 1478 - 1495, 2003.
13. B. A. Whitehead and T. D. Choate, "Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction, " IEEE Transactions on Neural Networks, vol. 7, no. 4, pp. 869 - 880, 1996.
14. L. Guo, D.-S. Huang, and W. Zhao, "Combining genetic optimisation with hybrid learning algorithm for radial basis function neural networks, " Electronics Letters, vol. 39, no. 22, pp. 1600 - 1601, 2003.
15. F Schwenker, H. Kestler, and G. Palm, "Three learning phases for radial-basis-function networks, " Neural Networks, vol. 14, no. 4-5, pp. 439-458, 2001.
16. O. Buchtala, P. Neumann, and B. Sick, "A strategy for an efficient training of radial basis function networks for classification applications, " in Proceedings of the International Joint Conference on Neural Networks (IJCNN 2003), vol. 2, Portland, OR, 2003, pp. 1025 - 1030.
17. Y.-Y Ou, Y.-J. Oyang, and C.-Y Chen, "A novel radial basis function network classifier with centers set by hierarchical clustering, " in Proceedings of the International Joint Conference on Neural Networks, Montreal, Canada, 2005, pp. 1383 - 1388.
18. A. Bouchachia, "Learning with hybrid data, " in Proceedings of the 5th International Conference on Hybrid Intelligent Systems (HIS '05), Rio de Janeiro, Brazil, 2005, pp. 193 - 198.
19. J. Grim, "Maximum-likelihood design of layered neural networks, " in Proceedings of the 13th International Conference on Pattern Recognition (ICPR'96), vol. 4, Vienna, Austria, 1996, pp. 85 - 89.
20. R. Langari, L. Wang, and J. Yen, "Radial basis function networks, regression weights, and the expectation-maximization algorithm, " IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, vol. 27, no. 5, pp. 613 - 623, 1997.
21. Z. R. Yang, "A novel radial basis function neural network for discriminant analysis, " IEEE Transactions on Neural Networks, vol. 17, no. 3, pp. 604 - 612, 2006.
22. Y.-J. Oyang, S.-C. Hwang, Y.-Y. Ou, C.-Y. Chen, and Z.-W. Chen, "Data classification with radial basis function networks based on a novel kernel density estimation algorithm, " IEEE Transactions on Neural Networks, vol. 16, no. 1, pp. 225 - 236, 2005.
23. M. Titsias and A. Likas, "A probabilistic RBF network for classification, " in Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN 2000), vol. 4, Como, Italy, July 1997, pp. 238 - 243.
24. M. K. Titsias and A. C. Likas, "Shared kernel models for class conditional density estimation, " IEEE Transactions on Neural Networks, vol. 12, no. 5, pp. 987 - 997, 2001.
25. M. K. Titsias and A. Likas, "Class conditional density estimation using mixtures with constrained component sharing, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 924- 928, 2003.
26. C. Constantinopoulos and A. Likas, "An incremental training method for the probabilistic RBF network, " IEEE Transactions on Neural Networks, vol. 17, no. 4, pp. 966 - 974, 2006.
27. -, "Unsupervised learning of gaussian mixtures based on variational component splitting, " IEEE Transactions on Neural Networks, vol. 18, no. 3, pp. 745 - 755, 2007.
28. F Bajramovic, C. Gruber, and B. Sick, "A comparison of first- and second-order training algorithms for dynamic neural networks, " in Proceedings of the International Joint Conference on Neural Networks (IJCNN 2004), vol. 2, Budapest, Hungary, 2004, pp. 837 - 842.
29. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm, " Journal of the Royal Statistical Society. Series B (Methodological), vol. 39, no. 1, pp. 1 - 38, 1977.
30. G. J. McLachlan and T. Krishnan, The EM Algorithm and Extensions, 2nd ed., ser. Probability and Statistics. John Wiley &Sons, New York, NY, 2008.
31. T. S. Jaakkola, "Tutorial on variational approximation methods, " in Advanced Mean Field Methods: Theory and Practice, M. Opper and D. Saad, Eds. MIT Press, Cambridge, MA, 2001, pp. 129 - 160.
32. R. Srinivasan, Importance sampling: Applications in communications and detection. Springer, Berlin, 2002.
33. C. Aviles-Cruz, A. Guerin-Dugue, J. L. Voz, and D. Van Cappel, "ELENA - enhanced learning for evolutive neural architecture, " UCL Machine Learning Group, Catholic University of Leuven, Leuven, Belgium, Technical report of ESPRIT Basic Research Project Number 6891, http://www.dice.ucl.ac.be/mlg/?page=Elena, 1995.
34. R. P. Würtz, Ed., Organic Computing, ser. Understanding Complex Systems. Germany: Springer-Verlag Berlin and Heidelberg, 2008.