Technical data mining with evolutionary radial basis function classifiers

Applied Soft Computing Journal

Volumn 9, Issue 2, 2009, Pages 765-774

  Bauer, Markus ^a   Buchtala, Oliver ^b   Horeis, Timo ^c   Kern, Ralf ^d   Sick, Bernhard ^b   Wagner, Robert ^b  

^a WACKER CHEMIE AG   (Germany)

^b UNIVERSITY OF PASSAU   (Germany)

^c Siltronic AG ^*

^d Micro Epsilon Messtechnik GmbH and Co KG   (Germany)

Author keywords

Data mining; Evolutionary algorithm; Feature selection; Interpretability; Knowledge extraction; Model selection; Radial basis function neural network; Understandability

Indexed keywords

ALGORITHMS; ATTITUDE CONTROL; CUSTOMER SATISFACTION; DATA MINING; EVOLUTIONARY ALGORITHMS; FEATURE EXTRACTION; FEEDFORWARD NEURAL NETWORKS; FUNCTION EVALUATION; FUNCTIONS; IMAGE SEGMENTATION; INDUSTRIAL APPLICATIONS; INFORMATION MANAGEMENT; KNOWLEDGE BASED SYSTEMS; KNOWLEDGE MANAGEMENT; MINING; NEURAL NETWORKS; PROBABILITY DENSITY FUNCTION; QUALITY ASSURANCE; QUALITY FUNCTION DEPLOYMENT; TOTAL QUALITY MANAGEMENT;

EVOLUTIONARY ALGORITHM; FEATURE SELECTION; INTERPRETABILITY; KNOWLEDGE EXTRACTION; MODEL SELECTION; RADIAL BASIS FUNCTION NEURAL NETWORK; UNDERSTANDABILITY;

RADIAL BASIS FUNCTION NETWORKS;

EID: 58849108463     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2008.07.007     Document Type: Article

References (54)

1. Bishop C.M. Neural Networks for Pattern Recognition (1995), Clarendon Press, Oxford
2. T. Poggio, F. Girosi, A theory of networks for approximation and learning, A.I. Memo no. 1140, C.B.I.P. Paper no. 31, Massachusetts Institute of Technology-Artificial Intelligence Laboratory & Center for Biological Information Processing-Whitaker College (1989).
3. Haykin S. Neural Networks-A Comprehensive Foundation (1994), Macmillan College Publishing Company, New York
4. T. Bäck, Evolutionary algorithms in theory and practice, Ph.D. thesis, Universität Dortmund, Fachbereich Informatik (1994).
5. Michalewicz Z. Genetic Algorithms + Data Structures = Evolution Programs. third ed. (1996), Springer-Verlag, Berlin/Heidelberg/New York
6. Brodley C.E., and Smyth P. Applying classification algorithms in practice. Statistics and Computing 7 (1997) 45-56
7. O. Buchtala, B. Sick, Goodness of fit: measures for a fuzzy classifier, in: Proceedings of the First IEEE Symposium on Foundations of Computational Intelligence (FOCI'07), Honolulu, 2007, pp. 201-207.
8. O. Buchtala, Transformation von Radialen-Basisfunktionen-Netzen in Fuzzy Systeme, Master's thesis, University of Passau, Department of Mathematics and Computer Science (2005).
9. M. Bauer, O. Buchtala, T. Horeis, R. Kern, B. Sick, R. Wagner, Process Identification and Quality Control with Evolutionary Optimized RBF Classifiers, in: Proceedings of the 2005 IEEE Mid-Summer Workshop on Soft Computing in Industrial Applications (SMCia/05), Espoo, 2005, pp. 178-183.
10. Klimek M., and Sick B. Architecture optimization of radial basis function networks with a combination of hard- and soft-computing techniques. Proceedings of the 2003 IEEE International Conference on Systems, vol. 5. Man and Cybernetics, Washington DC (2003) 4664-4671
11. Buchtala O., Klimek M., and Sick B. Evolutionary optimization of radial basis function classifiers for data mining applications, IEEE Transactions on Systems, Man. and Cybernetics-Part B: Cybernetics 35 5 (2005) 928-947
12. Liu H., and Motoda H. Feature Selection for Knowledge Discovery and Data Mining (1998), Kluwer Academic Publishers, Boston
13. H. Liu, H. Motoda (Eds.), Feature Extraction, Construction, and Selection: A Data Mining Perspective, Kluwer Academic Publishers, Boston, 1998.
14. Whitehead B.A., and Choate T.D. Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction. IEEE Transactions on Neural Networks 7 4 (1996) 869-880
15. A.J. Rivera, J. Ortega, I. Rojas, A. Prieto, Optimizing RBF networks with cooperative/competitive evolution of units and fuzzy rules, in: Connectionist Models of Neurons, Learning Processes, Artificial Intelligence, vol., 1 of Springer LNCS (6th International Work-Conference on Artificial, Natural Neural Networks (IWANN 2001), Granada), 2001, pp. 570-578.
16. Whitehead B.A., and Choate T.D. Evolving space-filling curves to distribute radial basis functions over an input space. IEEE Transactions on Neural Networks 5 1 (1994) 15-23
17. Bai Y., and Zhang L. Genetic algorithm based self-growing training for RBF neural networks. Proceedings of the 2002 International Joint Conference on Neural Networks (IJCNN'02), Honolulu, vol. 1 (2002) 840-845
18. González J., Rojas I., Ortega J., Pomares H., Fernández F., and Diaz A.F. Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation. IEEE Transactions on Neural Networks 14 6 (2003) 1478-1495
19. Lacerda E., de Carvalho A., and Ludermir T. Evolutionary optimization of RBF networks. In: Howlett R.J., and Jain L.C. (Eds). Radial Basis Function Networks 1-Recent Developments in Theory and Applications, vol. 66 of Studies in fuzzyness and soft computing (2001), Physica-Verlag, Heidelberg/New York 281-309 (Chapter 11)
20. Roberts S.G., and Turega M. Evolving neural network structures: an evaluation of encoding techniques. In: Pearson D.W., Steele N.C., and Albrecht R.F. (Eds). Artificial Neural Nets and Genetic Algorithms, Alès (1995), Springer Verlag, Wien, New York 96-99
21. Buchtala O., Hofmann A., and Sick B. Fast and efficient training of RBF networks. In: Kaynak O., Alpaydin E., Oja E., and Xu L. (Eds). Artificial Neural Networks and Neural Information Processing-ICANN/ICONIP, 2003, Istanbul, no. 2714 in LNCS (2003), Springer Verlag, Berlin/Heidelberg/New York 43-51
22. Buchtala O., Neumann P., and Sick B. A strategy for an efficient training of radial basis function networks for classification applications. Proceedings of the IEEE-INNS International Joint Conference on Neural Networks, vol. 2. Portland (2003) 1025-1030
23. Zhao W., Huang D.-S., and Guo L. Optimizing radial basis probabilistic neural networks using recursive orthogonal least squares algorithms combined with micro-genetic algorithms. Proceedings of the International Joint Conference on Neural Networks, vol. 3. Portland (2003) 2277-2282
24. Chen S., Wu Y., and Alkadhimi K. A two-layer learning method for radial basis function networks using combined genetic and regularised OLS algorithms. First International Conference on Genetic Algorithms in Engineering Systems: Innovations and Applications (GALESIA), Sheffield (1995) 245-249
25. M. Riedmiller, RPROP-Description and implementation details, Technical report, Univ. Karlsruhe, 1994.
26. Møller M.F. A scaled conjugate algorithm for fast supervised learning. Neural Networks 6 1 (1993) 525-533
27. Bishop C.M. Pattern Recognition and Machine Learning (2006), Springer, New York, NY
28. Liu G.P., and Kadirkamanathan V. Multiobjective criteria for neural network structure selection and identification of nonlinear systems using genetic algorithms. IEE Proceedings Control Theory and Applications 146 5 (1999) 373-382
29. Billings S.A., and Zheng G.L. Radial basis function network configuration using genetic algorithms. Neural Networks 8 6 (1998) 877-890
30. Yen G.G., and Lu H. Hierarchical rank density genetic algorithm for radial-basis function neural network design. Proceedings of the 2002 Congress on Evolutionary Computation (CEC'02), Honolulu, vol. 1 (2002) 25-30
31. Liu G.P., and Kadirkamanathan V. Learning with multi-objective criteria. Fourth International Conference on Artificial Neural Networks. Cambridge (1995) 53-58
32. de Lacerda E.G.M., de Carvalho A.C.P.L.F., and Ludermir T.B. A study of cross-validation and bootstrap as objective functions for genetic algorithms. VII Brazilian Symposium on Neural Networks (SBRN 2002), Recife (2002) 118-123
33. Ferreira P.M., Ruano A.E., and Fonseca C.M. Genetic assisted selection of RBF model structures for greenhouse inside air temperature prediction. Proceedings of IEEE Conference on Control Applications (CCA 2003), Istanbul, vol. 1 (2003) 576-581
34. Barreto A.D.M.S., Barbosa H.J.C., and Ebecken N.F.F. Growing compact RBF networks using a genetic algorithm. Proceedings of the VII Brazilian Symposium on Neural Networks (SBRN 2002), Recife (2002) 61-66
35. Zhao W., Huang D.-S., and Yunjian G. The structure optimization of radial basis probabilistic neural networks based on genetic algorithms. Proceedings of the 2002 International Joint Conference on Neural Networks (IJCNN'02), Honolulu, vol. 2 (2002) 1086-1091
36. Hwang M.W., Kim M.H., and Choi J.Y. Second-order multiplayer perceptions and its optimization with genetic algorithms. Proceedings of the 2000 Congress on Evolutionary Computation (CEC 2000), La Jolla, vol. 1 (2000) 652-658
37. Maillard E.P., and Gueriot D. RBF neural network, basis functions and genetic algorithm. International Conference on Neural Networks, Houston, vol. 4 (1997) 2187-2192
38. Aouiti C., Alimi A.M., and Maalej A. A comparative study between real and discrete genetic algorithms for the design of beta basis function neural networks. IEEE International Conference on Systems, Man and Cybernetics, Hammamet, vol. 3 (2002)
39. Najarian K., Dumont G.A., and Davies M.S. A learning-theory-based training algorithm for variable-structure dynamic neural modeling. International Joint Conference on Neural Networks (IJCNN'99), Washington, vol. 1 (1999) 477-482
40. de Lacerda E.G.M., de Carvalho A.C.P.L.F., and Ludermir T.B. Evolutionary optimization of RBF networks. Sixth Brazilian Symposium on Neural Networks, Rio de Janeiro (2000) 219-224
41. Bhumireddy C., and Chen C.L.P. Genetic learning of functional link networks. Proceedings of the International Joint Conference on Neural Networks, Portland, vol. 1 (2003) 432-437
42. M. Klimek, Evolutionäre Architekturoptimierung von RBF-Netzen, Master's thesis, University of Passau, Department of Mathematics and Computer Science, 2003.
43. P. Maier, Untersuchung von Nebenbedingungen bei der Evolution von RBF-Netzen, Bachelor's thesis, University of Passau, Department of Mathematics and Computer Science, 2006.
44. Wacker Siltronic AG, Burghausen, Wacker Siltronic-Wafers for the World of Microchips, February 2000.
45. Siltronic AG, How to Produce a Silicon Wafer, Flyer (2004). URL http://www.siltronic.com/int/media/publication/downloads/Poster_2004_DE. pdf.
46. T. Sheridan, W. Verplank, Human and computer control of undersea teleoperators, Technical report, MIT Man-Machine Systems Laboratory, Cambridge, Massachusetts, 1978.
47. Mitra S., Pal S., and Mitra P. Data mining in soft computing framework: a survey. IEEE Transactions on Neural Networks 13 1 (2001) 3-14
48. Roger Jang J.-S., and Sun C.-T. Functional equivalence between radial basis function networks and fuzzy inference systems. IEEE Transactions on Neural Networks 4 1 (1993) 156-159
49. Hunt K.J., Haas R., and Murray-Smith R. Extending the functional equivalence of radial basis function networks and fuzzy inference systems. IEEE Transactions on Neural Networks 7 3 (1996) 776-781
50. Andersen H.C., Lotfi A., and Westphal L.C. Comments on "Functional equivalence between radial basis function networks and fuzzy inference systems". IEEE Transactions on Neural Networks 9 6 (1998) 1529-1531
51. O. Buchtala, B. Sick, Functional knowledge exchange within an intelligent distributed system, in: P. Lukowicz, L. Thiele, G. Tröster (Eds.), in: Proceedings of the 20th International Conference on Architecture of Computing Systems-System Aspects in Pervasive and Organic Computing, Zurich, Architecture of Computing Systems-ARCS 2007. no. 4415 in Lecture Notes in Computer Science, Springer Verlag, Berlin/Heidelberg/New York, 2007, pp. 126-141.
52. Buchtala O., and Sick B. Techniques for the fusion of symbolic rules in distributed organic systems. Proceedings of the IEEE Mountain Workshop on Adaptive and Learning Systems (SMCals/06), Logan (2006) 85-90
53. Andrade D., Horeis T., and Sick B. Knowledge fusion using Dempster-Shafer theory and the imprecise Dirichlet model. Proceedings of the 2008 IEEE Conference on Soft Computing in Industrial Applications (SMCia/08), Muroran (2008) 142-148
54. Horeis T., and Sick B. Collaborative knowledge discovery & data mining: from knowledge to experience. IEEE Symposium on Computational Intelligence and Data Mining (CIDM), Honolulu (2007) 421-428