Variable selection in nonlinear modeling based on RBF networks and evolutionary computation

International Journal of Neural Systems

Volumn 20, Issue 5, 2010, Pages 365-379

  Patrinos, Panagiotis ^a   Alexandridis, Alex ^b   Ninos, Konstantinos ^a   Sarimveis, Haralambos ^a  

^a NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

^b UNIVERSITY OF WEST ATTICA   (Greece)

Author keywords

evolutionary computation; gas furnace data; Mackey glass data; neural networks; quantitative structure activity relationship (QSAR); radial basis functions; Variable selection

Indexed keywords

EVOLUTIONARY COMPUTATIONS; MACKEY GLASS DATA; QUANTITATIVE STRUCTURE-ACTIVITY RELATIONSHIPS; RADIAL BASIS FUNCTIONS; VARIABLE SELECTION;

CALCULATIONS; FUNCTION EVALUATION; FURNACES; GAS FURNACES; GENETIC ALGORITHMS; GLASS; IMAGE SEGMENTATION; NEURAL NETWORKS; PARAMETER ESTIMATION; TUNING;

RADIAL BASIS FUNCTION NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; DRUG DESIGN; FUZZY LOGIC; STRUCTURE ACTIVITY RELATION;

ALGORITHMS; DRUG DESIGN; FUZZY LOGIC; NEURAL NETWORKS (COMPUTER); STRUCTURE-ACTIVITY RELATIONSHIP;

EID: 77958043391     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065710002474     Document Type: Article

References (100)

1. X. Jiang and H. Adeli, Dynamic wavelet neural network for nonlinear identification of highrise buildings, Computer-Aided Civil and Infrastructure Engineering 20(5) (2005) 316-330. (Pubitemid 40906713)
2. H. Adeli and X. Jiang, Dynamic fuzzy wavelet neural network model for structural system identification, Journal of Structural Engineering, ASCE 132(1) (2006) 102-111.
3. X. Jiang, S. Mahadevan and H. Adeli, Bayesian wavelet packet denoising for structural system identification, Structural Control and Health Monitoring 14(2) (2007) 333-356.
4. X. He, B. Moaveni, J. P. Conte and A. Elgamal, Modal identification study of Vincent Thomas Bridge using simulated wind-induced ambient vibration data, Computer-Aided Civil and Infrastructure Engineering 23(5) (2008) 373-388.
5. G. Puscasu and B. Codres, Nonlinear system identification based on internal recurrent neural networks, International Journal of Neural Systems 19(2) (2009) 115-125.
6. B. Moaveni, X. He and J. P. Conte, Damage identification of a composite beam based on changes of modal parameters, Computer-Aided Civil and Infrastructure Engineering 23(5) (2008) 339-359.
7. S. Soyoz and M. Q. Feng, Long-term monitoring and identification of bridge structural parameters, Computer-Aided Civil and Infrastructure Engineering 24(2) (2009) 82-92.
8. D. Furundzic, Application example of neural networks for time series analysis: Rainfall-runoff modeling, Signal Processing 64(3) (1998) 383.
9. M. Kudo and J. Sklansky, Comparison of algorithms that select features for pattern classifiers, Pattern Recognition 33 (2000) 25-41.
10. Y. S. Kim and W. N. Street, An intelligent system for customer targeting: A data mining approach, Decision Support Systems 27(2) (2004) 215-228.
11. T. Similä and S. Laine, Visual approach to supervised variable selection by self-organizing map, International Journal of Neural Systems 15(1-2) (2005) 101-110.
12. B. T. Hoffman, T. Kopajtic, J. L. Katz and A. H. Newman, 2D QSAR modeling and preliminary database searching for dopamine transporter inhibitors using genetic algorithm variable selection of Molconn Z descriptors, J. Med. Chem. 43 (2000) 4151-4159.
13. D. Broadhurst, R. Goodacre, A. Jones, J. J. Rowland and D. B. Kell, Genetic algorithms as a method for variable selection in multiple linear regression and partial least squares regression, with applications to pyrolysis mass spectrometry, Anal. Chim. Acta 348 (1997) 71-86.
14. S. Guillaume and B. Charnomordic, Knowledge discovery for control purposes in food industry databases, Fuzzy Sets and Systems 122 (2001) 487-497.
15. H. Sarimveis, A. Alexandridis, G. Tsekouras and G. Bafas, A fast and efficient algorithm for training radial basis function neural networks based on a fuzzy partition of the input space, Ind. Eng. Chem. Res. 41 (2002) 751-759.
16. I. J. Leontaritis and S. A. Billings, Model selection and validation methods for non-linear systems, Int. J. Control 45 (1987) 311-341.
17. M. C. Mackey and L. Glass, Oscillation and chaos in physiological control systems, Science 197 (1977) 287-289.
18. D. E. Box and G. M. Jenkins, Time Series Analysis, Forecasting and Control (California: Holden Day, 1976).
19. D. L. Selwood, D. J. Livingstone, J. C. Comley, B. A. O'Dowd, A. T. Hudson, P. Jackson, K. S. Jandu, V. S. Rose and J. N. Stables, Structure-activity relationships on antifilarial antimycin analogues: A multivariate pattern recognition study, Journal of Medicinal Chemistry 33 (1990) 136-142.
20. N. R. Draper and H. Smith, Applied Regression Analysis, 2nd edition (Wiley, New York, 1981).
21. P. Geladi and B. R. Kowalski, Partial least squares regression: A tutorial, Anal. Chim. Acta 185 (1986) 1-17.
22. T. Næs and H. Martens, Principal component regression in NIR analysis: Viewpoints, background details and selection of components, J. Chemom. 2 (1988) 155-167.
23. Q. Wu and J. Ben-Arie, View invariant head recognition by hybrid PCA based reconstruction, Integrated Computer-Aided Engineering 15(2) (2008) 97-108.
24. E. Lopez-Rubio and J. M. Ortiz-de-Lazcano- Lobato, Dynamic competitive probabilistic principal components analysis, International Journal of Neural Systems 19(2) (2009) 91-103.
25. A. Panakkat and H. Adeli, Neural network models for earthquake magnitude prediction using multiple seismicity indicators, International Journal of Neural Systems 17(1) (2007) 13-33.
26. H. T. Huynh, Y. Won and J. J. Kim, An improvement of extreme learning machine for compact single- hidden-layer feedforward neural networks, International Journal of Neural Systems 18(5) (2008) 433-441.
27. S. L Hung and H. Adeli, Parallel backpropagation learning algorithms on cray Y-MP8/864 supercomputer, Neurocomputing 5(6) (1993) 287-302.
28. M. Asaduzzaman, M. Shahjahan and K. Murase, Faster training using fusion of activation functions for feed forward neural networks, International Journal of Neural Systems 19(6) (2009) 437-448.
29. F. Despagne and D. L. Massart, Variable selection for neural networks in multivariate calibration, Chemom. Intell. Lab. Syst. 40 (1998) 145-163.
30. F. Dieterle, B. Kieser and G. Gauglitz, Genetic algorithms and neural networks for the quantitative analysis of ternary mixtures using surface plasmon resonance, Chemom. Intell. Lab. Syst. 65 (2003) 67-81.
31. H. Adeli and S. L. Hung, A concurrent adaptive conjugate gradient learning algorithm on MIMD machines, Journal of Supercomputer Applications, MIT Press 7(2) (1993) 155-166.
32. H. Adeli and A. Samant, An adaptive conjugate gradient neural network - Wavelet model for traffic incident detection, Computer-Aided Civil and Infrastructure Engineering 15(4) (2000) 251-260.
33. H. Adeli and H. S. Park, A neural dynamics model for structural optimization - Theory, Computers and Structures 57(3) (1995b) 383-390.
34. H. Adeli and H. S. Park, Optimization of space structures by neural dynamics, Neural Networks 8(5) (1995c) 769-781.
35. H. S. Park and H. Adeli, A neural dynamics model for structural optimization - Application to plastic design of structures, Computers and Structures 57(3) (1995) 391-399.
36. H. S. Park and H. Adeli, Distributed neural dynamics algorithms for optimization of large steel structures, Journal of Structural Engineering, ASCE 123(7) (1997) 880-888. (Pubitemid 127663695)
37. A. Karim and H. Adeli, CONSCOM: An OO construction scheduling and change management system, Journal of Construction Engineering and Management 125(5) (1999) 368-376.
38. A. B. Senouci and H. Adeli, Resource scheduling using neural dynamics model of adeli and park, Journal of Construction Engineering and Management, ASCE 127(1) (2001) 28-34. (Pubitemid 32158956)
39. H. Adeli and H. S. Park, Counter propagation neural network in structural engineering, Journal of Structural Engineering, ASCE 121(8) (1995a) 1205-1212.
40. H. Adeli and A. Panakkat, A probabilistic neural network for earthquake magnitude prediction, Neural Networks 22 (2009) 1018-1024.
41. M. Ahmadlou and H. Adeli, Enhanced Probabilistic neural network with local decision circles: A robust classifier, Integrated Computer-Aided Engineering 17(3) (2010).
42. H. Adeli and A. Karim, Fuzzy-Wavelet RBFNN model for freeway incident detection, Journal of Transportation Engineering 126(4) (2000) 464-471.
43. S. Ghosh-Dastidar and H. Adeli, Wavelet- Clustering-Neural network model for freeway incident detection, Computer-Aided Civil and Infrastructure Engineering 18(5) (2003) 325-338.
44. X. Jiang and H. Adeli, Pseudospectra, MUSIC, and dynamic wavelet neural network for damage detection of highrise buildings, International Journal for Numerical Methods in Engineering 71(5) (2007) 606-629.
45. X. Jiang and H. Adeli, Dynamic fuzzy wavelet neuroemulator for nonlinear control of irregular highrise building structures, International Journal for Numerical Methods in Engineering 74(7) (2008a) 1045-1066.
46. X. Jiang and H. Adeli, Neuro-genetic algorithm for nonlinear active control of highrise buildings, International Journal for Numerical Methods in Engineering 75(8) (2008b) 770-786.
47. W. Zou, Z. Chi and K. C. Lo, Improvement of image classification using wavelet coefficients with structured-based neural network, International Journal of Neural Systems 18(3) (2008) 195-205.
48. A. M. A. Haidar, A. Mohamed, M. Al-Dabbagh, A. Aini Hussain and M. Masoum, An intelligent load shedding scheme using neural networks and neuro-fuzzy, International Journal of Neural Systems 19(6) (2009) 473-479.
49. P. Anand, B. V. N. Siva Prasad and Ch. Venkateswarlu, Modeling and optimization of a pharmaceutical formulation system using radial basis function network, International Journal of Neural Systems 19(2) (2009) 127-136.
50. A. Karim and H. Adeli, Comparison of the fuzzy - wavelet RBFNN freeway incident detection model with the california algorithm, Journal of Transportation Engineering 128(1) (2002) 21-30.
51. A. Karim and H. Adeli, Radial basis function neural network for work zone capacity and queue estimation, Journal of Transportation Engineering 129(5) (2003) 494-503.
52. R. V. Mayorga and J. Carrera, A radial basis function network approach for the computational of inverse continuous time variant functions, International Journal of Neural Systems 17(3) (2007) 149-160.
53. H. Liu, X. Wang and W. Qiang, A fast method for implicit surface reconstruction based on radial basis functions network from 3D scattered points, International Journal of Neural Systems 17(6) (2007) 459-465.
54. W. Pedrycz, R. Rai and J. Zurada, Experienceconsistent modeling for radial basis function neural networks, International Journal of Neural Systems 18(4) (2008) 279-292.
55. S. Ghosh-Dastidar, H. Adeli and N. Dadmehr, Principal component analysis-enhanced cosine radial basis function neural network for robust epilepsy and seizure detection, IEEE Transactions on Biomedical Engineering 55(2) (2008) 512-518.
56. P. Anand, B. V. N. Siva Prasad and C. Venkateswarlu, Modeling and optimization of a pharmaceutical formulation system using radial basis function network, International Journal of Neural Systems 19(2) (2009) 127-136.
57. R. Savitha, S. Suresh and N. Sundararajan, A fully complex-valued radial basis function network and its learning algorithm, International Journal of Neural Systems 19(4) (2009) 253-267.
58. Q. Junfei and H. Honggui, A repair algorithm for radial basis function neural network with application to chemical oxygen demand modeling, International Journal of Neural Systems 20(1) (2010) 63-74.
59. D. Wu, K. Warwick, Z. Ma, M. N. Gasson, J. G. Burgess, S. Pan and T. Z. Aziz, Prediction of Parkinson's disease tremor onset using radial basis function neural network based on particle swarm optimization, International Journal of Neural Systems 20(2) (2010) 109-116.
60. C. Lu, T. Van Gestel, J. A. K. Suykens, S. Van Huffel, I. Vergote and D. Timmerman, Preoperative prediction of malignancy of ovarian tumors using least squares support vector machines, Artificial Intelligence in Medicine 28 (2003) 281-306. (Pubitemid 36966127)
61. J. Pacheco, S. Casado, L. Ńuñez and O. Ǵomez, Analysis of new variable selection methods for discriminant analysis, Computational Statistics & Data Analysis 51(3) (2006) 1463-1478.
62. S. J. Cho and M. A. Hermsmeier, Genetic algorithm guided selection: Variable selection and subset selection, J. Chem. Inf. Comput. Sci. 42 (2002) 927-936.
63. A. Sierra, J. A. Macias and F. Corbacho, Evolution of functional link networks, IEEE Transaction on Evolutionary Computation 5(1) (2001).
64. K. C. Sarma and H. Adeli, Bi-level parallel genetic algorithms for optimization of large steel structures, Computer-Aided Civil and Infrastructure Engineering 16(5) (2001) 295-304.
65. M. W. Kang, P. Schonfeld and N. Yang, Prescreening and repairing in a genetic algorithm for highway alignment optimization, Computer-Aided Civil and Infrastructure Engineering 24(2) (2009) 109-119.
66. U. Horchner and J. H. Kalivas, Further investigation on a comparative study of simulated annealing and genetic algorithm for wavelength selection, Analytica Chimica Acta 311 (1995) 1-13.
67. I. Paya, V. Yepes, F. Gonźalez-Vidosa and A. Hospitaler, Multiobjective optimization of concrete frames by simulated annealing, Computer-Aided Civil and Infrastructure Engineering 23(8) (2008) 596-610.
68. J. A. Zeferino, A. P. Antunes and M. C. Cunha, An efficient simulated annealing algorithm for regional wastewater systems planning, Computer- Aided Civil and Infrastructure Engineering 24(5) (2009) 359-370.
69. K. Baumann, M. von Korff and H. Albert, A systematic evaluation of the benefits and hazards of variable selection in latent variable regression. Part I. Search Algorithm, theory and simulations, Journal of Chemometrics 16 (2002) 339-350.
70. G. Lebrun, C. Charrier, O. Lezoray and H. Cardot, Tabu search model selection for SVM, International Journal of Neural Systems 18(1) (2008) 19-31.
71. S. Izrailev and D. Agrafiotis, A novel method for building regression tree models for QSAR based on artificial ant colony systems, J. Chem. Inf. Comput. Sci. 41(1) (2001) 176-180.
72. B. J. Vitins and K. W. Axhausen, Optimization of large transport networks using the ant colony heuristic, Computer-Aided Civil and Infrastructure Engineering 24(1) (2009) 1-14.
73. D. K. Agrafiotis and W. Cedeno feature selection for structure-activity correlation using binary particle swarms, Journal of Medicinal Chemistry 45 (2002) 1098-1107.
74. A. Rodriguez and J. Reggia, A distributed learning algorithm for particle systems, Integrated Computer-Aided Engineering 16(1) (2009) 1-20.
75. H. M. Elragal, Improving neural networks prediction accuracy using particle swarm optimization combiner, International Journal of Neural Systems 19(5) (2009) 387-393.
76. D. R. Rogers and A. J. Hopfinger, Application of genetic function approximation to quantitative structure-activity relationships and quantitative structure-property relationships, J. of Chem. Inf. Comput. Sci. 34 (1994) 854-866.
77. D. Liu, S. L. Shah and D. G. Fisher, Choice of latent explanatory variables: A multiobjective optimization approach, J. Chemometrics 14(2) (2000) 79-92.
78. H. Akaike, A new look at a statistical model identification, IEEE Trans. Automat. Control 19 (1974) 716-722.
79. C. L. Mallows, Some comments on Cp, Technometrics 15 (1973) 661-675.
80. J. Moody and C. Darken, Fast learning in networks of locally-tuned processing units, Neural Computation 1 (1989) 281-294.
81. Z. Michalewitz, Genetic Algorithms+Data Structures= Evolution Programs, 3rd edn. (Berlin, Springer Verlag, 1996).
82. D. E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning (Addison- Wesley: Reading, MA, 1989).
83. X. Zhao, X. S. Gao and Z. C. Hu, Evolutionary programming based on non-uniform mutation, Applied Mathematics and Computation 192(1) (2007) 1-11.
84. J. S. R. Jang, ANFIS: Adaptive-network-based fuzzy inference system, IEEE Transactions on Systems, Man and Cybernetics 23(3) (1993) 665-685.
85. S. Paul and S. Kumar, Subsethood-product fuzzy neural inference system (SuPFuNIS),IEEE Transactions on Neural Networks 3 (2002) 578-599.
86. Y. Liu and X. Yao, Simultaneous training of negatively correlated neural networks in an ensemble, IEEE Transaction on Systems 29(6) (1999) 716-725.
87. M. Orr, Regularisation in the selection of radial basis function centres, Neural Computation 7(3) (1995) 606-623.
88. S. K. Oh, M. S. Kim, T. D. Eom and J. J. Lee, Heterogeneous local model networks for time series prediction, Applied Mathematics and Computation 168(1) (2005) 164-177.
89. R. M. Tong, The evaluation of fuzzy models derived from experimental data, Fuzzy Sets Syst. 13 (1980) 1-12.
90. M. Sugeno and T. Yasukawa, Linguistic modeling based on numerical data, in IFSA '91, Brussels, Computer, Management & Systems Science (1991) 264-267.
91. C. W. Xu and Y. Zailu, Fuzzy model identification self-learning for dynamic system, IEEE Trans. Syst., Man Cyber. SMC-17 4 (1987) 683-689.
92. W. Pedrycz, An identification algorithm in fuzzy relational system, Fuzzy Sets Syst. 13 (1984) 153-167.
93. S. K. Oh and W. Pedrycz, Identification of fuzzy systems by means of an auto-tuning algorithm and its application to non-linear systems, Fuzzy Sets Syst. 115(2) (2000) 205-230.
94. E. Kim, H. Lee, M. Park and M. Park, A simple identified Sugeno-type fuzzy model via double clustering, Inf. Sci. 110 (1998) 25-39.
95. Y. Lin and G. A. Cunningham III, A new approach to fuzzy-neural modeling, IEEE Trans. Fuzzy Syst. 3(2) (1995) 190-197.
96. S.-K. Oh, W. Pedrycz and H.-S. Park, Implicit rulebased fuzzy-neural networks using the identification algorithm of GA hybrid scheme based on information granulation, Advanced Engineering Informatics, 16 (2002) 247-263.
97. S. S. So and M. Karplus, Evolutionary optimization in quantitative structure-activity relationship: An application of genetic neural networks, J. Med. Chem. 39 (1996) 1521-1530.
98. S. S. Liu, H.-L. Liu, C.-S. Yin and L.-S. Wang, VSMP: A novel variable selection and modeling method based on the prediction, J. Chem. Inf. Comput. Sci. 43 (2003) 964-969.
99. C. L. Waller and M. P. Bradley, Development and validation of a novel variable selection technique with application to multidimensional quantitative structure-activity relationship studies, J. Chem. Inf. Comput. Sci. 39 (1999) 345-355.
100. O. Nicolotti, V. J. Gillet, P. J. Fleming and D. V. S. Green, Multiobjective optimization in quantitative structure-activity relationships: Deriving accurate and interpretable results, J. Med. Chem. 45 (2002) 5069-5080.