Generating balanced learning and test sets for function approximation problems

International Journal of Neural Systems

Volumn 21, Issue 3, 2011, Pages 247-263

  Florido, J P ^a   Pomares, H ^a   Rojas, I ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

Clustering; data distribution; function approximation; least squares support vector machines; nearest neighbor

Indexed keywords

CLUSTERING; DATA DISTRIBUTION; FUNCTION APPROXIMATION; LEAST SQUARES SUPPORT VECTOR MACHINES; NEAREST-NEIGHBORS;

APPROXIMATION ALGORITHMS; CLUSTERING ALGORITHMS; DATA MINING; DISTRIBUTION FUNCTIONS; EXPERIMENTS; FUNCTION EVALUATION; STATISTICAL TESTS;

LEARNING ALGORITHMS;

ALGORITHM; ANALYSIS OF VARIANCE; ARTICLE; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; DATA MINING; NONLINEAR SYSTEM;

ALGORITHMS; ANALYSIS OF VARIANCE; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; DATA MINING; NONLINEAR DYNAMICS;

EID: 79960070992     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065711002791     Document Type: Article

References (61)

1. P. Patrinos, A. Alexandridis, K. Ninos and H. Sarimveis, Variable selection in nonlinear modeling based on RBF networks and evolutionary computation, International Journal of Neural Systems 20(5) (2010) 365-379.
2. J. Neumann, C. Schn̈orr and G. Steidl, Combined SVM-based feature selection and classification, Machine Learning 61(1-3) (2005) 129-150. (Pubitemid 43049365)
3. Z. Chen, J. Li and L. Wei, A multiple kernel support vector machine scheme for feature selection and rule extraction from gene expression data of cancer tissue, Artificial Intelligence in Medicine 41(2) (2007) 161-175. (Pubitemid 47534223)
4. M. Asaduzzaman, M. Shahjahan and K. Murase, Faster training using fusion of activation functions for feed forward neural networks, International Journal of Neural Systems 19(6) (2009) 437-448.
5. C. Peterson and M. Ringńer, Analyzing tumor gene expression profiles, Artificial Int. in Medicine 28(1) (2003) 59-74. (Pubitemid 36870751)
6. D. C. Theodoridis, Y. S. Boutalis and M. A. Christodoulou, Indirect adaptive control of unknown multi variable nonlinear systems with parametric and dynamic uncertainties using a new neuro-fuzzy system description, International Journal of Neural Systems 20(2) (2010) 149-158.
7. S. Paul and S. Kumar, Subsethood-product Fuzzy Neural Inference System (SuPFuNIS), IEEE Trans. on Neural Networks 13(3) (2002) 578-599. (Pubitemid 34669649)
8. C. Wen and X. Ma, A Max-piecewise-linear neural network for function approximation, Neurocomput-ing 71(4-6) (2008) 843-852. (Pubitemid 351168424)
9. Z. J. Lee, A Novel Hybrid Algorithm for Function Approximation, Exp. Sys. with Applications 34(1) (2008) 384-390.
10. G. B. Huang, P. Saratchandran and N. Sundarara-jan, A Generalized Growing and Pruning RBF (GGAP-RBF) neural network for function approximation, IEEE Trans. On Neural Networks 16(1) (2005) 57-67. (Pubitemid 40241910)
11. J. Gonzalez, I. Rojas, J. Ortega, H. Pomares, F. J. Fernandez and A. F. Diaz, Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation, IEEE Trans. on Neural Networks 14(6) (2003) 1478-1495.
12. A. Sorjamaa, N. Reyhani and A. Lendasse, Input and structure selection for k-NN approximator, Lecture Notes in Computer Science 3512 (2005) 985-992. (Pubitemid 41343074)
13. A. Sorjamaa, J. Hao, N. Reyhani, Y. Ji and A. Lendasse, Methodology for long-term prediction of time series, Neurocomputing 70(16-18) (2007) 2861-2869. (Pubitemid 47308638)
14. O. Castillo and P. Melin, Hybrid intelligent systems for time series prediction using neural networks, fuzzy logic and fractal theory, IEEE Trans. on Neural Networks 13(6) (2002) 1395-1408. (Pubitemid 35428527)
15. A. Ghaffari, A. R. Mehrabian and M. Mohammad-Zaheri, Identification and control of power plant de-superheater using soft computing techniques, Engineering Applications of Artificial Intelligence 20(2) (2007) 273-287. (Pubitemid 44821780)
16. W. Yu and X. Li, Fuzzy Identification using fuzzy neural networks with stable learning algorithms, IEEE Trans. on Fuzzy Systems 12(3) (2004) 411-420.
17. R. Kohavi, A Study of Cross-validation and bootstrap for accuracy estimation and model selection, in Proc. of the 14th Int. Joint Conference on Artificial Intelligence (Montreal, Quebec, Canada, 1995) Vol. 2, pp. 1137-1145.
18. K. Jain, R. C. Dubes and C. Chen, Bootstrap techniques for error estimation, IEEE Trans. on Pattern Analysis and Machine Intelligence 9(5) (1987) 628-633.
19. B. Efron and R. Tibshirani, Improvements on cross-validation: The.632+ Bootstrap Method, Journal of the American Stat. Association 92(438) (1997) 548-560.
20. C. Nadeau and Y. Bengio, Inference for the generalization error, Machine Learning 52(3) (2003) 239-281.
21. N. A. Diamantidis, D. Karlis and E. A. Giakoumakis, Unsupervised stratification of cross-validation for accuracy estimation, Artificial Intelligence 116(1-2) (2000) 1-16. (Pubitemid 30560294)
22. C. F. Juang, A tsk-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms, IEEE Trans. on Fuzzy Systems 10(2) (2002) 155-170.
23. X. Zeng and T. R. Martinez, Distribution-balanced stratified cross-validation for accuracy estimation, Journal of Experimental & Theoretical Artificial Intelligence 12(1) (2000) 1-12.
24. G. Dupret and M. Koda, Bootstrap re-sampling for unbalanced data in supervised learning, European Journal of Operational Research 134 (2001) 141-156. (Pubitemid 32639096)
25. J. Gonzalez, I. Rojas, H. Pomares, J. Ortega and A. Prieto, A new clustering technique for function approximation, IEEE Trans. on Neural Networks 13(1) (2002) 132-142. (Pubitemid 34236843)
26. A. W. Jayawardena, P. C. Xu, F. L. Tsang and W. K. Li, Determining the structure of a radial basis function network for prediction of nonlinear hydrological time series, Hydrological Sci. Journal 51(1) (2006) 21-44. (Pubitemid 43231065)
27. A. S. Weigend and N. A. Gershenfeld, Time Series Prediction: Forecasting the Future and Understanding the Past (Addison-Wesley, Reading, MA, 1993).
28. L. Ljung, System Identification: Theory for the User, 2nd edn. (Prentice Hall, Upper Saddle River, N.J. 1999).
29. X. Li, M. J. Er, B. S. Lim, J. H. Zhou, O. P. Gan and L. Rutkowski, Fuzzy regression modeling for tool performance prediction and degradation detection, International Journal of Neural Systems 20(5) (2010) 405-419.
30. L. J. Herrera, H. Pomares, I. Rojas, M. Verleysen and A. Guiĺen, Effective Input Variable Selection for Function Approximation, Lecture Notes in Computer Science 4131 (2006) 41-50. (Pubitemid 44561652)
31. A. Lendasse, V. Wertz and M. Verleysen, Model selection with cross-validations and bootstraps-application to time series prediction RBFN models, Lect. Notes in Computer Science 2714 (2003) 573-580.
32. E. Balaguer, A. Palomares, E. Soria and J. D. Mart́in-Guerrero, Predicting service request in support centres based on nonlinear dynamics, ARMA modeling and neural networks, Expert Systems with Applications 34(1) (2008) 665-672. (Pubitemid 46778983)
33. G. Puscasu and B. Codres, Nonlinear system identification based on internal recurrent neural networks, International Journal of Neural Systems 19(2) (2009) 115-125.
34. H. Pomares, I. Rojas, J. Gonzalez, M. Damas, B. Pino and A. Prieto, Online global learning in direct fuzzy controllers, IEEE Trans. on Fuzzy Systems 12(2) (2004) 218-229.
35. P. Sastry, G. Santharam and K. Innikrishnan, Memory neuron networks for identification and control of dynamic systems, IEEE Trans. on Neural Networks 5(2) (1994) 306-319.
36. J. L. Elman, Finding structure in time, Cognitive Science, 14 (1990) 179-211.
37. J. A. K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor and J. Vandewalle, Least Squares Support Vector Machines (World Scientific, Singapore, 2002).
38. D. Wu, K. Warwick, Z. Ma, M. N. Gasson, J. G. Burgess, S. Pan and T. Z. Aziz, Prediction of Parki-son's disease tremor onset using radial basis function neural network based on particle swarm optimization, International Journal of Neural Systems 20(2) (2010) 109-116.
39. X. Yao and Y. Liu, EPNet for chaotic time-series prediction, Lecture Notes in Computer Science 1285 (1996) 146-156. (Pubitemid 127112746)
40. Y. H. Chen, B. Yang, J. Dong and A. Abraham, Time-series forecasting using flexible neural tree model, Information Sciences 174(3-4) (2005) 219-235. (Pubitemid 40893971)
41. R. Mojena, Hierarchical grouping methods and stopping rules: An evaluation, The Computer Journal 20(4) (1977) 359-363.
42. M. H́enon, A two-dimensional mapping with a strange attractor, Comm. in Mathematical Physics 50(1) (1976) 69-77.
43. R. M. May, Simple mathematical models with very complicated dynamics, Nature 261 (1976) 459-467.
44. M. C. Mackey and L. Glass, Oscillation and chaos in physiological control-systems, Science 197(4300) (1977) 287-289.
45. R. J. Korsan, Fractals and time series analysis, Math-ematica 3 (1993) 39-47.
46. V. Cherkassky, Comparison of adaptive methods for function estimation from samples, IEEE Trans. on Neural Networks 7(4) (1996) 969-984. (Pubitemid 126776368)
47. H. Pomares, New methodologies for fuzzy systems design, PhD dissertation, Dept. of Computer Architecture and Computer Technology, Univ. of Granada, Spain, (2000).
48. K. S. Narendra and K. Parthasarathy, Identification and control of dynamical systems using neural networks, IEEE Trans. on Neural Networks 1(1) (2006) 4-27.
49. V. Cherkassky and Y. Q. Ma, Practical selection of SVM parameters and noise estimation for SVM regression, Neural Networks 17(1) (2004) 113-126. (Pubitemid 38019003)
50. G. E. P. Box, W. G. Hunter and J. S. Hunter, Statistics for Experimenters: an Introduction to Design, Data Analysis and Model Building (Wiley, N. York, 1978).
51. I. Rojas, O. Valenzuela, M. Anguita and A. Prieto, Analysis of the operators involved in the definition of the implication functions and in the fuzzy inference process, International Journal of Approximate Reasoning 19(3) (1998) 367-389. (Pubitemid 128426487)
52. M. Vasquez and S. Janaqi, A Tabu algorithm for homogeneous partition of samples, in Proc. 4th Metaheuristics Int. Conference (Porto, Portugal, 2001).
53. Y. Fukuyama, Reactive Tabu search for distribution load transfer operation, in Proc. IEEE Power Engineering Society Winter Meeting (Singapore, 2000).
54. T. Jiang, Q. Cui, G. Shi and S. Ma, Protein folding simulations of the hydrophobic-hydrophilic model by combining Tabu search with genetic algorithms, Journal of Chemical Physics 119(8) (2003) 4592-4596.
55. S. Kullback and R. A. Leibler, On information and sufficiency, Annals of Mathematical Statistics 22(1) (1951) 79-86.
56. G. Dreyfus, Neural Networks: Methodology and Applications (Springer, Berlin, 2005), pp. 135-136.
57. LS-SVMlab: a MATLAB/C toolbox for Least Squares Support Vector Machines: (http://www.esat.kuleuven.be/sista/lssvmlab/)
58. J. S. Simonoff and F.Udina, Measuring the stability of histogram appearance when the anchor position is changed, Comp. Statistics & Data Analysis 23(3) (1997) 335-353.
59. G. Lefebvre, R. Stede and A. C. Vandal, A path sampling identity for computing the Kullback-Leibler and J divergences, Computational Statistics and Data Analysis 54 (2010) 1719-1731.
60. R. O. Duda, P. E. Hart and D. G. Stock, Pattern Classification, 2nd edn. (Wiley-Interscience, 2001)
61. MATLAB version 7.11.0: The MathWorks Inc., 2010.