Parameter estimation of q-Gaussian Radial Basis Functions Neural Networks with a Hybrid Algorithm for binary classification

Neurocomputing

Volumn 75, Issue 1, 2012, Pages 123-134

  Fernández Navarro, Francisco ^a   Hervás Martínez, César ^a   Gutiérrez, Pedro A ^a   Peña Barragán, Jose M ^b   López Granados, Francisca ^b  

^a UNIVERSITY OF CÓRDOBA   (Spain)

^b INSTITUTO DE AGRICULTURA SOSTENIBLE   (Spain)

Author keywords

Classification; Hybrid Algorithms; Q Gaussian Radial Basis Functions Neural Networks; Remote sensing; Weed discrimination and control

Indexed keywords

AERIAL PHOTOGRAPHY; ANTENNAS; CHAOS THEORY; CLASSIFICATION (OF INFORMATION); DECISION MAKING; DEGREES OF FREEDOM (MECHANICS); FUNCTIONS; GAUSSIAN DISTRIBUTION; HEAT CONDUCTION; IMAGE SEGMENTATION; INVERSE PROBLEMS; REMOTE SENSING; WEED CONTROL;

ARTIFICIAL INTELLIGENCE TECHNIQUES; BINARY CLASSIFICATION; DEGREE OF FREEDOM; DISCRIMINATIVE POWER; HYBRID ALGORITHMS; Q-GAUSSIAN; TEST PERFORMANCE; WEED DISCRIMINATION;

RADIAL BASIS FUNCTION NETWORKS;

ACCURACY; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLASSIFICATION ALGORITHM; EVOLUTIONARY ALGORITHM; INTERMETHOD COMPARISON; KERNEL METHOD; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; PRIORITY JOURNAL; PROCESS DEVELOPMENT; PROCESS OPTIMIZATION; RADIAL BASED FUNCTION; REMOTE SENSING; SIGNAL PROCESSING; SPAIN;

EID: 82455199144     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.03.056     Document Type: Article

References (55)

1. Er M.J., Wu S., Lu J., Toh H.L. Face recognition with radial basis function (rbf) neural networks. IEEE Transactions on Neural Networks 2002, 13(3):697-710.
2. Harpham C., Dawson C.W. The effect of different basis functions on a radial basis function network for time series prediction: a comparative study. Neurocomputing 2006, 69(16-18):2161-2170.
3. Li M., Huang G., Saratchandran P., Sundararajan N. Performance evaluation of gap-rbf network in channel equalization. Neural Processing Letters 2005, 22(2):223-233.
4. Perez-Godoy M.D., Fernández A., Rivera A.J., del Jesus M.J. Analysis of an evolutionary RBFN design algorithm, CO2RBFN, for imbalanced data sets. Pattern Recognition Letters 2010, 31:2375-2388.
5. Wei H., Amari S. Dynamics of learning near singularities in radial basis function networks. Neural Networks 2008, 21(7):989-1005.
6. Billings S.A., Wei H., Balikhin M.A. Generalized multiscale radial basis function networks. Neural Networks 2007, 20(10):1081-1094.
7. Punzi A., Sommariva A., Vianello M. Meshless cubature over the disk using thin-plate splines. Journal of Computational and Applied Mathematics 2008, 221(2):430-436.
8. Saranli A., Baykal B. Complexity reduction in radial basis function (RBF) networks by using radial B-spline functions. Neurocomputing 1998, 18(1-3):183-194.
9. Fernández-Navarro F., Hervás-Martínez C., Gutiérrez P.A., Cruz-Ramírez M., Carbonero-Ruz M. Evolutionary q-Gaussian radial basis functions for binary-classification. Fifth International Conference on Hybrid Artificial Intelligent Systems, Lecture Notes in Artificial Intelligence 2010, vol. 6077:280-287. Springer.
10. N. Gueorguieva, I. Valova, Building rbf neural network topology through potential functions, in: Artificial Neural Networks and Neural Information Processing - ICANN/ICONIP 2003, Lecture Notes in Computer Science, vol. 2714, 2003, pp. 179-180.
11. Lippmann R. Pattern classification using neural networks. IEEE Communications Magazine 1989, 27:47-64.
12. Martínez-Estudillo F.J., Hervás-Martínez C., Gutiérrez P.A., Martínez-Estudillo A.C. Evolutionary product-unit neural networks classifiers. Neurocomputing 2008, 72(1-2):548-561.
13. Gutiérrez P.A., López-Granados F., Peña-Barragán J.M., Jurado-Expósito M., Gómez-Casero M.T., Hervás C. Mapping sunflower yield as affected by Ridolfia segetum patches and elevation by applying evolutionary product unit neural networks to remote sensed data. Computers and Electronics in Agriculture 2008, 60(2):122-132.
14. Gutiérrez P.A., Hervás-Martínez C., Carbonero M., Fernández J.C. Combined projection and kernel basis functions for classification in evolutionary neural networks. Neurocomputing 2009, 72(13-15):2731-2742.
15. R. Tinos, L. Murta, Selection of radial basis functions via genetic algorithms in pattern recognition problems, in: Tenth Brazilian Symposium on Neural Networks, 2008. SBRN '08, 2008, pp. 171-176.
16. Tsallis C. Possible generalization of Boltzmann-Gibbs statistics. Journal of Statistical Physics 1988, 52(1-2):479-487.
17. Tsallis C., Mendes R.S., Plastino A.R. The role of constraints within generalized nonextensive statistics. Physica A: Statistical Mechanics and its Applications 1998, 261(3-4):534-554.
18. Díaz R., Pariguan E. On the Gaussian q-distribution. Journal of Mathematical Analysis and Applications 2009, 358(1):1-9.
19. Fernández-Navarro F., Hervás-Martínez C., Cruz M., Gutierrez P.A., Valero A. Evolutionary q-Gaussian radial basis function neural network to determine the microbial growth/no growth interface of Staphylococcus aureus. Applied Soft Computing 2011, 11(3):3012-3020.
20. Yingwei L., Sundararajan N., Saratchandran P. Performance evaluation of a sequential minimal radial basis function (rbf) neural network learning algorithm. IEEE Transactions on Neural Networks 1998, 9(2):308-318.
21. Huang G.-B., Saratchandran P., Sundararajan N., Member S., Member S., Sundararajan N. An efficient sequential learning algorithm for growing and pruning rbf (gap-rbf) networks. IEEE Transaction on System, Man and Cybernetics, Part-B: Cybernetics 2004, 34:2284-2292.
22. Suresh S., Sundararajan N., Saratchandran P. A sequential multi-category classifier using radial basis function networks. Neurocomputing 2008, 71:1345-1358.
23. Huang G.B., Zhu Q., Siew C. Extreme learning machine: theory and applications. Neurocomputing 2006, 70(1-3):489-501.
24. Huang G., Ding X., Zhou H. Optimization method based extreme learning machine for classification. Neurocomputing 2010, 74:155-163.
25. Fernández-Navarro F., Hervás-Martínez C., Sánchez-Monedero J., Gutierrez P.A. Melm-grbf: a modified version of the extreme learning machine for generalized radial basis function neural networks. Neurocomputing 2011, 74:2502-2510.
26. Huang G.-B., Chen L., Siew C.K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Transactions on Neural Networks 2006, 17(4):879-892. URL 〈http://doi.ieeecomputersociety.org/10.1109/TNN.2006.875977〉.
27. Zhu Q.-Y., Qin A., Suganthan P., Huang G.-B. Evolutionary extreme learning machine. Pattern Recognition 2005, 38(10):1759-1763.
28. Huang G.-B., Chen L. Convex incremental extreme learning machine. Neurocomputing 2007, 70(16-18):3056-3062.
29. Javier Sánchez-Monedero, Pedro Gutiérrez, F. Fernández-Navarro, C. Hervás-Martínez, Weighting efficient accuracy and minimum sensitivity for evolving multi-class classifiers. Neural Processing Letters (2011), 1-16. http://doi:10.1007/s11063-011-9186-9.
30. Liang N.-Y., Huang G.-B., Saratchandran P., Sundararajan N. A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Transactions on Neural Networks 2006, 17(6):1411-1423.
31. Angeline P.J., Sauders G.M., Pollack J.B. An evolutionary algorithm that constructs recurrent neural networks. IEEE Transactions on Neural Networks 1994, 5:54-65.
32. Fernández-Navarro F., Valero A., Hervás-Martínez C., Gutíerrez P., García-Gimeno R., Zurera-Cosano G. Development of a multi-classification neural network model to determine the microbial growth/no growth interface. International Journal of Food Microbiology 2010, 141:203-212.
33. Bishop C.M. Improving the generalization properties of radial basis function neural networks. Neural Computation 1991, 3(4):579-581.
34. Abraham A., Corchado E., Corchado J.M. Hybrid learning machines. Neurocomputing 2009, 72(13-15):2729-2730.
35. Corchado E., Abraham A., de Carvalho A.C.P.L.F. Hybrid intelligent algorithms and applications. Information Sciences 2010, 2633-2634.
36. Gutiérrez P.A., López-Granados F., Peña-Barragán J.M., Jurado-Expósito M., Hervás-Martínez C. Logistic regression product-unit neural networks for mapping Ridolfia segetum infestations in sunflower crop using multitemporal remote sensed data. Computers and Electronics in Agriculture 2008, 62(2):293-306.
37. Gutiérrez P.A., Hervás-Martínez C., Fernández J.C., Jurado-Expósito M., Peña-Barragán J.M., López-Granados F. Structural simplification of hybrid neuro-logistic regression models in multispectral analysis of remote sensed data. Neural Network World 2009, 19(1):3-20.
38. Broomhead D.S., Lowe D. Multivariable functional interpolation and adaptive networks. Complex Systems 1988, 2:321-355.
39. K. Shkurko, X. Qi, A radial basis function and semantic learning space based composite learning approach to image retrieval, in: Proceedings on ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 1, 2007, pp. 945-948.
40. J. Zhang, H. Li, A reconstruction approach to CT with cauchy RBFs network, in: Advances in Neural Networks - ISNN 2004, Lecture Notes in Computer Science, vol. 3174, 2004, pp. 234-236.
41. Fernández-Navarro F., Hervás-Martínez C., García-Alonso C., Torres-Jimenez M. Determination of relative agrarian technical efficiency by a dynamic over-sampling procedure guided by minimum sensitivity. Expert Systems with Applications 2011, 38(10):12483-12490.
42. Fernández-Navarro F., Hervás-Martínez C., Gutíerrez P. A dynamic over-sampling procedure based on sensitivity for multi-class problems. Pattern Recognition 2011, 44:1821-1833.
43. Igel C., Hüsken M. Empirical evaluation of the improved Rprop learning algorithms. Neurocomputing 2003, 50(6):105-123.
44. A. Asuncion, D. Newman, UCI machine learning repository, URL, 2007. http://www.ics.uci.edu/~mlearn/MLRepository.html.
45. Miche Y., Sorjamaa A., Bas P., Simula O., Jutten C., Lendasse A. OP-ELM: optimally pruned extreme learning machine. IEEE Transactions on Neural Networks 2010, 21(1):158-162.
46. Storn R., Price K. Differential evolution. A fast and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization 1997, 11:341-359.
47. Sokolova M., Lapalme G. A systematic analysis of performance measures for classification tasks. Information Processing and Management 2009, 45:427-437.
48. Hervás-Martínez C., Martínez-Estudillo F. Logistic regression using covariates obtained by product-unit neural network models. Pattern Recognition 2007, 40(1):52-64.
49. Hervás-Martínez C., Martínez-Estudillo F.J., Carbonero-Ruz M. Multilogistic regression by means of evolutionary product-unit neural networks. Neural Networks 2008, 21(7):951-961.
50. Demšar J. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 2006, 7:1-30.
51. Friedman M. A comparison of alternative tests of significance for the problem of m rankings. Annals of Mathematical Statistics 1940, 11(1):86-92.
52. Hochberg Y., Tamhane A. Multiple Comparison Procedures 1987, John Wiley & Sons.
53. Wright S. Statistical comparisons of classifiers over multiple data sets. Biometrics 1992, 48:1005-1013.
54. Peña-Barragán J., López-Granados F., Jurado-Expósito M., García-Torres L. Spectral discrimination of Ridolfia segetum and sunflower as affected by phenological stage. Weed Research 2006, 46(1):10-21.
55. López-Granados F. Weed detection for site-specific weed management: mapping and real-time approaches. Weed Research 2011, 51(1):1-11.