A comprehensive evaluation of random vector functional link networks

Information Sciences

Volumn 367-368, Issue , 2016, Pages 1094-1105

  Zhang, Le ^a   Suganthan, P N ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Data classification; Moore Penrose pseudoinverse; Random vector functional link networks; Ridge regression

Indexed keywords

CHEMICAL ACTIVATION; RANDOM PROCESSES; REGRESSION ANALYSIS; TIME VARYING NETWORKS;

CLASSIFICATION ABILITY; CLOSED FORM SOLUTIONS; COMPREHENSIVE EVALUATION; DATA CLASSIFICATION; FUNCTIONAL-LINK NETWORK; PSEUDO-INVERSES; RIDGE REGRESSION; UNIVERSAL APPROXIMATORS;

FUNCTION EVALUATION;

EID: 84951823694     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2015.09.025     Document Type: Article

References (39)

1. [1] Alhamdoosh, M., Wang, D., Fast decorrelated neural network ensembles with random weights. Inf. Sci. 264 (2014), 104–117.
2. [2] An, S., Liu, W., Venkatesh, S., Face recognition using kernel ridge regression. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, 2007, IEEE, 1–7.
3. [3] Bartlett, P.L., The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans. Inf. Theor. 44:2 (1998), 525–536.
4. [4] Breiman, L., Arcing classifier (with discussion and a rejoinder by the author). The Ann. Stat. 26:3 (1998), 801–849.
5. [5] Chen, C.P., Wan, J.Z., A rapid learning and dynamic stepwise updating algorithm for flat neural networks and the application to time-series prediction. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 29:1 (1999), 62–72.
6. [6] Chi, H.-M., Ersoy, O.K., A statistical self-organizing learning system for remote sensing classification. IEEE Trans. Geosci. Remote Sens. 43:8 (2005), 1890–1900.
7. [7] Cun, L., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D., Handwritten digit recognition with a back-propagation network. Advances in Neural Information Processing Systems, 1990, 396–404.
8. [8] Dehuri, S., Cho, S.-B., A comprehensive survey on functional link neural networks and an adaptive pso–bp learning for cflnn. Neural Comput. Appl. 19:2 (2010), 187–205.
9. [9] Demšar, J., Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7 (2006), 1–30.
10. [10] Denker, J.S., Gardner, W., Graf, H.P., Henderson, D., Howard, R., Hubbard, W., Jackel, L.D., Baird, H.S., Guyon, I., Neural network recognizer for hand-written zip code digits. Advances in Neural Information Processing Systems, 1989, 323–331.
11. [11] Fernández-Delgado, M., Cernadas, E., Barro, S., Amorim, D., Do we need hundreds of classifiers to solve real world classification problems?. J. Mach. Learn. Res. 15:1 (2014), 3133–3181.
12. [12] Friedman, M., The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J. American Stat. Assoc. 32:200 (1937), 675–701.
13. [13] Friedman, M., A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11:1 (1940), 86–92.
14. [14] Hornik, K., Stinchcombe, M., White, H., Multilayer feedforward networks are universal approximators. Neural Netw. 2:5 (1989), 359–366.
15. [15] Husmeier, D., Taylor, J.G., Modelling conditional probabilities with committees of RVFL networks. Artificial Neural Networks–ICANN’97, 1997, Springer, 1053–1058.
16. [16] Husmeier, D., Taylor, J.G., Neural networks for predicting conditional probability densities: improved training scheme combining EM and RVFL. Neural Netw. 11:1 (1998), 89–116.
17. [17] Igelnik, B., Pao, Y.-H., Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Trans. Neural Netw. 6:6 (1995), 1320–1329.
18. [18] Kearns, M.J., Vazirani, U.V., An Introduction to Computational Learning Theory, 1994, MIT press.
19. [19] Krizhevsky, A., Sutskever, I., Hinton, G.E., Imagenet classification with deep convolutional neural networks. Procedings of Advances in Neural Information Processing Systems, 2012, 1097–1105.
20. [20] Leshno, M., Lin, V.Y., Pinkus, A., Schocken, S., Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. Neural Netw. 6:6 (1993), 861–867.
21. [21] Li, W., Wang, D., Chai, T., Multisource data ensemble modeling for clinker free lime content estimate in rotary kiln sintering processes. IEEE Trans. Syst. Man Cybern.: Syst. 45:2 (2015), 303–314, 10.1109/TSMC.2014.2332305.
22. [22] M. Lichman, UCI machine learning repository, 2013, ( http://archive.ics.uci.edu/ml).
23. [23] Martínez-Villena, J.M., Rosado-Muñoz, A., Soria-Olivas, E., Hardware implementation methods in random vector functional-link networks. Appl. Intell. 41:1 (2014), 184–195.
24. [24] Nemenyi, P., Distribution-free Multiple Comparisons, 1963, Princeton University.
25. [25] Pao, Y., Adaptive pattern recognition and neural networks, 1989, Addison-Wesley Longman Publishing Co., Inc. Boston, MA, USA.
26. [26] Pao, Y.-H., Park, G.-H., Sobajic, D.J., Learning and generalization characteristics of the random vector functional-link net. Neurocomputing 6:2 (1994), 163–180.
27. [27] Pao, Y.-H., Phillips, S.M., The functional link net and learning optimal control. Neurocomputing 9:2 (1995), 149–164.
28. [28] Pao, Y.-H., Phillips, S.M., Sobajic, D.J., Neural-net computing and the intelligent control of systems. Int. J. Control 56:2 (1992), 263–289.
29. [29] Park, G.H., Lee, Y.J., LeClair, S.R., Intelligent rate control for MPEG-4 coders. Eng. Appl. Artif. Intell. 13:5 (2000), 565–575.
30. [30] Park, G.H., Pao, Y.H., Unconstrained word-based approach for off-line script recognition using density-based random-vector functional-link net. Neurocomputing 31:1 (2000), 45–65.
31. [31] Park, J., Sandberg, I.W., Universal approximation using radial-basis-function networks. Neural Comput. 3:2 (1991), 246–257.
32. [32] Rahimi, A., Recht, B., Random features for large-scale kernel machines. Advances in Neural Information Processing Systems, 2007, 1177–1184.
33. [33] Saunders, C., Gammerman, A., Vovk, V., Ridge regression learning algorithm in dual variables. Proceedings of the 15th International Conference on Machine Learning, 1998, Morgan Kaufmann, 515–521.
34. [34] Scardapane, S., Wang, D., Panella, M., Uncini, A., Distributed learning for random vector functional-link networks. Inf. Sci. 301 (2015), 271–284.
35. [35] Schmidt, W.F., Kraaijveld, M., Duin, R.P., Feedforward neural networks with random weights. Proceedings of the 11th IAPR International Conference on Pattern Recognition, 1992, IEEE, 1–4.
36. [36] Sheskin, D.J., Handbook of parametric and nonparametric statistical procedures, 2003, CRC Press.
37. [37] Tyukin, I., Prokhorov, D., Feasibility of random basis function approximators for modeling and control. Proceedings of IEEE International Symposium on Intelligent Control, 2009, 1391–1396.
38. [38] Wang, Z., Yoon, S., Xie, S.J., Lu, Y., Park, D.S., Random vector functional-link net based pedestrian detection using multi-feature combination. Proceedings of the 6th International Congress on Image and Signal Processing (CISP), 2, 2013, IEEE, 773–777.
39. [39] Wang, Z., Yoon, S., Xie, S.J., Lu, Y., Park, D.S., A high accuracy pedestrian detection system combining a cascade adaboost detector and random vector functional-link net. The Scientific World J., 2014, 2014.