Generalized extreme learning machine acting on a metric space

Soft Computing

Volumn 16, Issue 9, 2012, Pages 1503-1514

  Zhao, Jianwei ^a,b   Park, Dong Sun ^b   Lee, Joonwhoan ^b   Cao, Feilong ^a,b  

^a CHINA JILIANG UNIVERSITY   (China)

^b Chonbuk National University   (South Korea)

Author keywords

Functional data; Generalized extreme learning machine; Learning; Metric space

Indexed keywords

EUCLIDEAN SPACES; EXTREME LEARNING MACHINE; FUNCTIONAL DATAS; HILBERT; LEARNING; LEARNING SPEED; METRIC SPACES; SINGLE-HIDDEN LAYER FEEDFORWARD NEURAL NETWORKS; SUPPORT VECTOR REGRESSION (SVR);

BACKPROPAGATION ALGORITHMS; GEOMETRY; LEARNING ALGORITHMS; LEARNING SYSTEMS; SET THEORY;

TOPOLOGY;

EID: 84865728527     PISSN: 14327643     EISSN: 14337479     Source Type: Journal    
DOI: 10.1007/s00500-012-0825-5     Document Type: Article

References (48)

1. p metric. Math Comput Model 49(7-8): 1563-1572.
2. Cao FL, Zhang YQ, He ZR (2009) Interpolation and rate of convergence for a class of neural networks. Appl Math Model 33(3): 1441-1456.
3. Cao FL, Lin SB, Xu ZB (2010) Constructive approximate interpolation by neural networks in the metric space. Math Comput Model 52: 1674-1681.
4. Chacko BP, Vimal Krishnan VR, Raju G, Babu Anto P (2011) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern. doi: 10. 1007/s13042-011-0049-5.
5. Chen TP, Chen H, Liu RW (1995) Approximation capability in by multiplayer feedforward networks and related problems. IEEE Trans Neural Netw 6: 25-30.
6. Chen TP, Chen H (1995) Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems. IEEE Trans Neural Netw 6: 911-917.
7. Conway JB (1985) A course in functional analysis. GTM96, Springer-Verlag, New York, USA.
8. Corrieu P (2005) Function approximation on non-Euclidean spaces. Neural Netw 18: 91-102.
9. Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3): 273-297.
10. Cybenko G (1989) Approximation by superposition of sigmoidal functions. Math Control Signal Syst 2(4): 303-314.
11. Deng WY, Zheng QH, Lian SG, Chen L, Wang X (2010) Ordinal extreme learning machine. Neurocomputing 74: 447-456.
12. Feng GR, Huang GB, Lin QP, Gay R (2009) Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans Neural Netw 20(8): 1352-1357.
13. Fukuoka Y, Matsuki H, Minamitani H (1998) A modified backpropagation method to avoid false local minima. Neural Netw 11: 1059-1072.
14. Funahashi KI (1989) On the approximate realization of continuous mappings by neural networks. Neural Netw 2: 183-192.
15. Guo GD, Chen S, Chen LF (2011) Soft subspace clustering with an improved feature weight self-adjustment mechanism. Int J Mach Learn Cybern. doi: 10. 1007/s13042-011-0039-7.
16. Heeswijk M, Miche Y, Oja E, Lendasse A (2011) GPU-accelerated and parallelized ELM ensembles for large-scale regression. Neurocomputing 74(16): 2430-2437.
17. Hornik K (1993) Some new results on neural network approximation. Neural Netw 6: 1069-1072.
18. Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of international joint conference on neural networks (IJCNN), vol 2, Budapest, Hungary, pp 985-990.
19. Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70: 489-501.
20. Huang GB, Zhu QY, Siew CK (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4): 879-892.
21. Huang GB, Chen L (2007) Convex incremental extreme learning machine. Neurocomputing 70: 3056-3062.
22. Huang GB, Chen L (2008) Enhanced random search based incremental extreme learning machine. Neurocomputing 71: 3460-3468.
23. Huang GB, Ding X, Zhou X (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74: 155-163.
24. Huang GB, Wang DH, Lan Y (2011) Extreme learning machine: a survey. Int J Mach Learn Cybern 2(2): 107-122.
25. Kadirkamanathan V, Niranjan M (1993) A function estimation approach to sequential learning with neural networks. Neural Comput 5: 954-975.
26. Lan Y, Soh YC, Huang GB (2009) Ensemble of online sequential extreme learning machine. Neurocomputing 72: 3391-3395.
27. Lan Y, Soh YC, Huang GB (2010) Constructive hidden nodes selection of extreme learning machine for regression. Neurocomputing 73: 3193-3199.
28. Lan Y, Soh YC, Huang GB (2010) Two-stage extreme learning machine for regression. Neurocomputing 73: 3028-3038.
29. Li J, Han G, Wen J, Gao XB (2011) Robust tensor subspace learning for anomaly detection. Int J Mach Learn Cybern 2(2): 89-98.
30. Liang NY, Huang GB, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17(6): 1411-1423.
31. Mangasarian OL, Solodov MV (1994) Serial and parallel backpropagation convergence via nonmonotone perturbed minimization. Optim method Softw 4(2): 103-116.
32. Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A (2010) OP-ELM: optimally pruned extreme learning machine. IEEE Trans Neural Netw 21(1): 1411-1423.
33. Miche Y, Heeswijk M, Bas P, Simula O, Lendasse A (2011) TROP-ELM: A double-regularized ELM using LARS and Tikhonov regularization. Neurocomputing 74(16): 2413-2421.
34. Muńoz A, Gonźlez J (2010) Representing functional data using support vector machines. Pattern Recog Lett 31: 511-516.
35. Park J, Sandberg IW (1991) Universal approximation using radial-basis-function networks. Neural Comput 3(2): 246-257.
36. Rao CR, Mitra SK (1971) Generalized inverse of matrices and its applications. Wiley, New York.
37. Rossi F, Delannay N, Guez BC, Verleysen M (2005) Representation of functional data in neural networks. Neurocomputing 64: 83-210.
38. Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by backpropagation errors. Nature 323: 533-536.
39. Scholkopf B, Mika S, Burges CJC, Knirsch P, Muller KR, Ratsch G (1999) Input space vs. feature space in kernel-basedmethods. IEEE Trans Neural Netw 10(5): 1000-1017.
40. Schölkopf B, Smola AJ, Williamson R, Bartlett PL (2000) New support vector algorithms. Neural Comput 12(5): 1207-1245.
41. Sharma A, Imoto S, Miyano S, Sharma V (2011) Null space based feature selection method for gene expression data. Int J Mach Learn Cybern. doi: 10. 1007/s13042-011-0061-9.
42. Vapnik V (1998) Statistical learning theory. Wiley, New York.
43. Wang XZ, Dong CR (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Trans Fuzzy Syst 17(3): 556-567.
44. Wang XZ, Chen AX, Feng HM (2011a) Upper integral network with extreme learning mechanism. Neurocomputing 74(16): 2520-2525.
45. Wang YG, Cao FL, Yuan YB (2011b) A study on effectiveness of extreme learning machine. Neurocomputing 74(16): 2483-2490.
46. Wu J, Wang ST, Chung FL (2011) Positive and negative fuzzy rule system, extreme learning machine and image classification. Int J Mach Learn Cybern 2(4): 261-271.
47. Wu W, Wang J, Cheng MS, Li ZX (2011) Convergence analysis of online gradient method for BP neural networks. Neural Netw 24: 91-98.
48. Yamamuro S (1970) Differential calculus in topological linear spaces. Lect Notes Math, vol 374, Springer, Berlin.