Extreme learning machines

IEEE Intelligent Systems

Volumn 28, Issue 6, 2013, Pages 30-59

  Cambria, Erik ^a   Huang, Guang Bin ^b   Kasun, Liyanaarachchi Lekamalage Chamara ^b   Zhou, Hongming ^b   Vong, Chi Man ^c   Lin, Jiarun ^d   Yin, Jianping ^d   Cai, Zhiping ^d   Liu, Qiang ^d   Li, Kuan ^d   Leung, Victor C M ^e   Feng, Liang ^f   Ong, Yew Soon ^f   Lim, Meng Hiot ^b   Akusok, Anton ^g   Lendasse, Amaury ^g,h   Corona, Francesco ^g   Nian, Rui ⁱ   Miche, Yoan ^g   Gastaldo, Paolo ^j   Zunino, Rodolfo ^j   Decherchi, Sergio ^k   Yang, Xuefeng ^b   Mao, Kezhi ^b   Oh, Beom Seok ^l   Jeon, Jehyoung ^l   Toh, Kar Ann ^l   Teoh, Andrew Beng Jin ^l   Kim, Jaihie ^l   Yu, Hanchao ^m   Chen, Yiqiang ^m   Liu, Junfa ^m   more..

^a MIT MEDIA LAB   (United States)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c UNIVERSITY OF MACAU   (Macao)

^d NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^e UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^f NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^g AALTO UNIVERSITY   (Finland)

^h UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

ⁱ OCEAN UNIVERSITY OF CHINA   (China)

^j UNIVERSITY OF GENOA   (Italy)

^k ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^l Yonsei University   (South Korea)

^m INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

more..

Author keywords

[No Author keywords available]

Indexed keywords

BIG DATA; COMPUTATION THEORY; DATA HANDLING; KNOWLEDGE ACQUISITION; OUTSOURCING; PROBLEM SOLVING; RADIAL BASIS FUNCTION NETWORKS;

EXTREME LEARNING MACHINE; FEATURE REPRESENTATION; FEED-FORWARD NETWORK; LEARNING TECHNIQUES; MEMETIC COMPUTATIONS; RANDOM PROJECTIONS; UNIFIED SOLUTIONS; UNIVERSAL APPROXIMATION;

LEARNING SYSTEMS;

EID: 84919336343     PISSN: 15411672     EISSN: None     Source Type: Journal    
DOI: 10.1109/MIS.2013.140     Document Type: Note

References (68)

1. G.-B. Huang, L. Chen, and C.-K. Siew, "Universal Approximation Using Incremental Constructive Feedforward Networks with Random Hidden Nodes," IEEE Trans. Neural Networks, vol. 17, no. 4, 2006, pp. 879-892.
2. G.-B. Huang, X. Ding, and H. Zhou, "Optimization Method Based Extreme Learning Machine for Classification," Neurocomputing, vol. 74, 2010, pp. 155-163.
3. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme Learning Machine: Theory and Applications," Neurocomputing, vol. 70, 2006, pp. 489-501.
4. G.-B. Huang et al., "Extreme Learning Machine for Regression and Multiclass Classification," IEEE Trans. Systems, Man, and Cybernetics, vol. 42, no. 2, 2011, pp. 513-529.
5. G. E. Hinton and R. R. Salakhutdinov, "Reducing the Dimensionality of Data with Neural Networks," Science, vol. 313, no. 5786, 2006, pp. 504-507.
6. P. Vincent et al., "Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion," J. Machine Learning Research, vol. 11, 2010, pp. 3371-3408.
7. R. Salakhutdinov and H. Larochelle "Efficient Learning of Deep Boltzmann Machines," J. Machine Learning Research, vol. 9, 2010, pp. 693-700.
8. G.-B. Huang, Q.-Y. Zhu and C.-K. Siew, "Extreme Learning Machine: Theory and Applications," Neurocomputing, vol. 70, 2006, pp. 489-501.
9. Y. LeCun et al., "Gradient-Based Learning Applied to Document Recognition," Proc. IEEE, vol. 86, no. 11, 1998, pp. 2278-2324.
10. G.-B. Huang et al.,"Extreme Learning Machine for Regression and Multiclass Classification," IEEE Trans. Systems, Man, and Cybernetics, vol. 42, no. 2, 2012, pp. 513-529.
11. B. Widrow et al., "The No-Prop Algorithm: A New Learning Algorithm for Multilayer Neural Networks," Neural Networks, vol. 37, 2013, pp. 182-188.
12. G.-B. Huang, L. Chen, and C.-K. Siew, "Universal Approximation Using Incremental Constructive Feedforward Networks with Random Hidden Node," IEEE Trans. Neural Networks, vol. 17, no. 4, 2006, pp. 879-892.
13. W. Johnson and J. Lindenstrauss, "Extensions of Lipschitz Mappings into a Hilbert Space," Proc. Conf. Modern Analysis and Probability, vol. 26, 1984, pp. 189-206.
14. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks," Proc. Int'l Joint Conf. Neural Networks (IJCNN2004), vol. 2, IEEE, 2004, pp. 985-990.
15. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme Learning Machine: Theory and Applications," Neurocomputing, vol. 70, 2006, pp. 489-501.
16. G.-B. Huang et al., "Extreme Learning Machine for Regression and Multiclass Classification," IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 42, no. 2, 2012, pp. 513-529.
17. Q. He et al., "Parallel Extreme Learning Machine for Regression Based on Map-Reduce," Neurocomputing, vol. 102, 2013, pp. 52-58.
18. M. van Heeswijk et al., "GPU-Accelerated and Parallelized ELM Ensembles for Large-Scale Regression," Neurocomputing, vol. 74, no. 16, 2011, pp. 2430-2437.
19. D. Serre, Matrices: Theory and Applications, Springer, 2010.
20. Y. Cheng et al., "Efficient Revocation in Ciphertext-Policy Attribute-Based Encryption Based Cryptographic Cloud Storage," J. Zhejiang University-Science C (Computers & Electronics), vol. 14, Feb. 2013, pp. 85-97.
21. C. Wang, K. Ren, and J. Wang, "Secure and Practical Outsourcing of Linear Programming in Cloud Computing," Proc. INFOCOM, IEEE, 2011, pp. 820-828.
22. P. Shi et al., "Dependable Deployment Method for Multiple Applications in Cloud Services Delivery Network," China Communications, vol. 8, July 2011, pp. 65-75.
23. A. Krizhevsky and G. Hinton, "Learning Multiple Layers of Features from Tiny Images," master's thesis, Dept. of Computer Science, University of Toronto, 2009.
24. Q. Le, T. Sarlos, and A. Smola, "Fastfood-Approximating Kernel Expansions in Loglinear Time," to appear in Proc. ICML, 2013.
25. G. Dantzig and J.H. Ramser, "The Truck Dispatching Problem," Management Science, vol. 6, 1959, pp. 80-91.
26. Y.C. Jin, Knowledge Incorporation in Evolutionary Computation, Springer, 2010.
27. X.S. Chen et al., "A Multi-Facet Survey on Memetic Computation," IEEE Trans. Evolutionary Computation, no. 5, 2011, pp. 591-607.
28. Y.S. Ong, M.H. Lim, and X.S. Chen, "Research Frontier: Memetic Computation-Past, Present & Future," IEEE Computational Intelligence Magazine, vol. 5, no. 2, 2010, pp. 24-36.
29. G.B. Huang, Q.Y. Zhu, and C.K. Siew, "Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks," Proc. IEEE Int'l Joint Conf. Neural Networks, IEEE, 2004, pp. 985-990.
30. X. Chen, L. Feng, and Y. S. Ong, "A self-adaptive memeplexes robust search scheme for solving stochastic demands vehicle routing problem," Interational Journal Systems Science, vol. 43, no. 7, pp. 1347-1366, 2012.
31. J.A. Lee and M. Verleysen, Nonlinear Dimensionality Reduction, Springer, 2007.
32. T. Kohonen, "Self-Organized Formation of Topologically Correct Feature Maps," Biological Cybernetics, vol. 43, no. 1, 1982, pp. 59-69.
33. J. Venna et al., "Information Retrieval Perspective to Nonlinear Dimensionality Reduction for Data Visualization," J. Machine Learning Research, vol. 11, 2010, pp. 451-490.
34. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme Learning Machine: Theory and Applications," Neurocomputing, vol. 70, no. 1, 2006, pp. 489-501.
35. G.-B. Huang, L. Chen, and C.-K. Siew, "Universal Approximation Using Incremental Constructive Feedforward Networks with Random Hidden Nodes," IEEE Trans. Neural Networks, vol. 17, no. 4, 2006, pp. 879-892.
36. C.R. Rao and S.K. Mitra, Generalized Inverse of a Matrix and Its Applications, J. Wiley, 1971.
37. G.-B. Huang et al., "Extreme Learning Machine for Regression and Multiclass Classification," IEEE Trans. Systems, Man, and Cybernetics, vol. 42, no. 2, 2012, pp. 513-529.
38. R. Baraniuk et al., "A Simple Proof of the Restricted Isometry Property for Random Matrices," Constructive Approximation, vol. 28, no. 3, 2008, pp. 253-263.
39. G.-B. Huang, D.H. Wang, and Y. Lan, "Extreme Learning Machines: A Survey," Int'l J. Machine Leaning and Cybernetics, vol. 2, no. 2, 2011, pp. 107-122.
40. Y. Miche, B. Schrauwen, and A. Lendasse, "Machine Learning Techniques based on Random Projections," Proc. of European Symp. Artificial Neural Networks - Computational Intelligence and Machine Learning, 2010, pp. 295-302.
41. D. Wimalasuriya and D. Dou, "Ontology- Based Information Extraction: An Introduction and a Survey of Current Approaches," J. Information Science, vol. 36, no. 3, 2010, pp. 306-323.
42. E. Cambria, T. Mazzocco, and A. Hussain, "Application of Multi-Dimensional Scaling and Artificial Neural Networks for Biologically Inspired Opinion Mining," Biologically Inspired Cognitive Architectures, vol. 4, no. 0, 2013, pp. 41-53.
43. R. Girju et al., "Text Mining for Causal Relations," Proc. FLAIRS Conf., AAAI Press, 2002, pp. 360-364.
44. R. Girju, "Automatic Detection of Causal Relations for Question Answering," Proc. ACL 2003 Workshop on Multilingual Summarization and Question Answering, Assoc. Computational Linguistics, 2003, pp. 76-83.
45. B. Beamer, A. Rozovskaya, and R. Girju, "Automatic Semantic Relation Extraction with Multiple Boundary Generation," Proc. 23rd Nat'l Conf. Artificial Intelligence, AAAI Press, 2008, pp. 824-829.
46. E. Blanco, N. Castell, and D. Moldovan, "Causal Relation Extraction," Proc. 6th Int'l Language Resources and Evaluation, European Language Resources Assoc., 2008, pp. 310-313.
47. M. Galar et al., "A Review on Ensembles for the Class Imbalance Problem: Bagging-, Boosting-, and Hybrid-Based Approaches," IEEE Trans. Systems, Man, and Cybernetics, vol. 42, no. 4, 2012, pp. 463-484.
48. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme Learning Machine: Theory and Applications," Neurocomputing, vol. 70, no. 1, 2006, pp. 489-501.
49. H.-J. Rong et al., "A Fast Pruned-Extreme Learning Machine for Classification Problem," Neurocomputing, vol. 72, no. 1, 2008, pp. 359-366.
50. Y. Lan, Y.C. Soh, and G.-B. Huang, "Random Search Enhancement of Error Minimized Extreme Learning Machine," European Symp. Artificial Neural Networks, European Neural Network Soc., 2010, pp. 327-332.
51. Y. Lan, Y.C. Soh, and G.-B. Huang, "Constructive Hidden Nodes Selection of Extreme Learning Machine for Regression," Neurocomputing, vol. 73, no. 16, 2010, pp. 3191-3199.
52. Y. Miche et al., "Op-elm: Optimally Pruned Extreme Learning Machine," IEEE Trans. Neural Networks, vol. 21, no. 1, 2010, pp. 158-162.
53. Y. Freund and R.E. Schapire, "A Decision-Theoretic Generalization of On-line Learning and an Application to Boosting," Computational Learning Theory, Springer, 1995, pp. 23-37.
54. P. Kingsbury and M. Palmer, "From Treebank to Propbank," Proc. 3rd Int'l Conf. Language Resources and Evaluation, Citeseer, 2002, pp. 1989-1993.
55. M. Katagiri and T. Sugimura, "Personal Authentication by Free Space Signing with Video Capture," Proc. 5th Asian Conf. Computer Vision, Japan: Asian Federation of Computer Vision Societies, 2002, pp. 350-355.
56. G. Bailador et al., "Analysis of Pattern Recognition Techniques for In-Air Signature Biometrics," Pattern Recognition, vol. 44, no. 10, 2011, pp. 2468-2478.
57. B.-S. Oh et al., "Combining Local Face Image Features for Identity Verification," Neurocomputing, vol. 74, no. 16, 2011, pp. 2452-2463.
58. K.-A. Toh, "Deterministic Neural Classification," Neural Computation, vol. 20, no. 6, 2008, pp. 1565-1595.
59. J.-H. Jeon et al., "A System for Hand Gesture based Signature Recognition," Proc. 12th Int'l Conf. Control Automation Robotics & Vision, IEEE, 2012, pp. 171-175.
60. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme Learning Machine: Theory and Applications," Neurocomputing, vol. 70, no. 1-3, 2006, pp. 489-501.
61. C.J.C. Burges, "A Tutorial on Support Vector Machines for Pattern Recognition," Data Mining and Knowledge Discovery, vol. 2, no. 2, 1998, pp. 121-167.
62. S. Mitra, and T. Acharya, "Gesture Recognition: A Survey," IEEE Trans. Systems, Man, and Cybernetics, vol. 37, no. 3, 2007, pp. 311-324.
63. Z. Ren et al., "Robust Hand Gesture Recognition with Kinect Sensor," Proc. 19th ACM Int'l Conf. Multimedia, ACM, 2011, pp. 759-760.
64. M.K. Bhuyan, V.V. Ramaraju, and Y. Iwahori, "Hand Gesture Recognition and Animation for Local Hand Motions," Int'l J. Machine Learning and Cybernetics, vol. 3, 2013, pp. 1-17.
65. M.M. Sole and M.S. Tsoeu, "Sign Language Recognition Using the Extreme Learning Machine," Proc. 2011 IEEE Region 8 Flagship Conf. African Continent AFRICON 2011), IEEE, 2011, pp. 1-6.
66. G.B. Huang, Q.Y. Zhu, and C.K. Siew, "Extreme Learning Machine: Theory and Applications," Neurocomputing, vol. 70, no. 1, 2006, pp. 489-501.
67. N. Y. Liang et al., "A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks," IEEE Trans. Neural Networks, vol. 17, no. 6, 2006, pp. 1411-1423.
68. H.C. Yu et al., "Robust Single Fingertip Tracking Method Based on Palm Posture Self-Adaption," J. Computer-Aided Design & Computer Graphics, vol. 25, no. 12, 2013, pp. 1793-1800.