Sparse extreme learning machine for classification

IEEE Transactions on Cybernetics

Volumn 44, Issue 10, 2014, Pages 1858-1870

  Bai, Zuo ^a   Huang, Guang Bin ^a   Wang, Danwei ^a   Wang, Han ^a   Westover, M Brandon ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b MASSACHUSETTS GENERAL HOSPITAL   (United States)

Author keywords

Classification; extreme learning machine (ELM); quadratic programming (QP); sequential minimal optimization (SMO); sparse ELM; support vector machine (SVM); unified ELM

Indexed keywords

SUPPORT VECTOR MACHINES;

EXTREME LEARNING MACHINE; SEQUENTIAL MINIMAL OPTIMIZATION; SPARSE ELM; UNIFIED ELM;

CLASSIFICATION (OF INFORMATION);

BIOLOGY; GENETIC DATABASE; HUMAN; NEOPLASM; PROCEDURES; SUPPORT VECTOR MACHINE;

COMPUTATIONAL BIOLOGY; DATABASES, GENETIC; HUMANS; NEOPLASMS; SUPPORT VECTOR MACHINES;

EID: 84907219786     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2298235     Document Type: Article

References (33)

1. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme learning machine: A new learning scheme of feedforward neural networks," in Proc. IJCNN, vol. 2, 2004, pp. 985-990.
2. G.-B. Huang, L. Chen, and C.-K. Siew, "Universal approximation using incremental constructive feedforward networks with random hidden nodes," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 879-892, Jul. 2006.
3. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme learning machine: Theory and applications," Neurocomputing, vol. 70, pp. 489-501, Dec. 2006.
4. G.-B. Huang and L. Chen, "Convex incremental extreme learning machine," Neurocomputing, vol. 70, pp. 3056-3062, Oct. 2007.
5. Q. Liu, Q. He, and Z. Shi, "Extreme support vector machine classifier," in Advances in Knowledge Discovery and Data Mining (LNCS). Berlin, Germany: Springer, 2008, pp. 222-233.
6. G.-B. Huang and L. Chen, "Enhanced random search based incremental extreme learning machine," Neurocomputing, vol. 71, pp. 3460-3468, Oct. 2008.
7. B. Frénay and M. Verleysen, "Using SVMs with randomised feature spaces: An extreme learning approach," in Proc. 18th ESANN, 2010, pp. 315-320.
8. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagation errors," Nature, vol. 323, pp. 533-536, Oct. 1986.
9. G.-B. Huang, Q.-Y. Zhu, K. Z. Mao, C.-K. Siew, P. Saratchandran, and N. Sundararajan, "Can threshold networks be trained directly?" IEEE Trans. Circuits Syst. II, vol. 53, no. 3, pp. 187-191, Mar. 2006.
10. M.-B. Li, G.-B. Huang, P. Saratchandran, and N. Sundararajan, "Fully complex extreme learning machine," Neurocomputing, vol. 68, pp. 306-314, Oct. 2005.
11. N.-Y. Liang, G.-B. Huang, P. Saratchandran, and N. Sundararajan, "A fast and accurate online sequential learning algorithm for feedforward networks," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1411-1423, Nov. 2006.
12. C. Cortes and V. Vapnik, "Support vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
13. G. Fung and O. L. Mangasarian, "Proximal support vector machine classifiers," in Proc. Int. Conf. Knowl. Discover. Data Min., 2001, pp. 77-86.
14. J. A. K. Suykens and J. Vandewalle, "Least squares support vector machine classifiers," Neural Process. Lett., vol. 9, no. 3, pp. 293-300, 1999.
15. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
16. G.-B. Huang, X. Ding, and H. Zhou, "Optimization method based extreme learning machine for classification," Neurocomputing, vol. 74, pp. 155-163, Dec. 2010.
17. J. Platt, "Sequential minimal optimization: A fast algorithm for training support vector machines," Microsoft Research, Redmond, WA, USA, Tech. Rep. MSR-TR-98-14, 1998.
18. J. Suykens and J. Vandewalle, "Multiclass least squares support vector machines," in Proc. IJCNN, vol. 2, 1999, pp. 900-903.
19. Y. Tang and H. H. Zhang, "Multiclass proximal support vector machines," J. Comput. Graph. Statist., vol. 15, no. 2, pp. 339-355, 2006.
20. H. Drucker, C. J. Burges, L. Kaufman, A. Smola, and V. Vapnik, "Support vector regression machines," in Neural Information Processing Systems 9, M. Mozer, J. Jordan, and T. Petscbe, Eds. Cambridge, MA, USA: MIT Press, 1997, pp. 155-161.
21. A. Smola and B. Schölkopf, "A tutorial on support vector regression," Statist. Comput., vol. 14, no. 3, pp. 199-222, 2004.
22. R. Fletcher, Practical Methods of Optimization: Volume 2 Constrained Optimization. New York, NY, USA: Wiley, 1981.
23. B. Widrow, A. Greenblatt, Y. Kim, and D. Park, "The no-prop algorithm: A new learning algorithm for multilayer neural networks," J. Comput. Graph. Statist., vol. 37, pp. 182-188, 2013.
24. V. Vapnik, The Nature of Statistical Learning Theory. Berlin, Germany: Springer, 1999.
25. J. Nocedal and S. J. Wright, Numerical Optimization. Berlin, Germany: Springer, 1999.
26. E. Osuna, R. Freund, and F. Girosi, "An improved training algorithm for support vector machines," in Proc. IEEE Workshop Neural Netw. Signal Process., 1997, pp. 276-285.
27. S. Canu, Y. Grandvalet, V. Guigue, and A. Rakotomamonjy, "SVM and kernel methods MATLAB toolbox," Perception Systèmes et Information, INSA de Rouen, Rouen, France, 2005.
28. A. Frank and A. Asuncion. (2010) UCI Machine Learning Repository [Online]. Available: archive.ics.uci.edu/ml/
29. U. Alon, N. Barkai, D. A. Notterman, K. Gish, S. Ybarra, D. Mack, et al., "Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays," Proc. Nat. Acad. Sci., vol. 96, no. 12, pp. 6745-6750, 1999.
30. T. R. Golub, D. K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J. P. Mesirov, et al., "Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring," Science, vol. 286, pp. 531-537, Oct. 1999.
31. C. W. Hsu, C. C. Chang, and C. J. Lin. (2003). A Practical Guide to Support Vector Classification [Online]. Available: http://www.csie.ntu.edu.tw/cjlin/papers.html
32. A. Uzilov, J. Keegan, and D. Mathews, "Detection of non-coding RNAs on the basis of predicted secondary structure formation free energy change," BMC Bioinf., vol. 7, no. 1, p. 173, 2006.
33. H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information criteria of max-dependency, max-relevance, and minredundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005.