Extreme learning machine for ranking: Generalization analysis and applications

Neural Networks

Volumn 53, Issue , 2014, Pages 119-126

  Chen, Hong ^a   Peng, Jiangtao ^b,c   Zhou, Yicong ^c   Li, Luoqing ^b   Pan, Zhibin ^a  

^a HUAZHONG AGRICULTURAL UNIVERSITY   (China)

^b HUBEI UNIVERSITY   (China)

^c UNIVERSITY OF MACAU   (Macao)

Author keywords

Coefficient regularization; Extreme learning machine; Generalization bound; Learning theory; Ranking

Indexed keywords

BENCHMARKING; KNOWLEDGE ACQUISITION; LEARNING TO RANK;

COEFFICIENT REGULARIZATIONS; EXTREME LEARNING MACHINE; GENERALIZATION BOUND; LEARNING THEORY; RANKING;

LEARNING SYSTEMS;

ARTICLE; CLASSIFICATION ALGORITHM; COMPUTER PREDICTION; CONTROLLED STUDY; EXTREME LEARNING MACHINE; INTERMETHOD COMPARISON; KERNEL METHOD; LINEAR SYSTEM; MACHINE LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NONLINEAR SYSTEM; PRIORITY JOURNAL; QUALITY CONTROL; ALGORITHM; ARTIFICIAL INTELLIGENCE; QUANTITATIVE STRUCTURE ACTIVITY RELATION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; QUANTITATIVE STRUCTURE-ACTIVITY RELATIONSHIP;

EID: 84896834052     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2014.01.015     Document Type: Article

References (40)

1. Agarwal S., Dugar D., Sengupt S. Ranking chemical structures for drug discovery: a new machine learning approach. Journal of Chemical Information and Modeling 2010, 50(5):716-731.
2. Agarwal S., Niyogi P. Generalization bounds for ranking algorithms via algorithmic stability. Journal of Machine Learning Research 2009, 10:441-474.
3. Bueno-Crespoa A., García-Laencinab P.J., Sancho-Gómez J. Neural architecture design based on extreme learning machine. Neural Networks 2013, 48:19-24.
4. Burges C., Ragno R., Le Q. Learning to rank with nonsmooth cost functions. Advances in neural information processing systems 19 2007, MIT Press. B. Schölkopf, J. Platt, T. Hoffman (Eds.).
5. Burges, C., Shaked, T., Renshaw, E., Lazier, A., Deeds, M., & Hamilton, N. et al. (2005). Learning to rank using gradient descent. In Proc. 22th international conference on machine learning.
6. Cao F.L., Liu B., Park D.S. Image classification based on effective extreme learning machine. Neurocomputing 2013, 102:90-97.
7. Chen H. The convergence rate of a regularized ranking algorithm. Journal of Approximation Theory 2012, 164(12):1513-1519.
8. Chen H., Pan Z.B., Li L.Q., Tang Y.Y. Learning rates of coefficient-based regularized classifier for density level detection. Neural Computation 2013, 25(4):1107-1121.
9. Chen H., Tang Y., Li L.Q., Yuan Y., Li X., Tang Y.Y. Error analysis of stachastic gradient descent ranking. IEEE Transactions on Cybernetics 2013, 43(3):898-909.
10. Chen D.R., Wu Q., Ying Y., Zhou D.X. Support vector machine soft margin classifiers: error analysis. Journal of Machine Learning Research 2004, 5:1143-1175.
11. Clemencon S., Luogosi G., Vayatis N. Ranking and empirical minimization of U-satistics. The Annals of Statistics 2008, 36:844-874.
12. Cortes, C., Mohri, M., & Rastogi, A. (2007). Magnitude-preserving ranking algorithms. In Proc. 24th international conference on machine learning.
13. Cossock D., Zhang T. Statistical analysis of Bayes optimal subset ranking. IEEE Transaction on Information Theory 2008, 54:5140-5154.
14. Cucker F., Smale S. On the mathematical foundations of learning. American Mathematical Society. Bulletin 2002, 39:1-49.
15. Cucker F., Zhou D.X. Learning theory: an approximation theory viewpoint 2007, Cambridge Univ. Press, Cambridge, UK.
16. Freund Y., Iyer R., Schapire R.E., Singer Y. An efficient boosting algorithm for combining preferences. Journal of Machine Learning Research 2003, 4:933-969.
17. Herbrich R., Graepel T., Obermayer K. Large margin rank boundaries for ordinal regression. Advances in large margin classifiers 2000, 115-132.
18. Hu T., Fan J., Wu Q., Zhou D.X. Learning theory approach to minimum error entropy criterion. Journal of Machine Learning Research 2013, 14:377-397.
19. Huang G.B., Ding X., Zhou H. Optimization method based extreme learning machine for classification. Neurocomputing 2010, 74:155-163.
20. Huang G.B., Wang D.H., Lan Y. Extreme learning machines: a survey. International Journal of Machine Learning and Cybernetics 2011, 2(2):107-122.
21. Huang G.B., Zhou H., Ding X., Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 2012, 42(2):513-529.
22. Huang G.B., Zhu Q.Y., Siew C.K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70(1):489-501.
23. Joachims, T. (2002). Optimizing search engines using click through data. In Proc. in eighth ACM SIGKDD int'l conf. knowledge discovery and data mining(pp. 133-142).
24. Li H., Chen N., Li L.Q. Error analysis for matrix elastic-net regularization algorithms. IEEE Transactions on Neural Networks and Learning Systems 2012, 23(5):737-748.
25. Liu, X., Lin, S., & Xu, Z.B. (2013). Is extreme learning machine feasible? A theoretical assessment. Preprint.
26. Rejchel W. On ranking and generalization bounds. Journal of Machine Learning Research 2012, 13:1373-1392.
27. Rudin C. The P-norm push: a simple convex ranking algorithm that concentrates at the top of the list. Journal of Machine Learning Research 2009, 10:2233-2271.
28. Sutherland J.J., O'Brien L.A., Weaver D.F. A comparison of methods for modeling quantitative structure-activity relationships. Journal of Medicinal Chemistry 2004, 22:5541-5554.
29. Suykens J.A.K., Van Gestel T., De Brabanter J., De Moor B., Vandewalle J. Least squares support vector machines 2002, World Scientific, Singapore.
30. ℓp-coefficient regularization. Neural Computation 2012, 22:3221-3235.
31. Vapnik V. Statistical learning theory 1998, Wiley, New York.
32. Wang Y., Cao F.L., Yuan Y. A study on effectiveness of extreme learning machine. Neurocomputing 2011, 74(16):2483-2490.
33. L1 / 2 regularization: a thresholding representation theory and a fast solver. IEEE Transactions on Neural Networks and Learning Systems 2012, 23(7):1013-1027.
34. Zhang Y.Q., Cao F.L. Analysis of convergence performance of neural networks ranking algorithm. Neural Networks 2012, 34:65-71.
35. Zhang R., Lan Y., Huang G.B., Xu Z.B. Universal approximation of extreme learning machine with adaptive growth of hidden nodes. IEEE Transactions on Neural Networks and Learning Systems 2012, 23(2):365-371.
36. Zhou D.X. The covering number in learning theory. Journal of Complexity 2002, 18:739-767.
37. Zhou D.X. Capacity of reproducing kernel spaces in learning theory. IEEE Transaction on Information Theory 2003, 49(7):1743-1752.
38. Zong W., Huang G.B. Learning to rank with extreme learning machine. Neural Processing Letters 2013, 10.1007/s11063-013-9295-8.
39. Zou B., Li L.Q., Xu Z.B. The generalization performance of ERM algorithm with strongly mixing observations. Machine Learning 2009, 75:275-295.
40. Zou B., Li L.Q., Xu Z.B., Luo T., Tang Y.Y. Generalization performance of Fisher linear discriminant based on Markov sampling. IEEE Transactions on Neural Networks and Learning Systems 2013, 24(2):288-300.