Incremental support vector learning for ordinal regression

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 7, 2015, Pages 1403-1416

  Gu, Bin ^a,b   Sheng, Victor S ^c   Tay, Keng Yeow ^d   Romano, Walter ^e   Li, Shuo ^b,f  

^a NANJING UNIVERSITY OF INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

^c UNIVERSITY OF CENTRAL ARKANSAS   (United States)

^d LONDON HEALTH SCIENCES CENTRE   (Canada)

^e ST JOSEPH S HEALTH CENTRE   (Canada)

^f GE HEALTHCARE   (Canada)

Author keywords

Incremental learning; online learning; ordinal regression (OR); support vector machine (SVM)

Indexed keywords

CONSTRAINT THEORY; REGRESSION ANALYSIS; SOCIAL NETWORKING (ONLINE); SUPPORT VECTOR MACHINES; VECTORS; VIRTUAL REALITY;

INCREMENTAL LEARNING; INEQUALITY CONSTRAINT; NUMERICAL EXPERIMENTS; ONLINE LEARNING; ORDINAL REGRESSION; QUADRATIC FORMULATION; SUPPORT VECTOR CLASSIFICATION; SUPPORT VECTOR LEARNING;

ALGORITHMS;

EID: 85028203782     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2342533     Document Type: Article

References (33)

1. G. Huang, S. Song, C. Wu, and K. You, "Robust support vector regression for uncertain input and output data, " IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 11, pp. 1690-1700, Nov. 2012.
2. S. Agarwal, "Generalization bounds for some ordinal regression algorithms, " in Proc. 19th Int. Conf. Algorithmic Learn. Theory (ALT), Berlin, Germany, 2008, pp. 7-21.
3. Y. Amit, S. Shalev-Shwartz, and Y. Singer, "Online learning of complex prediction problems using simultaneous projections, " J. Mach. Learn. Res., vol. 9, pp. 1399-1435, Jan. 2008.
4. S. Boyd and L. Vandenberghe, Convex Optimization. New York, NY, USA: Cambridge Univ. Press, 2004.
5. W. Karush, "Minima of functions of several variables with inequalities as side constraints, " M.S. thesis, Dept. Math., Univ. Chicago, Chicago, IL, USA, 1939.
6. A. Shashua and A. Levin, "Taxonomy of large margin principle algorithms for ordinal regression problems, " in Advances in Neural Information Processing Systems 15. Cambridge, MA, USA: MIT Press, 2002.
7. G. Cauwenberghs and T. Poggio, "Incremental and decremental support vector machine learning, " in Advances in Neural Information Processing Systems 13. Cambridge, MA, USA: MIT Press, 2001, pp. 409-415. [Online]. Available: http://www.isn.ucsd.edu/svm/incremental/
8. W. Chu and S. S. Keerthi, "Support vector ordinal regression, " Neural Comput., vol. 19, no. 3, pp. 792-815, 2007. [Online]. Available: http://www.gatsby.ucl.ac.uk/~chuwei/svor.htm
9. K. Crammer and Y. Singer, "A new family of online algorithms for category ranking, " in Proc. 25th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, New York, NY, USA, 2002, pp. 151-158.
10. K. Crammer and Y. Singer, "Online ranking by projecting, " Neural Comput., vol. 17, no. 1, pp. 145-175, 2005.
11. M. Martin, "On-line support vector machine regression, " in Proc. 13th Eur. Conf. Mach. Learn. (ECML), London, U.K., 2002, pp. 282-294.
12. B. Gu, J. Wang, and H. Chen, "On-line off-line ranking support vector machine and analysis, " in Proc. IEEE Int. Joint Conf. Neural Netw. (IJCNN), 2008, pp. 1365-1370.
13. L. Gunter and J. Zhu, "Computing the solution path for the regularized support vector regression, " in Advances in Neural Information Processing Systems 18. Cambridge, MA, USA: MIT Press, 2005, pp. 483-490.
14. T. Hastie, S. Rosset, R. Tibshirani, J. Zhu, and N. Cristianini, "The entire regularization path for the support vector machine, " J.Mach. Learn. Res., vol. 5, pp. 1391-1415, Oct. 2004.
15. R. Herbrich, T. Graepel, and K. Obermayer, "Support vector learning for ordinal regression, " in Proc. 9th Int. Conf. Artif. Neural Netw., vol. 1. 1999, pp. 97-102.
16. A. S. Householder, The Theory of Matrices in Numerical Analysis. New York, NY, USA: Dover, 1974.
17. C.-W. Seah, I. W. Tsang, and Y.-S. Ong, "Transductive ordinal regression, " IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 7, pp. 1074-1086, Jul. 2012.
18. P. Laskov, C. Gehl, S. Kröger, and K. R. Möller, "Incremental support vector learning: Analysis, implementation and applications, " J. Mach. Learn. Res., vol. 7, pp. 1909-1936, Jan. 2006.
19. B. Schölkopf and A. J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA, USA: MIT Press, 2001.
20. L. Li and H. T. Lin, "Ordinal regression by extended binary classification, " in Advances in Neural Information Processing Systems 19. Cambridge, MA, USA: MIT Press, 2007, pp. 865-872.
21. C.-J. Lin, "On the convergence of the decomposition method for support vector machines, " IEEE Trans. Neural Netw., vol. 12, no. 6, pp. 1288-1298, Nov. 2001.
22. M. V. McCrea, H. D. Sherali, and A. A. Trani, "A probabilistic framework for weather-based rerouting and delay estimations within an airspace planning model, " Transp. Res. C, Emerg. Technol., vol. 16, no. 4, pp. 410-431, 2008.
23. J. S. Cardoso and J. F. Pinto da Costa, "Learning to classify ordinal data: The data replication method, " J. Mach. Learn. Res., vol. 8, pp. 1393-1429, Jan. 2007.
24. B. Schölkopf, A. J. Smola, R. C. Williamson, and P. L. Bartlett, "New support vector algorithms, " Neural Comput., vol. 12, no. 5, pp. 1207-1245, 2000.
25. M. Karasuyama and I. Takeuchi, "Multiple incremental decremental learning of support vector machines, " IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1048-1059, Jul. 2010.
26. V. Vapnik, Statistical Learning Theory. New York, NY, USA: Wiley, 1998.
27. G. Wang, D.-Y. Yeung, and F. H. Lochovsky, "A kernel path algorithm for support vector machines, " in Proc. 24th Int. Conf. Mach. Learn. (ICML), New York, NY, USA, 2007, pp. 951-958.
28. B. Gu, J. D. Wang, Y. C. Yu, G. S. Zheng, Y. F. Huang, and T. Xu, "Accurate on-line V-support vector learning, " Neural Netw., vol. 27, pp. 51-59, Mar. 2012.
29. B. Gu and V. S. Sheng, "Feasibility and finite convergence analysis for accurate on-line V-support vector machine, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 8, pp. 1304-1315, Aug. 2013.
30. A. Frank and A. Asuncion. (2010). UCI Machine Learning Repository. [Online]. Available: http://archive.ics.uci.edu/ml
31. C. W. Pfirrmann, A. Metzdorf, M. Zanetti, J. Hodler, and N. Boos, "Magnetic resonance classification of lumbar intervertebral disc degeneration, " Spine, vol. 26, no. 17, pp. 1873-1878, 2001.
32. K. Ritter, "On parametric linear and quadratic programming problems, " in Proc. Int. Congr. Math. Program., 1984, pp. 307-335.
33. X. Xu, I. W. Tsang, and D. Xu, "Soft margin multiple kernel learning, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 5, pp. 749-761, May 2013.