A stagewise least square loss function for classification

Society for Industrial and Applied Mathematics - 8th SIAM International Conference on Data Mining 2008, Proceedings in Applied Mathematics 130

Volumn 1, Issue , 2008, Pages 120-131

  Yang, Shuang Hong ^a   Hu, Bao Gang ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

Classification; Kernel methods; Loss function; Online learning; Supervised learning

Indexed keywords

CLASSIFICATION (OF INFORMATION); E-LEARNING; LEARNING ALGORITHMS; SUPERVISED LEARNING; SUPPORT VECTOR MACHINES;

COMPUTATIONAL ADVANTAGES; EMPIRICAL RISK MINIMIZATION; GENERALIZATION ACCURACY; KERNEL METHODS; LOSS FUNCTIONS; NON-CONVEX LOSS FUNCTION; ONLINE LEARNING; ONLINE LEARNING ALGORITHMS;

DATA MINING;

EID: 53849111236     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972788.11     Document Type: Conference Paper

References (31)

1. An, S., Liu, W., Venkatesh, S.: Face Recognition Using Kernel Ridge Regression. Proceeding of IEEE Computer Society Conference on (CVPR), 2007.
2. Bartlett, P., Jordan, M.I., McAuliffe, J.D.: Convexity, Classification and Risk Bounds, Journal of the American Statistical Association, Vol.101, No.473, 3 (2006) 138-156.
3. Bishop, C. M.: Pattern Recognition and Machine Learning, Springer, 2006.
4. Bishop, C. M., Tipping, M.E.: Variational Relevance Vector Machines. Proceeding of the 16th Conference on Uncertainty in Artificial Intelligence (UAI), 2000.
5. Breiman, L.: Prediction Games and Arcing Classifiers. Neural Computation, Vol.11, (1999)1493-1517.
6. Chapelle, O.: Training the Support Vector Machine in the Primal, Neural Computation, Vol.19, No.5, 3(2007) 1155-1178.
7. Collobert, R., Sinz, F., Weston, J., Bottou, L. : Trading Convexity for Scalability. Proceeding of the 23rd International Conference on Machine Learning (ICML), 2006.
8. Cristianini, N., Taylor, J.S.: An Introduction to Support Vector Machines. Cambridge Univ. Press, 2000.
9. Duda, R. O., Hart, P. E., Stork, D. G.: Pattern Classification (2nd Edition) . John-Wiley&Sons, 2001.
10. Engel, Y., Mannor, S., Meir, R.: The Kernel Recursive Least Squares Algorithm, IEEE Transaction on Signal Processing, Vol.52, 8(2004)2275-2285.
11. Fung, G., Mangasarian, O.L.: Proximal Support Vector Machine Classifiers. Procedding of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining SIGKDD, 2001.
12. Golub, G., Loan, C.V.: Matrix Computation (3rd Edition), The John Hopkins University Press, 1996.
13. Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer, 2001.
14. Krause, N., Singer, Y.: Leveraging the Margin More Carefully. Proceeding of the 21st International Conference on Machine Learning (ICML), 2004.
15. Li, F., Yang, Y.: A Loss Function Analysis of Classification Methods in Text Categorization. Proceeding of the 20th International Conference on Machine Learning (ICML), 2003.
16. Lin, Y.: Support Vector Machine and the Bayes Rule in Classification. Data Mining and Knowledge Discovery, Vol. 6, (2002) 259-275.
17. Lin, Y.: A Note on Margin-based Loss Functions in Classification, Statistics and Probability Letters, Vol.68, (2004) 73-82.
18. Liu, Y., Shen, X.: Multicategory ψ-Learning. Journal of the American Statistical Association, Vol.101, No.474, 6(2006) 500-509.
19. Liu, Y., Shen, X., Wong, W. H.: Computational Developments of ψ-Learning. Proceeding of the 7th SIAM International Conference on Data Mining (SDM), 2006.
20. Mangasarian, O.L., Musicant, D.R.: Lagrangian Support Vector Machines, Journal of Machine Learning Research, Vol.1, (2001) 161-177.
21. Mason, L., Bartlett, P.L., Baxter, J.: Improved Generalization Through Explicit Optimization of the Margins. Machine Learning, Vol.38, (2001) 243-255.
22. Nair, P. B., Choudhury, A., Keane, A. J.: Some Greedy Learning Algorithms for Sparse Regression and Classification with Mercer Kernels, Journal of Machine Learning Research, Vol.3, (2002) 781-801.
23. Opper, M., Winther, O.: Gaussian Processes for Classification: Mean-Field Algorithms. Neural Computation, Vol.12, (2000) 2655-2684.
24. Pérez-Cruz, F., Navia-Vázquez, A., Figueiras-Vidal, A. R., Artés-Rodríguez, A.: Empirical Risk Minimization for Support Vector Classifiers. IEEE Transaction on Neural Networks, Vol.14, (2002) 296-303.
25. Reyzin, L., Schapire, R.E.: How Boosting the Margin Can Also Boost Classifier Complexity, Proceeding of the 23rd International Conference on Machine Learning (ICML), 2006.
26. Schapire, R.E., Freund, Y., Bartlett, P., Lee, W.S.: Boosting the Margin: A New Explanation for the Effectiveness of Voting Methods. Annals of Statistics, Vol.26, 5(1998)1651-1686.
27. Sebastiani, F.: Machine Learning in Automated Text Categorization, ACM Computing Surveys, Vol.34, 3(2002)1-47.
28. Shen, X., Tseng, G., Zhang, X., Wang, W.: On ψ-learning. Journal of the American Statistical Association, (1998)724-734.
29. Suykens, J. A. K., Vandewalle, J.: Benchmarking Least Squares Support Vector Machine Classifiers, Machine Learning, Vol. 54, 1 (2004) 5-32.
30. Zhang, T., Oles, F. J.: Text Categorization Based on Regularized Linear Classification Methods, Information Retrieval, Vol.4, (2001)5-31.
31. Zhang, T.: Statistical Behavior and Consistency of Classification Methods based on Convex Risk Minimization, Annals of Statistics, Vol.53,(2004)56-134.