One-pass AUC optimization

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 3, 2013, Pages 1943-1951

  Gao, Wei ^a   Jin, Rong ^b   Zhu, Shenghuo ^c   Zhou, Zhi Hua ^a  

^a NANJING UNIVERSITY   (China)

^b Michigan State University   (United States)

^c NEC LABORATORIES AMERICA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COVARIANCE MATRIX; LEARNING SYSTEMS; OPTIMIZATION;

COVARIANCE MATRICES; HIGH DIMENSIONAL DATA; ONLINE LEARNING ALGORITHMS; PERFORMANCE MEASURE; RANDOMIZED ALGORITHMS; REGRESSION-BASED ALGORITHMS; SECOND ORDER STATISTICS; STORAGE REQUIREMENTS;

DIGITAL STORAGE;

EID: 84897548505     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Cesa-Bianchi, N. and Lugosi, G. Prediction, learning, and games. Cambridge University Press, 2006.
2. Cortes, C. and Mohri, M. AUC optimization vs. error rate minimization. In Advances in Neural Information Processing Systems 16, pp. 313-320. MIT Press, Cambridge, MA, 2004.
3. Flach, P. A., Hernández-Orallo, J., and Ramirez, C. F. A coherent interpretation of AUC as a measure of aggregated classification performance. In Proceedings of the 28th International Conference on Machine Learning, pp. 657-664, Bellevue, WA, 2011.
4. Gao, W. and Zhou, Z.-H. On the consistency of AUC optimization. CoRR/abstract, 1208.0645, 2012.
5. Gao, W., Jin, R., Zhu, S., and Zhou, Z.-H. One-pass AUC optimization. CoRR/abstract, 1305.1363, 2013.
6. Hanley, J. A. and McNeil, B. J. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology, 148 (3):839-843, 1983. (Pubitemid 13033817)
7. Hansen, P. C. Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion. SIAM, 1987.
8. Herschtal, A. and Raskutti, B. Optimising area under the ROC curve using gradient descent. In Proceedings of the 21st International Conference on Machine Learning, Alberta, Canada, 2004.
9. Hsu, D., Kakade, S., and Zhang, T. Random design analysis of ridge regression. In Proceedings of the 25th Annual Conference on Learning Theory, pp. 9.1-9.24, Edinburgh, Scotland, 2012.
10. Joachims, T. A support vector method for multivariate performance measures. In Proceedings of the 22nd International Conference on Machine Learning, pp. 377-384, Bonn, Germany, 2005.
11. Joachims, T. Training linear svms in linear time. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 217-226, Philadelphia, PA, 2006.
12. Johnstone, I. High dimensional statistical inference and random matrices. In Proceedings of the International Congress of Mathematicians, pp. 307-333, Madrid, Spain, 2006.
13. Kotlowski, W., Dembczynski, K., and Hiillermeier, E. Bipartite ranking through minimization of univariate loss. In Proceedings of the 28th International Conference on Machine Learning, pp. 1113-1120, Bellevue, WA, 2011.
14. Liu, X.-Y., Wu, J., and Zhou, Z.-H. Exploratory undersampling for class-imbalance learning. IEEE Trans. Systems, Man, and Cybernetics - B, 39(2): 539-550, 2009.
15. Metz, C. E. Basic principles of ROC analysis. Seminars in Nuclear Medicine, 8(4):283-298, 1978. (Pubitemid 9075026)
16. Nocedal, J. and Wright, S. J. Numerical optimization. Springer, 1999.
17. Provost, F. J., Fawcett, T., and Kohavi, R. The case against accuracy estimation for comparing induction algorithms. In Proceedings of the 15th International Conference on Machine Learning, pp. 445-453, Madison, WI, 1998.
18. Rakhlin, A., Shamir, O., and Sridharan, K. Making gradient descent optimal for strongly convex stochastic optimization. In Proceedings of the 29th International Conference on Machine Learning, pp. 449-456, Edinburgh, Scotland, 2012.
19. Rudin, C. and Schapire, R. E. Margin-based ranking and an equivalence between AdaBoost and Rank-Boost. Journal of Machine Learning Research, 10: 2193-2232, 2009.
20. Srebro, N., Sridharan, K., and Tewari, A. Smoothness, low noise and fast rates. In Advances in Neural Information Processing Systems 24, pp. 2199-2207. MIT Press, Cambridge, MA, 2010.
21. Zhao, P., Hoi, S., Jin, R., and Yang, T. Online AUC maximization. In Proceedings of the 28th International Conference on Machine Learning, pp. 233-240, Bellevue, WA, 2011.