Predicting accurate probabilities with a ranking loss

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 1, Issue , 2012, Pages 703-710

  Menon, Aditya Krishna ^a   Jiang, Xiaoqian ^a   Vembu, Shankar ^b   Elkan, Charles ^a   Ohno Machado, Lucila ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ISOTONIC REGRESSION; LEARNING CLASSIFIERS; LOGISTIC REGRESSIONS; REAL-WORLD APPLICATION; SEMIPARAMETRIC;

LEARNING SYSTEMS; LOGISTICS; PROBABILITY DISTRIBUTIONS;

FORECASTING;

EID: 84867129185     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Agarwal, S., Graepel, T, Herbrich, R., Har-Peled, S., and Roth, D. Generalization Bounds for the Area Under the ROC Curve. Journal of Machine Learning Research, 6(1):393-425, December 2005.
2. Barlow, R. E., Bartholomew, D. J., Bremner, J. M., and Brunk, H. D. Statistical Inference under Order Restrictions: The Theory and Application of Isotonic Regression. Wiley, New York, NY, 1972.
3. Brümmer, N. and Preez, J. D. The PAV-Algorithm optimized binary proper scoring rules, 2007. Unpublished manuscript.
4. Brunk, H. D. On the Estimation of Parameters Restricted by Inequalities. The Annals of Mathematical Statistics, 29(2):437-454, 1958.
5. Buja, A., Stuetzle, W, and Shen, Y. Loss Functions for Binary Class Probability Estimation: Structure and Applications. Technical report, University of Pennsylvania, 2005.
6. Clémençon, S., Lugosi, G., and Vayatis, N. Ranking and empirical minimization of U-statistics. The Annals of Statistics, 36: 32, March 2006.
7. Cordeiro, G. M. and McCullagh, P. Bias Correction in Generalized Linear Models. Journal of the Royal Statistical Society. Series B (Methodological), 53(3):629-643, 1991.
8. Cosslett, S. R. Distribution-Free Maximum Likelihood Estimator of the Binary Choice Model. Econometrica, 51(3):765-782, 1983.
9. Czado, C. and Santner, T. J. The effect of link misspecification on binary regression inference. Journal of Statistical Planning and Inference, 33(2):213-231, 1992.
10. El-Kareh, R., Roy, C., Brodsky, G., Perencevich, M., and Poon, E. G. Incidence and predictors of microbiology results returning post-discharge and requiring follow-up. Journal of Hospital Medicine, 6(5):291-296, 2010.
11. Elkan, C. and Noto, K. Learning classifiers from only positive and unlabeled data. In KDD, pp. 213-220, 2008.
12. Firth, D. Bias Reduction of Maximum Likelihood Estimates. Biometrika, 80(1):27-38, 1993.
13. Flach, P. and Matsubara, E. A simple lexicographic ranker and probability estimator. In ECML, pp. 575-582, 2007.
14. Foster, D. P. and Stine, R. A. Variable Selection in Data Mining. Journal of the American Statistical Association, 99(466):303-313, 2004.
15. Hambleton, R. K., Swaminathan, H., and Rogers, H. J. Fundamentals of Item Response Theory (Measurement Methods for the Social Science). Sage Publications, Inc, 1 edition, July 1991.
16. Herbrich, R., Graepel, T., and Obermayer, K. Large margin rank boundaries for ordinal regression. In Smola, A. J., Bartlett, P. L., Schölkopf, B., and Schuurmans, D. (eds.), Advances in Large Margin Classifiers, pp. 115-132. MIT Press, Cambridge, MA, 2000.
17. Joachims, T. Optimizing search engines using clickthrough data. In KDD, pp. 133-142, 2002.
18. Joachims, T. Training linear SVMs in linear time. In KDD, pp. 217-224, 2006.
19. Kalai, A. and Sastry, R. The Isotron Algorithm: High-Dimensional Isotonic Regression. In COLT, pp. 1-9, 2009.
20. King, G. and Zeng, L. Logistic Regression in Rare Events Data. Political Analysis, 9(2): 137-163, 2001.
21. Kotlowski, W, Dembczynski, K., and Hüllermeier, E. Bipartite Ranking through Minimization of Univariate Loss. In ICML, pp. 1113-1120, 2011.
22. Manickam, S. and Abidi, S. S. R. Experienced Based Medical Diagnostics System Over The World Wide Web (WWW). In AIAI, 1999.
23. Manski, C. F. Maximum score estimation of the stochastic utility model of choice. Journal of Econometrics, 3(3):205-228, 1975.
24. Niculescu-Mizil, A. and Caruana, R. Predicting good probabilities with supervised learning. In ICML, pp. 625-632, 2005.
25. Platt, J. Probabilistic Output for Support Vector Machines and Comarisons to Regularized Likelihood Methods. Advances in Large Margin Classifiers, 10(3):61-74, 1999.
26. Richardson, M., Dominowska, E., and Ragno, R. Predicting clicks: Estimating the Click-Through Rate for New Ads. In WWW, pp. 521-529. ACM Press, 2007.
27. Rudin, C. On Equivalence Relationships Between Classification and Ranking Algorithms. Journal of Machine Learning Research, 12:2905-2929, October 2011.
28. Schervish, M. J. A General Method for Comparing Probability Assessors. Annals of Statistics, 17(4):1856-1879, 1989.
29. Sculley, D. Large Scale Learning to Rank. In NIPS Workshop on Advances in Ranking, pp. 1-6, 2009.
30. Sculley, D. Combined regression and ranking. In KDD, pp. 979-988, 2010.
31. Sculley, D., Otey, M. E., Pohl, M., Spitznagel, B., Hainsworth, J., and Zhou, Y. Detecting adversarial advertisements in the wild. In KDD, pp. 274-282, 2011.
32. Subbe, C. P., Kruger, M., Rutherford, P., and Gemmel, L. Validation of a modified Early Warning Score in medical admissions. QJM: An International Journal of Medicine, 94(10):521-526, 2001.
33. Zadrozny, B. and Elkan, C. Learning and making decisions when costs and probabilities are both unknown. In KDD, pp. 204-213, 2001.
34. Zadrozny, B. and Elkan, C. Transforming classifier scores into accurate multiclass probability estimates. In KDD, pp. 694-699, 2002.
35. Zhang, T. Statistical behavior and consistency of classification methods based on convex risk minimization. Annals of Statistics, 32(1):56-85, 2004.
36. Zhu, J. and Hastie, T. Kernel Logistic Regression and the Import Vector Machine. Journal of Computational and Graphical Statistics, 14(1):185-205, March 2005.