QBoost: Predicting quantiles with boosting for regression and binary classification

Expert Systems with Applications

Volumn 39, Issue 2, 2012, Pages 1687-1697

  Zheng, Songfeng ^a  

^a MISSOURI STATE UNIVERSITY   (United States)

Author keywords

Binary classification; Boosting; Functional gradient algorithm; Quantile regression

Indexed keywords

BINARY CLASSIFICATION; BOOSTING; CLASS LABELS; CLASSIFICATION ALGORITHM; FUNCTIONAL GRADIENT; FUNCTIONAL GRADIENT ALGORITHM; FUNCTIONAL GRADIENT DESCENT; FUNCTIONAL SPACES; GRADIENT DESCENT; HIDDEN VARIABLE; HIGH DIMENSIONAL SPACES; OBJECTIVE FUNCTIONS; QUANTILE REGRESSION;

ALGORITHMS;

REGRESSION ANALYSIS;

EID: 80054899703     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2011.06.060     Document Type: Conference Paper

References (36)

1. P. Bühlmann, and T. Hothorn Boosting algorithms: Regularization, prediction and model fitting Statistical Science 22 2007 477 505
2. 2-loss: Regression and classification Journal of the American Statistical Association 98 2003 324 340
3. B.S. Cade, and B.R. Noon A gentle introduction to quantile regression for ecologists Frontiers in Ecology and the Environment 1 8 2003 412 420
4. M. Dettling, and P. Bühlmann Boosting for tumor classification with gene expression data Bioinformatics 19 2003 1061 1069 (Pubitemid 36790007)
5. T.G. Dietterich, and G. Bakiri Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research 2 1995 263 286
6. N. Duffy, and D. Helmbold Boosting methods for regression Machine Learning 47 2002 153 200 (Pubitemid 34126109)
7. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani Least angle regression Annals of Statistics 32 2004 407 499 (Pubitemid 41250302)
8. Y. Freund, and R. Schapire A decision-theoretic generalization of on-line learning and an application to boosting Journal of Computer and System Sciences 55 1997 119 139 (Pubitemid 127433398)
9. J. Friedman Greedy function approximation: A gradient boosting machine Annals of Statistics 29 2001 1189 1232 (Pubitemid 33405972)
10. J. Friedman, T. Hastie, and R. Tibshirani Additive logistic regression: A statistical view of boosting Annals of Statistics 28 2000 337 407 (Pubitemid 33227445)
11. P. Hall, D.M. Titterington, and J.H. Xue Median-based classifiers for high-dimensional data Journal of the American Statistical Association 104 2009 597 1608
12. W. Hendricks, and R. Koenker Hierarchical spline models for conditional quantiles and the demand for electricity Journal of the American Statistical Association 93 1992 58 68
13. D.R. Hunter, and K. Lange Quantile regression via an MM algorithm Journal of Computational and Graphical Statistics 9 2000 60 77
14. R. Koenker Quantile regression 1st ed. 2005 Cambridge University Press New York
15. R. Koenker, and G. Bassett Regression quantiles Econometrica 46 1978 33 50
16. R. Koenker, and R. Geling Reappraising medfly longevity: A quantile regression survival analysis Journal of the American Statistical Association 96 2001 458 468
17. R. Koenker, and K. Hallock Quantile regression Journal of Economic Perspectives 15 2001 143 156 (Pubitemid 33594780)
18. 1-norm and related methods.
19. G. Kordas Smoothed binary regression quantiles Journal of Applied Econometrics 21 2006 387 407 (Pubitemid 43680619)
20. Kriegler, B.; & Berk, R. (2007). Boosting the quantile distribution: A cost-sensitive statistical learning procedure. Technical Report, Department of Statitics, University of California, Los Angeles.
21. Langford, J.; Oliveira, R.; & Zadrozny, B. (2006). Predicting conditional quantiles via reduction to classification. In Proceedings of uncertainty in artificial intelligence.
22. 1-Norm quantile regression Journal of Computational and Graphical Statistics 17 2008 163 185
23. Y. Li, Y. Liu, and J. Zhu Quantile regression in reproducing kernel Hilbert spaces Journal of the American Statistical Association 102 2007 255 268
24. C.F. Manski Semiparametric analysis of discrete response: Asymptotic properties of the maximum score estimator Journal of Economics 27 1985 313 333
25. Masnadi-Shirazi, H.; & Vasconcelos, N. (2007). Asymmetric boosting. In Proceedings of international conference on machine learning (ICML).
26. Mason, L.; Baxter, J.; Bartlett, P. L.; & Frean, M. (2000). Boosting algorithms as gradient descent. In Proceedings of advances in neural information processing systems (NIPS).
27. D. Mease, A.J. Wyner, and A. Buja Boosted classification trees and class probability/quantile estimation Journal of Machine Learning Research 8 2007 409 439 (Pubitemid 46434120)
28. W. Navidi Statistics for engineers and scientists 3rd ed. 2010 McGraw-Hill New York
29. Osuna, E.; Freund, R.; & Girosit, F. (1997). Training support vector machines: An application to face detection. In Proceedings of IEEE conference on computer vision and pattern recognition (CVPR).
30. Y. Sun, M. Kamel, A. Wong, and Y. Wang Cost-sensitive boosting for classification of imbalanced data Pattern Recognition 40 2007 3358 3378 (Pubitemid 47223287)
31. I. Takeuchi, Q.V. Le, T.D. Sears, and A.J. Smola Nonparametric quantile estimation Journal of Machine Learning Research 7 2006 1231 1264 (Pubitemid 44024585)
32. Torralba, A.; Murphy, K. P.; & Freeman, W. T. (2004). Sharing features: Efficient boosting procedures for multiclass object detection. In Proceedings of IEEE conference on computer vision and pattern recognition (CVPR).
33. Viola, P.; & Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In Proceedings of IEEE conference on computer vision and pattern recognition (CVPR).
34. G.R. Walsh Methods of optimization 1975 John Wiley and Sons London
35. Y. Wu, and Y. Liu Variable selection in quantile regression Statistica Sinica 19 2009 801 817
36. Zemel, R.; & Pitassi, T. (2001). A gradient-based boosting algorithm for regression problems. In Proceedings of advances in neural information processing systems (NIPS).