The boosting: A new idea of building models

Chemometrics and Intelligent Laboratory Systems

Volumn 100, Issue 1, 2010, Pages 1-11

  Cao, Dong Sheng ^a   Xu, Qing Song ^a   Liang, Yi Zeng ^a   Zhang, Liang Xiao ^a   Li, Hong Dong ^a  

^a CENTRAL SOUTH UNIVERSITY   (China)

Author keywords

AdaBoost; Bagging; Classification and Regression Tree (CART); Ensemble learning; Gradient boosting (GB)

Indexed keywords

ALGORITHM; ARTICLE; CHEMICAL MODEL; CLASSIFICATION; CONTROLLED STUDY; DATA MINING; MACHINE LEARNING; MATHEMATICS; METHODOLOGY; PREDICTION; PRIORITY JOURNAL;

EID: 71549120384     PISSN: 01697439     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chemolab.2009.09.002     Document Type: Article

References (83)

1. Valiant L.G. A theory of the learnable. Proceedings of the Sixteenth Annual ACM Symposium on Theory of Computing (1984), ACM
2. Dietterich T.G. Lecture Notes in Computer Science 1857 (2000) 1-15
3. Opitz D., and Maclin R. Journal of Artificial Intelligence Research 11 (1999) 169-198
4. Kearns M., and Valiant L.G. Journal of the Association for Computing Machinery 41 (1994) 67-95
5. Breiman L. Annals of Statistics 26 (1998) 801-824
6. Breiman L. Neural Computation 11 (1999) 1493-1517
7. Bishop C.M. Pattern Recognition and Machine Learning (2006), Springer, Cambridge
8. Schapire R.E. Machine Learning 5 (1990) 197-227
9. Freund Y. Information and Computation 12 (1995) 252-285
10. Freund Y., and Schapire R.E. Journal of computer and system sciences 55 (1997) 119-139
11. Freund Y., and Schapire R.E. Machine learning. Proceedings of the Thirteenth International Conference (1996) 148-156
12. Schapire R.E., Freund Y., Bartlett P., and Lee W.S. Annals of Statistics 26 (1998) 1651-1686
13. Schapire R.E., and Singer Y. Machine Learning 37 (1999) 297-336
14. Quinlan J.R. Bagging, Boosting, and C4.5. Proceedings of the Thirteenth National Conference on Artificial Intelligence 1 (1996) 725-730
15. Bauer E., and Kohavi R. Machine Learning 36 (1999) 105-139
16. Dietterich T.G. Machine Learning 40 (2000) 139-157
17. Friedman J.H., Hastie T., and Tibshirani R. Annals of Statistics 28 (2000) 337-374
18. Friedman J.H., Hastie T., and Tibshirani R. The Elements of Statistical Learning: Data Mining, Inference and Prediction (2008), Springer-Verlag, New York
19. Friedman J.H. Annals of Statistics 29 (2001) 1189-1232
20. Friedman J.H. Computational Statistics & Data Analysis 38 (2002) 367-378
21. Freund Y., Iyer R., Schapire R.E., and Singer Y. Journal of Machine Learning Research 4 (2004) 933-969
22. Freund Y. 12th Annual Conference on Computational Learning Theory, Santa Cruz, California (1999) 293-318
23. Assaad M., Bon R., and Cardot H. Information Fusion 9 (2008) 41-55
24. Schapire R.E. Workshop on Nonlinear Estimation and Classification, Berkeley, CA, Berkeley, CA (2001) 149-171
25. Schapire R.E., Rochery M., Rahim M., and Gupta N. IEEE Transactions on Speech and Audio Processing 13 (2005) 174-181
26. Borra S., and Ciaccio A. Computational Statistics & Data Analysis 38 (2002) 407-420
27. Cesario E., Folino F., Locane A., Manco G., and Ortale R. Knowledge and Information Systems 15 (2008) 285-320
28. Lin W.C., Oakes M., and Tait J. International Workshop on Content-based Multimedia Indexing (2008), IEEE, London, ENGLAND 176-183
29. Choudhury T., Rehg J.M., and Pavlovic A. V. 16th International Conference on Pattern Recognition (ICPR) (2002), IEEE Computer Soc, Quebec City, Canada 789-794
30. Robinson J.W. Health Services Research 43 (2008) 755-772
31. Gertheiss J., and Tutz G. Bioinformatics 25 (2009) 1076-1077
32. Geurts P., Fillet M., Seny D., Meuwis M.-A., Malaise M., Merville M.-P., and Wehenkel L. Bioinformatics 21 (2005) 3138-3145
33. Li H.Z., and Luan Y.H. Bioinformatics 21 (2005) 2403-2409
34. Dettling M., and Buhlmann P. Bioinformatics 19 (2003) 1061-1069
35. Hong P.Y., Liu X.S., Lu X., Liu J.S., and Wong W.H. Bioinformatics 21 (2005) 2636-2643
36. Binder H., Allignol A., Schumacher M., and Beyersmann J. Bioinformatics 25 (2009) 890-896
37. Hothorn T., and Buhlmann P. Bioinformatics 22 (2006) 2828-2829
38. Saigo H., Uno T., and Tsuda K. Bioinformatics 23 (2007) 2455-2462
39. Lin C.-C., Tsai Y.-S., Lin Y.-S., and Chiu T.-Y. Bioinformatics 23 (2007) 3374-3381
40. Wu B.L., Abbott T., Fishman D., McMurrary W., Mor G., Stone K., Ward D., Williams K., and Zhao H.Y. Bioinformatics 19 (2003) 1636-1643
41. Hong J.-H., and Cho S.-B. Pattern Recognition 42 (2009) 1761-1767
42. Takahashi H., Murase Y., Kobayashi T., and Hongda H. Biochemical Engineering Journal 33 (2007) 100-109
43. Hsieh J.-W., and Hsu Y.-T. Pattern Recognition 41 (2008) 3078-3091
44. Altun H., and Polat G. Expert Systems with Applications 36 (2009) 8197-8203
45. Zitouni I., Jeff Kuo H.-K.w., and Lee C.-H. Speech Communication 41 (2003) 647-661
46. Liu X.Z., Zhang L., Li M.J., Zhang H.J., and Wang D.X. Pattern Recognition 38 (2005) 887-901
47. Shafik N., and Tutz G. Computational Statistics & Data Analysis 53 (2009) 2453-2464
48. Zhang M.H., Xu Q.S., Daeyaert F., Lewi P.J., and Massart D.L. Analytica Chimica Acta 544 (2005) 167-176
49. Zhang M.H., Xu Q.S., and Massart D.L. Analytical Chemistry 77 (2005) 1423-1431
50. He P., Fang K.-T., Liang Y.-Z., and Li B.-Y. Analytica Chimica Acta 543 (2005) 181-191
51. Deconinck E., Zhang M.H., Coomans D., and Vander Heyden Y. Journal of Chemical Information and Modeling 46 (2006) 1410-1419
52. Zhou Y.-P., and Jiang J.-H. European Journal of Pharmaceutical Sciences 28 (2006) 344-353
53. Deconinck E., Zhang M.H., Coomans D., and Heyden Y.V. Journal of Chemometrics 21 (2007) 280-291
54. Xu Q.S., Daszykowski M., Walczak B., Daeyaert F., de Jonge M.R., Heeres J., Koymans L.M.H., Lewi P.J., Vinkers H.M., Janssen P.A., and Massart D.L. Chemometrics and Intelligent Laboratory Systems 72 (2004) 27-34
55. Svetnik V., Wang T., Tong C., Liaw A., Sheridan R.P., and Song Q. Journal of Chemical Information and Modeling 45 (2005) 786-799
56. Cai Y.-D., Feng K.-Y., and Lu W.-C. Journal of Theoretical Biology 238 (2006) 172-176
57. He P., Xu C.-J., Liang Y.-Z., and Fang K.-T. Chemometrics and Intelligent Laboratory Systems 70 (2004) 39-46
58. Breiman L., Friedman J.H., Olsen R.A., and Stone C.J. Classification and Regression Trees (1984), Wadsworth International Group, Minterey, CA
59. Breiman L. Machine Learning 24 (1996) 123-140
60. Efron B., and Tibshirani R.J. An Introduction to the Bootstrap (1993), Chapman & Hall
61. Polikar R. IEEE Circuits and Systems Magazine 6 (2006) 21-45
62. Cheze N., and Poggi J.M. Journal of Statistical Research of Iran 3 (2006) 1-21
63. Freund Y., and Schapire R.E. Journal of Computer and System Sciences 55 (1997) 119-139
64. Drucker H. Improving regressors using boosting techniques. In Machine Learning - International Workshop then Conference (1997)
65. Copas J.B. Journal of the Royal Statistical Society. Series B (Methodological) 45 (1983) 311-354
66. Shao J. Journal of the American Statistical Association 88 (1993) 486-494
67. Laud P., and Ibrahim J. Journal of the Royal Statistical Society. Series B 57 (1995) 247-262
68. Pesaran M.H. The Review of Economic Studies 41 (1974) 153-171
69. Geisser S., and Eddy W. Journal of the American Statistical Association 74 (1979) 153-160
70. Raftery A. Sociological Methodology 25 (1995) 111-163
71. Bozdogan H. Psychometrika 52 (1987) 345-370
72. Shao J. Journal of the American Statistical Association 91 (1996) 655-665
73. Xu Q.-S., and Liang Y.-Z. Chemometrics and Intelligent Laboratory Systems 56 (2001) 1-11
74. Xu Q.S., Liang Y.Z., and Du Y.P. Journal of Chemometrics 18 (2004) 112-120
75. Kuncheva L.I., and Whitaker C.J. Machine Learning 51 (2003) 181-207
76. Hawkins D.M. Journal of Chemical Information and Computer Sciences 44 (2004) 1-12
77. Kong E.B., and Dietterich T. Proceedings of the Twelfth International Conference on Machinde Learning (1995) 313-321
78. Cao D.S., Liang Y.Z., Xu Q.S., Li H.D., and Chen X. A new strategy of outlier detection for QSAR/QSPR. Journal of Computational Chemistry (2009) DOI:10.1002/jcc.21351
79. http://cran.r-project.org/web/packages/gbm/index.html.
80. http://www.ics.uci.edu/ mlearn/MLRepository.html.
81. http://software.eigenvector.com/Data/SWRI/index.html.
82. http://www.swri.org/.
83. http://www.r-project.org/.