A noise-detection based AdaBoost algorithm for mislabeled data

Pattern Recognition

Volumn 45, Issue 12, 2012, Pages 4451-4465

  Cao, Jingjing ^a   Kwong, Sam ^a   Wang, Ran ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

AdaBoost; EM; Ensemble learning; k NN; Pattern recognition

Indexed keywords

ADABOOST ALGORITHM; BENCHMARK DATA; BOOSTING APPROACH; EM; ENSEMBLE LEARNING; EVALUATION CRITERIA; EXPECTATION MAXIMIZATION; K-NEAREST NEIGHBORS; K-NN; LOSS FUNCTIONS; MISLABELED DATA; NOISE SENSITIVITY; NOISY DATA; OVERFITTING; TRAINING ERRORS; WEIGHT DISTRIBUTIONS;

ALGORITHMS; PATTERN RECOGNITION;

ADAPTIVE BOOSTING;

EID: 84864290253     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.05.002     Document Type: Article

References (41)

1. Y. Freund, R.E. Schapire, Experiments with a new boosting algorithm, in: ICML, 1996, pp. 148-156.
2. J. Quinlan, Bagging, boosting, C4. 5, in: Proceedings of the National Conference on Artificial Intelligence, 1996, pp. 725-730.
3. F. Yoav, E. Robert A decision-theoretic generalization of on-line learning and an application to boosting Journal of Computer and System Sciences 55 1 1997 119 139
4. Y. Sun, M. Kamel, A. Wong, Y. Wang Cost-sensitive boosting for classification of imbalanced data Pattern Recognition 40 12 2007 3358 3378
5. H. Masnadi-Shirazi, N. Vasconcelos Cost-sensitive boosting IEEE Transactions on Pattern Analysis and Machine Intelligence 2010 294 309
6. P.K. Mallapragada, R. Jin, A.K. Jain, Y. Liu SemiBoost: boosting for semi-supervised learning IEEE Transactions on Pattern Analysis and Machine Intelligence 31 11 2009 2000 2014
7. S. Avidan Ensemble tracking IEEE Transactions on Pattern Analysis and Machine Intelligence 2007 261 271
8. W. Hu, W. Hu, S. Maybank Adaboost-based algorithm for network intrusion detection IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics 38 2 2008 577 583
9. R. Schapire The strength of weak learnability Machine Learning 5 2 1990 197 227 ISSN 0885-6125
10. G. Rätsch, T. Onoda, K.-R. Müller Soft margins for adaBoost Machine Learning 42 3 2001 287 320
11. T. Dietterich An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, randomization Machine Learning 40 2 2000 139 157 ISSN 0885-6125
12. C. Bishop Pattern Recognition and Machine Learning vol. 4 2006 Springer New York
13. A. Frank, A. Asuncion, UCI Machine Learning Repository 〈 http://archive.ics.uci.edu/ml 〉, 2010.
14. J. Hastie, R. Tibshirani Additive logistic regression: a statistical view of boosting The Annals of Statistics 28 2 2000 337 374
15. R. Schapire, Y. Singer Improved boosting algorithms using confidence-rated predictions Machine Learning 37 3 1999 297 336
16. G. Lematre, M. Radojevic, Directed Reading: Boosting algorithms. 〈http://g.lemaitre58.free.fr/pdf/vibot/english-writting/literature-review. pdf〉, 2009
17. A. Vezhnevets, V. Vezhnevets, Modest adaBoost-teaching adaBoost to generalize better, Graphicon-2005. Novosibirsk Akademgorodok, Russia, 2005.
18. A. Ferreira, Survey on Boosting Algorithms for Supervised and Semi-supervised Learning, Technical Report, Instituto Superior de Engenharia de Lisboa, 2007.
19. C. Domingo, O. Watanabe, MadaBoost: a modification of adaBoost, in: COLT, 2000, pp. 180-189.
20. Y. Gao, F. Gao, X. Guan, Improved boosting algorithm with adaptive filtration, in: 2010 8th World Congress on Intelligent Control and Automation (WCICA), IEEE, 2010, pp. 3173-3178.
21. N.C. Oza, AveBoost2: boosting for noisy data, in: Multiple Classifier Systems, 2004, pp. 31-40.
22. N. García-Pedrajas Supervised projection approach for boosting classifiers Pattern Recognition 42 9 2009 1742 1760
23. N. García-Pedrajas, C. García-Osorio Constructing ensembles of classifiers using supervised projection methods based on misclassified instances Expert Systems with Applications 38 1 2011 343 359
24. Y. Gao, F. Gao Edited adaBoost by weighted kNN Neurocomputing 73 16-18 2010 3079 3088
25. U. Rebbapragada, C. Brodley Class noise mitigation through instance weighting Machine Learning: ECML 2007 2007 708 715
26. T. Ho The random subspace method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligence 20 8 1998 832 844
27. S. Shirai, M. Kudo, A. Nakamura Comparison of bagging and boosting algorithms on sample and feature weighting Multiple Classifier Systems 2009 22 31
28. N. García-Pedrajas, D. Ortiz-Boyer Boosting random subspace method Neural Networks 21 9 2008 1344 1362
29. L. Nanni, A. Franco Reduced reward-punishment editing for building ensembles of classifiers Expert Systems with Applications 38 3 2011 2395 2400
30. M. Collins, R. Schapire, Y. Singer Logistic regression, adaBoost and Bregman distances Machine Learning 48 1 2002 253 285
31. R. Schapire, Y. Freund, P. Bartlett, W. Lee Boosting the margin: a new explanation for the effectiveness of voting methods The Annals of Statistics 26 5 1998 1651 1686 ISSN 0090-5364
32. S. Theodoridis, K. Koutroumbas Pattern Recognition 2003 Academic Press
33. T. Cover, P. Hart Nearest neighbor pattern classification IEEE Transactions on Information Theory 13 1 1967 21 27
34. A. Vezhnevets, Gml adaboost matlab toolbox, Technique Manual, Graphics and Media Laboratory, Computer Science Department, Moscow State University, Moscow, Russian Federation.
35. G. Huang, Q. Zhu, C. Siew Extreme learning machine: theory and applications Neurocomputing 70 1-3 2006 489 501
36. C.C. Chang, C.J. Lin, LIBSVM: a library for support vector machines, software available at 〈 http://www.csie.ntu.edu.tw/ 〉 cjlin/libsvm, 2001.
37. L. Breiman Classification and Regression Trees 1984 Chapman & Hall, CRC
38. J. Demšar Statistical comparisons of classifiers over multiple data sets The Journal of Machine Learning Research 7 2006 1 30
39. N. Garcia-Pedrajas Constructing ensembles of classifiers by means of weighted instance selection IEEE Transactions on Neural Networks 20 2 2009 258 277 ISSN 1045-9227
40. M. Galar, A. Fernández, E.B. Tartas, H.B. Sola, F. Herrera An overview of ensemble methods for binary classifiers in multi-class problems: experimental study on one-vs-one and one-vs-all schemes Pattern Recognition 44 8 2011 1761 1776
41. R. Iman, J. Davenport Approximations of the critical region of the Friedman statistic Communications in Statistics - Theory and Methods 9 6 1980 571 595