Boosting by weighting critical and erroneous samples

Neurocomputing

Volumn 69, Issue 7-9 SPEC. ISS., 2006, Pages 679-685

  Gómez Verdejo, Vanessa ^a   Ortega Moral, Manuel ^a   Arenas García, Jerónimo ^a   Figueiras Vidal, Aníbal R ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Boosting; Convex combination; Emphasis functions; Real adaboost

Indexed keywords

ADA (PROGRAMMING LANGUAGE); ARTIFICIAL INTELLIGENCE; COMBINATORIAL MATHEMATICS; PATTERN RECOGNITION SYSTEMS;

BOOSTING; CONVEX COMBINATION; EMPHASIS FUNCTIONS; REAL ADABOOST;

LEARNING SYSTEMS;

ABALONE; ALGORITHM; ANALYTIC METHOD; ARTICLE; ARTIFICIAL NEURAL NETWORK; BAYES THEOREM; INFORMATION PROCESSING DEVICE; LOGISTIC REGRESSION ANALYSIS; MATHEMATICAL COMPUTING; MEDICAL RESEARCH; PHONEME; PRIORITY JOURNAL; PROBLEM SOLVING; SAMPLING ERROR; STATISTICAL ANALYSIS; STATISTICAL SIGNIFICANCE; VALIDATION PROCESS;

EID: 32544445427     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2005.12.011     Document Type: Article

References (27)

1. P. Alinat, Periodic Progress Report 4, ROARS Project ESPRIT II - Number 5516. Technical Thomson Report TS. ASM 93/S/EGS/NC/079, 1993.
2. J. Arenas-García, A. Figueiras-Vidal, A.J.C. Sharkey, The beneficial effects of using multi net systems that focus on hard patterns, in: T. Windeatt, F. Rolli (Eds.), Multi Classifier Systems, Proceedings of the fourth International Workshop, Surrey, UK, Lecture Notes in Computer Science, Springer, Berlin, 2003, pp. 45-54.
3. P.L. Bartlett R.E. Schapire Y. Freund W.S. Lee Boosting the margin: A new explanation for effectiviness of voting methods Ann. Statist. 26 5 1998 1651-1686
4. C.L. Blake, C.J. Merz, UCI Repository of machine learning databases, 〈http://www.ics.uci.edu〉. University of California, Irvine, Department of Information and Computer Sciences, 1998.
5. L. Breiman Multi-Net Systems A.J.C. Sharkey Combining Artificial Neural Nets: Ensemble and Modular Multi-Nets Systems 1999 Springer London, UK 31-50
6. C.J.C. Burges A tutorial on support vector machines for pattern recognition Data Mining Knowledge Discovery 2 2 1998 121-167
7. Y. Freund R.E. Schapire Experiments with a new boosting algorithm in: Proceedings of the 13th International Conference on Machine Learning Bari, Italy 1996 148-156
8. Y. Freund R.E. Schapire Game theory on-line prediction and boosting Proceedings of the Ninth Annual Conference on Computer Learning Theory Desenzano del Garda, Italy 1996 325-332
9. J. Friedman, Greedy Function Approximation, Department of Statistics, Stanford University Technical Report, 1999.
10. J. Friedman, T. Hastie, R. Tibshirani, Additive logistic regression: A statistical view of boosting, Ann. Statist. 28(2) (2000) 337-374.
11. R. Garcia-Marciel I. Mora-Jimenez A. Figueiras-Vidal Improving kernel-based classifiers by guided dynamic sample selection Proceedings of the 13th International Conference on Artificial Neural Networks in Engineering St. Louise, MI, ASME Press 2003 27-32
12. V. Gómez-Verdejo J. Arenas-García M. Ortega-Moral A. Figueiras-Vidal Designing RBF classifiers for weighted boosting Proceedings of IJCNN'05 Montreal, Canada 2005 1057-1062
13. V. Gómez-Verdejo M. Ortega-Moral J.P. Cabrera J. Arenas-García A. Figueiras-Vidal Boosting by emphasizing boundary samples Proceedings of the Learning'04 International Conference Elche, Spain 2004 67-72
14. L. Hansen O. Salomon Neural network ensembles IEEE Trans. Pattern Anal. Mach. Intell. 12 10 1990 993-1001
15. S. Haykin Neural Networks: A Comprehensive Foundation second ed. 1999 Prentice-Hall Upper Saddle River, NJ
16. J.T. Kwok Moderating the output of support vector classifiers IEEE Trans. Neural Networks 10 5 1999 1018-1031
17. H.B. Mann D.R. Whitney On a test of whether one of two random variables is stochastically larger than the other Ann. Math. Statist. 18 1947 50-60
18. R. Meir, G. Ratsch, An introduction to boosting and leveraging, in: S. Mendelson, A. Smola (Eds.), Advanced Lectures on Machine Learning, Lecture Notes in Computer Science, Springer, Berlin, 2003, pp. 119-184.
19. G. Ratsch T. Onoda K.R. Muller Soft margins for Adaboost Mach. Learn. 42 3 2001 287-320
20. G. Ratsch M.K. Warmuth Marginal boosting in: Proceedings of the 15th of the Annual Conference on Computational Learning Theory Sydney, Australia, Springer, Berlin 2002
21. D. Rudin R.E. Schapire I. Daubechies Boosting based on a smooth margin in: Proceedings of COLT'04 2004 502-517
22. A. Ruiz P.E. López de Teruel Nonlinear kernels-based statistical pattern analysis IEEE Trans. Neural Networks 12 1 2001 16-32
23. R.E. Schapire The strength of weak learnability Mach. Learn. 5 2 1990 197-227
24. R.E. Schapire Y. Singer Improved boosting algorithms using confidence-rated predictions Mach. Learn. 37 3 1999 297-336
25. A.J.C. Sharkey Multi-net Systems A.J.C. Sharkey Combining Artificial Neural Nets: Ensemble and Modular Multi-Nets Systems 1999 Springer London, UK 1-30
26. J. Sklansky L. Michelotti Locally trained piecewise linear classifiers IEEE Trans. Pattern Anal. and Mach. Intell. 2 1 1980 101-111
27. L. Valiant Theory of the learnable Commun. ACM 27 1984 1134-1142