When efficient model averaging out-performs boosting and bagging

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4213 LNAI, Issue , 2006, Pages 478-486

  Davidson, Ian ^a   Fan, Wei ^b  

^a STATE UNIVERSITY OF NEW YORK   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; DATA MINING; LEARNING SYSTEMS; MATHEMATICAL MODELS; PROBLEM SOLVING; STATISTICAL METHODS;

BAGGING; BAYES OPTIMAL CLASSIFIER (BOC); BOOSTING; ENSEMBLE TECHNIQUES; EXTENSIVE CLASS LABEL NOISE;

CLASSIFICATION (OF INFORMATION);

EID: 33750321908     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11871637_46     Document Type: Conference Paper

References (17)

1. Buntine W. (1990). A Theory of Learning Classification Rules, Ph.D. Thesis, UTS.
2. Davidson I. (2004). An Ensemble Technique for Stable Learners with Performance Bounds, AAAI 2004.
3. Dietterich, T. G. (2000). An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Machine Learning, 40 (2).
4. Domingos, P., (1997). Why Does Bagging Work? A Bayesian Account and its Implications. KDD 1997.
5. Domingos P. (2000). Bayesian Averaging of Classifiers and the Overfitting Problem, AAAI 2000
6. Efron, B. (1982). The jackknife, the bootstrap, and other resampling plans. SIAM Monograph 38.
7. Fan W., Davidson I., Zadrozny B. and Yu P., (2005) An Improved Categorization of Classifier's Sensitivity on Sample Selection Bias, ICDM 2005.
8. Fan W., Wang H., Yu P.S, Ma S., (2003). Is random model better? On its accuracy and Efficiency, ICDM 2003.
9. Fei Tony Liu, Kai Ming Ting, Wei Fan, (2005). Maximizing Tree Diversity by Building Complete-Random Decision Trees. PAKDD 2005.
10. Frank, Eibe, Personal Communication, 2004.
11. Hoeting J., Madigan D., Raftery A., and Volinsky C., (1999). "Bayesian Model Averaging: A Tutorial", Statistical Science 14.
12. Kohavi R., Wolpert D., (1996). Bias Plus Variance Decomposition for 0-1 Loss Functions, ICML 1996.
13. McCallum, A. (1996). Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering, http://www.cs.cmu.edu/~mccallum/ bow.
14. Mitchell T., (1997). Machine Learning, McGraw-Hill.
15. Minka, T.P., Bayesian model averaging is not model combination, MIT Media Lab note (7/6/00), http://research.microsoft.com/~minka/papers/bma.html
16. Rennie, J. (2003) 20 Newsgroups. Technical Report, Dept C.S., MIT.
17. Zadrozny B., (2004). Learning and evaluating classifiers under sample selection bias, ICML 2004.