Ensembles of restricted Hoeffding trees

ACM Transactions on Intelligent Systems and Technology

Volumn 3, Issue 2, 2012, Pages

  Bifet, Albert ^a   Frank, Eibe ^a   Holmes, Geoff ^a   Pfahringer, Bernhard ^a  

^a UNIVERSITY OF WAIKATO   (New Zealand)

Author keywords

Data streams; Decision trees; Ensemble methods

Indexed keywords

ATTRIBUTE INTERACTIONS; CHANGE DETECTION; CLASSIFICATION ACCURACY; DATA STREAM; DECISION TREES (DTS); ENSEMBLE CLASSIFIERS; ENSEMBLE MEMBERS; ENSEMBLE METHODS; LEARNING RATES; MEMORY CONSUMPTION; MODEL COMPLEXES; MODEL INTERACTION; NAIVE BAYES; PERCEPTRON; PRACTICAL PROBLEMS; PROBABILITY ESTIMATE; RUNTIMES; SIMPLE METHOD; STACKING METHOD;

CYBERNETICS; DATA COMMUNICATION SYSTEMS; DECISION TREES; PATTERN RECOGNITION SYSTEMS; SET THEORY;

FORESTRY;

COMMUNICATION; CYBERNETICS; DATA PROCESSING; DECISION THEORY; EXPERIMENTATION; FORESTRY; MATHEMATICAL MODELS; PATTERN RECOGNITION; SET;

EID: 84858171410     PISSN: 21576904     EISSN: 21576912     Source Type: Journal    
DOI: 10.1145/2089094.2089106     Document Type: Conference Paper

References (23)

1. BIFET, A. AND GAVALDÀ, R. 2007. Learning from time-changing data with adaptive windowing. In Proceedings of the SIAM International Conference on Data Mining.
2. BIFET, A., HOLMES, G., PFAHRINGER, B., AND GAVALDÀ , R. 2009a. Improving adaptive bagging methods for evolving data streams. In Proceedings of the 1st Asian Conference on Machine Learning (ACML). 23-37.
3. BIFET, A., HOLMES, G., PFAHRINGER, B., KIRKBY, R., AND GAVALDÀ, R. 2009b. New ensemble methods for evolving data streams. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 139-148.
4. BIFET, A., HOLMES, G., KIRKBY, R., AND PFAHRINGER, B. 2010a. MOA: Massive online analysis. J. Mach. Learn. Res. 11, 1601-1604.
5. BIFET, A., HOLMES, G., AND PFAHRINGER, B. 2010b. Leveraging bagging for evolving data streams. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases (ECML PKDD). Part I. 135-150.
6. BIFET, A., HOLMES, G., PFAHRINGER, B., AND FRANK, E. 2010c. Fast perceptron decision tree learning from evolving data streams. In Proceedings of the 14th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining (PAKDD). Part II. 299-310.
7. BREIMAN, L. 2001. Random forests. In Machine Learning, 5-32. (Pubitemid 32933532)
8. BREIMAN, L., FRIEDMAN, J. H., OLSHEN, R. A., AND STONE, C. J. 1984. Classification and Regression Trees. Wadsworth.
9. DOMINGOS, P. AND HULTEN, G. 2000. Mining high-speed data streams. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 71-80.
10. FRANK, A. AND ASUNCION, A. 2010. UCI machine learning repository. http://archive.ics.uci.edu/ml/citation policy.html.
11. GAMA, J., ROCHA, R., AND MEDAS, P. 2003. Accurate decision trees for mining high-speed data streams. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 523-528.
12. GAMA, J., MEDAS, P., CASTILLO, G., AND RODRIGUES, P. P. 2004. Learning with drift detection. In Proceedings of the SBIA Brazilian Symposium on Artificial Intelligence. 286-295. (Pubitemid 39751638)
13. GAMA, J., SEBASTIÃO, R., AND RODRIGUES, P. P. 2009. Issues in evaluation of stream learning algorithms. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and DataMining. 329-338.
14. HARRIES, M. 1999. Splice-2 comparative evaluation: Electricity pricing. Tech. rep., The University of South Wales.
15. HO, T. K. 1998. The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 20, 8, 832-844. (Pubitemid 128741345)
16. HOLMES, G., KIRKBY, R., AND PFAHRINGER, B. 2005. Stress-Testing Hoeffding trees. In Proceedings of the 9th European Conference on Knowledge Discovery in Databases (PKDD'05). 495-502.
17. HULTEN, G., SPENCER, L., AND DOMINGOS, P. 2001. Mining time-changing data streams. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 97-106.
18. KIRKBY, R. 2007. Improving hoeffding trees. Ph.D. thesis, University of Waikato.
19. KOLTER, J. Z. AND MALOOF, M. A. 2007. Dynamic weighted majority: An ensemble method for drifting concepts. J. Mach. Learn. Res. 8, 2755-2790.
20. MARGINEANTU, D. D. AND DIETTERICH, T. G. 1997. Pruning adaptive boosting. In Proceedings of the 14th International Conference on Machine Learning (ICML). 211-218.
21. OZA, N. C. AND RUSSELL, S. J. 2001a. Experimental comparisons of online and batch versions of bagging and boosting. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 359-364.
22. OZA, N. C. AND RUSSELL, S. J. 2001b. Online bagging and boosting. In Proceedings of the Conference on Artificial Intelligence and Statistics. 105-112.
23. WOLPERT, D. H. 1992. Stacked generalization. Neural Netw. 5, 2, 241-259.