A random decision tree ensemble for mining concept drifts from noisy data streams

Applied Artificial Intelligence

Volumn 24, Issue 7, 2010, Pages 680-710

  Li, Peipei ^a   Wu, Xindong ^a,b   Hu, Xuegang ^a   Liang, Qianhui ^c   Gao, Yunjun ^d  

^a HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^b University of Vermont   (United States)

^c SINGAPORE MANAGEMENT UNIVERSITY   (Singapore)

^d ZHEJIANG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA HANDLING; DATA MINING; DECISION TREES; LEARNING ALGORITHMS;

CONCEPT DRIFTING; CONCEPT DRIFTS; DATA STREAM; ENSEMBLE CLASSIFICATION; INDUCTIVE LEARNING; NOISY DATA STREAMS; RANDOM DECISION TREES; REAL APPLICATIONS; STREAMING DATA; TREE ENSEMBLES;

LEARNING SYSTEMS;

EID: 77955356202     PISSN: 08839514     EISSN: 10876545     Source Type: Journal    
DOI: 10.1080/08839514.2010.499500     Document Type: Article

References (46)

1. Abdulsalam, H., D. B. Skillicorn, and P. Martin. 2007. Streaming random forests. In: Proceedings of the 11th International Database Engineering and Applications Symposium (IDEAS'07), 225-232. IEEE Computer Society.
2. Abdulsalam, H., D. B. Skillicorn, and P. Martin. 2008. Classifying evolving data streams using dynamic streaming random forests. In: Proceedings of the 19th International Conference on Database and Expert Systems Applications (DEXA'08), 643-651. Springer-Verlag.
3. Aggarwal, C. C. 2009. On classification and segmentation of massive audio data streams. Knowledge and Information Systems 20:137-156.
4. Breiman, L. 2001. Random forests. Machine Learning 45(1):5-32.
5. Castillo, G., J. Gama, and P. Medas. 2003. Adaptation to drifting concepts. In: Proceedings of 11th Portuguese Conference on Artificial Intelligence (Epia'03), 279-293. Springer-Verlag.
6. Chu, F., Y. Z. Wang, and C. Zaniolo. 2004. An adaptive learning approach for noisy data streams. In: Proceedings of 4th IEEE International Conference on Data Mining (ICDM'04), 351-354. IEEE Computer Society.
7. Dang, X. H., W. K. Ng, and K. L. Ong. 2008. Online mining of frequent sets in data streams with error guarantee. Knowledge and Information Systems 16(2):245-258.
8. Denton, A. M., C. A. Besemann, and D. H. Dorr. 2009. Pattern-based time-series subsequence clustering using radial distribution functions. Knowledge and Information Systems 18(1):1-27.
9. Duda, R., P. Hart, and D. Stork. 2001. Pattern Classification. John Willey & Sons.
10. Enembreck, F., B. C. Ávila, E. E. Scalabrin, and J. P. Barthès. 2007. Learning drifting negotiations. Applied Artificial Intelligence 21(9):861-881.
11. Fan, W. 2004. Streamminer: a classifier ensemble-based engine to mine concept-drifting data streams. In: Proceedings of the 30th International Conference on Very Large Data Bases (VLDB'04), 1257-1260. VLDB Endowment.
12. Gaber, M. M. 2009. Data stream mining using granularity-based approach. Foundations of Computational Intelligence 6:47-66.
13. Gama, J. 2005. Learning decision trees from dynamic data streams. Journal of Universal Computer Science 11(8):1353-1366.
14. Gama, J., P. Medas, G. Castillo, and P. Rodrigues. 2004. Learning with drift detection. SBIA Brazilian Symposium on Artificial Intelligence 3171:286-295.
15. Gama, J., R. Fernandes, and R. Rocha. 2006. Decision trees for mining data streams. Intelligent Data Analysis 10:23-45.
16. Gama, J., R. Rocha, and P. Medas. 2003. Accurate decision trees for mining high-speed data streams. In: Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 523-528. ACM Press.
17. Gama J., R. Sebastião, and P. P. Rodrigues. 2009. Issues in evaluation of stream learning algorithms. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery in Data Mining (KDD'09), 329-338. ACM Press.
18. Gehrke, J., V. Ganti, R. Ramakrishnan, and W. Y. Loh. 1999. Boat-optimistic decision tree construction. In: Proceedings of the 1999 ACM SIGMOD International Conference on Management of data, 169-180. ACM Press.
19. Ho, T. K. 1995. Random decision forests. In: Proceedings of the 3rd international Conference on Document Analysis and Recognition, 278-282. IEEE Computer Society.
20. Hoeffding, W. 1963. Probability inequalities for sums of bounded random variables. Journal of the American Statistical Association 58(301):13-30.
21. Hulten, G., L. Spencer, and P. Domingos. 2001. Mining time-changing data streams. In: Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'01), 97-106. ACM Press.
22. Hu, X. G., P. P. Li, X. D. Wu, and G. Q. Wu. 2007. A semi-random multiple decision-tree algorithm for mining data streams. Journal of Computer Science and Technology 22(5):711-724.
23. KDDCup99 DataSet. 1999. http://kdd.ics.uci.edu//databases/kddcup99/. ACM Special Interest Group on Knowledge Discovery and Data Mining.
24. Kolter, J. Z., and M. A. Maloof. 2005. Using additive expert ensembles to cope with concept drift. In: Proceedings of the 22nd International Conference on Machine Learning (ICML'05), 449-456. ACM Press.
25. Kolter, J. Z., and M. A. Maloof. 2007. Dynamic weighted majority: an ensemble method for drifting concepts. Journal of Machine Learning Research 8:2755-2790.
26. Li, P. P., Q. H. Liang, X. D. Wu, and X. G. Hu. 2009. Parameter estimation in semi-random decision tree ensembling on streaming data. In: Proceedings of 13th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD'09), 376-388. Springer-Verlag.
27. Li, P. P., Q. H. Liang, X. D. Wu, and X. G. Hu. 2010. Random ensemble decision trees for learning concept-drifting data streams. Submitted for publication to New Generation Computing.
28. Li, P. P., X. G. Hu, and X. D. Wu. 2008. Mining concept-drifting data streams with multiple semirandom decision trees. In: Proceedings of 4th International Conference on Advanced Data Mining and Applications (ADMA'08), 733-740. Springer-Verlag.
29. Ludl, M. C., A. Lewandowski, and G. Dorffner. 2008. Adaptive machine learning in delayed feedback domains by selective relearning. Applied Artificial Intelligence 22(6):543-557.
30. Montgomery, D. C. 2004. Introduction to Statistical Quality Control (5th ed.). John Wiley & Sons.
31. Quinlan, R. J. 1993. C4.5: Programs for Machine Learning. San Francisco: Morgan Kaufmann.
32. Sallehuddin, R., and S. M. Hj. Shamsuddin. 2009. Hybrid grey relational artificial neural network and auto regessive integrated moving average model for forecasting time-series Data. Applied Artificial Intelligence 23(5):443-486.
33. Schlimmer, J. C., and R. H. Granger, Jr. 1986. Incremental learning from noisy data. Machine Learning 1(3):317-354.
34. Scholz, M., and R. Klinkenberg. 2005. An ensemble classifier for drifting concepts. In: Proceedings of the 2nd International Workshop on Knowledge Discovery in Data Streams (IWKDDS'05), 53-64.
35. Scholz, M., and R. Klinkenberg. 2007. Boosting classifiers for drifting concepts. Intelligent Data Analysis (IDA), Special Issue on Knowledge Discovery from Data Streams 11(1):3-28. Holland: IOS Press.
36. Shafer, J., R. Agrawal, and M. Mehta. 1996. Sprint: A scalable parallel classifier for data mining. In: Proceedings of 22nd International Conference on Very Large Data Bases, 544-555. VLDB Endowment.
37. Stanley, K. O. 2003. Learning concept drift with a committee of decision trees. Technical Report AI-03-302, University of Texas at Austin.
38. Street, W. N., and Y. S. Kim. 2001. A streaming ensemble algorithm (sea) for large-scale classification. In: Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'01), 377-382. ACM Press.
39. Tsymbal, A., M. Pechenizkiy, P. Cunninggham, and S. Puuronen. 2008. Dynamic integration of classifiers for handling concept drift. Information Fusion 9(1):56-68.
40. Wang, H. X., W. Fan, P. S. Yu, and J. W. Han. 2003. Mining concept-drifting data streams using ensemble classifiers. In: Proceedings of the 9th International Conference on Knowledge Discovery and Data Mining (KDD'03), 226-235. ACM Press.
41. Wei, L. Y., and W. C. Peng. 2009. Clustering data streams in optimization and geography domains. In: Proceedings of the 13th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD'09), 997-1005. Yahoo! Shopping Web Services. http://developer.yahoo.com/everything.html. Yahoo! Inc.
42. Yang, Y., X. D. Wu, and X. Q. Zhu. 2005. Combining proactive and reactive predictions for data streams. In: Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery in Data Mining (KDD'05), 710-715. ACM Press.
43. Zhang, Y., and X. M. Jin. 2006. An automatic construction and organization strategy for ensemble learning on data streams. ACM SIGMOD Record 35(3):28-33.
44. Zhang, P., X. Q. Zhu, and Y. Shi. 2008. Categorizing and mining concept drifting data streams. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'08), 812-820. ACM Press.
45. Zhou, A., F. Cao, W. N. Qian, and C. Q. Jin. 2008. Tracking clusters in evolving data streams over sliding windows. Knowledge and Information Systems 15(2):181-214.
46. Zhu, X. Q., X. D. Wu, and Y. Yang. 2006. Effective classification of noisy Data Streams with attributeoriented dynamic classifier selection. Knowledge and Information Systems 9(3):339-363.