Decision trees for mining data streams based on the mcdiarmid's bound

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 6, 2013, Pages 1272-1279

  Rutkowski, Leszek ^a,b   Pietruczuk, Lena ^b   Duda, Piotr ^b   Jaworski, Maciej ^b  

^a CZESTOCHOWA UNIVERSITY OF TECHNOLOGY   (Poland)

^b Academy of Management   (Poland)

Author keywords

Data streams; Decision trees; Gini index; Hoeffding's bound; Information gain; McDiarmid's bound

Indexed keywords

DATA STREAM; GINI INDEX; HOEFFDING'S BOUND; INFORMATION GAIN; MCDIARMID'S BOUND;

ALGORITHMS; DATA COMMUNICATION SYSTEMS; DECISION TREES; LEARNING SYSTEMS; TREES (MATHEMATICS);

DATA MINING;

EID: 84897584541     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.66     Document Type: Article

References (27)

1. C. Aggarwal, Data Streams. Models and Algorithms. Springer, 2007.
2. A. Bifet, Adaptive Stream Mining: Pattern Learning and Mining from Evolving Data Streams. IOS Press, 2010.
3. A. Bifet, G. Holmes, G. Pfahringer, R. Kirkby, and R. Gavalda, "New Ensemble Methods for Evolving Data Streams," Proc. 15th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD '09), June/July 2009.
4. A. Bifet and R. Kirkby, Data Stream Mining a Practical Approach, technical report, Univ. of Waikato, 2009.
5. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone, Classification and Regression Trees. Chapman and Hall, 1993.
6. P. Domingos and G. Hulten, "Mining high-speed Data Streams," Proc. Sixth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 71-80, 2000.
7. W. Fan, Y. Huang, and P.S. Yu, "Decision Tree Evolution using Limited Number of Labeled Data Items from Drifting Data Streams," Proc. IEEE Fourth Int'l Conf. Data Mining, pp. 379-382, 2004. (Pubitemid 40731062)
8. M.M Gaber, A. Zaslavsky, and S. Krishnaswamy, "Mining Data Streams: A Review," ACM SIGMOD Record, vol. 34, no. 2, pp. 18-26, June 2005. (Pubitemid 41260006)
9. J. Gama, R. Fernandes, and R. Rocha, "Decision Trees for Mining Data Streams," Intelligent Data Analysis, vol. 10, no. 1, pp. 23-45, Mar. 2006.
10. J. Han and M. Kamber, Data Mining: Concepts and Techniques, second ed. Elsevier, 2006.
11. W. Hoeffding, "Probability Inequalities for Sums of Bounded Random Variables," J. Am. Statistical Assoc., vol. 58, no. 301, pp. 13-30, Mar. 1963.
12. G. Hulten, L. Spencer, and P. Domingos, "Mining Time-Changing Data Streams," Proc. Seventh ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 97-106, 2001.
13. R. Kirkby, "Improving Hoeffding Trees," PhD dissertation, Univ. of Waikato, Hamilton, 2007.
14. J.Z. Kolter and M.A. Maloof, "Dynamic Weighted Majority: A New Ensemble Method for Tracking Concept Drift," Proc. IEEE Third Int'l Conf. Data Mining, pp. 123-130, 2003.
15. D.T. Larose, Discovering Knowledge in Data: An Introduction to Data Mining. Wiley & Sons, Inc, 2005.
16. X. Li, J.M. Barajas, and Y. Ding, "Collaborative Filtering On Streaming Data With Interest-Drifting," Int'l Intelligent Data Analysis, vol. 11, no. 1, pp. 75-87, 2007.
17. J. Liu, X. Li, and W. Hong, "Ambiguous Decision Trees for Mining Concept-Drifting Data Streams," Pattern Recognition Letters, vol. 30, no. 15, pp. 1347-1355, Nov. 2009.
18. C. McDiarmid, On the Method of Bounded Differences, Surveys in Combinatorics, J. Siemons, ed., pp. 148-188, Cambridge Univ. Press, 1989.
19. B. Pfahringer, G. Holmes, and R. Kirkby, "New Options for Hoeffding Trees," Proc. 20th Australian Joint Conf. Advances in Artificial Intelligence, pp. 90-99, 2007.
20. J.R. Quinlan, "Learning Efficient Classification Procedures and Their Application to Chess End Games," Machine Learning: An Artificial Intelligence Approach, vol. 1, pp. 463-482, 1983.
21. J.R. Quinlan, C4.5: Programs for Machine Learning. Morgan Kaufmann, 1993.
22. L. Rutkowski, Computational Intelligence: Methods and Techniques. Springer-Verlag, 2008.
23. L. Rutkowski, New Soft Computing Techniques for System Modelling. Springer-Verlag, 2004.
24. L. Rutkowski, "Adaptive Probabilistic Neural-Networks for Pattern Classification in Time-Varying Environment," IEEE Trans. Neural Networks, vol. 15, no. 4, pp. 811-827, July 2004.
25. L. Rutkowski, "Generalized Regression Neural Networks in Time-Varying Environment," IEEE Trans. Neural Networks, vol. 15, no. 3, pp. 576-596, May 2004.
26. A. Tsymbal, "The Problem of Concept Drift: Definitions and Related Work," Technical Report TCD-CS-2004-15, Computer Science Department, Trinity College Dublin, Apr. 2004.
27. H. Wang, W. Fan, P.S. Yu, and J. Han, "Mining Concept-Drifting Data Streams Using Ensemble Classifiers," Proc. Ninth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 226-235, 2003.