Self-adaptive induction of regression trees

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 33, Issue 8, 2011, Pages 1659-1672

  Fidalgo Merino, Raul ^a   Núñez, Marlon ^a  

^a UNIVERSITY OF MÁLAGA   (Spain)

Author keywords

heuristics design; knowledge acquisition; Machine learning; mining methods and algorithms

Indexed keywords

BINARY REGRESSION; CURRENT DYNAMICS; DATA STREAM; DIFFERENT SPEED; HEURISTICS DESIGN; INCREMENTAL CONSTRUCTION; INTERNAL PARAMETERS; MINING METHODS AND ALGORITHMS; NOISE LEVELS; REGRESSION METHOD; REGRESSION TREES; SAMPLING DISTRIBUTION; SELF-ADAPTIVE;

ALGORITHMS; BINARY TREES; DATA COMMUNICATION SYSTEMS; KNOWLEDGE ACQUISITION; MINING; PLANT EXTRACTS; REGRESSION ANALYSIS;

TREES (MATHEMATICS);

ALGORITHM; DATA MINING; FACTUAL DATABASE; MACHINE LEARNING; REGRESSION ANALYSIS;

ALGORITHMS; DATA MINING; DATABASES, FACTUAL; MACHINE LEARNING; REGRESSION ANALYSIS;

EID: 79959517343     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2011.19     Document Type: Article

References (36)

1. D.H. Widyantoro, T.R. Ioerger, and J. Yen, "An Adaptive Algorithm for Learning Changes in User Interests," Proc. Eighth Int'l Conf. Information and Knowledge Management, pp. 405-412, 1999. (Pubitemid 32262568)
2. W. Fan, "Systematic Data Selection to Mine Concept-Drifting Data Streams," Proc. ACM SIGKDD, pp. 128-137, 2004. (Pubitemid 40114923)
3. M. Núñez, R. Fidalgo, and R. Morales, "Learning in Environments with Unknown Dynamics: Towards More Robust Concept Learners," J. Machine Learning Research, vol. 8, pp. 2595-2628, 2007. (Pubitemid 350241863)
4. P. Domingos and G. Hulten, "Mining High-Speed Data Streams," Proc. Sixth ACM SIGKDD, pp. 71-80, 2000.
5. M.A. Maloof and R.S. Michalski, "Selecting Examples for Partial Memory Learning," Machine Learning, vol. 41, no. 1, pp. 27-52, 2000.
6. E. Ikonomovska and J. Gama, "Learning Model Trees from Data Streams," Proc. Int'l Conf. Discovery Science, J.F. Boulicaut, M.R. Berthold, and T. Horváth, eds., pp. 52-63, 2008.
7. E. Ikonomovska, J. Gama, R. SebastiÃo, and D. Gjorgjevik, "Regression Trees from Data Streams with Drift Detection," Proc. Int'l Conf. Discovery Science, pp. 121-135, 2009.
8. D. Potts and C. Sammut, "Incremental Learning of Linear Model Trees," Machine Learning, vol. 61, pp. 5-48, 2005. (Pubitemid 43049361)
9. J.R. Quinlan, "Learning with Continuous Classes," Proc. Fifth Australian Joint Conf. Artificial Intelligence, pp. 307-310, 1992.
10. L. Breiman, J. Friedman, C.J. Stone, and R. Olsen, Classification and Regression Trees. Wadsworth Publishing Company, 1984.
11. D. Aha, D. Kibler, and M. Albert, "Instance-Based Learning Algorithms," Machine Learning, vol. 6, pp. 37-66, 1991. (Pubitemid 21727227)
12. J.Z. Kolter and M.A. Maloof, "Using Additive Expert Ensembles to Cope with Concept Drift," Proc. 22nd Int'l Conf. Machine Learning, pp. 449-456, 2005. (Pubitemid 43183365)
13. F. Rosenthal, P.B. Volk, M. Hahmann, D. Habich, and W. Lehner, "Drift-Aware Ensemble Regression," Proc. Int'l Conf. Machine Learning and Data Mining, pp. 221-235, 2009.
14. G. Widmer and M. Kubat, "Learning in the Presence of Concept Drift and Hidden Contexts," Machine Learning, vol. 23, pp. 69-101, 1996. (Pubitemid 126737384)
15. M. Kubat and G. Widmer, "Adapting to Drift in Continuous Domains (Extended Abstract)," Proc. Eighth European Conf. Machine Learning, pp. 307-310, 1995.
16. G. Hulten, L. Spencer, and P. Domingos, "Mining Time-Changing Data Streams," Proc. Seventh ACM SIGKDD, pp. 97-106, 2001.
17. R. Klinkenberg and T. Joachims, "Detecting Concept Drift with Support Vector Machines," Proc. 17th Int'l Conf. Machine Learning, pp. 487-494, 2000.
18. R. Klinkenberg, "Learning Drifting Concepts: Example Selection versus Example Weighting," Intelligent Data Analysis, vol. 8, no. 3, pp. 281-300, 2004.
19. M. Nunez, R. Fidalgo, and R. Morales, "On-Line Learning of Decision Trees in Problems with Unknown Dynamics," Proc. Fourth Mexican Int'l Conf. Artificial Intelligence, pp. 443-453, 2005. (Pubitemid 43763549)
20. J.B. MacQueen, "Some Methods for Classification and Analysis of Multivariate Observations," Proc. Fifth Berkeley Symp. Math. Statistics and Probability, vol. 1, pp. 281-297, 1967.
21. J. Dougherty, R. Kohavi, and M. Sahami, "Supervised and Unsupervised Discretization of Continuous Features," Proc. 20th Int'l Conf. Machine Learning, pp. 194-202, 1995.
22. J.W. Tukey, Exploratory Data Analysis. Addison-Wesley, 1977.
23. J. Nagle, "On Packets Switches with Infinite Storage," IEEE Trans. Comm., vol. 35, no. 4, pp. 435-438, Apr. 1987.
24. J. Postel, "RFC-793: TCP Specification," ARPANET WGRC, DDN Network Information Center, SRI Int'l, 1981.
25. V. Paxson and M. Allman, "RFC-2988: Computing TCPs Transmission Timer," Network WGRC, 2000.
26. F. Esposito, D. Malerba, and G. Semeraro, "A Comparative Analysis of Methods for Pruning Decision Trees," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 5, pp. 476-491, May 1997. (Pubitemid 127762239)
27. J.R. Quinlan, "Induction of Decision Trees," Machine Learning, vol. 1, pp. 81-106, 1986.
28. W. Hoeffding, "Probability Inequalities for Sums of Bounded Random Variables," J. Am. Statistical Assoc, vol. 58, pp. 13-30, 1963.
29. I.H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, second ed. Morgan Kaufmann, 2005.
30. M. Harries, C. Sammut, and K. Horn, "Extracting Hidden Context," Machine Learning, vol. 32, no. 2, pp. 101-126, 1998. (Pubitemid 40626077)
31. J. Gama, P. Medas, and P. Rodrigues, "Learning in Dynamic Environments: Decision Trees for Data Streams," Proc. Fourth Int'l Workshop Pattern Recognition in Information Systems, pp. 149-158, 2004.
32. A. Asuncion and D.J. Newman, "UCI Machine Learning Repository," http://www.ics.uci.edu/~mlearn/MLRepository.html, 2007.
33. C.E. Rasmussen, R.M. Neal, and G. Hinton, "DELVE Dataset Repository," Univ. of Toronto, http://www.cs.toronto.edu/delve/data/ datasets.html, 2003.
34. P. Vlachos, "StatLib Repository," Carnegie Mellon Univ., Dept. of Statistics, http://lib.stat.cmu.edu/datasets/, 2007.
35. T.G. Dietterich, "Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms," Neural Computation, vol. 10, no. 7, pp. 1895-1923, 1998. (Pubitemid 128463689)
36. J. Demsar, "Statistical Comparisons of Classifiers over Multiple Data Sets," J. Machine Learning Research, vol. 7, pp. 1-30, 2006. (Pubitemid 43022939)