Knowledge discovery in data streams with regression tree methods

Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

Volumn 2, Issue 1, 2012, Pages 69-78

  Alberg, Dima ^a   Last, Mark ^b   Kandel, Abraham ^c  

^a Shamoon College of Engineering   (Israel)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^c UNIVERSITY OF SOUTH FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA MINING; DATA STREAMS; FORESTRY; REGRESSION ANALYSIS;

DATA STREAM MINING; DIVIDE AND CONQUER; GREEDY ALGORITHMS; INCREMENTAL MODELING; INTERPRETABILITY; KNOWLEDGE DISCOVERY IN DATA; REGRESSION TREE ALGORITHMS; REGRESSION TREES;

TREES (MATHEMATICS);

ALGORITHMS; FORESTRY; MATHEMATICS; REGRESSION ANALYSIS; TREES;

EID: 84873203642     PISSN: 19424787     EISSN: 19424795     Source Type: Journal    
DOI: 10.1002/widm.51     Document Type: Review

References (62)

1. Gama J, Sebastiao R, Rodrigues P. Issues in evaluation of stream learnings algorithms. In: Proceedings of KDD2009; Paris 2009, 329-338.
2. Last M. Online classification of nonstationary data streams. Intell Data Anal 2002, 6:129- 147.
3. Holmes G, Kirkby R, Bainbridge D. Batch Incremental Learning for Mining Data Streams. Hamilton, New Zealand: University of Waikato, Department of Computer Science, New Zealand; 2004.
4. Schlimmer J, Granger R. Incremental learning from noisy data. Mach Learn 1986, 1:317-354.
5. Granger C, Newbold P. Forecasting in Business and Economics. 2nd ed. New York:Academic Press; 1986.
6. Friedman J.Multivariate adaptative regression splines. Ann Stat 1991, 19:1-67.
7. Krzanowski W, Hand D. A recursive partitioning tool for interval prediction. Proc ADAC 2007, 1:241-254.
8. Witten I, Frank E. Data Mining: Practical Machine Learning Tools and Techniques, 2nd ed. San Francisco: Morgan Kaufmann; 2005.
9. Schaal S, Atkeson C. Constructive incremental learning from only local information. Neural Comput 1998, 10:2047-2084.
10. Nelles O. Nonlinear System Identification. Berlin: Springer; 2001.
11. Vijayakumar S, Schaal S. Locally weighted projection regression: incremental real time learning in high dimensional space. In: Proceedings of the 17th International Conference on Machine Learning. San Francisco: Morgan Kaufmann; 2000, 1079-1086.
12. Craven M, Shavlik J. Understanding time-series networks: a case study in rule extraction. Int J Neural Syst 1997, 8:373-384.
13. Dietterich T. Machine Learning for Sequential Data: A Review. Berlin: Springer; 2009.
14. Klinkenberg R, Joachims T. Detecting concept drift with support vector machines. In: Langley P, ed. In: Proceedings of ICML 2000. 17th International Conference on Machine Learning; San Francisco Stanford: Morgan Kaufmann; 2000, 487-494.
15. Mierswa I, Klinkenberg R, Martin S, Euler T. YALE: rapid prototyping for complex data mining tasks. In: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2006, 935-940.
16. Bifet A, Kirkby R. Data Stream Mining A Practical Approach. COSI 2009. Available at http://www.cs. waikato.ac.nz /~abifet /MOA.
17. Keogh E, Chu S, Hart D, Pazzani M. Segmenting time series: a survey and novel approach. In: Last M, Kandel A, Bunke H, eds. Data Mining in Time Series Databases. Singapore: World Scientific; 2004, 1-22.
18. Last M, Bunke H, Kandel A. Data Mining in Time Series Database. Singapore: World Scientific; 2004.
19. Bartlett P, Ben David S, Kulkarni S. Learning changing concepts by exploiting the structure of change. Mach Learn 2000, 41:153-174.
20. Bifet A, Holmes G, Pfahringer B, Kirkby R, Gavald'a R. New ensemble methods for evolving data streams. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and DataMining (KDD'09). Paris; 2009, 139-148.
21. Morgan J, Sonquist J. Problems in the analysis of survey data and a proposal. J Am Stat Assoc 1963, 58:415-434.
22. Morgan J, Messenger R. THAID a Sequential Analysis Program for Analysis of Nominal Scale Dependent Variables. Ann Arbor,MI: Institute for Social Research, University of Michigan; 1973.
23. Kass G. An exploratory technique for investigating large quantities of categorical data. Appl Stat 1980, 29:119-127.
24. Rounds E. A combined nonparametric approach to feature selection and binary decision tree design. Pattern Recognit 1980, 12:313-317.
25. Breiman L, Friedman J, Olshen R, Stone C. Classification and Regression Trees. Belmont, CA: Wadsworth & Brooks/Cole. Pacific Grove; 1984.
26. Wang Y, Witten I. Inducing of model trees for predicting continuous Classes. In: Proceedings of the 9th European Conference on Machine Learning. London: Springer-Verlag; 1997, 128-137.
27. Quinlan J. Combining instance-based and model-based learning. In: Proceedings of the 10th International Conference on Machine Learning. Amherst: Morgan Kaufmann; 1993, 236-243.
28. Quinlan J. Learning with continuous classes. In: Proceedings of the 5th Australian Joint Conference on Artificial Intelligence. Sydney/Singapore: World Scientific; 343-348.
29. Frank E, Inglis S, Holmes G, Witten I. Using model trees for classification. Mach Learn 1998, 32:63-76.
30. Torgo L. Functional models for regression tree leaves. In: Proceedings of the Fourteenth International Conference on (ICML 1997). Nashville; 1997, 385-393.
31. Karalic A. Linear regression in regression tree leaves. In: Proceedings of International School for Synthesis of Expert Knowledge; Bled 1992, 10:151-162.
32. Niblett T, Bratko I. Learning decision rules in noisy domains. In: Bramer MA, ed. Research and Development in Expert Systems III. Cambridge: Cambridge University Press; 1986, 25-34.
33. Cestnik B, Bratko I. On estimating probabilities in tree pruning. In: Proceedings of European Working Session on Learning, EWSL 1991; Porto 1991, 138-150.
34. Chaudhuri P, Huang M, Loh W, Yao R. Piecewise polynomial regression trees. Stat Sin 1994, 4:143-167.
35. Dobra A, Gehrke J. Bias correction in classification tree construction. In: Proceedings of the Seventeenth International Conference on Machine Learning ICML2001; Williamstown 2001, 90-97.
36. Potts D. Incremental learning of linear model trees. In: Proceedings of the 21st International Conference on Machine Learning. Alberta: ACM; 2004, 663-670.
37. Potts D, Sammut C. Incremental learning of linear model trees. Mach Learn 2005, 61:5-48.
38. Ceci M, Appice A, Malerba D. Comparing simplification methods for model trees with regression and splitting nodes. In: Proceedings of Foundations of Intelligent Systems, 14th International LNAI Symposium. LNAI. Vol. 2871. 2003, 49-56.
39. Malerba D, Esposito F, Ceci M, Appice A. Top-down induction of model trees with regression and splitting nodes. IEEE Trans Pattern Anal Mach Intell 2004, 26:612-625.
40. Loh W. Regression by parts: fitting visually interpretable models with GUIDE. In: Handbook of Computational Statistics, Vol. III, Berlin: Springer; 2008, 447-469.
41. Loh W. Classification and regression trees. Wiley Interdisc Rev: Data Min Knowl Discov 2011, 1:14-23.
42. Loh W, Vanichsetakul N. Tree-structured Classification via Generalized Discriminant Analysis (with discussion). J Am Stat Assoc 1988, 715-728.
43. Vogel D, Asparouhov O, Scheffer T. Scalable lookahead linear regression trees. In: Proceedings of KDD'07. New York: ACM; 2007, 757-764.
44. Brockwell P, Davis R. Time Series: Theory and Methods. New York: Springer-Verlag; 1991.
45. Wei W. Time Series Analysis: Univariate and Multivariate Methods. New York: Addison-Wesley; 2006.
46. Chow G. Tests of equality between sets of coefficients in two linear regressions. Econometrica 1960, 28:591- 605.
47. Hyndman R. Highest-density forecast regions for nonlinear and non-normal time series models. J Forecast 1995, 14:431-441.
48. Olive D. Prediction intervals for regression models. Comput Stat Data Anal 2007, 51:3115-3122.
49. Gooijer J, Gannoun A. Nonparametric conditional predictive regions for time series. Comput Stat Data Anal 2000, 33:259-275.
50. Olive D, Hawkins D. Variable selection for 1D regression models. Technometrics 2005, 47:43-50.
51. Chatfield C. Prediction Intervals for Time-Series Forecasting. Boston: Kluwer Academic Publishers; 2001.
52. Montgomery D. Introduction to Statistical Quality Control. 6th ed. New York: Wiley; 2009.
53. Alberg D, Last M, Neuman R, Sharon A. Induction of mean output prediction trees from continuous temporal meteorological data. In: Proceedings of 2009 IEEE International Conference on Data Mining Workshops. Miami, FL: IEEE Computer Society; 2009, 208- 213.
54. Chen Y, Dong G, Han J, Wah B, Wang J. Multidimensional regression analysis of time series data streams. In: Proceedings of the 28th International Conference on Very Large Databases. San Francisco, CA: Morgan Kaufmann; 2002, 323-334.
55. Zliobaite I. Learning under concept drift: an overview. CoRR abs/1010.4784; 2010. doi:abs/1010.4784.
56. Harvey A. Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge, UK: Cambridge University Press; 1989.
57. Ikonomovska E, Gama J, Dzeroski S. Learning model trees from evolving data streams. Data Min KnowlDiscov J 2010, 23:128-168.
58. Hulten P, Domingos G. A general framework for mining massive data streams. J Comput Graph Stat 2003, 12:945-949.
59. Mouss H, Mouss D, Mouss N, Sefouhi L. Test of page-hinkley, an approach for fault detection in an agro-alimentary production system. In: 5th Asian Control Conference 2;Melbourne IEEE Computer Society; 2004, 815-818.
60. Rodrigues P, Gama J. A system for analysis and prediction of electricity-load streams. Intell Data Anal 2009, 13:477-496.
61. Cohen L, Avrahami G, Last M, Kandel A. Info-fuzzy algorithms for mining dynamic data streams. Appl Soft Comput 2008, 8:1283-1294.
62. Cohen L, Avrahami G, Last M, Kandel A, Kipersztok O. Real-time data mining of non-stationary data streams from sensor networks. Inf Fusion 9, 2008:344- 353.