A general framework for accurate and fast regression by data summarization in random decision trees

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn 2006, Issue , 2006, Pages 136-146

  Fan, Wei ^a   McCloskey, Joe ^b   Yu, Philip S ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b ARMED FORCES INSTITUTE OF PATHOLOGY   (United States)

Author keywords

Decision trees; Random; Regression

Indexed keywords

DATA MINING; DECISION THEORY; PARAMETER ESTIMATION; PROBLEM SOLVING; REGRESSION ANALYSIS; TREES (MATHEMATICS);

DATA SUMMARIZATION; KERNEL-BASED METHODS; RANDOM DECISION TREES;

DATA PROCESSING;

EID: 33749568964     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1150402.1150421     Document Type: Conference Paper

References (19)

1. Amit, Y. and Geman, D. (1997). Shape quantization and recognition with randomized trees. Neural Computation, 9(7):1545-1588.
2. Breiman, L. (2001). Random forests. Machine Learning, 45(1):5-32.
3. Breiman, L., Friedman, J., Olshen, R., and Stone, C. (1984). Classification and Regression Trees. Wadsworth.
4. Fan, J. and Huang, L.-S. (2001). Goodness-of-fit tests for parametric regression models. Journal of the American Statistical Association, 96(454):640-664.
5. Fan, W., Greengrass, E., McCloskey, J., Yu, P. S., and Drummey, K. (2005). Effective estimation of posterior probabilities: Explaining the accuracy of randomized decision tree approaches. In Proceedings of the 5th IEEE International Conference on Data Mining (ICDM 2005), pages 154-161.
6. Fan, W., Wang, H., Yu, P. S., and Ma, S. (2003). Is random model better? on its accuracy and efficiency. In Proceedings of Third IEEE International Conference on Data Mining (ICDM'2003).
7. Hardle, W. (1990). Applied Nonparametric Regression. Cambridge University Press.
8. Hastie, T. and Tibshirani, R. (1986). Generalized additive models. Statistical Science, 1:297-318.
9. Indurkhya, N. and Weiss, S. M. (2001). Solving regression problems with rule-based ensemble classifiers. In ACM International Conference Knowledge Discovery and Data Mining (KDD01), pages 287-292.
10. Kedem, B. and Fokianos, K. (2002). Regression Models for Time Series Analysis.
11. Liu, T. F. (July 2005). The utility of randomness in decision tree ensemble. Master's thesis, Faculty of Information Technology, Monash University.
12. Loh, W.-Y. (2002). Regression trees with unbiased variable selection and interaction detection. Statistica Sinica, 12:361-386.
13. McCullagh, P. and Nelder, J. A. (1989). Generlized linear models, 2nd edition. Chapman and Hall, London.
14. Nelder, J. A. and Wedderburn, R. W. M. (1972). Generlized linear models. Journal of Royal Statistical Survey. Series A, 135:370-384.
15. Segal, M. R. (2004). Machine learning benchmarks and random forest regression, available from eScholarship repository, http://repositories.cdlib. org/cbmb/bench-rf_regn/.
16. Van, J., Li, S., Zhu, S., and Zhang, H. (2001). Ensemble svm regression based multi-view face detection system. Technical Report MSR-TR-2001-09, Microsoft Research.
17. Zhang, K., Xu, Z., Peng, J., and Buckles, B. P. (2005). Learning through changes: An empirical study of dynamic behaviors of probability estimation trees. In Proceedings of the 5th IEEE International Conference on Data Mining (ICDM 2005), pages 817-820.
18. Zhou, Z. H., Wu, J. X., Tang, W., and Chen., Z. Q. (2001). Combining regresson estimators: Ga-based selective neural network ensemble. International Journal of Computational Intelligence and Applications, 2001, 1(4):341-356,
19. International Journal of Computational Intelligence and Applications, 1(4):341-356.