Extrapolation errors in linear model trees

ACM Transactions on Knowledge Discovery from Data

Volumn 1, Issue 2, 2007, Pages

  Loh, Wei Yin ^a   Chen, Chien Wei ^a   Zheng, Wei ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Decision tree; Prediction; Regression; Statistics

Indexed keywords

ERROR ANALYSIS; INTERPOLATION; LINEAR SYSTEMS; MATHEMATICAL MODELS;

INTERPOLATION ERRORS; REAL DATASETS;

DECISION TREES;

EID: 34548281605     PISSN: 15564681     EISSN: 1556472X     Source Type: Journal    
DOI: 10.1145/1267066.1267067     Document Type: Article

References (49)

1. AABERGE, R., COLOMBINO, U., AND STROM, S. 1999. Labor supply in Italy: An empirical analysis of joint household decisions, with taxes and quantity constraints. J. Appl. Econom. 14, 403-422.
2. AFIPI, A. AND AZEN, S. 1979. Statistical Analysis: A Computer Oriented Approach, 2nd ed. Academic Press, New York.
3. BELSLEY, D. A., KUH, E., AND WELSCH, R. E. 1980. Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. Wiley, New York.
4. BEHNDT, E. R. 1991. The Practice of Econometrics. Addison-Wesley, New York.
5. BLAKE, C. AND MERZ, C. 1998. UCI Repository of Machine Learning Databases, http://www.ics.uci.edu/~mlaarri/ MLRepository.html.
6. BOLLINO, C. A., PERALI, F., AND ROSSI, N. 2000. Linear household technologies. J. Appl. Econom. 15, 253-274.
7. BREIMAN, L. 2001. Random forests. Mach. Learn. 45, 5-32.
8. BREIMAN, L. AND FRIEDMAN, J. 1988. Estimating optimal transformations for multiple regression and correlation. J. Amer. Stat. Assoc. 83, 580-597.
9. BREIMAN, L., FRIEDMAN, J. H., OLSHEN, R. A., AND STONE, C. J. 1984. Classification and Regression Trees. Wadsworth, Belmont, CA.
10. BRYANT, P. G. AND SMITH, M. A. 1996. Practical Data Analysis: Case Studies in Business Statistics, vol. 3. Irwin/McGraw Hill, New York.
11. CHATTOPADHYAY, S. 2003. Divergence in alternative Hicksian welfare measures: The case of revealed preference for public amenities. J. Appl. Econom. 17, 641-666.
12. CHU, S. 2001. Pricing the C's of diamond stones. J. Stat. Educat. 9. http://www.amstat.org/publications/jse.
13. COCHRAN, J. J. 2000. Career records for all modern position players eligible for the Major League Baseball Hall of Fame. J. Stat. Educat. 8. http://www.amstat.org/publications/jse.
14. COCHRAN, J. J. 2002. Data management, exploratory data analysis, and regression analysis with 1969-2000 Major League Baseball Attendance. J. Stat. Educat. 10. http://www.amstat.org/publications/jse.
15. COOK, D. 1998. Regression Graphics: Ideas for Studying Regression Through Graphics. Wiley, New York.
16. COOK, D. AND WEISBERG, S. 1994. An Introduction to Regression Graphics. Wiley, New York.
17. DEB, P. AND TRIVEDI, P. K. 1997. Demand for medical care by the elderly: A finite mixture approach. J. Appl. Econom. 12, 313-336.
18. DENMAN, N. AND GREGORY, D. 1998. Analysis of sugar cane yields in the Mulgrave area, for the 1997 sugar cane season. Tech. rep., MS305 Data Analysis Project, Department of Mathematics, University of Queensland, Queensland, Australia.
19. DELGADO, M. A. AND MORA, J. 1998. Testing non-nested semiparametric models: An application to Engel curves specification. J. Appl. Econom. 13, 145-162.
20. FERNANDEZ, C., LEY, E., AND STEEL, M. F. J. 2002. Bayesian modelling of catch in a north-west Atlantic fishery. Appl. Stat. 51, 257-280.
21. FRIEDMAN, J. 1991. Multivariate adaptive regression splines (with discussion). Ann. Stat. 19, 1-141.
22. HAIR, J. F. ANDERSON, R. E., TATHAM, R. L., AND BLACK, W. C. 1998. Multivariate Data Analysis. Prentice Hall, Englewood Cliffs, NJ.
23. HALLIN, M. AND INGENBLEEK, J.-F. 1983. The Swedish automobile portfolio in 1977: A statistical study. Scand. Actuarial J. 83, 49-64.
24. HAMPEL, F. R., RONCHETTI, E. M., ROUSSEEUW, P. J., AND STAHEL, W A. 1986. Robust Statistics: The Approach Based on Influence Functions. Wiley, New York.
25. HARRELL, JR., F. E. 2001. Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. Springer-Verlag, New York.
26. HASTIE, T. AND TIBSHIRANI, R. 1990. Generalized Additive Models. CRC Press.
27. HORRACE, W. C. AND SCHMIDT, P. 2000. Multiple comparisons with the best, with economic applications. J. Appl. Econom. 15, 1-26.
28. KENKEL, D. S. AND TERZA, J. V. 2001. The effect of physician advice on alcohol consumption: Count regression with an endogenous treatment effect. J. Appl. Economet. 16, 165-184.
29. KIM, H., LOH, W.-Y., SHIH, Y.-S., AND CHAUDHURI, P. 2007. A visualizable and interpretable regression model with good prediction power. IIE Transactions 39, 565-579.
30. LAI, T. L., ROBBINS, H., AND WEI, C. Z. 1977. Strong consistency of least squares estimates in multiple regression. Proc. Nat. Acad. Sci., USA 75, 3034-3036.
31. LAROQUE, G. AND SALANIE, B. 2002. Labor market institutions and employment in France. J. Appl. Econom. 17, 25-28.
32. LIU, Z. AND STENGOS, T. 1999. Non-linearities in cross country growth regressions: A semiparametric approach. J. Appl. Econom. 14, 527-538.
33. LOH, W.-Y. 2002. Regression trees with unbiased variable selection and interaction detection. Stat. Sinica 12, 361-386.
34. LUTKEPOHL, H., TERASVIRTA, T., AND WOLTERS, J. 1999. Investigating stability and linearity of a German M1 money demand function. J. Appl. Econom. 14, 511-525.
35. MARTINS, M. F. O. 2001. Parametric and semiparametric estimation of sample selection models: An empirical application to the female labour force in Portugal. J. Appl. Economet. 16, 23-40.
36. NETER, J., KUTNER, M. H., NACHTSHEIM, C. J., AND WASSERMAN, W 1996. Applied Linear Statistical Models, 4th ed. Irwin.
37. OLSON, C. A. 1998. A comparison of parametric and semiparametric estimates of the effect of spousal health insurance coverage on weekly hours worked by wives. J. Appl. Econom. 13, 543-565.
38. ONOYAMA, K., OHSUMI, N., MITSUMOCHI, N., AND KISHIHARA, T. 1998. Data analysis of deer-train collisions in eastern Hokkaido, Japan. In Data Science, Classification, and Related Methods, (Tokyo, Japan) C. Hayashi, N. Ohsumi, K. Yajima, Y. Tanaka, H.-H. Bock, and Y. Baba, Eds. Springer-Verlag, New York, 746-751.
39. PACE, R. K. AND BARRY, R. 1997. Sparse spatial autoregressions. Stat. Probab. Lett. 33, 291-297.
40. PENROSE, K., NELSON, A., AND FISHER, A. 1985. Generalized body composition prediction equation for men using simple measurement techniques. Med. Sci. Sports Exer. 17, 189.
41. QUINLAN, J. R. 1992. Learning with continuous classes. In Proceedings of the Australian Joint Conference on Artificial Intelligence (Singapore), World Scientific, 343-348.
42. R DEVELOPMENT CORE TEAM. 2005. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, (Vienna, Austria). ISBN 3-900051-07-0.
43. RAWLINGS, J. O. 1988. Applied Regression Analysis: A Research Tool. Wadsworth & Brooks/Cole Advanced Books & Software.
44. SCHAFGANS, M. M. 1998. Ethnic wage differences in Malaysia: Parametric and semiparametric estimation of the Chinese-Malay wage gap. J. Appl. Econom. 13, 481-504.
45. SIMONOFF, J. 1996. Smoothing Methods in Statistics. Springer-Verlag, New York.
46. TORGO, L. 1999. Inductive Learning of Tree-Based Regression Models. PhD thesis, Department of Computer Science, Faculty of Sciences, University of Porto.
47. WANG, Y. AND WITTEN, I. 1997. Inducing model trees for continuous classes. In Proceedings of the Poster Papers of the European Conference on Machine Learning (Prague).
48. WEISS, S. AND INDURKHYA, N. 1995. Rule-based machine learning methods for functional prediction. J. Artif. Int. Res. 3, 383-403.
49. WITTEN, I. AND FRANK, E. 2005. Data Mining: Practical Machine Learning Tools and Techniques with JAVA Implementations, 2nd ed. Morgan Kaufmann, San Fransico, CA. http://www. cs.waikato.ac.nz/ml/weka.