Exploratory data mining using decision trees in the behavioral sciences

Contemporary Issues in Exploratory Data Mining in the Behavioral Sciences

Volumn , Issue , 2013, Pages 3-47

  McArdle, John J ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84917480339     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203403020     Document Type: Chapter

References (139)

1. Abdolell, M., LeBlanc, M, Stephens, D. & Harrison, R.V. (2002). Binary partitioning for continuous longitudinal data: Categorizing a prognostic variable. Statistics in Medicine, 21, 3395-3409.
2. Albert, M., Blacker, D., Moss, M.B., Tanzi, R., & McArdle, J.J. (2007). Longitudinal change in cognitive performance among individuals with mild cognitive impairment. Neuropsychology, 21(2), 158-169.
3. Amick, D.J. & Walberg, H.J. (1976; Eds.) Introduction to Multivariate Analysis. Berkeley: McCutcheon.
4. Belson, W.A. (1959). Matching and prediction on the principle of biological classification. Applied Statistics, 8(2), 65-75.
5. Berk, R.A. (2003). Regression Analysis:A Constructive Critique. Newbury Park, CA: Sage Publications
6. Berk, R.A. (2009). Statistical Learning from a Regression Perspective. New York: Springer.
7. Breiman, L. (2001) Statistical modeling:The two cultures. Statistical Science, 16(3), 199-231.
8. Breiman, L. & Friedman, J.H. (1985). Estimating optimal transformations for multiple regression correlation. Journal of the American Statistical Association, 80(391), 580-598.
9. Breiman, L., Friedman, J., Olshen, R., & Stone, C. (1984). Classification and Regression Trees. Pacific Grove, CA:Wadsworth and Brooks/Cole.
10. Brown, T.A. (2006). Confirmatory Factor Analysis for Applied Research. New York: Guilford Press.
11. Browne, M.B. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36(1), 111-150.
12. Browne, M.W. & Cudeck, R. (1989). Single sample cross-validation indices for covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62-83.
13. Box, G.E.P. (1976). Science and statistics. Journal of the American Statistical Association, 71(356), 791-799.
14. Box, J.F. (1978). R. A. Fisher:The Life of a Scientist. NewYork: JohnWiley & Sons.
15. Cattell, R.B. (1966). Psychological theory and scientific method (pp. 1-18). In R.B. Cattell (Ed.) Handbook of Multivariate Experimental Psychology. Chicago: Rand McNally & Co.
16. Cliff, N. & Krus, D. J. (1976). Interpretation of canonical variate analysis: Rotated vs. unrotated solutions. Psychometrika, 41(1), 35-42.
17. Crouse, J. & Trusheim, D. (1988). The Case Against the SAT. Chicago: University of Chicago Press.
18. Cooley, J. & Lohnes, P. (1962, 1971, 1985). Mutivariate Data Analysis. Boston: Duxbury Press.
19. Dierker, L.C., Avenevoli, S., Goldberg, A., & Glantz, M. (2004). Defining subgroups of adolescents at risk for experimental and regular smoking. Prevention Science, 5(3), 169-183.
20. Drezner, Z., Marcoulides, G.A., & Stohs, M.H. (2001). Financial application of a Tabu search variable selection model. Journal of Applied Mathematics and Decision Sciences, 5(4), 215-234.
21. Dwinnell, W. (2000). Exploring MARS:An alternative to neural networks. PC AI, 14(1), 21-24.
22. Efron, B. (1979). Bootstrap methods: Another look at the jackknife. Annals of Mathematical Statistics, 7, 1-26.
23. Everitt, B.S. (1979). Unresolved problems in cluster analysis. Biometrics, 35, 169-181.
24. Fielding, A. & O’Muircheaetaigh, C.A. (1977). Binary segmentation in survey analysis with particular reference to AID. The Statistician, 26(1), 17-28.
25. Fisher, R.A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7, 179-188.
26. Feldesman, M.R. (2002). Classification trees as an alternative to linear discriminant analysis. American Journal of Psychical Anthropology, 119, 257-275.
27. Ferrer, E., Hamagami, F., & McArdle, J.J. (2004). Modeling latent growth curves with incomplete data using different types of structural equation modeling and multilevel software. Structural Equation Modeling, 11(3), 452-483.
28. Fox, J. (1997). Applied Regression Analysis, Linear Models, and Related Methods. Thousand Oaks, CA: SAGE.
29. Friedman, J.H. (1991). Multivariate adaptive regression splines. Annals of Statistics, 19(1), 1-67.
30. Fruend, Y. & Schapire, R.E. (1999) A short introduction to boosting. Journal of the Japanese Society for Artificial Intelligence, 14, pp. 771-780.
31. Gabadinho, A., Ritschard, G., Muller, N.S., & Studer, M. (2011). Analyzing and visualizing state sequences in R with TraMineR. Journal of Statistical Software, 40(4), 1-37.
32. Goldberger, L.R. (1965). Diagnotician vs. diagnostic signs: The diagnosis of psychosis vs neurosis from the MMPI. Psychological Monographs(602), p. 79.
33. Gordon, L. & Olshen, R. (1985). Tree-structured survival analysis. CancerTreatment Reports, 69, 1065-1069.
34. Granger, C.V., Lackner, J.M., Kulas, M., & Russell, C.F. (2003). Outpatients with low back pain: An analysis of the rate per day of pain improvement that may be expected and factors affecting improvement. American Journal of Physical Medicine & Rehabilitation, 82(4), 253-260.
35. Grimm, K. J., McArdle, J. J., & Hamagami, F. (2007). Nonlinear growth mixture models in research on cognitive aging. In K. van Montfort, H. Oud, &A. Satorra (Eds.), Longitudinal models in the behavioral and related sciences(pp. 267-294). Mahwah, NJ: Erlbaum.
36. Gruenewald, T.L., Mroczek, D.K., Ryff, C.D., & Singer, B.H. (2008). Diverse pathways to positive and negative affect in adulthood and later life:An integrative approach using recursive partitioning. Development Psychology, 44(2), 330-343.
37. Hand, D.J., Blunt, G., Kelly, M.G., & Adams, N.M. (2000). Data mining for fun and profit. Statistical Science, 15(2), 111-131.
38. Hastie, R. & Dawes, R. (2010). Rational choice in an uncertain world:The psychology of judgment and decision making(2nd Ed). Los Angeles: SAGE.
39. Hastie, T., Tibshirani, R., & Freidman, J. (2001). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. NewYork: Springer.
40. Hothorn, T., Hornik, K. & Zeileis, A. (2006). Unbiased recursive partitioning: A Conditional inference framework. Journal of Computational and Graphical Statistics, 15(3), 651-674.
41. Horn, J.L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179-185.
42. Horn, J.L. & Little, K.B. (1966). Isolating change and invariance in patterns of behavior. Multivariate Behavioral Research, 1(2), 219-228.
43. Horton, N.J. & Lipsitz, S.R. (2001). Multiple imputation in practice: Comparing software packages for regression models with missing values. The American Statistician, 55, 244-254.
44. Hosmer, D.W. & Lemeshow, S. (2000) Applied Logistic Regression. New York: John Wiley & Sons.
45. Ishwaran, H. (2007). Variable importance in binary regression trees and forests. Electronic Journal of Statistics, 1, 519-537.
46. Joreskog, K.G. & Sorbom, D. (1979). Advances in Factor Analysis and Structural Equation Models. Cambridge, MA:Abt.
47. Joreskog, K.G. and Wold, H. (1982). The ML and PLS techniques for modeling with latent variables: Historical and comparative aspects, in H. Wold and K. Joreskog (Eds.), Systems Under Indirect Observation: Causality, Structure, Prediction(Vol. I), Amsterdam: North-Holland, 263-270.
48. Jung, T. & Wickrama, K.A.S. (2008). An introduction to latent class growth analysis and growth mixture modeling, Social and Personality Psychology Compass, 2/1, 302-317.
49. Keith, T.Z. (2006). Multiple Regression Analysis and Beyond. Boston: Allyn and Bacon.
50. Kerby, D.S. (2003). CART analysis with unit-weighted regression to predict suicide ideation from Big Five traits. Personality and Individual Differences, 35, 249-261.
51. King, D.W., King, L.A., Bachrach, P.S., & McArdle, J.J. (2001). Contemporary approaches to missing data: The glass is really half full. PTSD Quarterly, 12(2), 1-7.
52. Kline, R.B. (2010). Principles and Practice of Structural Equation Modeling(2nd Ed). NewYork: Guilford Press.
53. Lawley, D.N. & Maxwell, A.E. (1971). Factor Analysis as a Statistical Method. NewYork: Macmillan Publishing Co., Inc.
54. Lazersfeld, P.F. (1955). The interpretation of statistical relations as a research operation, in P.F. Lazersfeld & M. Rosenberg (Eds.), The Language of Social Research. Glencoe, IL:The Free Press.
55. Leamer, E.E. (1978). Specification Searches: Ad Hoc Inferences with Nonexperimental Data. NewYork:Wiley.
56. Lemon, S.C., Roy, J., Clark, M.A., Friedmann, P.D., & Rakowski, W. (2003). Classification and regression tree analysis in public health: Methodological review and comparison with logistic regression. Annals of Behavioral Medicine, 26(3), 172-181.
57. Liang, K.H., Krus, D.J. & Webb, J.M. (1995). K-fold cross-validation in canonical analysis. Multivariate Behavioral Research, 30, 539-545.
58. Loehlin, J.C. (2005). Latent Variable Models: An Introduction to Factor, Path, and Structural Analysis(5th edn). Mahwah, NJ: Lawrence Erlbaum Associates.
59. Loh, W-Y & Shih, Y-S. (1997). Split selection methods for classification trees. Statistica Sinica, 7, 815-840.
60. MacCallum R.C. (1986). Specification searches in covariance structure modeling. Psychological Bulletin, 100, 107-120.
61. MacCallum, R.C., Roznowski, M., & Necowitz, L.B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111, 490-504.
62. Marcoulides, G.A., Chin, W.W., & Saunders, C. (2009). A critical look at partial least squares modeling. MIS Quarterly, 33(1), 171-175.
63. Marcoulides, G.A. & Drezner, Z. (2004). Tabu search variable selection with resource constraints. Communications in Statistics, 33(2), 355-362.
64. McArdle, J.J. (1988). Dynamic but structural equation modeling of repeated measures data, in J.R. Nesselroade & R.B. Cattell (Eds.), The Handbook of Multivariate Experimental Psychology, (Vol. 2). NewYork, Plenum Press, 561-614.
65. McArdle, J.J. (1991). Principals versus principles in factor analysis. Multivariate Behavioral Research, 25(1), 81-87.
66. McArdle, J.J. (1994). Structural factor analysis experiments with incomplete data. Multivariate Behavioral Research, 29(4), 409-454.
67. McArdle, J.J. (1997). Modeling longitudinal data by latent growth curve methods. In G. Marcoulides (Ed.), Modern Methods for Business Research. Mahwah, NJ: Lawrence Erlbaum Associates, pp. 359-406.
68. McArdle, J.J. (1998). Test bias. In J.J. McArdle & R.W.Woodcock (Eds.), (1998). Human Cognitive Abilities in Theory and Practice. Mahwah, NJ: Lawrence Erlbaum Associates.
69. McArdle, J.J. (2009). Latent variable modeling of longitudinal data. Annual Review of Psychology, 60, 577-605.
70. McArdle, J.J. (2010). Ethical issues in factor analysis. In A. Panter (Ed.), Statistics Through An Ethical Lens.Washington, DC:APA.
71. McArdle, J.J. (2012). Exploratory data mining using CART in the behavioral sciences. In H. Cooper & A. Panter (Eds.), Handbook of Methodology in the Behavioral Sciences (Chapter 20).Washington, DC:APA.
72. McArdle, J.J. & Aber, M.S. (1990). Patterns of change within latent variable structural equation modeling. In A. von Eye (Ed.), New Statistical Methods in Developmental Research. NewYork: Academic Press, 151-224.
73. McArdle, J.J. & Cattell, R.B. (1994). Structural equation models of factorial invariance in parallel proportional profiles and oblique confactor problems. Multivariate Behavioral Research, 29(1), 63-113.
74. McArdle, J.J. & Epstein, D.B. (1987). Latent growth curves within developmental structural equation models. Child Development, 58(1), 110-133.
75. McArdle, J.J. & Hamagami, F. (1994). Logit and multilevel logit modeling studies of college graduation for 1984-85 freshman student-athletes. The Journal of the American Statistical Association, 89(427), 1107-1123.
76. McArdle, J.J. & Nesselroade, J.R. (1994). Using multivariate data to structure developmental change. In S.H. Cohen & H.W. Reese (Eds.), Life-Span Developmental Psychology: Methodological Innovations. Hillsdale, NJ: Erlbaum, pp. 223-267.
77. McArdle, J.J. & Wang, L. (2008). Modeling Age-Based Turning Points in Longitudinal Life-Span Growth Curves of Cognition (pp. 105-127). In P. Cohen (Ed.), Applied data analytic techniques for turning points research, Multivariate applications series.
78. MahwahErlbaum, McCall R.B., Appelbaum, M.I., Hogarty, P.A. (1973). Developmental Changes in Mental Performance. Monographs of the Society for Research in Child Development.
79. McDonald, R.P. (1985). Factor Analysis and Related Methods. Hillsdale, NJ: Erlbaum.
80. McDonald, R.P. (1999). Test Theory:A Unified Treatment. Mawah, NJ: Erlbaum.
81. McLachlan, G. & Peel, D. (2000). Finite Mixture Models. NewYork:Wiley.
82. McVicar, D. & Anyadike-Danes, M. (2002). Predicting successful and unsuccessful transitions from school to work by using sequence methods. Journal of the Royal Statistical Society, Series A, 165, Part 2, 317-334.
83. Meredith, W. & Horn, J.L. (2001). The role of factorial invariance in modeling growth and change. In L. Collins & A. Sayers (Eds.), New Methods for the Analysis of Change.Washington, DC:APA, pp. 203-240.
84. Miller, A.J. (1990). Subset Selection in Regression. London: Chapman & Hall.
85. Milligan, G.W. (1981).A review of Monte Carlo tests of cluster analysis. Multivariate Behavioral Research, 16, 379-407.
86. Mills, J.D., Olejnik, S.F., & Marcoulides, G.A. (2005). The Tabu search procedure: An alternative to the variable selection methods. Multivariate Behavioral Research, 40(3), 351-371.
87. Miloslava, K., Jiri, K., & Pavel, J. (2008). Application of decision trees in problem of air quality modeling in the Czech Republic locality. WSEAS Transactions on Systems, 7(10), 1166-1175.
88. Monahan, J., Steadman, H.J., Silver, E., Appelbaum, P.S., Robbins, P.C., Mulvey, E.P., Roth, L., Grisso, T., & Banks, S. (2001). Rethinking Risk Assessment:The MacArthur Study of Mental Disorder and Violence. Oxford: Oxford University Press.
89. Morgan, J.N. & Sonquist, J.A. (1963). Problems in the analysis of survey data:And a proposal. Journal of the American Statistical Association, 58, 415-434.
90. Mosteller, F. & Tukey, J.W. (1977). Data Analysis and Regression:A Second Course in Statistics. Reading, MA:Addison-Wesley.
91. Muthen, B. (2004). Latent variable analysis: Growth mixture modeling and related techniques for longitudinal data. In D. Kaplan (Ed.), Handbook of Quantitative Methodology for the Social Sciences(pp. 345-368). Newbury Park, CA: Sage Publications.
92. Nagin, D.S. (2005). Group-Based Models of Development. Cambridge: MA: Harvard University Press.
93. Nylund, K.L., Asparouhov, T., & Muthen, B.O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14(4), 535-569.
94. Osborne, R.T., & Suddick, D.E. (1972). A longitudinal investigation of the intellectual differentiation hypothesis. Journal of Genetic Psychology, 121, 83-89.
95. Penny, K., & Chesney, T. (2006). A comparison of data mining methods and logistic regression to determine factors associated with death following injury. In S. Zani, A. Cerioli, M. Riani,& M.Vichi (Eds.), Data Analysis, Classification and the Forward Search. Heidelberg: Springer-Verlag, pp. 417-423.
96. Put, R., Perrin, C., Questier, F., Coomans, D., Massart, D.L., & Vander Heyden, Y. (2002). Classification and regression tree analysis for molecular descriptor selection and retention prediction in chromatographic quantitative structure-retention relationship studies. Journal of Chromatography A, 988, 261-276.
97. Questier, F., Put, R., Coomans, D., Walczak, B., & Vander Heyden, Y. (2005). The use of CART and multivariate regression trees for supervised and unsupervised feature selection. Chemometrics and Intelligent Laboratory Systems, 76, 45-54.
98. Quinlan, J.R. & Cameron-Jones, R.M. (1995). Oversearching and layered search in empirical learning. In Proceedings of the 14th International Joint Conference on Artificial Intelligence, Montreal, Vol. 2 (Edited by M. Kaufman), pp. 1019-1024.
99. Riley, M.W. (1964). Sources and types of sociological data. In R.E. Faris (Ed.), Handbook of Modern Sociology. Chicago: Rand-McNally.
100. Rovlias, A. & Kotsou, S. (2004). Classification and regression tree for prediction of outcome after severe head injury using simple clinical and laboratory variables. Journal of Neurotrauma, 21(7), 886-893.
101. Sawitzki, G. (1994). Testing numerical reliability of data analysis systems. Computational Statistics & Data Analysis, 18(2), 269-286.
102. Scheffe, H. (1959). The Analysis of Variance. NewYork:Wiley.
103. Segal, M.R. (1992). Tree-structured methods for longitudinal data. Journal of the American Statistical Association, 87(418), 407-417.
104. Sephton, P. (2001). Forecasting recessions: Can we do better on MARS(TM)? Federal Reserve Bank of St. Louis Review, 83(2), 39-49.
105. Seroczynski, A.D., Cole, D.A., Maxwell, S.E. (1997). Cumulative and compensatory effects of competence and incompetence on depressive symptoms in children. Journal of Abnormal Psychology, 106(4), 586-597.
106. Shmueli, G., Patel, N.R., & Bruce, P.C. (2007). Data Mining for Business Intelligence. NewYork:Wiley.
107. Sonquist, J. (1970). Multivariate Model Building. Ann Arbor, MI: Institute for Social Research.
108. Sonquist, J. & Morgan, J.N. (1964). The Detection of Interaction Effects. Ann Arbor, MI: Institute for Social Research.
109. Steadman, H., Mulvey, E., Monahan, J., Robbins, P., Appelbaum, P., Grisso, T., Roth, L., & Silver, E. (1998). Violence by people discharged from acute psychiatric inpatient facilities and by others in the same neighborhoods. Archives of General Psychiatry, 55, 393-401.
110. Steadman, H.J., Silver, E., Monohan, J., Applebaum, P.S., Robbins, P.C., Mulvey, E.P., Grisso, T., Roth, L.H., & Banks, S. (2000). A classification tree approach to the development of actuarial violence risk assessment tools. Law and Human Behavior, 24(1), 83-100.
111. Steinberg, D. & Colla, P. (1999). MARS:An Introduction. San Diego: Salford Systems.
112. Strobl, C. & Augustin, T. (2009). Adaptive selection of extra cutpoints—an approach towards reconciling robustness and interpretability in classification trees. Journal of Statistical Theory and Practice, 3(1), 119-135.
113. Strobl, C., Hothorn, T., & Zeileis, A. (2009). Party on! A new, conditional variable importance measure for random forests available in the party package. The R Journal, 1(2), 14-17.
114. Strobl, C., Malley, J., & Tutz, G. (2009). An introduction to recursive partitioning: Rationale, application and characteristics of classification and regression trees, bagging and random forests. Psychological Methods, 14(4), 323-348.
115. Strobl, C., Wickelmaier, F., & Zeileis, A. (2013). Accounting for individual differences in Bradley-Terry models by means of recursive partitioning. Journal of Educational and Behavioral Statistics, 36(2), 135-153.
116. Studer, M., Ritschard, G., Gabadinho, A., & Muller, N.S. (2011). Discrepancy analysis of state sequences. Sociological Methods and Research, 40(3), 471-510.
117. Su, X., & Tsai, C. (2005). Tree-augmented Cox proportional hazards models. Biostatistics, 6(3), 486-499.
118. Sullivan, P.F., Kovalenko, P., York, T.P., Prescott, C.A., & Kendler, K.S. (2003). Fatigue in a community sample of twins. Psychological Medicine, 33, 263-281.
119. Swets, J.A., Dawes, R.M., & Monahan, J. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest, 1(1), 1-26.
120. Tatsuoka, M.M. & Tiedeman, D.V. (1954). Discriminant analysis. Review of Educational Research, Washington, DC:AERA Press.
121. Temkin, N.R., Holubkov, R., Machamer, J.E., Winn, H.R., & Dikmen, S.S. (1995). Classification and regression trees (CART) for prediction of function at 1 year following head trauma. Journal of Neurosurgery, 82, 764-771.
122. Tibshirani, R.J. & Tibshirani, R. (2009). A bias correction for the minimum error rate in cross-validation. The Annals of Applied Statistics, 3(2), 822-829.
123. Tucker, L.R & Lewis, C. (1973). The reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10.
124. Tukey, J.W. (1962). The future of data analysis. Annals of Mathematical Statistics, 33, 1-67.
125. Tukey, J.W. (1977). Exploratory Data Analysis. Reading, MA:Addison-Wesley.
126. Ture, M., Tokatli, F., & Kurt, I. (2009). Using Kaplan-Meier analysis together with decision tree methods (C&RT, CHAID, QUEST, C4.5 and ID3) in determining recurrence-free survival of breast cancer patients. Expert Systems with Applications, 36, 2017-2026.
127. Vayssieres, M.P., Plant, R.E., & Allen-Diaz, B.H. (2000). Classification trees: An alternative non-parametric approach for predicting species distributions. Journal of Vegetation Science, 11, 679-694.
128. Vermunt, J.K. & McCutcheon, A.L. (2004). An Introduction to Modern Categorical Data Analysis. CA: SAGE.
129. Wallace, K.A., Bergeman, C.S., & Maxwell, S.E. (2002). Predicting well-being outcomes in later life: An application of classification and regression tree (CART) analysis. In S. P. Shohov (Ed.), Advances in Psychology Research(Vol. 17). Hauppauge, NY: Nova Science Publishers, Inc., pp. 71-92.
130. Weber, G., Vinterbo, S., & Ohno-Machado, L. (2004). Multivariate selection of genetic markers in diagnostic classification. Artificial Intelligence in Medicine, 31, 155-167.
131. Wilcox, R. (2003). Applying Contemporary StatisticalTechniques.Amsterdam:Academic Press
132. Willingham, W.W., Lewis, C., Morgan, R., & Ramist, L. (1990). Predicting College Grades:An Analysis of InstitutionalTrends overTwo Decades. NewYork:The College Board.
133. Witten, I.H. & Frank, E. (2005). Data Mining: Practical Machine Learning Tools and Techniques(2nd Edn). Amsterdam: Morgan Kaufman.
134. Yates, A. (1987). Multivariate Exploratory Data Analysis. Albany, NY: State University Press.
135. Zhang, H.P. (1997) Multivariate adaptive splines for longitudinal data. Journal of Computational and Graphic Statistics, 6, 74-91.
136. Zhang, H.P. (1999) Analysis of infant growth curves using MASAL. Biometrics, 55, 452-459.
137. Zhang, H.P. (2004) Multivariate adaptive splines in the analysis of longitudinal and growth curve data. Statistical Methods in Medical Research, 13, 63-82.
138. Zhang, H. & Singer, B. (1999). Recursive Partitioning in the Health Sciences. NewYork: Springer.
139. Zwick, W.R. & Velicer, W.F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432-442.