Theory-guided exploration with structural equation model forests

Psychological Methods

Volumn 21, Issue 4, 2016, Pages 566-582

  Brandmaier, Andreas M ^a,b   Prindle, John J ^a,c   McArdle, John J ^c   Lindenberger, Ulman ^a,d  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^b MAX PLANCK UCL CENTRE FOR COMPUTATIONAL PSYCHIATRY AND AGEING RESEARCH   (United Kingdom)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^d EUROPEAN UNIVERSITY INSTITUTE   (Italy)

Author keywords

Case proximity; Model based tree; Recursive partitioning; SEM forest; Variable importance

Indexed keywords

CHEMICAL BINDING; DECISION TREE; EPISODIC MEMORY; FOREST; HUMAN; INTELLIGENCE; SCIENTIST; STATISTICAL MODEL; STRUCTURAL EQUATION MODELING; THEORETICAL MODEL; UNCERTAINTY; CLUSTER ANALYSIS; CROSS-SECTIONAL STUDY;

CLUSTER ANALYSIS; CROSS-SECTIONAL STUDIES; FORESTS; HUMANS; MEMORY, EPISODIC; MODELS, THEORETICAL;

EID: 85004045085     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/met0000090     Document Type: Article

References (73)

1. Bender, A. R., Daugherty, A. M., & Raz, N. (2013). Vascular risk moderates associations between hippocampal subfield volumes and memory. Journal of Cognitive Neuroscience, 25, 1851-1862. http://dx.doi.org/10.1162/jocn_a_00435
2. Berk, R. (2006). An introduction to ensemble methods for data analysis. Sociological Methods & Research, 34, 263-295. http://dx.doi.org/10.1177/0049124105283119
3. Bertram, L., Böckenhoff, A., Demuth, I., Důzel, S., Eckardt, R., Li, S.-C., Steinhagen-Thiessen, E. (2014). Cohort profile: The Berlin Aging Study II (BASE-II). International Journal ofEpidemiology, 43, 703-712. http://dx.doi.org/10.1093/ije/dyt018
4. Böckenhoff, A., Sassenroth, D., Kroh, M., Siedler, T., Eibich, P., & Wagner, G. G. (2013). The socio-economic module of the Berlin Aging Study II (SOEP-BASE): Description, structure, and questionnaire. (SOEPpapers on Multidisciplinary Panel Data Research No. 568). Berlin, Germany: DIW.
5. Boker, S. M., Neale, M., Maes, H., Wilde, M., Spiegel, M., Brick, T. R., Fox, J. (2011). OpenMx: An open source extended structural equation modeling framework. Psychometrika, 76, 306-317. http://dx.doi.org/10.1007/s11336-010-9200-6
6. Boker, S. M., Neale, M., & Rausch, J. (2004). Latent differential equation modeling with multivariate multi-occasion indicators. In K. van Mont-fort, J. Oud, & A. Satorra (Eds.), Recent developments on structural equation models: Theory and applications (pp. 151-174). Dordrecht, the Netherlands: Kluwer Academic Publishers. http://dx.doi.org/10.1007/978-1-4020-1958-6_9
7. Borsboom, D., Kievit, R. A., Cervone, D., & Hood, S. B. (2009). The two disciplines of scientific psychology, or: The disunity of psychology as a working hypothesis. In Dynamic process methodology in the social and developmental sciences (pp. 67-97). New York, NY: Springer. http://dx.doi.org/10.1007/978-0-387-95922-1_4
8. Brandmaier, A. M. (2015). semtree: Recursive partitioning ofstructural equation models in R [Computer software manual]. Retrieved from http://www.brandmaier.de/semtree
9. Brandmaier, A. M., von Oertzen, T., McArdle, J. J., & Lindenberger, U. (2013a). Exploratory data mining with structural equation model trees. In J. J. McArdle & G. Ritschard (Eds.), Contemporary issues in exploratory data mining in the behavioral sciences (pp. 96-127). New York, NY: Routledge.
10. Brandmaier, A. M., von Oertzen, T., McArdle, J. J., & Lindenberger, U. (2013b). Structural equation model trees. Psychological Methods, 18, 71-86. http://dx.doi.org/10.1037/a0030001
11. Breiman, L. (1996). Bagging predictors. Machine learning, 24, 123-140. http://dx.doi.org/10.1023/A:1018054314350
12. Breiman, L. (2001a). Random forests. Machine Learning, 45, 5-32. http://dx.doi.org/10.1023/A:1010933404324
13. Breiman, L. (2001b). Statistical modeling: The two cultures (with comments and a rejoinder by the author). Statistical Science, 16, 199-231. http://dx.doi.org/10.1214/ss/1009213726
14. Breiman, L., & Cutler, A. (2014). Random forests [Computer software manual]. Retrieved from http://www.stat.berkeley.edu/breiman/RandomForests/cc_home.htm
15. Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984). Classification and regression trees. Belmont, CA: Wadsworth International.
16. Bůhlmann, P., & Yu, B. (2002). Analyzing bagging. The Annals of Statistics, 30, 927-961. http://dx.doi.org/10.1214/aos/1031689014
17. Diaaz-Uriarte, R., & De Andres, S. A. (2006). Gene selection and classification of microarray data using random forest. BMC Bioinformatics, 7, 3. http://dx.doi.org/10.1186/1471-2105-7-3
18. Důzel, S., Voelkle, M. C., Důzel, E., Gerstorf, D., Drewelies, J., Steinhagen-Thiessen, E., Lindenberger, U. (2016). The subjective health horizon questionnaire (SHH-Q): assessing future time perspectives for facets of an active lifestyle. Gerontology, 62, 345-353. http://dx.doi.org/10.1159/000441493
19. Fernández-Delgado, M., Cernadas, E., Barro, S., & Amorim, D. (2014). Do we need hundreds of classifiers to solve real world classification problems? Journal of Machine Learning Research, 15, 3133-3181.
20. Ghisletta, P. (2013). Recursive partitioning to study terminal decline in the berlin aging study. In J. J. McArdle & G. Ritschard (Eds.), Contemporary issues in exploratory data mining in the behavioral sciences (pp. 405-428). New York, NY: Routledge.
21. Gower, J. C. (1966). Some distance properties of latent root and vector methods used in multivariate analysis. Biometrika, 53, 325-338. http://dx.doi.org/10.2307/2333639
22. Hapfelmeier, A., Hothorn, T., Ulm, K., & Strobl, C. (2014). A new variable importance measure for random forests with missing data. Statistics and Computing, 24, 21-34. http://dx.doi.org/10.1007/s11222-012-9349-1
23. Hapfelmeier, A., & Ulm, K. (2013). A new variable selection approach using random forests. Computational Statistics & Data Analysis, 60, 50-69. http://dx.doi.org/10.1016/j.csda.2012.09.020
24. Hastie, T., Tibshirani, R., & Friedman, J. (2001). The elements ofstatistical learning. New York, NY: Springer. http://dx.doi.org/10.1007/978-0-387-21606-5
25. Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117-144. http://dx.doi.org/10.1080/03610739208253916
26. Jöreskog, K. G. (1969). A general approach to confirmatory maximum likelihood factor analysis. Psychometrika, 34, 183-202. http://dx.doi.org/10.1007/BF02289343
27. Jöreskog, K. G. (1970). Estimation and testing of simplex models. British Journal ofMathematical and Statistical Psychology, 23, 121-145. http://dx.doi.org/10.1111/j.2044-8317.1970.tb00439.x
28. Josefsson, M., de Luna, X., Pudas, S., Nilsson, L.-G., & Nyberg, L. (2012). Genetic and lifestyle predictors of 15-year longitudinal change in episodic memory. Journal ofthe American Geriatrics Society, 60, 2308-2312. http://dx.doi.org/10.1111/jgs.12000
29. Kaufman, A. S., Reynolds, C. R., & McLean, J. E. (1989). Age and WAIS-R intelligence in a national sample of adults in the 20- to 74-year age range: A cross-sectional analysis with educational level controlled. Intelligence, 13, 235-253. http://dx.doi.org/10.1016/0160-2896(89)90020-2
30. Kievit, R. A., Frankenhuis, W. E., Waldorp, L. J., & Borsboom, D. (2013). Simpson's paradox in psychological science: A practical guide. Frontiers in Psychology, 4. http://dx.doi.org/10.3389/fpsyg.2013.00513
31. Lamiell, J. T. (1981). Toward an idiothetic psychology of personality. American Psychologist, 36, 276-289. http://dx.doi.org/10.1037/0003-066X.36.3.276
32. Lang, F. R., John, D., Lůdtke, O., Schupp, J., & Wagner, G. G. (2011). Short assessment of the big five: Robust across survey methods except telephone interviewing. Behavior Research Methods, 43, 548-567.
33. Little, T. D., Lindenberger, U., & Nesselroade, J. R. (1999). On selecting indicators for multivariate measurement and modeling with latent variables: When "good" indicators are bad and "bad" indicators are good. Psychological Methods, 4, 192-211. http://dx.doi.org/10.1037/1082-989X.4.2.192
34. Loh, W., & Shih, Y. (1997). Split selection methods for classification trees. Statistica Sinica, 7, 815-840.
35. McArdle, J. J. (1994). Structural factor analysis experiments with incomplete data. Multivariate Behavioral Research, 29, 409-454. http://dx.doi.org/10.1207/s15327906mbr2904_5
36. McArdle, J. J. (2009). Latent variable modeling of differences and changes with longitudinal data. Annual Review of Psychology, 60, 577-605. http://dx.doi.org/10.1146/annurev.psych.60.110707.163612
37. McArdle, J. J. (2013). Exploratory data mining using decision trees in the behavioral sciences. In J. J. McArdle & G. Ritschard (Eds.), Contemporary issues in exploratory data mining in the behavioral sciences (pp. 3-47). New York, NY: Routledge.
38. McArdle, J. J., & Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, 58, 110-133. http://dx.doi.org/10.2307/1130295
39. McArdle, J. J., & Hamagami, F. (1992). Modeling incomplete longitudinal and cross-sectional data using latent growth structural models. Experimental Aging Research, 18, 145-166. http://dx.doi.org/10.1080/03610739208253917
40. McArdle, J. J., & Hamagami, F. (2001). Latent difference score structural models for linear dynamic analyses with incomplete longitudinal data: New methods for the analysis of change. In L. M. Collins & A. G. Sayer (Eds.), New methods for the analysis ofchange (pp. 139-175). Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10409-005
41. McArdle, J. J., & Nesselroade, J. R. (2014). Longitudinal data analysis using structural equation models. Washington, DC: American Psychological Association.
42. McArdle, J. J., & Prescott, C. A. (1992). Age-based construct validation using structural equation modeling. Experimental Aging Research, 18, 87-115. http://dx.doi.org/10.1080/03610739208253915
43. Miller, P. J., Lubke, G. H., McArtor, D. B., & Bergeman, C. S. (2016). Finding structure in data using multivariate tree boosting. Psychological Methods, 21, 583-602.
44. Molenaar, P. C. M. (2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement, 2, 201-218. http://dx.doi.org/10.1207/s15366359mea0204_1
45. Muthén, B. O. (2004). Latent variable analysis: Growth mixture modeling and related techniques for longitudinal data. In D. Kaplan (Ed.), The SAGE handbook ofquantitative methodology for the social sciences (pp. 345-370). Thousand Oaks, CA: SAGE Publications.
46. Nesselroade, J. R., Gerstorf, D., Hardy, S. A., & Ram, N. (2007). Focus article: Idiographic filters for psychological constructs. Measurement: Interdisciplinary Research & Perspective, 5, 217-235. http://dx.doi.org/10.1080/15366360701741807
47. Nesselroade, J. R., & Molenaar, P. C. M. (1999). Pooling lagged covari-ance structures based on short, multivariate time series for dynamic factor analysis. In R. H. Hoyle (Ed.), Statistical strategies for small sample research Nesselroade (pp. 223-251). Newbury Park, CA: Sage.
48. Nordahl, C. W., Ranganath, C., Yonelinas, A. P., DeCarli, C., Reed, B. R., & Jagust, W. J. (2005). Different mechanisms of episodic memory failure in mild cognitive impairment. Neuropsychologia, 43, 1688-1697. http://dx.doi.org/10.1016/j.neuropsychologia.2005.01.003
49. Quinlan, J. (1986). Induction of decision trees. Machine Learning, 1, 81-106. http://dx.doi.org/10.1007/BF00116251
50. Quinlan, J. (1993). C4. 5: Programs for machine learning. San Francisco, CA: Morgan Kaufmann.
51. Raz, N., Rodrigue, K. M., & Acker, J. D. (2003). Hypertension and the brain: Vulnerability of the prefrontal regions and executive functions. Behavioral Neuroscience, 117, 1169-1180. http://dx.doi.org/10.1037/0735-7044.117.6.1169
52. R. Core Team. (2013). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria. Retrieved from http://www.R-project.org/
53. Reynolds, C. R., Chastain, R. L., Kaufman, A. S., & McLean, J. E. (1987). Demographic characteristics and IQ among adults: Analysis of the WAIS-R standardization sample as a function of the stratification variables. Journal ofSchool Psychology, 25, 323-342. http://dx.doi.org/10.1016/0022-4405(87)90035-5
54. Rousseeuw, P. J. (1987). Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal ofComputational and Applied Mathematics, 20, 53-65. http://dx.doi.org/10.1016/0377-0427(87)90125-7
55. Schulz, P., & Schlotz, W. (1999). The trier inventory for the assessment of chronic stress (tics): scale construction, statistical testing, and validation of the scale work overload. Diagnostica, 45, 8-19.
56. Scott, S. B., Whitehead, B. R., Bergernan, C. S., & Pitzer, L. (2013). Understanding global perceptions of stress in adulthood through tree-based exploratory data mining. In J. Mcardle & G. Ritschard (Eds.), contemporary issues in exploratory data mining in the behavioral sciences (pp. 371-404). New York, NY: Routledge.
57. Shing, Y. L., Werkle-Bergner, M., Brehmer, Y., Můller, V., Li, S. C., & Lindenberger, U. (2010). Episodic memory across the lifespan: The contributions of associative and strategic components. Neuroscience & Biobehavioral Reviews, 34, 1080-1091. http://dx.doi.org/10.1016/j.neubiorev.2009.11.002
58. Shmueli, G. (2010). To explain or to predict? Statistical Science, 25, 289-310. http://dx.doi.org/10.1214/10-STS330
59. Simpson, E. H. (1951). The interpretation of interaction in contingency tables. Journal ofthe Royal Statistical Society: Series B, 13, 238-241.
60. Singer, T., Verhaeghen, P., Ghisletta, P., Lindenberger, U., & Baltes, P. B. (2003). The fate of cognition in very old age: Six-year longitudinal findings in the berlin aging study (base). Psychology and Aging, 18, 318-331. http://dx.doi.org/10.1037/0882-7974.18.2.318
61. Sonquist, J., & Morgan, J. (1964). The detection ofinteraction effects. A report on a computer program for the selection ofoptimal combinations of explanatory variables (No. 35). Ann Arbor, MI: Survey Research Centre, The Institute for Social Research, University of Michigan.
62. Strobl, C., Boulesteix, A.-L., Kneib, T., Augustin, T., & Zeileis, A. (2008). Conditional variable importance for random forests. BMC Bioinformat-ics, 9, 307. http://dx.doi.org/10.1186/1471-2105-9-307
63. Strobl, C., Boulesteix, A., Zeileis, A., & Hothorn, T. (2007). Bias in random forest variable importance measures: Illustrations, sources and a solution. BMC Bioinformatics, 8, 25. http://dx.doi.org/10.1186/1471-2105-8-2
64. Strobl, C., Malley, J., & Tutz, G. (2009). An introduction to recursive partitioning: Rationale, application and characteristics of classification and regression trees, bagging and random forests. Psychological Methods, 14, 323-348. http://dx.doi.org/10.1037/a0016973
65. Strobl, C., & Zeileis, A. (2008). Danger: High power! Exploring the statistical properties ofa test for random forest variable importance (Tech. Rep. No. 017). Department of Statistics, University of Munich.
66. Tucker, L. (1966). Learning theory and multivariate experiment: Illustration by determination of generalized learning curves. In R. B. Cattell (Ed.), Handbook of multivariate experimental psychology (pp. 476-501). Chicago. IL: Rand McNally & Company.
67. Tukey, J. W. (1962). The future of data analysis. The Annals ofMathe-matical Statistics, 33, 1-67. http://dx.doi.org/10.1214/aoms/1177704711
68. Verikas, A., Gelzinis, A., & Bacauskiene, M. (2011). Mining data with random forests: A survey and results of new tests. Pattern Recognition, 44, 330-349. http://dx.doi.org/10.1016/j.patcog.2010.08.011
69. Vermunt, J. K., & Magidson, J. (2002). Latent class cluster analysis. In J. Hagenaars & A. McCutcheon (Eds.), Applied latent class analysis (pp. 89-106). Cambridge, UK: Cambridge University Press.
70. VonDras, D. D., Powless, M. R., Olson, A. K., Wheeler, D., & Snudden, A. L. (2005). Differential effects of everyday stress on the episodic memory test performances of young, mid-life, and older adults. Aging & Mental Health, 9, 60-70. http://dx.doi.org/10.1080/13607860412331323782
71. Von Oertzen, T., Brandmaier, A. M., & Tsang, S. (2015). Structural equation modeling with Onyx. Structural Equation Modeling: A Multi-disciplinary Journal, 22, 148-161. http://dx.doi.org/10.1080/10705511.2014.935842
72. Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of personality and social psychology, 54, 1063-1070. http://dx.doi.org/10.1037/0022-3514.54.6.1063
73. Wolf, O. T. (2009). Stress and memory in humans: Twelve years of progress? Brain Research, 1293, 142-154.