Multilevel Modeling: Current and Future Applications in Personality Research

Journal of Personality

Volumn 79, Issue 1, 2011, Pages 2-50

  West, Stephen G ^a   Ryu, Ehri ^b   Kwok, Oi Man ^c   Cham, Heining ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

^b BOSTON COLLEGE   (United States)

^c TEXAS A AND M UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; MULTILEVEL ANALYSIS; PERSONALITY; REGRESSION ANALYSIS; STATISTICAL MODEL;

HUMANS; MODELS, STATISTICAL; MULTILEVEL ANALYSIS; PERSONALITY; REGRESSION ANALYSIS;

EID: 78651246871     PISSN: 00223506     EISSN: 14676494     Source Type: Journal    
DOI: 10.1111/j.1467-6494.2010.00681.x     Document Type: Article

References (92)

1. Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. New York: Sage.
2. Aiken, L. S., West, S. G., & Millsap, R. E. (2008). Doctoral training in statistics, measurement, and methodology in psychology: Replication and extension of Aiken, West, Sechrest, and Reno (1990) survey of Ph.D. programs in North America. American Psychologist, 63, 32-50.
3. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Csaki (Eds.), Second International Symposium on Information Theory (pp. 267-281). Budapest: Akademiai Kiado.
4. Armeli, S., Carney, M. A., Tennen, H., Affleck, G., & O'Neil, T. P. (2000). Stress and alcohol use: A daily process examination of the stressor-vulnerability model. Journal of Personality and Social Psychology, 78, 979-994.
5. Bahrick, H. P. (1979). Maintenance of knowledge: Questions about memory we forgot to ask. Journal of Experimental Psychology: General, 108, 296-308.
6. Bauer, D. J., & Curran, P. J. (2005). Probing interactions in fixed and multilevel regression: Inferential and graphical techniques. Multivariate Behavioral Research, 40, 373-400.
7. Belsley, D. A., Kuh, E., & Welsch, R. E. (1980). Regression diagnostics: Identifying influential data and sources of collinearity. New York: Wiley.
8. Beretvas, S. N. (2008). Cross-classified random effects models. In A. A. O'Connell & D. B. McCoach (Eds.), Multilevel modeling of educational data (pp. 161-197). Charlotte, NC: Information Age.
9. Biesanz, J. C., Deeb-Sossa, N., Papadakis, A. A., Bollen, K. A., & Curran, P. J. (2004). The role of coding time in estimating and interpreting growth curve models. Psychological Methods, 9, 30-52.
10. Biesanz, J. C., West, S. G., & Kwok, O. M. (2003). Personality over time: Methodological approaches to the study of short-term and long-term development and change. Journal of Personality, 71, 905-942.
11. Biesanz, J. C., West, S. G., & Millevoi, A. (2007). What do you learn about someone over time? The relationship between length of acquaintance and consensus and self-other agreement in judgments of personality. Journal of Personality and Social Psychology, 92, 119-135.
12. Bollen, K. A., & Curran, P. J. (2006). Latent curve models: A structural equation perspective. Hoboken, NJ: Wiley.
13. Bosker, R. J., Snijders, T. A. B., & Guldemond, H. (2003). PINT (Power in two-level designs) user's manual. Oxford, UK: Author. Available from
14. Browne, W. J., Golalizadeh-Lahi, M., & Parker, R. M. A. (2009). A guide to sample size calculations for random effect models via simulation and the MLPowSim software package. University of Bristol, UK. Retrieved October 29, 2010, from
15. Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage.
16. Cheung, M. W. L., & Au, K. (2005). Applications of multilevel structural equation modeling to cross-cultural research. Structural Equation Modeling, 12, 598-619.
17. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Erlbaum.
18. Conner, T. S., Feldman-Barrett, L., Tugade, M. M., & Tennen, H. (2007). Idiographic personality: The theory and practice of experience sampling. In R. W. Robins, R. C. Fraley, & R. R. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 79-96). New York: Guilford Press.
19. Coxe, S. J., West, S. G., & Aiken, L. S. (in press). Generalized linear models. In T. Little (Ed.), Oxford handbook of quantitative methods. New York: Oxford University Press.
20. Cramer, P., & Jones, C. J. (2007). Defense mechanisms predict differential lifespan change in self-control and self-acceptance. Journal of Research in Personality, 41, 841-855.
21. Cudeck, R. (1996). Mixed-effects models in the study of individual differences with repeated measures data. Multivariate Behavioral Research, 31, 371-403.
22. Cudeck, R., & Klebe, K. J. (2002). Multiphase mixed effects models for repeated measures data. Psychological Methods, 7, 41-63.
23. Curran, P. J. (2003). Have multilevel models been structural equation models all along? Multivariate Behavioral Research, 38, 529-568.
24. de Leeuw, J., & Meijer, E. (Eds.). (2008). Handbook of multilevel analysis. New York: Springer.
25. Enders, C. K. (2005). Maximum likelihood estimation. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (Vol. 3, pp. 1164-1170). Chichester, UK: Wiley.
26. Enders, C. K., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121-138.
27. Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. New York: Cambridge University Press.
28. Goldstein, H. (1986). Multilevel mixed linear model analysis using iterative generalized least squares. Biometrika, 73, 43-56.
29. Goldstein, H. (1995). Multilevel statistical models (2nd ed.). London: Arnold.
30. Goldstein, H., & McDonald, R. P. (1988). A general model for the analysis of multilevel data. Psychometrika, 53, 455-467.
31. Henderson, C. R. (1953). Estimation of variance and covariance components. Biometrics, 9, 226-252.
32. Hoffman, L. (2007). Multilevel models for examining individual differences in within-person variation and covariation over time. Multivariate Behavioral Research, 42, 609-629.
33. Hox, J. J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). New York: Routledge.
34. Hox, J. J., & Maas, C. J. (2001). The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation, 8, 157-174.
35. Huttenlocher, J., Haight, W., Bryk, A., Seltzer, M., & Lyons, T. (1991). Early vocabulary growth: Relation to language input and gender. Developmental Psychology, 27, 236-248.
36. Jones, C. J., & Meredith, W. (1996). Patterns of personality change across the life span. Psychology and Aging, 11, 57-65.
37. Kenny, D. A., Kashy, D. A., & Bolger, N. (1998). Data analysis in social psychology. In D. T. Gilbert, S. T. Fiske, & G. Lindzey (Eds.), Handbook of social psychology (4th ed., pp. 233-265). New York: McGraw-Hill.
38. Krahé, B. (1992). Personality and social psychology: Towards a synthesis. Thousand Oaks, CA: Sage.
39. Kreft, I. G. G., & de Leeuw, J. (1998). Introducing multilevel modeling. Thousand Oaks, CA: Sage.
40. Kreft, I. G. G., de Leeuw, J., & Aiken, L. S. (1995). The effect of different forms of centering in hierarchical linear models. Multivariate Behavioral Research, 30, 1-21.
41. Kwok, O. M., West, S. G., & Green, S. B. (2007). The impact of misspecifying the within-subject covariance structure in multiwave longitudinal multilevel models: A Monte Carlo study. Multivariate Behavioral Research, 42, 557-592.
42. Langford, I. H., & Lewis, T. (1998). Outliers in multilevel data. Journal of the Royal Statistical Society, Series A, 161, 121-160.
43. Lee, S. Y. (1990). Multilevel analysis of structural equation models. Biometrika, 77, 763-772.
44. Lesaffre, E., & Verbeke, G. (1998). Local influence in linear mixed models. Biometrics, 54, 570-582.
45. Lewis, T., & Langford, I. H. (2001). Outliers, robustness and the detection of discrepant data. In A. H. Leyland & H. Goldstein (Eds.), Multilevel modeling of health statistics (pp. 75-91). New York: Wiley.
46. Longford, N. T., & Muthén, B. O. (1992). Factor analysis for clustered observations. Psychometrika, 57, 581-597.
47. Lucas, R. E., Clark, A. E., Georgellis, Y., & Diener, E. (2003). Reexamining adaptation and the set point model of happiness: Reactions to changes in marital status. Journal of Personality and Social Psychology, 84, 527-539.
48. Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. O. (2008). The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13, 203-229.
49. Luo, W., & Kwok, O. M. (2009). Impacts of ignoring a crossed factor in analyzing multilevel data with cross-classified structures: A Monte Carlo study. Multivariate Behavioral Research, 44, 182-212.
50. MacKinnon, D. P. (2008). Introduction to statistical mediation analysis. Mahwah, NJ: Erlbaum.
51. McArdle, J. J. (2009). Latent variable modeling of differences and changes in longitudinal data. Annual Review of Psychology, 60, 577-605.
52. McArdle, J. J., Ferrer-Caja, E., Hamagami, F., & Woodcock, R. W. (2002). Comparative longitudinal structural analyses of the growth and decline of multiple intellectual abilities over the life span. Developmental Psychology, 38, 115-142.
53. McLean, K. C., & Fournier, M. A. (2008). The content and processes of autobiographical reasoning in narrative identity. Journal of Research in Personality, 42, 527-545.
54. Mehta, P. D., & West, S. G. (2000). Putting the individual back into individual growth curves. Psychological Methods, 5, 23-43.
55. Meyers, J., & Beretvas, S. N. (2006). The impact of inappropriate modeling of cross-classified data structures. Multivariate Behavioral Research, 41, 473-497.
56. Mok, M. (1995). Sample size requirements for 2-level designs in educational research. Multilevel Modeling Newsletter, 7, 11-15.
57. Muthén, L. K., & Muthén, B. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9, 599-620.
58. Muthén, B. O., & Satorra, A. (1995). Complex sample data in structural equation modeling. Sociological Methodology, 25, 267-316.
59. Nezlek, J. B. (2001). Multilevel random coefficient analyses of event- and interval-contingent data in social and personality research. Personality and Social Psychology Bulletin, 27, 771-785.
60. Nezlek, J. B. (2007). Multilevel modeling in personality research. In R. W. Robins, R. C. Fraley, & R. R. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 502-522). New York: Guilford Press.
61. Oishi, S., Diener, E., Choi, D., Kim-Prieto, C., & Choi, I. (2007). The dynamics of daily events and well-being across cultures: When less is more. Journal of Personality and Social Psychology., 93, 685-698.
62. Oishi, S., Lun, J., & Sherman, G. D. (2007). Residential mobility, self-concept, and positive affect in social interactions. Journal of Personality and Social Psychology, 93, 131-141.
63. Preacher, K. J., Curran, P. J., & Bauer, D. J. (2006). Computational tools for probing interactions in multiple linear regression, multilevel modeling, and latent curve analysis. Journal of Educational and Behavioral Statistics, 31, 437-448.
64. Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010). A general multilevel SEM framework for assessing multilevel mediation. Psychological Methods, 15, 209-233.
65. Rasbash, J., & Browne, W. J. (2008). Non-hierarchical multilevel models. In J. de Leeuw & E. Meyer (Eds.), Handbook of multilevel analysis (pp. 301-334). New York: Springer.
66. Rasbash, J., & Goldstein, H. (1994). Efficient analysis of mixed hierarchical and cross-classified random structures using a multilevel model. Journal of Educational and Behavioral Statistics, 19, 337-350.
67. Raudenbush, S. W. (1993). A crossed random effects model for unbalanced data with applications in cross-sectional and longitudinal research. Journal of Educational and Behavioral Statistics, 18, 321-349.
68. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
69. Raudenbush, S. W., Bryk, A. S., Cheong, Y., Congdon, R., & du Toit, M. (2004). HLM6: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: SSI.
70. Reis, H. T., & Gable, S. L. (2000). Event-sampling and other methods for studying daily experience. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 190-222). New York: Cambridge University Press.
71. Reise, S. P., Ventura, J., Nuechterlein, K. H., & Kim, K. H. (2005). An illustration of multilevel factor analysis. Journal of Personality Assessment, 84, 126-136.
72. Roberts, J. K. (2007, April). Group dependency in the presence of small intraclass correlation coefficients: An argument in favor of not interpreting the ICC. Paper presented at the American Educational Research Association Meeting, Chicago. Retrieved October 29, 2010, from
73. Ryu, E. (2004). Effects of small group sizes on the estimation of multilevel models: A Monte Carlo study. Unpublished master's thesis, Arizona State University.
74. Ryu, E., & West, S. G. (2009). Level-specific evaluation of model fit in multilevel structural equation modeling. Structural Equation Modeling, 16, 583-601.
75. Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464.
76. Shi, L., & Chen, G. (2009). Influence measures for general linear models with correlated errors. American Statistician, 63, 40-42.
77. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
78. Shrout, P. E., Herman, C. E., & Bolger, N. (2006). The costs and benefits of practical and emotional support on adjustment: A daily diary study of couples experiencing acute stress. Personal Relationships, 13, 115-134.
79. Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. New York: Oxford University Press.
80. Skrondal, A., & Rabe-Hesketh, S. (2004). Generalized latent variable modeling: Multilevel, longitudinal, and structural equation models. Boca Raton, FL: Chapman & Hall/CRC.
81. Snijders, T. A. B., & Berkhof, J. (2008). Diagnostic checks for multilevel models. In J. de Leeuw & E. Meijer (Eds.), Handbook of multilevel analysis (pp. 140-175). New York: Springer.
82. Snijders, T. A. B., & Bosker, R. J. (1994). Modeled variance in two-level models. Sociological Methods & Research, 22, 342-363.
83. Snijders, T. A. B., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage.
84. Snyder, M., & Ickes, W. (1985). Personality and social behavior. In G. Lindsay & E. Aronson (Eds.), Handbook of social psychology (Vol. 2, pp. 883-947). New York: Random House.
85. Stoel, R. D., Garre, F. G., Dolan, C., & van den Wittenboer, G. (2006). On the likelihood ratio test in structural equation modeling when parameters are subject to boundary constraints. Psychological Methods, 11, 439-455.
86. Tamir, M., John, O. P., Srivastava, S., & Gross, J. J. (2007). Implicit theories of emotion: Affective and social outcomes across a major life transition. Journal of Personality and Social Psychology, 92, 731-744.
87. Verbeke, G., & Molenberghs, G. (2000). Linear mixed models for longitudinal data. New York: Springer.
88. West, S. G., Aiken, L. S., & Krull, J. L. (1996). Experimental personality designs: Analyzing categorical by continuous variable interactions. Journal of Personality, 64, 1-48.
89. West, S. G., Aiken, L. S., Wu, W., & Taylor, A. B. (2007). Multiple regression: Applications of the basics and beyond in personality research. In R. W. Robins, R. C. Fraley, & R. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 573-601). New York: Guilford Press.
90. West, S. G., & Hepworth, J. T. (1991). Statistical issues in the study of temporal data: Daily experiences. Journal of Personality, 59, 609-662.
91. Wu, W., West, S. G., & Hughes, J. N. (2008). Effect of retention in first grade on children's achievement trajectories over four years: A piecewise growth analysis using propensity score matching. Journal of Educational Psychology, 100, 727-740.
92. Zimprich, D., Perren, S., & Hornung, R. (2005). A two-level confirmatory factor analysis of a modified Rosenberg self-esteem scale. Educational and Psychological Measurement, 65, 465-481.