The conceptualization and analysis of change over time: An integrative approach incorporating longitudinal mean and covariance structures analysis (LMACS) and multiple indicator latent growth modeling (MLGM)

Organizational Research Methods

Volumn 1, Issue 4, 1998, Pages 421-483

  Chan, David ^a,b  

^a MICHIGAN STATE UNIVERSITY   (United States)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0001557972     PISSN: 10944281     EISSN: None     Source Type: Journal    
DOI: 10.1177/109442819814004     Document Type: Article

References (105)

1. Allport, G. W. (1937). Personality. New York: Holt.
2. Alwin, D. F., & Jackson, D. J. (1981). Application of simultaneous factor analysis to issues of factor invariance. In D. J. Jackson & E. F. Borgatta (Eds.), Factor analysis and measurement in sociological research (pp. 249-279). Beverly Hills, CA: Sage.
3. Anderson, J. C., & Gerbing, D. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika, 49, 155-173.
4. Arvey, R. D., & Cole, D. A. (1989). Evaluating change due to training. In I. Goldstein (Ed.), Training and development in organizations (pp. 89-117). San Francisco: Jossey-Bass.
5. Austin, J. T., Humphreys, L. G., & Hulin, C. L. (1989). Another view of dynamic criteria: A critical reanalysis of Barett, Caldwell, and Alexander. Personnel Psychology, 42, 597-612.
6. Baltagi, B. H. (1995). Econometric analysis of panel data. Chichester, UK: Wiley.
7. Barrett, G. V., Caldwell, M. S., & Alexander, R. A. (1985). The concept of dynamic criteria: A critical reanalysis. Personnel Psychology, 38, 41-56.
8. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
9. Bentler, P. M. (1993). EQS: Structural equations program manual. Los Angeles: BMDP Statistical Software.
10. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606.
11. Bentler, P. M., & Chou, C. P. (1988). Practical issues in structural modeling. In J. S. Long (Ed.), Common problems/proper solutions: Avoiding error in quantitative research (pp. 161-192). Newbury Park, CA: Sage.
12. Bereiter, C. (1963). Some persisting dilemmas in the measurement of change. In C. W. Harris (Ed.), Problems in the assessment of change. Madison: University of Wisconsin Press.
13. Bergh, D. D. (1993a). Watch the time carefully: The use and misuse of time effects in management research. Journal of Management, 19, 683-705.
14. Bergh, D. D. (1993b). Don't "waste" your time! The effects of time series errors in management research: The case of ownership concentration and research and development spending. Journal of Management, 19, 897-914.
15. Bergh, D. D. (1995). Problems with repeated measures analysis: Demonstration with a study of the diversification and performance relationship. Academy of Management Journal, 38, 1692-1708.
16. Bollen, K. A. (1989). Structural equations with latent variables. New York: John Wiley.
17. Box, G.E.P. (1954). Some theorems on quadratic forms applied in the study of analysis of variance problems: Vol. 1. Effect of inequality of variance in the one-way classification. Annals of Mathematical Statistics, 25, 290-302.
18. Browne, M. W., & Arminger, G. (1995). Specification and estimation of mean-and-covariance structure models. In G. Arminger, C. C. Clogg, & M. E. Sobal (Eds.), Handbook of statistical modeling for the social and behavioral sciences. New York: Plenum.
19. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
20. Bryk, A. S., & Raudenbush, S. W. (1987). Application of hierarchical linear models to assessing change. Psychological Bulletin, 101, 147-158.
21. Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models. Newbury Park, CA: Sage.
22. Bryk, A. S., & Weisberg, H. I. (1977). Use of the nonequivalent control group design when subjects are growing. Psychological Bulletin, 85, 950-962.
23. Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
24. Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83, 234-246.
25. Chan, D., & Schmitt, N. (1997). Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in performance and face validity perceptions. Journal of Applied Psychology, 82, 143-159.
26. Cohen, P. (1991). A source of bias in longitudinal investigations of change. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 18-25). Washington, DC: American Psychological Association.
27. Collins, L. M. (1991). Measurement in longitudinal research. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 137-148). Washington, DC: American Psychological Association.
28. Collins, L. M., & Graham, J. W. (1991). Comments on "A source of bias in longitudinal investigations of change." In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 26-30). Washington, DC: American Psychological Association.
29. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton Mifflin.
30. Cook, T. D., Campbell, D. T., & Peracchio, L. (1990). Quasi experimentation. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology, (Vol. 1, pp. 491-576). Palo Alto, CA: Consulting Psychologists Press.
31. Cronbach, L. J., & Furby, L. (1970). How we should measure "change" - or should we? Psychological Bulletin, 74, 68-80.
32. Deadrick, D., Bennett, N., & Russell, C. (1997). Using hierarchical linear modeling to examine dynamic performance criteria over time. Journal of Management, 23, 745-757.
33. Drasgow, F. (1984). Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are central issues. Psychological Bulletin, 95, 134-135.
34. Drasgow, F. (1987). Study of measurement bias of two standardized psychological tests. Journal of Applied Psychology, 72, 19-29.
35. Duncan, S. C., & Duncan, T. E. (1994). Modeling incomplete longitudinal substance use data using latent variable growth curve methodology. Multivariate Behavioral Research, 29, 313-338.
36. Duncan, S. C., & Duncan, T. E. (1996). A multivariate growth curve analysis of adolescent substance use. Structural Equation Modeling, 3, 323-347.
37. Duncan, T. E., Duncan, S. C., Alpert, A., Hops, H., Stoolmiller, M., & Muthen, B. (1997). Latent variable modeling of longitudinal and multilevel substance use data. Multivariate Behavioral Research, 32, 275-318.
38. Duncan, T. E., Duncan, S. C., & Hops, H. (1994). The effects of family cohesiveness and peer encouragement on the development of adolescent alcohol use: A cohort-sequential approach to the analysis of longitudinal data. Journal of Studies on Alcohol, 55, 588-599.
39. Duncan, T. E., Duncan, S. C., & Stoolmiller, M. (1994). Modeling developmental processes using latent growth structural equation methodology. Applied Psychological Measurement, 18, 343-354.
40. Edwards, J. R. (1994). Regression analysis as an alternative to difference scores. Journal of Management, 20, 683-689.
41. Fichman, M. (1988). Motivational consequences of absence and attendance: Proportional hazard estimation of a dynamic motivation model. Journal of Applied Psychology, 73, 119-134.
42. Golembiewski, R. T., Billingsley, K., & Yeager, S. (1976). Measuring change and persistence in human affairs: Types of change generated by OD designs. Journal of Applied Behavioral Science, 12, 133-157.
43. Gollob, H. F., & Reichardt, C. S. (1991). Interpreting and estimating indirect effects assuming time lags really matter. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 243-259). Washington, DC: American Psychological Association.
44. Hanges, P. J., Schneider, B., & Niles, K. (1990). Stability of performance: An interactionist perspective. Journal of Applied Psychology, 75, 658-667.
45. Harrison, D., & Hulin, C. (1989). Investigation of absenteeism: Using event history models to study the absence-taking process. Journal of Applied Psychology, 74, 300-316.
46. Henry, R. A., & Hulin, C. L. (1987). Stability of skilled performance across time: Some generalizations and limitations on utilities. Journal of Applied Psychology, 72, 457-462.
47. Hofmann, D. A. (1997). An overview of the logic and rationale of hierarchical linear models. Journal of Management, 23, 723-744.
48. Hofmann, D. A., Jacobs, R., & Baratta, J. (1993). Dynamic criteria and the measurement of change. Journal of Applied Psychology, 78, 194-204.
49. Hofmann, D. A., Jacobs, R., & Gerras, S. J. (1992). Mapping individual performance over time. Journal of Applied Psychology, 77, 185-195.
50. Hsiao, C. (1986). Analysis of panel data. Cambridge, UK: Press Syndicate of the University of Cambridge.
51. Huynh, H., & Mandeville, G. K. (1979). Validity conditions in repeated measures designs. Psychological Bulletin, 86, 964-973.
52. James, L. R., Mulaik, S. A., & Brett, J. M. (1982). Causal analysis: Assumptions, models, and data. Beverly Hills, CA: Sage.
53. Johns, G. (1981). Difference score measures of organizational behaviors: A critique. Organizational Behavior and Human Performance, 27, 443-463.
54. Jöreskog, K., & Sörbom, D. (1989). LISREL 7: A guide to the program and applications (2nd ed.). Chicago: SPSS.
55. Jöreskog, K., & Sörbom, D. (1993). LISREL 8 user's reference guide. Chicago: Scientific Software.
56. Kanfer, R., & Ackerman, P. L. (1989). Motivational and cognitive abilities: An integrative/ aptitude-treatment interaction approach to skill acquisition. Journal of Applied Psychology, 74, 657-690.
57. Laird, N. M., & Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics, 38, 963-974.
58. Linn, R. L., & Slinde, J. A. (1977). The determination of the significance of change between pre- and posttesting periods. Review of Educational Research, 47, 121-150.
59. Little, T. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76.
60. MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130-149.
61. MacCallum, R. C., Kim, C., Malarkey, W. B., & Kiecolt-Glaser, J. K. (1997). Studying multivariate change using multilevel models and latent curve models. Multivariate Behavioral Research, 32, 215-254.
62. MacCallum, R. C., & Tucker, L. R. (1991). Representing sources of error in the common-factor model: Implications for theory and practice. Psychological Bulletin, 109, 501-511.
63. McArdle, J. J. (1988). Dynamic but structural equation modeling of repeated measures data. In R. B. Catell & J. Nesselroade (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 561-614). New York: Plenum.
64. McArdle, J. J. (1996). Current directions in structural factor analysis. Current Directions, 5, 11-18.
65. McArdle, J. J., & Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, 58, 110-133.
66. McArdle, J. J., & Hamagami, F. (1991). Modeling incomplete longitudinal and cross-sectional data using latent growth structural models. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 276-304). Washington, DC: American Psychological Association.
67. McArdle, J. J., & McDonald, R. P. (1984). Some algebraic properties of the reticular action model for moment structures. British Journal of Mathematical and Statistical Psychology, 37, 234-251.
68. Meredith, W., & Tisak, J. (1990). Latent curve analysis. Psychometrika, 55, 107-122.
69. Meyer, J. P., Allen, N. J., & Gelatly, I. R. (1990). Affective and continuance commitment to the organization: Evaluation of measures and analysis of concurrent and time-lagged relations. Journal of Applied Psychology, 75, 710-720.
70. Millsap, R. E., & Hartog, S. B. (1988). Alpha, beta, and gamma change in evaluation research: A structural equation approach. Journal of Applied Psychology, 73, 574-584.
71. Morita, J. G., Lee, T. W., & Mowday, R. T. (1989). Introducing survival analysis to organizational researchers: A selected application to turnover research. Journal of Applied Psychology, 74, 280-292.
72. Muthen, B. O. (1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49, 115-132.
73. Muthen, B. O. (1991). Analysis of longitudinal data using latent variable models with varying parameters. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 1-17). Washington, DC: American Psychological Association.
74. Muthen, B. O. (1996). Growth modeling with binary responses. In A. V. Eye & C. Clogg (Eds.), Categorical variables in developmental research: Methods of analysis (pp. 37-54). San Diego: Academic Press.
75. Muthen, B. O. (1997). Latent variable modeling of longitudinal and multilevel data. In A. E. Raftery (Ed.), Sociological methodology (pp. 453-480). Washington, DC: Blackwell.
76. Muthen, B. O., & Curran, P. J. (1997). General longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychological Methods, 2, 371-402.
77. Nesselroade, J. R. (1991). Interindividual differences in intraindividual change. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 92-105). Washington, DC: American Psychological Association.
78. Raykov, T., & Widaman, K. F. (1995). Issues in applied structural equation modeling. Structural equation modeling, 2, 289-318.
79. Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566.
80. Rindskopf, F. (1984). Using phantom and imaginary latent variables to parameterize constraints in linear structural models. Psychometrika, 49, 37-47.
81. Rogosa, D. R. (1995). Myths and methods: "Myths about longitudinal research" plus supplemental questions. In J. M. Gottman (Ed.), The analysis of change (pp. 3-66). Hillsdale, NJ: Lawrence Erlbaum.
82. Rogosa, D. R., Brandt, D., & Zimowski, M. (1982). A growth curve approach to the measurement of change. Psychological Bulletin, 92, 726-748.
83. Rogosa, D. R., & Willett, J. B. (1983). Demonstrating the reliability of the difference score in the measurement of change. Journal of Educational Measurement, 20, 335-343.
84. Rogosa, D. R., & Willett, J. B. (1985). Understanding correlates of change by modeling individual differences in growth. Psychometrika, 50, 203-228.
85. Rousseau, D. M. (1985). Issues of level in organizational research: Multi-level and cross-level perspectives. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior (pp. 1-37). Greenwich, CT: JAI.
86. Satorra, A., & Saris, W. E. (1985). Power of the likelihood ratio test in covariance structure analysis. Psychometrika, 50, 83-90.
87. Schaubroeck, J., & Green, S. G. (1989). Confirmatory factor analytic procedures for assessing change during organizational entry. Journal of Applied Psychology, 74, 892-900.
88. Schmitt, N. (1982). The use of analysis of covariance structures to assess beta and gamma change. Multivariate Behavioral Research, 17, 343-358.
89. Snow, R. E., & Lohman, D. L. (1984). Toward a theory of cognitive aptitude for learning from instruction. Journal of Educational Psychology, 76, 347-376.
90. Sörbom, D. (1974). A general method for studying differences in factor means and factor structures between groups. British Journal of Mathematical and Statistical Psychology, 27, 229-239.
91. Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173-180.
92. Stoolmiller, M. (1994). Antisocial behavior, delinquent peer association and unsupervised wandering for boys: Growth and change from childhood to early adolescence. Multivariate Behavioral Research, 29, 263-288.
93. Stoolmiller, M. (1995). Using latent growth curve models to study developmental processes. In J. M. Gottman (Ed.), The analysis of change (pp. 103-138). Hillsdale, NJ: Lawrence Erlbaum.
94. Stoolmiller, M., Duncan, T., Bank, L., & Patterson, G. R. (1993). Some problems and solutions in the study of change: Significant patterns in client resistance. Journal of Consulting and Clinical Psychology, 61, 920-928.
95. Thompson, R. C., & Hunt, J. G. (1996). Inside the black box of alpha, beta, and gamma change: Using a cognitive-processing model to assess attitude structure. Academy of Management Review, 21, 655-690.
96. Tisak, J., & Smith, C. S. (1994a). Defending and extending difference score methods. Journal of Management, 20, 675-682.
97. Tisak, J., & Smith, C. S. (1994b). Rejoinder to Edward's comments. Journal of Management, 20, 675-682.
98. Vandenberg, R. J., & Self, R. M. (1993). Assessing newcomers' changing commitments to the organization during the first 6 months of work. Journal of Applied Psychology, 75, 557-568.
99. Werts, C. E., & Linn, R. L. (1970). A general linear model for studying growth. Psychological Bulletin, 73, 17-22.
100. Willett, J. B. (1989). Some results on reliability for the longitudinal measurement of change: Implications for the design of studies of individual growth. Educational and Psychological Measurement, 49, 587-602.
101. Willett, J. B., & Sayer, A. G. (1994). Using covariance structure analysis to detect correlates and predictors of individual change over time. Psychological Bulletin, 116, 363-381.
102. Willett, J. B., & Sayer, A. G. (1996). Cross-domain analyses of change over time: Combining growth modeling and covariance structure analysis. In G. A. Marcoulides & R. E. Schumacker (Eds.), Advanced structural equation modeling: Issues and techniques. Hillsdale, NJ: Lawrence Erlbaum.
103. Williams, L. J. (1995). Covariance structure modeling in organizational research: problems with the method versus applications of the method. Journal of Organizational Behavior, 16, 225-233.
104. Williams, L. J., & Podsakoff, P. M. (1989). Longitudinal field methods for studying reciprocal relationships in organizational behavior: Toward improved causal analysis. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior (Vol. 2, pp. 247-292). Greenwich, CT: JAI.
105. Zimmerman, D. W., & Williams, R. H. (1982). Gain scores in research can be highly reliable. Journal of Educational Measurement, 19, 149-154.