Measurement invariance within and between individuals: A distinct problem in testing the equivalence of intra- and inter-individual model structures

Frontiers in Psychology

Volumn 5, Issue SEP, 2014, Pages

  Adolf, Janne ^a   Schuurman, Noémi K ^b   Borkenau, Peter ^c   Borsboom, Denny ^d   Dolan, Conor V ^e  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^b UTRECHT UNIVERSITY   (Netherlands)

^c MARTIN LUTHER UNIVERSITY HALLE WITTENBERG   (Germany)

^d UNIVERSITY OF AMSTERDAM   (Netherlands)

^e VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Ergodicity; Intra individual level of analysis; Latent variables; Measurement invariance; State space modeling

Indexed keywords

EID: 84907920745     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2014.00883     Document Type: Article

References (74)

1. Akaike, H. (1974). A new look at statistical model identification. IEEE Trans. Automat. Contr. 19, 716-723. doi: 10.1109/TAC.1974.1100705
2. Bollen, K. A. (2002). Latent variables in psychology and the social sciences. Annu. Rev. Psychol. 53, 605-634. doi: 10.1146/annurev.psych.53.100901.135239
3. Borkenau, P., and Ostendorf, F. (1990). Comparing exploratory and confirmatory factor analysis: a study on the 5-factor model of personality. Pers. Individ. Dif. 11, 515-524. doi: 10.1016/0191-8869(90)90065-Y
4. Borkenau, P., and Ostendorf, F. (1998). The big five as states: How useful is the five factor model to describe inraindividual variations over time? J. Res. Pers. 32, 202-221. doi: 10.1006/jrpe.1997.2206
5. Borsboom, D. (2008). Latent variable theory. Measurement 6, 25-53. doi: 10.1080/15366360802035497
6. Borsboom, D., and Dolan, C. V. (2007). Theoretical equivalence, measurement, invariance, and the idiographic filter. Measurement 5, 236-263. doi: 10.1080/15366360701765020
7. Borsboom, D., Kievit, R. A., Cervone, D., and Hood, B. S. (2009). "The two disciplines of scientific psychology, or: the disunity of psychology as a working hypothesis," in Developmental Process Methodology in the Social and Developmental Sciences, eds J. Valsiner, P. C. M. Molenaar, M. C. D. P. Lyra, and N. Chaudary (New York, NY: Springer), 67-97.
8. Borsboom, D., Mellenbergh, G. J., and van Heerden, J. (2003). The theoretical status of latent variables. Psychol. Rev. 110, 203-219. doi: 10.1037/0033-295x.110.2.203
9. Brose, A., Schmiedek, S., Lövdén, M., Molenaar, P. C. M., and Lindenberger, U. (2010). Adult age differences in covariation of motivation and working memory performance: contrasting between-person and within-person findings. Res. Hum. Dev. 7, 61-78. doi: 10.1080/15427600903578177
10. Brose, A., Voelkle, M. C., Lövdén, M., Lindenberger, U., and Schmiedek, F. (2014). Differences in the between-person and within-person structures of affect are a matter of degree. Eur. J. Psychol. doi: 10.1002/per.1961
11. Byrne, B. M., and Campbell, T. L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: a look beneath the surface. J. Cross Cult. Psychol. 30, 555-574. doi: 10.1177/0022022199030005001
12. Byrne, B. M., Shavelson, R. J., and Muthén, B. O. (1989). Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychol. Bull. 105, 456-466. doi: 10.1037/0033-2909.105.3.456
13. Cattell, R. B. (1952). The three basic factor-analytic designs: their interrelations and derivatives. Psychol. Bull. 49, 499-520. doi: 10.1037/h0054245
14. Cervone, D. (2004). The architecture of personality. Psychol. Rev. 111, 183-204. doi: 10.1037/0033-295X.111.1.183
15. Cervone, D. (2005). Personality architecture: within-person structures and processes. Annu. Rev. Psychol. 56, 423-452. doi: 10.1146/annurev.psych.56.091103.070133
16. Chow, S.-M., Ho, R. M., Hamaker, E. L., and Dolan, C. V. (2010). Equivalences and differences between structural equation modeling and state-space modeling techniques. Struct. Equ. Model. 17, 303-332. doi: 10.1080/10705511003661553
17. Chow, S.-M., and Zhang, G. (2013). Non-linear regime-switching state-space (rsss) models. Psychometrika 78, 740-768. doi: 10.1007/S11336-013-9330-8
18. Chow, S.-M., Zu, J., Shifren, K., and Zhang, G. (2011). Dynamic factor analysis models with time-varying parameters. Multivariate Behav. Res. 46, 303-339. doi: 10.1080/00273171.2011.563697
19. Del Negro, M., and Otrok, C. (2008). "Dynamic factor models with time-varying parameters: measuring changes in international business cycles," in Federal Reserve Bank of New York StaffReports, No. 326. Available online at: http://hdl.handle.net/10419/60779
20. Dolan, C. V. (1994). Factor analysis of variables with 2, 3, 5, and 7 response categories: A comparison of categorical variable estimators using simulated data. Br. J. Math. Stat. Psychol. 47, 309-326. doi: 10.1111/j.2044-8317.1994.tb01039.x
21. Dolan, C. V. (2009). "Structural equation mixture modeling," in The Sage Handbook of Quantitative Methods in Psychology, eds R. E. Millsap and A. Maydeu-Olivares (Thousand Oaks, CA: Sage Publications Ltd.), 568-591. doi: 10.4135/9780857020994.n23
22. Dolan, C. V. (2010). MKFM6: Multi-Group, Multi-Subject Stationary Time Series Modeling Based on the Kalman Filter. Amsterdam: University of Amsterdam.
23. Dolan, C. V., Roorda, W., and Wicherts, J. M. (2004). Two failures of spearman's hypothesis: the GATB in holland and the JAT in south africa. Intelligence 32, 155-173. doi: 10.1016/j.intell.2003.09.001
24. Durbin, J., and Koopman, S. J. (2001). Time Series Analysis by State Space Methods. New York, NY: Oxford University Press.
25. Ellis, J. L., and van den Wollenberg, A. L. (1993). Local homogeneity in latent trait models: a characterization of the homogeneous monotone IRT model. Psychometrika 58, 417-429. doi: 10.1007/bf02294649
26. Fleeson, W. (2001). Toward a structure- and process-integrated view of personality: traits as density distributions of states. J. Pers. Soc. Psychol. 89, 1011-1027. doi: 10.1037/0022-3514.80.6.1011
27. Graziano, W. G., and Tobin, R. M. (2009). "Agreeableness," in Handbook of Individual Differences in Social Behavior, eds M. R. Leary and R. H. Hoyle (New York, NY: Guilford Press), 46-61.
28. Gregson, R. A. M. (1983). Time Series in Psychology. Hillsdale, NJ: Lawrence Erlbaum Associates. Inc.
29. Hamaker, E. J., Dolan, C. V., and Molenaar, P. C. M. (2005). Statistical modeling of the individual: Rationale and application of multivariate stationary time series analysis. Multivariate Behav. Res. 40, 207-233. doi: 10.1207/s15327906mbr4002_3
30. Hamaker, E. L. (2007). How to inspect fruit. Measurement 5, 250-253. doi: 10.1080/15366360701775961
31. Hamaker, E. L., and Dolan, C. V. (2009). "Idiographic data analysis: quantitative methods - from simple to advanced," in Dynamic Process Methodology in the Social and Developmental Sciences, eds J. Valsiner, P. C. M. Molenaar, M. Lyra, and N. Chaudhary (New York, NY: Springer-Verlag), 191-216.
32. Hamaker, E. L., Nesselroade, J. R., and Molenaar, P. C. M. (2007). The integrated trait-state model. J. Res. Pers. 41, 295-315. doi: 10.1016/j.jrp.2006.04.003
33. Hamilton, J. D. (1994). Time Series Analysis. Princeton, NJ: Princeton University Press.
34. Harvey, A. C. (1989). Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge: Cambridge University Press.
35. Holtgraves, T. (2004). Social desirability and self-reports: Testing models of socially desirable responding. Pers. Soc. Psychol. Bull. 30, 161-172. doi: 10.1177/0146167203259930
36. Horn, J. L., and McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Exp. Aging Res. 18, 117-144. doi: 10.1080/03610739208253916
37. Hox, J. J. (2002). Multilevel Analysis: Techniques and Applications. Mahwah, NJ: Erlbaum.
38. Hunter, M. D. (2014). Abstract: dynamic mixture modeling of a single simulated case. Multivariate Behav. Res. 49, 286-287. doi: 10.1080/00273171.2014.912890
39. Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika 36, 409-426. doi: 10.1007/BF02291366
40. Kelderman, H., and Molenaar, P. C. M. (2007). The effect of individual differences in factor loadings on the standard factor model. Multivariate Behav. Res. 42, 435-456. doi: 10.1080/00273170701382997
41. Klein, A., and Moosbrugger, H. (2000). Maximum likelihood estimation of latent interaction effects with the LMS method. Psychometrika 65, 457-474. doi: 10.1007/BF02296338
42. Kuppens, P., Allen, N. B., and Sheeber, L. B. (2010). Emotional inertia and psychological maladjustment. Psychol. Sci. 21, 984-991. doi: 10.1177/0956797610372634
43. Lodewyckx, T., Tuerlinckx, F., Kuppens, P., Allen, N. B., and Sheeber, L. (2011). A hierarchical state space approach to affective dynamics. J. Math. Psychol. 55, 68-83. doi: 10.1016/j.jmp.2010.08.004
44. Lubke, G. H., Dolan, C. V., Kelderman, H., and Mellenbergh, G. J. (2003a). On the relationship between- and within group differences and measurement invariance in the common factor model. Intelligence 31, 543-566. doi: 10.1016/s0160-2896(03)00051-5
45. Lubke, G. H., Dolan, C. V., Kelderman, H., and Mellenbergh, G. J. (2003b). Weak measurement invariance with respect to unmeasured variables: An implication of strict factorial invariance. Br. J. Math. Stat. Psychol. 56, 231-248. doi: 10.1348/000711003770480020
46. Lubke, G. H., and Muthén, B. O. (2004). Applying multigroup confirmatory factor models for continuous outcomes to likert scale data complicates meaningful group comparisons. Struct. Equ. Model. 11, 514-534. doi: 10.1207/s15328007sem1104_2
47. McCrae, R. R., and John, O. P. (1992). An introduction to the five-factor model and its applications. J. Pers. 60, 175-215. doi: 10.1111/j.1467-6494.1992.tb00970.x
48. Mellenbergh, G. J. (1989). Item bias and item response theory. Int. J. Educ. Res. 13, 127-143. doi: 10.1016/0883-0355(89)90002-5
49. Mellenbergh, G. J. (1994). A unidimensional latent trait model for continuous item responses. Multivariate Behav. Res. 29, 223-236. doi: 10.1207/s15327906mbr2903_2
50. Meredith, W. (1964). Notes on factorial invariance. Psychometrika 29, 177-185. doi: 10.1007/BF02289699
51. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika 58, 525-543. doi: 10.1007/BF02294825
52. Millsap, R. E. (2011). Statistical Approaches to Measurement Invariance. New York, NY: Routledge.
53. Millsap, R. E., and Hartog, S. B. (1988). Alpha, beta, and gamma change in evaluation research: a structural equation approach. J. Appl. Psychol. 73, 574-584. doi: 10.1037/0021-9010.73.3.574
54. Molenaar, P. C. M. (1985). A dynamic factor model for the analysis of multivariate time series. Psychometrika 50, 181-202. doi: 10.1007/bf02294246
55. Molenaar, P. C. M. (2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement 2, 201-218. doi: 10.1207/s15366359mea0204_1
56. Molenaar, P. C. M., and Campbell, C. G. (2009). The new person-specific paradigm in psychology. Curr. Dir. Psychol. 18, 112-117. doi: 10.1111/j.1467-8721.2009.01619.x
57. Molenaar, P. C. M., Huizenga, H. M., and Nesselroade, J. R. (2003). "The relationship between the structure of interindividual and intraindividual variability: a theoretical and empirical vindication of developmental systems theory," in Understanding Human Development: Dialogues with Lifespan Psychology, eds U. M. Staudinger and U. Lindenberger (Dordrecht: Kluwer Academic Publishers), 339-360.
58. Montpetit, M. A., Bergeman, C. S., Deboeck, P. R., Tiberio, S. S., and Boker, S. M. (2010). Resilience-as-process: negative affect, stress, and coupled dynamical systems. Psychol. Aging 25, 631-640. doi: 10.1037/a0019268
59. Muthén, B. O. (1989). Latent variable modeling in heterogeneous populations. Psychometrika 54, 557-585. doi: 10.1007/BF02296397
60. Nesselroade, J. R. (2010). "On an emerging third discipline of scientific psychology," in Individual Pathways of Change: Statistical Models for Analyzing Learning and Development, eds P. C. M. Molenaar and K. M. Newell (Washington, DC: American Psychological Association), 209-218.
61. Nesselroade, J. R., Gerstorf, D., Hardy, S. A., and Ram, N. (2007). Idiographic filters for psychological constructs. Measurement 5, 217-235. doi: 10.1080/15366360701741807
62. Nesselroade, J. R., Ram, N., Gerstorf, D., and Hardy, S. A. (2009). Rejoinder to commentaries on Nesselroade, Gerstorf, Hardy, and Ram. Measurement 7, 17-26. doi: 10.1080/15366360802715361
63. Oud, J. H. L., van den Bercken, J. H., and Essers, R. J. (1990). Longitudinal factor score estimation using the Kalmanfilter. Appl. Psychol. Meas. 14, 395-418. doi: 10.1177/014662169001400406
64. Paulhus, D. L., and Reid, D. B. (1991). Enhancement and denial in socially desirable responding. J. Pers. Soc. Psychol. 60, 307-317. doi: 10.1037/0022-3514.60.2.307
65. Rammstedt, B., and John, O. P. (2005). Kurzversion des Big Five Inventory (BFI-K): Entwicklung und Validierung eines ökonomischen Inventars zur Erfassung der fünf Faktoren der Persönlichkeit. Diagnostica 51, 195-206. doi: 10.1026/0012-1924.51.4.195
66. Raykov, T., Marcoulides, G. A., and Li, C. H. (2012). Measurement invariance for latent constructs in multiple populations: a critical view and refocus. Educ. Psychol. Meas. 72, 954-974. doi: 10.1177/0013164412441607
67. Schmiedek, F., Lövdén, M., and Lindenberger, U. (2009). On the relation of mean reaction time and intraindividual reaction time variability. Psychol. Aging 24, 841-857. doi: 10.1037/a0017799
68. Schwarz, G. (1978). Estimating the dimension of a model. Ann. Stat. 6, 461-464. doi: 10.1214/aos/1176344136
69. Shumway, R. S., and Stoffer, D. S. (2011). Time Series Analysis and its Applications: With R Examples. New York, NY: Springer. doi: 10.1007/978-1-4419-7865-3
70. van der Maas, H. L. J., Dolan, C. V., Grasman, R. P. P. P., Wicherts, J. M., Huizenga, H. M., and Raijmakers, M. E. J. (2006). A dynamical model of general intelligence: the positive manifold of intelligence by mutualism. Psychol. Rev. 113, 842-861. doi: 10.1037/0033-295X.113.4.842
71. van der Sluis, S., Posthuma, D., Dolan, C. V., de Geus, E. J. C., Colom, R., and Boomsma, D. I. (2006). Sex differences on the dutch WAIS-III. Intelligence 34, 273-289. doi: 10.1016/j.intell.2005.08.002
72. van Rijn, P., Dolan, C. V., and Molenaar, P. C. M. (2010). "State space methods for item response modeling of multisubject time series," in Individual Pathways of Change: Statistical Models for Analyzing Learning and Development, eds P. C. M. Molenaar and K. M. Newell (Washington, DC: American Psychological Association), 125-135.
73. Voelkle, M. C., Brose, A., Schmiedek, F., and Lindenberger, U. (2014). Toward a unified framework for the study of between-person and within-person structures: building a bridge between two research paradigms. Multivariate Behav. Res. 49, 193-213. doi: 10.1080/00273171.2014.889593
74. Wicherts, J. M., and Dolan, C. V. (2010). Measurement invariance in confirmatory factor analysis: an illustration using IQ test performance of minorities. Educ. Meas. 29, 39-47. doi: 10.1111/j.1745-3992.2010.00182.x