Switching principal component analysis for modeling means and covariance changes over time

Psychological Methods

Volumn 19, Issue 1, 2014, Pages 113-132

  De Roover, Kim ^a   Timmerman, Marieke E ^b   Van Diest, Ilse ^a   Onghena, Patrick ^a   Ceulemans, Eva ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Dimensionality; Multivariate time series data; Principal component analysis; Segmentation; Time contiguity

Indexed keywords

ALGORITHM; HUMAN; MULTIVARIATE ANALYSIS; PRINCIPAL COMPONENT ANALYSIS; STATISTICAL MODEL; TIME;

ALGORITHMS; HUMANS; MODELS, STATISTICAL; MULTIVARIATE ANALYSIS; PRINCIPAL COMPONENT ANALYSIS; TIME FACTORS;

EID: 84897960526     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0034525     Document Type: Article

References (93)

1. Aach, J., & Church, G. M. (2001). Aligning gene expression time series with time warping algorithms. Bioinformatics, 17, 495-508.
2. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716-723.
3. Aue, A., Hörmann, S., Horváth, L., & Reimherr, M. (2009). Break detection in the covariance structure of multivariate time series models. Annals of Statistics, 37, 4046-4087.
4. Bauer, D. J., & Curran, P. J. (2004). The integration of continuous and discrete latent variable models: Potential problems and promising opportunities. Psychological Methods, 9, 3-29.
5. Baum, L. E., & Petrie, T. (1966). Statistical inference for probabilistic functions of finite state Markov chains. Annals of Mathematical Statistics, 37, 1554-1563.
6. Besse, P., & Ramsay, J. O. (1986). Principal components analysis of sampled functions. Psychometrika, 51, 285-311.
7. Boiten, F. (1993). Component analysis of task-related respiratory patterns. International Journal of Psychophysiology, 15, 91-104.
8. Boker, S. M., Neale, M. C., & Rausch, J. (2004). Latent differential equation modeling with multivariate multi-occasion indicators. In K. van Montfort, H. Oud, & A. Satorra (Eds.), Recent developments on structural equation models: Theory and applications (pp. 151-174). Dordrecht, the Netherlands: Kluwer Academic.
9. Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003). The theoretical status of latent variables. Psychological Review, 110, 203-219.
10. Bulteel, K., Wilderjans, T. F., Tuerlinckx, F., & Ceulemans, E. (2013). CHull as an alternative to AIC and BIC in the context of mixtures of factor analyzers. Behavior Research Methods, 45, 782-791.
11. Butler, E. A. (2011). Temporal interpersonal emotion systems: The "TIES" that form relationships. Personality and Social Psychology Review, 15, 367-393.
12. Cattell, R. B. (1952). The three basic factor analytic designs: Their interrelations and derivatives. Psychological Bulletin, 49, 499-520.
13. Ceulemans, E., & Kiers, H. A. L. (2006). Selecting among three-mode principal component models of different types and complexities: A numerical convex hull based method. British Journal of Mathematical and Statistical Psychology, 59, 133-150.
14. Ceulemans, E., Timmerman, M. E., & Kiers, H. A. L. (2011). The CHULL procedure for selecting among multilevel component solutions. Chemometrics and Intelligent Laboratory Systems, 106, 12-20.
15. Christie, I. C., & Friedman, B. H. (2004). Autonomic specificity of discrete emotion and dimensions of affective space: A multivariate approach. International Journal of Psychophysiology, 51, 143-153.
16. Cotton, D. J., Sheiban, M., & Engel, L. A. (1988). Volume acceleration as an index of neuromuscular output. Respiration Physiology, 71, 117-130.
17. De Roover, K., Ceulemans, E., & Timmerman, M. E. (2012). How to perform multiblock component analysis in practice. Behavior Research Methods, 44, 41-56.
18. De Roover, K., Ceulemans, E., Timmerman, M. E., Nezlek, J. B., & Onghena, P. (2013). Modeling differences in the dimensionality of multiblock data by means of clusterwise simultaneous component analysis. Psychometrika. Advance online publication.
19. Diebold, F. X., Lee, J. H., & Weinbach, G. C. (1994). Regime switching with time-varying transition probabilities. In P. Hargreaves (Ed.), Nonstationary time series analysis and cointegration (pp. 283-302). Oxford, England: Oxford University Press.
20. DiFiore, J. M., Martin, R. J., Dreshaj, I., Abu-Shaweesh, J., Neuman, M. R., Adams, J. A., & Sackner, M. A. (1997). Peak acceleration of respiratory waveforms at onset of inspiration: A new noninvasive measure of respiratory drive. Pediatric Research, 41, 251.
21. Dolan, C. V., Schmittman, V. D., Lubke, G. H., & Neale, M. C. (2005). Regime switching in the latent growth curve mixture model. Structural Equation Modeling, 12, 94-119.
22. 2 paradigm. Biological Psychology, 78, 87-92.
23. Filardo, A. J. (1998). Choosing information variables for transition probabilities in a time-varying transition probability model (Research Working Paper 98-09). Kansas, MO: Federal Reserve Bank of Kansas City.
24. Flavell, J. H. (1971). Stage-related properties of cognitive development. Cognitive Psychology, 2, 421-453.
25. Fraley, R. C. (2007). A connectionist approach to the organization and continuity of working model of attachment. Journal of Personality, 75, 1157-1180.
26. Francq, C., & Zakoïan, J.-M. (2001). Stationarity of multivariate Markovswitching ARMA models. Journal of Econometrics, 102, 339-364.
27. Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1993). Functional connectivity: The principal-component analysis of large (PET) data sets. Journal of Cerebral Blood Flow and Metabolism, 13, 5-14.
28. Gales, M. J. F. (1999). Semi-tied covariance matrices for hidden Markov models. IEEE Transactions on Speech and Audio Processing, 7, 272- 281.
29. Graham, J. W., Collins, L. M., Wugalter, S. E., Chung, N. K., & Hansen, W. B. (1991). Modeling transitions in latent stage-sequential processes: A substance use prevention example. Journal of Consulting and Clinical Psychology, 59, 48-57.
30. Gross, J. J. (2010). The future's so bright, I gotta wear shades. Emotion Review, 2, 212-216.
31. Hamilton, J. D. (1994). Time series analysis. Princeton, NJ: Princeton University Press.
32. Hubert, L., & Arabie, P. (1985). Comparing partitions. Journal of Classification, 2, 193-218.
33. Hudson, D. J. (1966). Fitting segmented curves whose join points have to be estimated. Journal of the American Statistical Association, 61, 1097- 1129.
34. Jolliffe, I. T. (2002). Principal component analysis (2nd ed.). New York, NY: Springer.
35. Jones, C. J., & Nesselroade, J. R. (1990). Multivariate, replicated, singlesubject, repeated measures designs and P-technique factor analysis: A review of intraindividual change studies. Experimental Aging Research, 16, 171-183.
36. Kiefer, N. M. (1978). Discrete parameter variation: Efficient estimation of a switching regression model. Econometrica, 46, 427-434.
37. Kiers, H. A. L. (1990). SCA: A program for simultaneous components analysis of variables measured in two or more populations. Groningen, the Netherlands: Iec ProGAMMA.
38. Kiers, H. A. L., & ten Berge, J. M. F. (1994). Hierarchical relations between methods for simultaneous components analysis and a technique for rotation to a simple simultaneous structure. British Journal of Mathematical and Statistical Psychology, 47, 109-126.
39. Kim, C.-J., & Nelson, C. R. (1999). State-space models with regimeswitching: Classical and Gibbs-sampling approaches with applications. Cambridge, MA: MIT Press.
40. Klausmeier, H. J., & Sipple, T. S. (1982). Factor structure of the Piagetian stage of concrete operations. Contemporary Educational Psychology, 7, 161-180.
41. Koval, P., & Kuppens, P. (2012). Changing emotion dynamics: Individual differences in the effect of anticipatory social stress on emotional inertia. Emotion, 12, 256-267.
42. Ku, W., Storer, R. H., & Georgakis, C. (1995). Disturbance detection and isolation by dynamic principal component analysis. Chemometrics and Intelligent Laboratory Systems, 30, 179 -196.
43. Lavielle, M., & Teyssière, G. (2006). Detection of multiple change-points in multivariate time series. Lithuanian Mathematical Journal, 46, 287- 306.
44. Lawley, D. N., & Maxwell, A. E. (1962). Factor analysis as a statistical method. The Statistician, 12, 209-229.
45. Lawson, A. E., & Nordland, F. H. (1976). The factor structure of some Piagetian tasks. Journal of Research in Science Teaching, 13, 461-466.
46. Li, F., Duncan, T. E., Duncan, S. C., & Acock, A. (2001). Latent growth modeling of longitudinal data: A finite growth mixture modeling approach. Structural Equation Modeling, 8, 493-530.
47. Liu, J., Wu, S., & Zidek, J. V. (1997). On segmented multivariate regression. Statistica Sinica, 7, 497-525.
48. Liu, J.-C. (2006). Stationarity of a Markov-switching GARCH model. Journal of Financial Econometrics, 4, 573-593.
49. Lodewyckx, T., Tuerlinckx, F., Kuppens, P., Allen, N. B., & Sheeber, L. B. (2011). A hierarchical state space approach to affective dynamics. Journal of Mathematical Psychology, 55, 68-83.
50. Lorenzo-Seva, U., & ten Berge, J. M. F. (2006). Tucker's congruence coefficient as a meaningful index of factor similarity. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 2, 57-64.
51. Lu, R.-P., Smith, E. P., & Good, I. J. (1989). Multivariate measures of similarity and niche overlap. Theoretical Population Biology, 35, 1-21.
52. Mauss, I. B., Levenson, R. W., McCarter, L., Wilhelm, F. H., & Gross, J. J. (2005). The tie that binds? Coherence among emotion experience, behavior, and physiology. Emotion, 5, 175-190.
53. McArdle, J. J. (2009). Latent variable modeling of differences and changes with longitudinal data. Annual Review of Psychology, 60, 577-605.
54. McArdle, J. J., & Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, 58, 110-133.
55. McLachlan, G. J., & Peel, D. (2000). Finite mixture models. New York, NY: Wiley.
56. Meredith, W., & Millsap, R. E. (1985). On component analyses. Psychometrika, 50, 495-507.
57. Milligan, G. W., Soon, S. C., & Sokol, L. M. (1983). The effect of cluster size, dimensionality, and the number of clusters on recovery of true cluster structure. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5, 40-47.
58. Mischel, W., & Shoda, Y. (1995). A cognitive-affective system theory of personality: Reconceptualizing situations, dispositions, dynamics, and invariance in personality structure. Psychological Review, 102, 246- 268.
59. Molenaar, P. C. M. (1985). A dynamic factor model for the analysis of multivariate time series. Psychometrika, 50, 181-202.
60. Molenaar, P. C. M., & Nesselroade, J. R. (2001). Rotation in the dynamic factor modeling of multivariate stationary time series. Psychometrika, 66, 99-107.
61. Molenaar, P. C. M., & von Eye, A. (1994). On the arbitrary nature of latent variables. In A. von Eye & C. C. Clogg (Eds.), Latent variable analysis: Applications for developmental research (pp. 226-242). Thousand Oaks, CA: Sage.
62. Muthén, B., Brown, C. H., Booil Jo, K. M., Khoo, S.-T., Yang, C.-C., Wang, C.-P. Liao, J. (2002). General growth mixture modeling for randomized preventive interventions. Biostatistics, 3, 459-475.
63. Nagin, D. S. (1999). Analyzing developmental trajectories: A semiparametric, group-based approach. Psychological Methods, 4, 139-157.
64. Pappens, M., de Peuter, S., Vansteenwegen, D., Van den Bergh, O., & Van Diest, I. (2012). Psychophysiological responses to CO2 inhalation. International Journal of Psychophysiology, 84, 45-50.
65. Pe, M. L., & Kuppens, P. (2012). The dynamic interplay between emotions in daily life: Augmentation, blunting, and the role of appraisal overlap. Emotion, 12, 1320-1328.
66. Pearson, K. (1901). On lines and planes of closest fit to systems of points in space. Philosophical Magazine, 2, 559 -572.
67. Piaget, J. (1972). Intellectual evolution from adolescence to adulthood. Human Development, 15, 1-12.
68. Raftery, A. E. (1985). A model for high-order Markov chains. Journal of the Royal Statistical Society: Series B. Methodological, 47, 528-539.
69. Ramadan, Z., Jacobs, D., Grigorov, M., & Kochlar, S. (2006). Metabolic profiling using principal component analysis, discriminant partial least squares, and genetic algorithms. Talanta, 68, 1683-1691.
70. Rao, C. R. (1958). Some statistical methods for the comparison of growth curves. Biometrics, 14, 1-17.
71. Rato, T. J., & Reis, M. S. (2013). Defining the structure of DPCA models and its impact on process monitoring and prediction activities. Chemometrics and Intelligent Laboratory Systems, 125, 74-86.
72. Repp, B. H. (2005). Sensorimotor synchronization: A review of the tapping literature. Psychonomic Bulletin & Review, 12, 969-992.
73. Rice, J. A., & Silverman, B. W. (1991). Estimating the mean and covariance structure nonparametrically when the data are curves. Journal of the Royal Statistical Society: Series B. Methodological, 53, 233-243.
74. Robert, P., & Escoufier, Y. (1976). A unifying tool for linear multivariate statistical methods: The RV-coefficient. Applied Statistics, 25, 257-265.
75. Rosti, A.-V. I., & Gales, M. J. F. (2004). Factor analysed hidden Markov models for speech recognition. Computer Speech and Language, 18, 181-200.
76. Sander, D., Grandjean, D., & Scherer, K. R. (2005). A systems approach to appraisal mechanisms in emotion. Neural Networks, 18, 317-352.
77. Schmittmann, V. D., Dolan, C. V., van der Maas, H. L. J., & Neale, M. C. (2005). Discrete latent Markov models for normally distributed response data. Multivariate Behavioral Research, 40, 461-488.
78. Sullivan, J. H., & Woodall, W. H. (2000). Change-point detection of mean vector or covariance matrix shifts using multivariate individual observations. IIE Transactions, 32, 537-549.
79. Timmerman, M. E. (2001). Component analysis of multisubject multivariate longitudinal data (Unpublished doctoral dissertation). University of Groningen, Groningen, the Netherlands.
80. Timmerman, M. E., Ceulemans, E., De Roover, K., & Van Leeuwen, K. (2013). Subspace K-means clustering. Behavior Research Methods. Advance online publication.
81. Timmerman, M. E., & Kiers, H. A. L. (2000). Three-mode principal component analysis: Choosing the numbers of components and sensitivity to local optima. British Journal of Mathematical and Statistical Psychology, 53, 1-16.
82. Timmerman, M. E., & Kiers, H. A. L. (2002). Three-way component analysis with smoothness constraints. Computational Statistics and Data Analysis, 40, 447-470.
83. Timmerman, M. E., & Kiers, H. A. L. (2003). Four simultaneous component models of multivariate time series from more than one subject to model intraindividual and interindividual differences. Psychometrika, 68, 105-121.
84. Tucker, L. R. (1951). A method for synthesis of factor analysis studies (Personnel Research Section Report No. 984). Washington, DC: Department of the Army.
85. Tucker, L. R. (1958). Determination of parameters of a functional relation by factor analysis. Psychometrika, 23, 19-23.
86. Velicer, W. F., Martin, R. A., & Collins, L. M. (1996). Latent transition analysis for longitudinal data. Addiction, 91, S197-S209.
87. Wilderjans, T. F., Ceulemans, E., Kiers, H. A. L., & Meers, K. (2009). The LMPCA program: A graphical user interface for fitting the linked-mode PARAFAC-PCA model to coupled real-valued data. Behavior Research Methods, 41, 1073-1082.
88. Wilderjans, T. F., Ceulemans, E., & Meers, K. (2013). CHull: A generic convex-hull-based model selection method. Behavior Research Methods, 45, 1-15.
89. Wilderjans, T. F., Ceulemans, E., Van Mechelen, I., & van den Berg, R. A. (2011). Simultaneous analysis of coupled data matrices subject to different amounts of noise. British Journal of Mathematical and Statistical Psychology, 64, 277-290.
90. Wohlwill, J. F. (1973). The study of behavioural development. New York, NY: Academic Press.
91. Woods, S. W., Charney, D. S., Loke, J., & Goodman, W. K. (1986). Carbon dioxide sensitivity in panic anxiety. Archives of General Psychiatry, 43, 900-909.
92. Yung, Y. F. (1997). Finite mixtures in confirmatory factor-analysis models. Psychometrika, 62, 297-330.
93. Zhang, Z., Hamaker, E. L., & Nesselroade, J. R. (2008). Comparison of four methods for estimating a dynamic factor model. Structural Equation Modeling, 15, 377-402.