Current methodological considerations in exploratory and confirmatory factor analysis

Journal of Psychoeducational Assessment

Volumn 29, Issue 4, 2011, Pages 304-321

  Schmitt, Thomas A ^a  

^a EASTERN MICHIGAN UNIVERSITY   (United States)

Author keywords

confirmatory factor analysis; exploratory factor analysis; factor analysis; structural equation modeling

Indexed keywords

EID: 79961215491     PISSN: 07342829     EISSN: None     Source Type: Journal    
DOI: 10.1177/0734282911406653     Document Type: Article

References (98)

1. Asparouhov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling, 16, 397-438.
2. Asparouhov, T., & Muthén, B. (2010a). Bayesian analysis of latent variable models using Mplus. Technical Report. Version 4. Retrieved fromhttp://www.statmodel.com/download/BayesAdvantages18.pdf.
3. Asparouhov, T., & Muthén, B. (2010b). Weighted least squares estimation with missing data (Technical Report). Retrieved fromhttp://www.statmodel.com/download/GstrucMissingRevision.pdf.
4. Barrett, P. (2007). Structural equation modelling: Adjudging model fit. Personality and Individual Differences, 42, 815-824.
5. Beauducel, A., & Herzberg, P.Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling, 13, 186-203.
6. Bentler, P.M. (2007). On tests and indices for evaluating structural models. Personality and Individual Differences, 42, 825-829.
7. Bentler, P.M. (2010). EQS structural equation modeling software. Encino, CA: Multivariate Software.
8. Bentler, P.M., & Yuan, K.H. (1999). Structural equation modeling with small samples: Test statistics. Multivariate Behavioral Research, 34, 181-197.
9. Bollen, K.A. (1989). Structural equations with latent variables. New York, NY: John Wiley.
10. Bollen, K.A., & Davis, W.R. (2009). Causal indicator models: Identification, estimation, and testing. Structural Equation Modeling: A Multidisciplinary Journal, 16, 498-522.
11. Bollen, K.A., Kirby, J.B., Curran, P.J., Paxton, P.M., & Chen, F. (2007). Latent variable models under misspecification: A comparison of Two Stage Least Squares (2SLS) to Full Information Maximum Likelihood estimators (FIML). Sociological Methods and Research, 36, 48-86.
12. Brown, T.A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford.
13. Browne, M.W. (1984). Asymptotically distribution-free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62-83.
14. Browne, M.W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36, 111-150.
15. Browne, M.W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods and Research, 21, 230-258.
16. Byrne, B.M. (2001). Structural equation modeling with Lisrel, Prelis, and Simplis: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum.
17. Chen, F., Curran, P.J., Bollen, K.A., Kirby, J., & Paxton, P. (2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods and Research, 36, 462-494.
18. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
19. Conway, J.M., & Huffcut, A.I. (2003). A review and evaluation of exploratory factor analysis practices in organizational research. Organizational Research Methods, 6, 147-168.
20. Costello, A.B., & Osborne, J.W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10. Retrieved fromhttp://pareonline.net/pdf/v10n7.pdf.
21. Cudeck, R., & MacCallum, R. C. (Eds.). (2007). Factor analysis at 100: Historical developments and future directions. Mahwah, NJ: Lawrence Erlbaum.
22. Cudeck, R., & O'Dell, L.L. (1994). Applications of standard error estimates in unrestricted factor analysis: Significance tests for factor loadings and correlations. Psychological Bulletin, 115, 475-487.
23. de Winter, J.C.F., Dodou, D., & Wieringa, P.A. (2009). Exploratory factor analysis with small sample sizes. Multivariate Behavioral Research, 44, 147-181.
24. Dinno, A. (2001-2009). Paran. Performs Horn's parallel analysis for principal component (or factor) retention. Packages written for use with STATA, and for R. Retrieved fromhttp://www.doyenne.com/stata/paran.html.
25. Dinno, A. (2009). Exploring the sensitivity of Horn's parallel analysis to the distributional form of simulated data. Multivariate Behavioral Research, 44, 362-388.
26. Dinno, A. (2010). Gently clarifying the application of Horn's parallel analysis to principal component analysis versus factor analysis. Retrieved fromhttp://doyenne.com/Software/files/PA_for_PCA_vs_FA.pdf.
27. Enders, C.K. (2010). Applied missing data analysis. New York, NY: Guilford.
28. Esposito Vinzi, V., Chin, W. W., Henseler, J., & Wang, H. (Eds.). (2010). Handbook of partial least squares. New York, NY: Springer.
29. Fabrigar, L.R., Wegener, D.T., MacCallum, R.C., & Strahan, E.J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299.
30. Flora, D.B., & Curran, P.J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466-491.
31. Ford, J.K., MacCallum, R.C., & Tait, M. (1986). The application of exploratory factor analysis in applied psychology: A critical review and analysis. Personnel Psychology, 39, 291-314.
32. Forero, C., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009). Factor analysis with ordinal indicators: A Monte Carlo study comparing DWLS and ULS estimation. Structural Equation Modeling, 16, 625-641.
33. Gerbing, D.W., & Hamilton, J.G. (1996). Viability of exploratory factor analysis as a precursor to confirmatory factor analysis. Structural Equation Modeling, 3, 62-72.
34. Glorfeld, L.W. (1995). An improvement on Horn's parallel analysis methodology for selecting the correct number of factors to retain. Educational and Psychological Measurement, 55, 377-393.
35. Glymour, C. (1982). Casual inference and causal explanation. In R. McLaughlin (Ed.), What? Where? When? Why? Essays on induction, space, and time,explanation (pp. 179-191). Boston, MA: D. Reidel Publishing Company.
36. Gorsuch, R.L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
37. Gorsuch, R.L. (1997). Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment, 68, 532-560.
38. Guadagnoli, E., & Velicer, W.F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103, 265-275.
39. Hayashi, K., Bentler, P.M., & Yuan, K.H. (2007). On the likelihood ratio test for the number of factors in exploratory factor analysis. Structural Equation Modeling, 14, 505-526.
40. Hayton, J.C., Allen, D.G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191-205.
41. Henson, R.K., & Roberts, J.K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66, 393-416.
42. Holgado-Tello, F.P., Chacón-Moscoso, S., Barbero-García, I., & Vila-Abad, E. (2010). Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Quality and Quantity, 44, 153-166.
43. Holzinger, K., & Swineford, F. (1939). A study in factor analysis: The stability of a bifactor solution. Supplementary Educational Monograph, no. 48. Chicago: University of Chicago Press.
44. Horn, J.L. (1965). A rationale and a test for the number of factors in factor analysis. Psychometrika, 30, 179-185.
45. Hu, L., & Bentler, P.M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model specification. Psychological Methods, 3, 424-453.
46. Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
47. Jackson, D.L. (2007). The effect of the number of observations per parameter in misspecified confirmatory factor analytic models. Structural Equation Modeling: A Multidisciplinary Journal, 14, 48-76.
48. Jackson, D.L., Gillaspy, J.A., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: A review and some recommendations. Psychological Methods, 14, 6-23.
49. Jennrich, R.I. (2007). Rotation methods, algorithms, and standard errors. In R. Cudeck & R. C. MacCallum (Eds.), Factor analysis at 100: Historical developments and future directions (pp. 315-335). Mahwah, NJ: Lawrence Erlbaum.
50. Jöreskog, K.G., & Sörbom, D. (2001). LISREL 8 user's reference guide. Lincolnwood, IL: Scientific Software International.
51. Kaplan, D. (2009). Structural equation modeling: Foundations and extensions (2nd ed.). Thousand Oaks, CA: SAGE.
52. Kelley, K., & Maxwell, S.E. (2003). Sample size for multiple regression: Obtaining regression coefficients that are accurate, not simply significant. Psychological Methods, 8, 305-321.
53. Kim, K.H. (2005). The relation among fit indexes, power, and sample size in structural equation modeling, 12, 368-390.
54. Lambert, Z.V., Wildt, A.R., & Durand, R.M. (1990). Assessing sampling variation relative to number-of-factors criteria. Educational and Psychological Measurement, 50, 33.
55. Lei, P.W. (2009). Evaluating estimation methods for ordinal data in structural equation modeling. Quality & Quantity, 43, 495-507.
56. Liu, O.L., & Rijmen, F. (2008). A modified procedure for parallel analysis for ordered categorical data. Behavior Research Methods, 40, 556-562.
57. MacCallum, R.C., Browne, M.W., & Sugawara, H.M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130-149.
58. MacCallum, R.C., Lee, T., & Browne, M.W. (2010). The issue of isopower in power analysis for tests of structural equation models. Structural Equation Modeling, 17, 23-41.
59. MacCallum, R.C., Roznowski, M., & Necowitz, L.B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111, 490-504.
60. MacCallum, R.C., Widaman, K.F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4, 84-99.
61. Marsh, H.W. (2009, May 27). Re: There are no golden rules about sample size. Retrieved fromhttp://bama.ua.edu/archives/semnet.html.
62. Marsh, H.W., Hau, K.T., Balla, J.R., & Grayson, D. (1998). Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research, 33, 181-220.
63. Marsh, H.W., Muthén, B., Asparouhov, A., Lüdtke, O., Robitzsch, A., Morin, A.J.S. Trautwein, U.(2009).Exploratory structural equation modeling, integrating CFA and EFA: Application to students' evaluations of university teaching. Structural Equation Modeling, 16, 439-476.
64. Marsh, H.W., Hau, K.T., & Grayson, D. (2005). Goodness of fit in structural equation models. In A. Maydeu-Olivares & J. J. McArdle (Eds.), Contemporary psychometrics (pp. 275-340). Mahwah, NJ: Lawrence Erlbaum.
65. Marsh, H.W., Hau, K.T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling, 11, 320-341.
66. Marsh, H.W., Liem, G.A.D., Martin, A.J., Morin, A.J.S., & Nagengast, B. (2011). Methodological-measurement fruitfulness of exploratory structural equation modeling (ESEM): New approaches to key substantive issues in motivation and engagement. Special issue in the Journal of Psychoeducational Assessment.
67. McArdle, J.J. (1990). Principles versus principals of structural factor-analyses. Multivariate Behavioral Research, 25, 81-87.
68. McDonald, R.P., & Marsh, H.W. (1990). Choosing a multivariate model: Noncentrality and goodness-offit. Psychological Bulletin, 107, 247-255.
69. McIntosh, C. (2007). Rethinking fit assessment in structural equation modelling: A commentary and elaboration on Barrett (2007). Personality and Individual Differences, 42, 859-857.
70. Miles, J., & Shevlin, M. (2007). A time and a place for incremental fit indices. Personality and Individual Differences, 42, 869-874.
71. Mulaik, S.A. (1972). The foundations of factor analysis. New York, NY: McGraw-Hill.
72. Muthén, B. (2010). Bayesian analysis in Mplus: A brief introduction. (Technical Report). Version 3. Retrieved fromhttp://www.statmodel.com/download/IntroBayesVersion%203.pdf.
73. Muthén, B., & Asparouhov, T. (2010, September). Bayesian SEM: A more flexible representation of substantive theory. Submitted for publication. Retrieved fromhttp://www.statmodel.com/download/BSEMv4.pdf.
74. Muthén, L.K., & Muthén, B.O. (1998-2010). Mplus user's guide. Los Angeles: Muthén & Muthén.
75. Muthén, L.K., & Muthén, B.O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 4, 599-620.
76. Oberski, D.L. (2009). Jrule for Mplus version 0.91 [computer software]. Retrieved fromhttp://wiki.github.com/daob/JruleMplus/.
77. O'Connor, B.P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, & Computers, 32, 396-402.
78. Preacher, K.J., & Maccallum, R.C. (2003). Repairing Tom Swift's electric factor analysis machine. Understanding Statistics, 2, 13-43.
79. R Development Core Team. (2010). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
80. Rhemtulla, M., Brosseau-Liard, P., & Savalei, V. (2010). How many categories is enough to treat data as continuous? A comparison of robust continuous and categorical SEM estimation methods under a range of non-ideal situations. Retrieved fromhttp://www.2.psych.ubc.ca/~mijke/files/HowManyCategories.pdf.
81. Roberts, N., & Thatcher, J. (2009). Conceptualizing and testing formative constructs: Tutorial and annotated example. ACM SIGMIS Database archive, 40, 9-39.
82. Russell, D. (2002). In search of underlying dimensions: the use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and social psychology bulletin, 28, 1629-1646.
83. Saris, W.E., Satorra, A., & van der Veld, W. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling, 16, 561-582.
84. Sass, D.A., & Schmitt, T.A. (2010). A Comparative investigation of rotation criteria within exploratory factor analysis. Multivariate Behavioral Research, 45, 1-33.
85. Satorra, A., & Saris, W.E. (1985). Power of the likelihood ratio test in covariance structure analysis. Psychometrika, 50, 83-89.
86. Scheines, R., Spirtes, P., Glymour, C., Meek, C., & Richardson, T. (1998). The TETRAD project: Constraint-based aids to causal model specification. Multivariate Behavioral Research, 33, 65-117.
87. Schmitt, T.A., & Sass, D.A. (2011). Rotation criteria and hypothesis testing for exploratory factor analysis: Implications for factor pattern loadings and interfactor correlations. Educational and Psychological Measurement, 71, 95-113.
88. Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington, DC: American Psychological Association.
89. Thompson, B., & Daniel, L.G. (1996). Factor analytic evidence for the construct validity of scores: A historical overview and some guidelines. Educational and Psychological Measurement, 56, 197-208.
90. Van der Veld, W., Saris, W.E., & Satorra, A. (2008). Jrule 2.0: User manual (Unpublished Manuscript, Internal Report). Radboud University Nijmegen, the Netherlands.
91. Vernon, T., & Eysenck, S. (2007). Introduction to special issue on Structural Equation Modeling. Personality and Individual Differences, 42, 813.
92. Widaman, K.F. (2007). Common factors versus components: Principals and principles, errors and misconceptions. In R. Cudeck & R. C. MacCallum (Eds.), Factor analysis at 100: Historical developments and future directions (pp. 177-203). Mahwah, NJ: Lawrence Erlbaum.
93. Worthington, R.W., & Whittaker, T.A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34, 806-838.
94. Yu, C.H., Popp, S.O., DiGangi, S., & Jannasch-Pennell, A. (2007). Assessing unidimensionality: A comparison of Rasch Modeling, Parallel Analysis, and TETRAD. Practical Assessment, Research, and Evaluation, 12. Retrieved fromhttp://pareonline.net/pdf/v12n14.pdf.
95. Yu, C.Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. Doctoral dissertation, University of California, Los Angeles.
96. Yuan, K.H., & Bentler, P.M. (2004). On chi-square difference and z-tests in mean and covariance structure analysis when the base model is misspecified. Educational and Psychological Measurement, 64, 737-757.
97. Yuan, K.-H., & Hayashi, K. (2003). Bootstrap approach to inference and power analysis based on three statistics for covariance structure models. British Journal of Mathematical and Statistical Psychology, 56, 93-110.
98. Zwick, W.R., & Velicer, W.F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432-442.