Component Analysis versus Common Factor Analysis: Some Further Observations

Multivariate Behavioral Research

Volumn 25, Issue 1, 1990, Pages 97-114

  Velicer, Wayne F ^a   Jackson, Douglas N ^b  

^a UNIVERSITY OF RHODE ISLAND   (United States)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 45749136205     PISSN: 00273171     EISSN: 15327906     Source Type: Journal    
DOI: 10.1207/s15327906mbr2501_12     Document Type: Article

References (83)

1. Allan, S. J., & Hubbard, R. (1986), Regression equations for the latent roots of random data correlation matrices with unities on the diagonal. Multivariate Behavioral Research, 21, 393–398.
2. Anderson, J. C., & Gerbing, D. W. (1984), The effect of sampling error on convergence, improper solutions, and factor analysis. Psychometrika, 49, 155–173.
3. Anderson, T. W. & Rubin, H. (1956), Statistical inference in factor analysis. Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, 5.
4. Bartholomew, D. J. (1981), Posterior analysis of the factor model. British Journal of Mathematical and Statistical Psychology, 38, 127–128.
5. Bentler, P. M. (1976), Multistructure statistical model applied to factor analysis. Multivariate Behavioral Research, 11, 3–25.
6. Bentler, P. M. & Mooijaart, A. (1989), Choice of structural model via parsimony: A rationale based on precision. Psychological Bulletin, 106, 315–317.
7. Bentler, P. M. & Kano, Y. (1990), On the equivalence of factors and components. Multivariate Behavioral Research, 25, 67–74.
8. Bentler, P. M. & Lee, S. Y. (1979), A statistical development of three-mode factor analysis. British Journal of Mathematical and Statistical Psychology, 32, 87–104.
9. Bookstein, F. L. (1990), Least squares and latent variables. Multivariate Behavioral Research, 25, 75–80.
10. Borgatta, E. F. (1989), A note on using factor analysis and other procedures in research: A reply to Wilkinson. Sociological Methods & Research, 17, 460–464.
11. Borgatta, E. F., Kercher, K., & Stull, D. E. (1986), A cautionary note on the use of principal components analysis. Sociological Methods & Research, 17, 160–168.
12. Burkett, G. R. (1964), A study of reduced rank models for multiple prediction. Psychometric Monographs, No. 12.
13. Cliff, N. (1988), The eigenvalues-greater-than-one rule and the reliability of components. Psychological Bulletin, 103, 276–279.
14. Cliff, N. & Krus, D. J. (1976), Interpretation of canonical analysis. Rotated vs. unrotated solutions. Psychometrika, 41, 35–42.
15. Dillon, W. R., Kumar, A., & Mulani, N. (1987), Offending estimates in covariance structure analysis: Comments on the causes of and solutions to Heywood cases. Psychological Bulletin, 101, 126–135.
16. Van Driel, O. P. (1978), On various causes of improper solutions in maximum likelihood factor analysis. Psychometrika, 43, 225–243.
17. Eckart, C. & Young, G. (1936), The approximation of one matrix by another of lower rank. Psychometrika, 1, 211–218.
18. Fava, J. L., & Velicer, W. F. (in press). An empirical comparison of factor, image, component. and scale scores. Multivariate Behavioral Research.
19. Gerbing, D. W., & Anderson, J. C. (1985), The effects of sampling error and model characteristics on parameter estimation for maximum likelihood confirmatory factor analysis. Multivariate Behavioral Research, 20, 255–271.
20. Gleason, T. C. & Staelin, R. (1973), Improving the metric quality of questionnaire data. Psychometrika. 38, 393–410.
21. Gorsuch, R. L. (1990), Common factor analysis versus component analysis: Some well and little known facts. Multivariate Behavioral Research, 25, 33–39.
22. Guadagnoli, E., & Velicer, W. F. (1988), The relationship of sample size to the stability of patterns: A simulation study. Psychological Bulletin, 103, 265–275.
23. Guttman, L. (1953), Image theory for the structure of quantitative variates. Psychometrika, 18. 277–296.
24. Guttman, L. (1958), To what extent can communalities reduce rank? Psychometrika. 23. 297–308.
25. Hakstian, A. R., Rogers, W. T., & Cattell, R. B. (1982), The behavior of number-of-factors rules with simulated data. Multivariate Behavioral Research, 17. 193–219.
26. Harman, H. H., & Fukuda. Y. (1966), Resolution of the Heywood case in the minres solution. Psychometrika, 31, 563–571.
27. Harris, C. W. (1962), Some Rao-Guttman relationships. Psychometrika, 27, 247–263.
28. Hays, R. D. (1987), PARALLEL: A program for performing parallel analysis. Applied Psychological Measurement, 11, 58.
29. Holden, R. R., Longman, R. S., Cota, A. A., & Fekken, G. C. (1989), PAR: Parallel analysis routine for random data eigenvalue estimation. Applied Psychological Measurement, 13. 192.
30. Horn, J. L. (1965), A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179–185.
31. Horst, P. (1961), Relations among m sets of measures. Psychometrika, 26, 129–149.
32. Horst, P. (1965), Factor analysis of data matrices. New York: Holt. Rinehart & Winston.
33. Howe, W. G. (1955). Some contributions to factor analysis. Oak Ridge. TN: Oak Ridge National Laboratory.
34. Hubbard, R. & Allan, S. J. (1987), A cautionary note on the use of principal components analysis: Supportive empirical evidence. Sociological Methods and Research. 16. 301–308.
35. Hubbard, R. & Allan, S. J. (1989), Differences in empirical results using principal components and factor analysis. A reply to Wilkinson. Sociological Methods and Research, 17. 465–466.
36. Jackson, D. N. (1975), Multimethod factor analysis: A reformulation. Multivariate Behavioral Research, 10, 259–275.
37. Jackson, D. N. (1977), Jackson Vocational Interest Survey Manual. Port Huron, Michigan: Research Psychologists Press.
38. Jackson, D. N. & Chan, D. W. (1980), Maximum-likelihood estimation in common factor analysis: A cautionary note. Psychological Bulletin. 88, 502–508.
39. Jackson, D. N. & Helmes, E. (1979), Basic structure content scaling. Applied Psychological Measurement. 3. 313–325.
40. Jackson, D. N. & Williams, D. R. (1975), Occupational classification in terms of interest patterns. Journal of Vocational Behavior, 6, 269–280.
41. Jolliffe, I. T. (1986). Principal component analysis. New York: Springer-Verlag.
42. Jöreskog, K. G. (1967), Some contributions to maximum likelihood factor analysis. Psychometrika, 32, 443–482.
43. Kaiser, H. F. (1960), The application of electric computers to factor analysis. Educational and Psychological Measurement, 20, 141–151.
44. Kaiser, H. F. (1963), Image analysis. In C.W. Harris (Ed.), Problems in Measuring Change (pp. 156–166). Madison: The University of Wisconsin Press.
45. Kroonenberg, P. M. (1983), Three-mode principal components analysis. DSWO Press: Leiden.
46. Lautenschlager, G. J. (1989a), A comparison of alternatives to conducting Monte Carlo analysis for determining parallel analysis criteria. Multivariate Behavioral Research. 24, 365–395.
47. Lautenschlager, G. J. (1989b), PARANAL.TOK: A program for developing parallel analysis criteria. Applied Psychological Measurement, 13, 176.
48. Lautenschlager, G. J., Lance, C. E., & Flaherty, V. L. (1989), Parallel analysis criteria: Revised regression equations for estimating the latent roots of random data correlation matrices. Educational and Psychological Measurement, 49, 339–345.
49. Lawley, D. N. (1940), The estimation of factor loadings by the method of maximum likelihood. Proceedings of the Royal Society of Edinburgh, 60, 64–82.
50. Lawley, D. N. (1941), Further investigation in factor estimation. Proceedings of the Royal Society of Edinburgh, 61, 176–185.
51. Lilly, R. S., Hoaglin, A., & Anderson-Kulman, R. A. (1989), The use of factor analysis in published psychological research. Paper presented at the 97th Annual Meeting of the American Psychological Association, New Orleans.
52. Loehlin, J. C. (1990), Component analysis versus common factor analysis: A case of disputed authorship. Multivariate Behavioral Research, 25, 29–31.
53. Longman, R. S., Cota, A. A., Holden, R. R., & Fekken, G. C. (1989), A regression equation for the parallel analysis criterion in principal component analysis: Mean and 95th percentile eigenvalues. Multivariate Behavioral Research, 24, 59–69.
54. Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988), Goodness-of-fit indices in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103, 391–410.
55. McArdle, J. J. (1990), Principles versus principals of structural factor analysis. Multivariate Behavioral Research, 25. 81–87.
56. Meredith, W. (1964), Notes on factorial invariance. Psychometrika, 29, 177–185.
57. Meredith, W., & Millsap, R. E. (1985), On component analysis. Psychometrika, 50, 495–507.
58. Meredith, W., & Millsap, R. E. (1988), Components analysis in cross-sectional and longitudinal data. Psychometrika, 53, 123–134.
59. Mulaik, S. A. (1990), Blurring the distinctions between component analysis and common factor analysis. Multivariate Behavioral Research, 25, 53–59.
60. Mulaik, S. A., Van James, L. R., Alstine, J., Bennett, N., Lind, S., & Stilwell, C. D. (1989), Evaluation of goodness-of-fit indices for structural equation models. Psychological Bulletin, 105, 430–445.
61. Rao, C. R. (1955), Estimation and tests of significance in factor analysis. Psychometrika, 20, 92–111.
62. Rozeboom, W. W. (1990), Whatever happened to broad perspective? Multivariate Behavioral Research, 25, 61–65.
63. Schönemann, P. H. (1990), Facts, fictions, and common sense about factors and components. Multivariate Behavioral Research, 25, 47–51.
64. Skinner, H. A., Jackson, D. N., & Hoffmann, H. (1974), Alcoholic personality types: Identification and correlates. Journal of Abnormal Psychology, 83, 658–666.
65. Snook, S. C., & Gorsuch, R. L. (1989), Principal component analysis versus common factor analysis: A monte carlo study. Psychological Bulletin, 106, 148–154.
66. Steiger, J. H. (1987, October). R.M.S. confidence intervals for goodness of fit in the analysis of covariance structures. Paper presented at the annual meeting of the Society for Multivariate Experimental Psychology, Vancouver, B.C., Canada.
67. Steiger, J. H. (1990), Some additional thoughts on components, factors, and factor indeterminacy. Multivariate Behavioral Research, 25, 41–45.
68. Tucker, L. R. (1966), Some mathematical notes on three-mode factor analysis. Psychometrika. 31. 279–311.
69. Velicer, W. F. (1974), A comparison of the stability of factor analysis, principal component analysis, and rescaled image analysis. Educational and Psychological Measurement. 34. 563–572.
70. Velicer, W. F. (1976a), Determining the number of components from the matrix of partial correlations. Psychometrika, 41, 321–327.
71. Velicer, W. F. (1976b), The relation between factor score estimates, image scores, and principal component scores. Educational and Psychological Measurement, 36. 149–159.
72. Velicer, W. F. (1977), An empirical comparison of the similarity of principal component. image, and factor patterns. Multivariate Behavioral Research, 12, 3–22.
73. Velicer, W. F., & Fava, J. L. (1987), An evaluation of the effects of variable sampling on component, image, and factor analysis. Multivariate Behavioral Research. 22. 193–210.
74. Velicer, W. F., & Fava, J. L. (1990), The effects of variable and subject sampling on factor pattern recovery. Manuscript under review.
75. Velicer, W. F., & Jackson, D. N. (1990), Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research. 25. 1–28.
76. Velicer, W. F., Peacock. A. C., & Jackson. D. N. (1982), A comparison of component and factor patterns: A Monte Carlo approach. Multivariate Behavioral Research. 17. 371–388.
77. Widaman, K. F. (1990), Bias in pattern loadings represented by common factor analysis and component analysis. Multivariate Behavioral Research. 25, 89–95.
78. Wilkinson, L. (1989a), A cautionary note on the use of factor analysis: A response to Borgatta. Kercher, and Stull and Hubbard and Allen. Sociological Methods & Research, 17. 449–459.
79. Wilkinson, L. (1989b), b Evanston, II: SYSTAT. Inc.
80. Williams, J. S. (1978), A definition for the common factor analysis model and the elimination of problems of factor analysis. Psychometrika. 43. 293–306.
81. Winer, B. J. (1971), Statistical principles in experimental design (2nd Ed.). New York: McGraw-Hill.
82. Zwick, W. R. & Velicer, W. F. (1982), Factors influencing four rules for determining the number of components to retain. Multivariate Behavioral Research. 17. 253–269.
83. Zwick, W. R. & Velicer, W. F. (1986), A comparison of five rules for determining the number of components to retain. Psychological Bulletin. 99. 432–442.