Dimensionality assessment of ordered polytomous items with parallel analysis

Psychological Methods

Volumn 16, Issue 2, 2011, Pages 209-220

  Timmerman, Marieke E ^a   Lorenzo Seva, Urbano ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b UNIVERSITAT ROVIRA I VIRGILI   (Spain)

Author keywords

Exploratory factor analysis; Minimum rank factor analysis; Number of common factors; Polychoric correlation; Principal component analysis; Tetrachoric correlation

Indexed keywords

ARTICLE; FACTORIAL ANALYSIS; HUMAN; MATHEMATICAL COMPUTING; METHODOLOGY; PRINCIPAL COMPONENT ANALYSIS; PSYCHOLOGY; RESEARCH; SAMPLE SIZE; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS;

DATA INTERPRETATION, STATISTICAL; FACTOR ANALYSIS, STATISTICAL; HUMANS; MATHEMATICAL COMPUTING; MODELS, STATISTICAL; PRINCIPAL COMPONENT ANALYSIS; PSYCHOLOGY; RESEARCH; RESEARCH DESIGN; SAMPLE SIZE; STATISTICS AS TOPIC;

EID: 79958855301     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0023353     Document Type: Article

References (63)

1. Allen S.J., Hubbard R. Regression equations for the latent roots of random data correlation matrices with unities on the diagonal. Multivariate Behavioral Research 1986, 21:393-396. doi: 10.1207/s15327906mbr2103_7.
2. Babakus E., Ferguson C.E., Jöreskog K.G. The sensitivity of confirmatory maximum likelihood factor analysis to violations of measurement scale and distributional assumptions. Journal of Marketing Research 1987, 24:222-228. doi: 10.2307/3151512.
3. Bartlett M.S. Tests of significance in factor analysis. British Journal of Psychology 1950, 3:77-85.
4. Becker P. Beyond the big five. Personality and Individual Differences 1999, 26:511-530. doi: 10.1016/S0191-8869(98)00168-8.
5. Bernstein I.H., Teng G. Factoring items and factoring scales are different: Spurious evidence for multidimensionality due to item categorization. Psychological Bulletin 1989, 105:467-477. doi: 10.1037/0033-2909.105.3.467.
6. Bonett D.G., Price R.M. Inferential methods for the tetrachoric correlation coefficient. Journal of Educational and Behavioral Statistics 2005, 30:213-225. doi: 10.3102/10769986030002213.
7. Borsboom D. The attack of the psychometricians. Psychometrika 2006, 71:425-440. doi: 10.1007/s11336-006-1447-6.
8. Browne M.W., Cudeck R. Alternative ways of assessing model fit. Sociological Methods & Research 1992, 21:230-258. doi: 10.1177/0049124192021002005.
9. Buja A., Eyuboglu N. Remarks on parallel analysis. Multivariate Behavioral Research 1992, 27(4):509-540. doi: 10.1207/s15327906mbr2704_2.
10. Cattell R.B. The scree test for the number of factors. Multivariate Behavioral Research 1966, 1:245-276. doi: 10.1207/s15327906mbr0102_10.
11. Cho S., Li F., Bandalos D. Accuracy of the parallel analysis procedure with polychoric correlations. Educational and Psychological Measurement 2009, 69:748-759. doi: 10.1177/0013164409332229.
12. Cota A.A., Longman R.S., Holden R.R., Fekken G.C. Comparing different methods for implementing parallel analysis: A practical index of accuracy. Educational and Psychological Measurement 1993, 53:865-876. doi: 10.1177/0013164493053004001.
13. Cota A.A., Longman R.S., Holden R.R., Fekken G.C., Xinaris S. Interpolating 95th percentile eigenvalues from random data: An empirical example. Educational and Psychological Measurement 1993, 53:585-596. doi: 10.1177/0013164493053003001.
14. De Raad B., Barelds D.P.H. A new taxonomy of Dutch personality traits based on a comprehensive and unrestricted list of descriptors. Journal of Personality and Social Psychology 2008, 94:347-364. doi: 10.1037/0022-3514.94.2.347.
15. Devlin S.J., Gnanadesikan R., Kettenring J.R. Robust estimation and outlier detection with correlation coefficients. Biometrika 1975, 62:531-545. doi: 10.1093/biomet/62.3.531.
16. Devlin S.J., Gnanadesikan R., Kettenring J.R. Robust estimation of dispersion matrices and principal components. Journal of the American Statistical Association 1981, 76:354-362. doi: 10.2307/2287836.
17. Dinno A. Exploring the sensitivity of Horn's parallel analysis to the distributional form of random data. Multivariate Behavioral Research 2009, 44:362-388. doi: 10.1080/00273170902938969.
18. Dolan C.V. Factor analysis of variables with 2, 3, 5 and 7 response categories: A comparison of categorical variable estimators using simulated data. British Journal of Mathematical and Statistical Psychology 1994, 47:309-326.
19. Fabrigar L.R., Wegener D.T., MacCallum R.C., Strahan E.J. Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods 1999, 4:272-299. doi: 10.1037/1082-989X.4.3.272.
20. Finch H., Monahan P. A bootstrap generalization of modified parallel analysis for IRT dimensionality assessment. Applied Measurement in Education 2008, 21:119-140. doi: 10.1080/08957340801926102.
21. Glorfeld L.W. An improvement on Horn's parallel analysis methodology for selecting the correct number of factors to retain. Educational and Psychological Measurement 1995, 55:377-393. doi: 10.1177/0013164495055003002.
22. Hattie J.A. Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement 1985, 9:139-164. doi: 10.1177/014662168500900204.
23. Hayton J.C., Allen D.G., Scarpello V. Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods 2004, 7:191-205. doi: 10.1177/1094428104263675.
24. Horn J.L. A rationale and test for the number of factors in factor analysis. Psychometrika 1965, 30:179-185. doi: 10.1007/BF02289447.
25. Hubbard R., Allen S. An empirical comparison of alternative methods for principal component extraction. Journal of Business Research 1987, 15:173-190. doi: 10.1016/0148-2963(84)90047-X.
26. Humphreys L.G., Ilgen D.R. Note on a criterion for the number of common factors. Educational and Psychological Measurement 1969, 29:571-578. doi: 10.1177/001316446902900303.
27. Humphreys L.G., Montanelli R.G. An investigation of the parallel analysis criterion for determining the number of common factors. Multivariate Behavioral Research 1975, 10:193-205. doi: 10.1207/s15327906mbr1002_5.
28. Kaiser H.F. The application of electronic computers to factor analysis. Educational and Psychological Measurement 1960, 20:141-151. doi: 10.1177/001316446002000116.
29. Lautenschlager G.J. A comparison of alternatives to conducting Monte Carlo analyses for determining parallel analysis criteria. Multivariate Behavioral Research 1989, 24:365-395. doi: 10.1207/s15327906mbr2403_6.
30. Lautenschlager G.J., Lance C.E., Flaherty V.L. Parallel analysis criteria: Revised equations for estimating the latent roots of random data correlation matrices. Educational and Psychological Measurement 1989, 49:339-345. doi: 10.1177/0013164489492006.
31. Ledesma R.D., Valero-Mora P. Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Practical Assessment, Research, and Evaluation 2007, 12:1-11.
32. Lee S., Poon W., Bentler P.M. Full maximum likelihood analysis of structural equation models with polytomous variables. Statistics & Probability Letters 1990, 9:91-97. doi: 10.1016/0167-7152(90)90100-L.
33. Liu O.L., Rijmen F. A modified procedure for parallel analysis for ordered categorical data. Behavior Research Methods, Instruments, & Computers 2008, 40:556-562. doi: 10.3758/BRM.40.2.556.
34. Longman R.S., Cota A.A., Holden R.R., Fekken G.C. A regression equation for the parallel analysis criterion in principal components analysis: Mean and 95th percentile eigenvalues. Multivariate Behavioral Research 1989, 24:59-69. doi: 10.1207/s15327906mbr2401_4.
35. Lorenzo-Seva U., Ferrando P.J. FACTOR: A computer program to fit the exploratory factor analysis model. Behavior Research Methods, Instruments, & Computers 2006, 38:88-91. doi: 10.3758/BF03192753.
36. MacCallum R.C., Tucker L.R. Representing sources of error in the common-factor model: Implications for theory and practice. Psychological Bulletin 1991, 109:502-511. doi: 10.1037/0033-2909.109.3.502.
37. Mokken R.J. A theory and procedure of scale analysis: With applications in political research 1971, Mouton, The Hague, the Netherlands.
38. Montanelli R.G., Humphreys L.G. Latent roots of random data correlation matrices with squared multiple correlations on the diagonal: A Monte Carlo study. Psychometrika 1976, 41:341-348. doi: 10.1007/BF02293559.
39. Muthén B., Kaplan D. A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology 1985, 38(2):171-189.
40. Muthén L.K., Muthén B.O. Mplus user's guide 1998-2010, Authors, Los Angeles, CA. 6th ed.
41. O'Connor B.P. SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, & Computers 2000, 32:396-402. doi: 10.3758/BF03200807.
42. Olsson U. Maximum likelihood estimation of the polychoric correlation coefficient. Psychometrika 1979, 44:443-460. doi: 10.1007/BF02296207.
43. Olsson U. On the robustness of factor analysis against crude classification of the observations. Multivariate Behavioral Research 1979, 14:485-500. doi: 10.1207/s15327906mbr1404_7.
44. Pearson K. On lines and planes of closest fit to systems of points in space. Philosophical Magazine 1901, 2:559-572.
45. Peres-Neto P.R., Jackson D.A., Somers K.M. How many principal components? Stopping rules for determining the number of non-trivial axes revisited. Computational Statistics & Data Analysis 2005, 49:974-997. doi: 10.1016/j.csda.2004.06.015.
46. R: A language and environment for statistical computing (Reference Index Version 2.x.x) [Computer software] 2005, R Development Core Team, R Foundation for Statistical Computing, Vienna, Austria.
47. Reddon J.R., Marceau R., Jackson D.N. An application of singular value decomposition to the factor analysis of MMPI items. Applied Psychological Measurement 1982, 6(3):275-283. doi: 10.1177/014662168200600303.
48. Roznowski M., Tucker L.R., Humphreys L.G. Three approaches to determining the dimensionality of binary items. Applied Psychological Measurement 1991, 15:109-127. doi: 10.1177/014662169101500201.
49. Sijtsma K., Molenaar I.W. Introduction to nonparametric item response theory 2002, Sage, Thousand Oaks, CA.
50. Stata (Version 11) [Computer software] 2009, StataCorp, College Station, TX.
51. Steger M.F. An illustration of issues in factor extraction and identification of dimensionality in psychological assessment data. Journal of Personality Assessment 2006, 86:263-272. doi: 10.1207/s15327752jpa8603_03.
52. Stuive I., Kiers H.A.L., Timmerman M.E., ten Berge J.M.F. The empirical verification of an assignment of items to subtests: The oblique multiple group method versus the confirmatory common factor method. Educational and Psychological Measurement 2008, 68:923-939. doi: 10.1177/0013164408315264.
53. Takane Y., de Leeuw J. On the relationship between item response theory and factor analysis of discretized variables. Psychometrika 1987, 52:393-408. doi: 10.1007/BF02294363.
54. ten Berge J.M.F., Kiers H.A.L. A numerical approach to the approximate and the exact minimum rank of a covariance matrix. Psychometrika 1991, 56:309-315. doi: 10.1007/BF02294464.
55. ten Holt J.C., van Duijn M.A.J., Boomsma A. Scale construction and evaluation in practice: A review of factor analysis versus item response theory. Psychological Test and Assessment Modeling 2010, 52:272-297.
56. Thompson B. Exploratory and confirmatory factor analysis: Understanding concepts and applications 2004, American Psychological Association, Washington, DC, doi: 10.1037/10694-000.
57. Tucker L.R., Koopman R.F., Linn R.L. Evaluation of factor analytic research procedures by means of simulated correlation matrices. Psychometrika 1969, 34(4 (Pt. 1)):421-459. doi: 10.1007/BF02290601.
58. Turner N.E. The effect of common variance and structure pattern on random data eigenvalues: Implications for the accuracy of parallel analysis. Educational and Psychological Measurement 1998, 58:541-568. doi: 10.1177/0013164498058004001.
59. Uebersax J. User guide for POLYCORR 1.1 (Advanced version) 2010, Retrieved from http://www.john-uebersax.com/stat/xpc.htm.
60. Velicer W.F., Eaton C.A., Fava J.L. Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. Problems and solutions in human assessment: Honoring Douglas N. Jackson at seventy 2000, 41-71. Kluwer Academic/Plenum, New York, NY. E. Helmes (Ed.).
61. Watkins M. Monte Carlo PCA for parallel analysis [Computer software] 2010, Retrieved from http://www.public.asu.edu/~mwwatkin/Watkins3.html.
62. Weng L., Cheng C. Parallel analysis with unidimensional binary data. Educational and Psychological Measurement 2005, 65:697-716. doi: 10.1177/0013164404273941.
63. Zwick W.R., Velicer W.F. Comparison of five rules for determining the number of components to retain. Psychological Bulletin 1986, 99(3):432-442. doi: 10.1037/0033-2909.99.3.432.