Incorporating Uncertainty Into Parallel Analysis for Choosing the Number of Factors via Bayesian Methods

Educational and Psychological Measurement

Volumn 81, Issue 3, 2021, Pages 466-490

  Levy, Roy ^a   Xia, Yan ^b   Green, Samuel B ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Bayesian analysis; dimensionality assessment; exploratory factor analysis; parallel analysis

Indexed keywords

EID: 85088368099     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164420942806     Document Type: Article

References (39)

1. Auerswald M., Moshagen M., (2019). How to determine the number of factors to retain in exploratory factor analysis: A comparison of extraction methods under realistic conditions. Psychological Methods, 24(4), 468-491. https://doi.org/10.1037/met0000200
2. Bhattacharya A., Dunson D. B., (2011). Sparse Bayesian infinite factor models. Biometrika, 98(2), 291-306. https://doi.org/10.1093/biomet/asr013
3. Bozdogan H., Shigemasu K., (1998). Bayesian factor analysis model and choosing the number of factors using a new informational complexity criterion. In Rizzi A., Vichi M., Bock H. H., (Eds.), Advances in data science and classification. Studies in classification, data analysis, and knowledge organization (pp. 335-342). Springer. https://doi.org/10.1007/978-3-642-72253-0_45
4. Buja A., Eyuboglu N., (1992). Remarks on parallel analysis. Multivariate Behavioral Research, 27(4), 509-540. https://doi.org/10.1207/s15327906mbr2704_2
5. Conti G., Frühwirth-Schnatter S., Heckman J. J., Piatek R., (2014). Bayesian exploratory factor analysis. Journal of Econometrics, 183(1), 31-57. https://doi.org/10.1016/j.jeconom.2014.06.008
6. Conway J. M., Huffcutt A. I., (2003). A review and evaluation of exploratory factor analysis practices in organizational research. Organizational research methods, 6(2), 147-168. https://doi.org/10.1177/1094428103251541
7. Crawford A., Green S. B., Levy R., Lo W-J, Scott L, Svetina D., Thompson M. S., (2010). Evaluation of parallel analysis methods for determining the number of factors. Educational and Psychological Measurement, 70(6), 885-901. https://doi.org/10.1177/0013164410379332
8. DiStefano C., Hess B., (2005). Using confirmatory factor analysis for construct validation: An empirical review. Journal of Psychoeducational Assessment, 23(3), 225-241. https://doi.org/10.1177/073428290502300303
9. Fabrigar L. R., Wegener D. T., MacCallum R. C., Strahan E. J., (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272-299. https://doi.org/10.1037/1082-989X.4.3.272
10. Ford J. K., MacCallum R. C., Tait M., (1986). The applications of exploratory factor analysis in applied psychology: A critical review and analysis. Personnel Psychology, 39(2), 291-314. https://doi.org/10.1111/j.1744-6570.1986.tb00583.x
11. Gelman A., Meng X. L., Stern H., (1996). Posterior predictive assessment of model fitness via realized discrepancies. Statistica Sinica, 6(4), 733-807. https://www.jstor.org/stable/24306036
12. Geweke J., Zhou G., (1996). Measuring the pricing error of the arbitrage pricing theory. Review of Financial Studies, 9(2), 557-587. https://doi.org/10.1093/rfs/9.2.557
13. Glorfeld L. W., (1995). An improvement on Horn’s parallel analysis methodology for selecting the correct number of factors to retain. Educational and Psychological Measurement, 55(3), 377-393. https://doi.org/10.1177/0013164495055003002
14. Green S. B., Levy R., Thompson M. S., Lu M., Lo W.-J., (2012). A proposed solution to the problem with using completely random data to assess the number of factors with parallel analysis. Educational and Psychological Measurement, 72(3), 357-374. https://doi.org/10.1177/0013164411422252
15. Green S. B., Redell N., Thompson M. S., Levy R., (2016). Accuracy of revised and traditional parallel analyses for assessing dimensionality with binary data. Educational and Psychological Measurement, 76(1), 5-21. https://doi.org/10.1177/0013164415581898
16. Green S. B., Thompson M. S., Levy R., Lo W.-J., (2015). Type I and II error rates and overall accuracy of the revised parallel analysis method for determining the number of factors. Educational and Psychological Measurement, 75(3), 428-457. https://doi.org/10.1177/0013164414546566
17. Green S. B., Xu Y., Thompson M. S., (2017). Relative accuracy of two parallel analysis methods that use the proper reference distribution. Educational and Psychological Measurement, 78(4), 589-604. https://doi.org/10.1177/0013164417718610
18. Harshman R. A., Reddon J. R., (1983, May). Determining the number of factors by comparing real with random data: A serious flaw and some possible corrections [Paper presentation]. Annual meeting of the Classification Society of North America, Philadelphia, PA, United States.
19. Hayton J. C., Allen D. G., Scarpello V., (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2), 191-205. https://doi.org/10.1177/1094428104263675
20. Holzinger K. J., Swineford E., (1939). A study in factor analysis: The stability of a bi-factor solution. Supplementary educational monographs. University of Chicago.
21. Humphreys L. G., Ilgen D. R., (1969). Note on a criterion for the number of common factors. Educational and Psychological Measurement, 29(3), 571-578. https://doi.org/10.1177/001316446902900303
22. Kaufmann S., Schumacher C., (2019). Bayesian estimation of sparse dynamic factor models with order-independent and ex-post mode identification. Journal of Econometrics, 210(1), 116-134. https://doi.org/10.1016/j.jeconom.2018.11.008
23. Kelley K., (2019). MBESS: The MBESS R Package (Version R package Version 4.6.0). https://CRAN.R-project.org/package=MBESS
24. Kruschke J. K., Liddell T. M., (2018). The Bayesian new statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective. Psychonomic Bulletin & Review, 25(1), 178-206. https://doi.org/10.3758/s13423-016-1221-4
25. Lee S.-Y., Song X.-Y., (2002). Bayesian selection on the number of factors in a factor analysis model. Behaviormetrika, 29(1), 23-39. https://doi.org/10.2333/bhmk.29.23
26. Levy R., (2011). Bayesian data-model fit assessment for structural equation modeling. Structural Equation Modeling, 18(4), 663-685. https://doi.org/10.1080/10705511.2011.607723
27. Levy R., Mislevy R. J., (2016). Bayesian psychometric modeling. Chapman & Hall/CRC Press. https://doi.org/10.1201/9781315374604
28. Lim S., Jahng S., (2019). Determining the number of factors using parallel analysis and its recent variants. Psychological Methods, 24(4), 452-467. https://doi.org/10.1037/met0000230
29. Martin A. D., Quinn K. M., Park J. H., (2011). MCMCpack: Markov chain Monte Carlo in R. Journal of Statistical Software, 42(9), 1-21. https://doi.org/10.18637/jss.v042.i09
30. Muthén B., Asparouhov T., (2012). Bayesian structural equation modeling: A more flexible representation of substantive theory. Psychological Methods, 17(3), 313-335. https://doi.org/10.1037/a0026802
31. Preacher K. J., MacCallum R. C., (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics, 2(1), 13-43. https://doi.org/10.1207/S15328031US0201_02
32. Press S. J., Shigemasu K., (1999). A note on choosing the number of factors. Communications in Statistics—Theory and Methods, 28(7), 1653-1670. https://doi.org/10.1080/03610929908832378
33. Reise S. P., (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667-696. https://doi.org/10.1080/00273171.2012.715555
34. Rijmen F., (2010). Formal relations and an empirical comparison among the bi-factor, the testlet, and a second-order multidimensional IRT model. Journal of Educational Measurement, 47(3), 361-372. https://doi.org/10.1111/j.1745-3984.2010.00118.x
35. Ročková V., George E. I., (2016). Fast Bayesian factor analysis via automatic rotations to sparsity. Journal of the American Statistical Association, 111(516), 1608-1622. https://doi.org/10.1080/01621459.2015.1100620
36. Timmerman M. E., Lorenzo-Seva U., (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods, 16(2), 209-220. https://doi.org/10.1037/a0023353
37. Turner N. E., (1998). The effect of common variance and structure pattern on random data eigenvalues: Implications for the accuracy of parallel analysis. Educational and Psychological Measurement, 58(4), 541-556. https://doi.org/10.1177/0013164498058004001
38. Xia Y, Green S. B., Xu Y., Thompson M. S., (2018). Proportion of indicator common variance due to a factor as an effect size statistic in revised parallel analysis. Educational and Psychological Measurement, 79(1), 85-107. https://doi.org/10.1177/0013164418754611
39. Zwick W. R., Velicer W. F., (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432-442. https://doi.org/10.1037/0033-2909.99.3.432