Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research

PLoS ONE

Volumn 12, Issue 6, 2017, Pages

  Golino, Hudson F ^a,b   Epskamp, Sacha ^c  

^a UNIVERSITY OF VIRGINIA   (United States)

^b SALGADO DE OLIVEIRA UNIVERSITY   (Brazil)

^c UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EXPLORATORY RESEARCH; HUMAN; HUMAN EXPERIMENT; SAMPLE SIZE; SIMULATION; ANALYSIS OF VARIANCE; COMPUTER SIMULATION; CONFIDENCE INTERVAL; DATA BASE; PSYCHOMETRY; RESEARCH; STATISTICS; THEORETICAL MODEL;

ANALYSIS OF VARIANCE; COMPUTER SIMULATION; CONFIDENCE INTERVALS; DATABASES AS TOPIC; MODELS, THEORETICAL; PSYCHOMETRICS; RESEARCH; STATISTICS AS TOPIC;

EID: 85020406882     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0174035     Document Type: Article

References (69)

1. Preacher KJ, MacCallum RC. Repairing Tom Swift's electric factor analysis machine. Understanding statistics: Statistical issues in psychology, education, and the social sciences. 2003 Feb 3; 2(1):13-43.
2. Ruscio J, Roche B. Determining the number of factors to retain in an exploratory factor analysis using comparison data of known factorial structure. Psychological assessment. 2012 Jun; 24(2):282. https://doi.org/10.1037/a0025697 PMID: 21966933
3. Velicer WF, Jackson DN. Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate behavioral research. 1990 Jan 1; 25(1):1-28. https://doi.org/10.1207/s15327906mbr2501-1 PMID: 26741964
4. James G, Witten D, Hastie T, Tibshirani R. An introduction to statistical learning. New York: springer; 2013 Feb 11.
5. Friedman J, Hastie T, Tibshirani R. The elements of statistical learning. Springer, Berlin: Springer series in statistics; 2001.
6. Guttman L. Some necessary conditions for common-factor analysis. Psychometrika. 1954 Jun 1; 19 (2):149-61.
7. Kaiser HF. The application of electronic computers to factor analysis. Educational and psychological measurement. 1960, 20:141-151.
8. Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965 Jun 1; 30 (2):179-85.
9. Velicer WF. Determining the number of components from the matrix of partial correlations. Psychometrika. 1976 Sep 1; 41(3):321-7.
10. Schwarz G. Estimating the dimension of a model. The annals of statistics. 1978; 6(2):461-4.
11. Chen J, Chen Z. Extended Bayesian information criteria for model selection with large model spaces. Biometrika. 2008 Sep 1; 95(3):759-71.
12. Revelle W, Rocklin T. Very simple structure: An alternative procedure for estimating the optimal number of interpretable factors. Multivariate Behavioral Research. 1979 Oct 1; 14(4):403-14. https://doi.org/10.1207/s15327906mbr1404-2 PMID: 26804437
13. Lauritzen SL. Graphical models. Clarendon Press; 1996 May 2.
14. Friedman J, Hastie T, Tibshirani R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008 Jul 1; 9(3):432-41. https://doi.org/10.1093/biostatistics/kxm045 PMID: 18079126
15. Foygel R, Drton M. Extended Bayesian information criteria for Gaussian graphical models. In Advances in neural information processing systems 2010 (pp. 604-612).
16. Golino, HF. EGA package. Available at github.com/hfgolino/EGA.
17. Garrido LE, Abad FJ, Ponsoda V. Are fit indices really fit to estimate the number of factors with categorical variables? Some cautionary findings via Monte Carlo simulation. Psychological methods. 2016 Mar; 21(1):93. https://doi.org/10.1037/met0000064 PMID: 26651983
18. Keith TZ, Caemmerer JM, Reynolds MR. Comparison of methods for factor extraction for cognitive testlike data: Which overfactor, which underfactor?. Intelligence. 2016 Feb 29; 54:37-54.
19. Osborne JW, Costello AB. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pan-Pacific Management Review. 2009 Jul 1; 12(2):131-46.
20. Bandalos DL, Boehm-Kaufman MR. Four common misconceptions in exploratory factor analysis. Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences. 2009:61-87.
21. Crawford AV, Green SB, Levy R, Lo WJ, Scott L, Svetina D, et al. Evaluation of parallel analysis methods for determining the number of factors. Educational and Psychological Measurement. 2010 Sep 1. https://doi.org/10.1177/0013164410387338
22. Green SB, Redell N, Thompson MS, Levy R. Accuracy of revised and traditional parallel analyses for assessing dimensionality with binary data. Educational and Psychological Measurement. 2016 Feb 1; 76(1):5-21.
23. Timmerman ME, Lorenzo-Seva U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods. 2011 Jun; 16(2):209. https://doi.org/10.1037/a0023353 PMID: 21500916
24. Velicer WF, Eaton CA, Fava JL. Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In Problems and solutions in human assessment 2000 (pp. 41-71). Springer US.
25. Zwick WR, Velicer WF. Comparison of five rules for determining the number of components to retain. Psychological bulletin. 1986 May; 99(3):432.
26. Garrido LE, Abad FJ, Ponsoda V. Performance of Velicer's minimum average partial factor retention method with categorical variables. Educational and Psychological Measurement. 2011 Apr 5:0013164410389489.
27. Dziak JJ, Coffman DL, Lanza ST, Li R. Sensitivity and specificity of information criteria. The Methodology Center and Department of Statistics, Penn State, The Pennsylvania State University. 2012 Jun 27:1-0.
28. Lopes HF, West M. Bayesian model assessment in factor analysis. Statistica Sinica. 2004 Jan 1:41-67.
29. Preacher KJ, Zhang G, Kim C, Mels G. Choosing the optimal number of factors in exploratory factor analysis: A model selection perspective. Multivariate Behavioral Research. 2013 Jan 1; 48(1):28-56. https://doi.org/10.1080/00273171.2012.710386 PMID: 26789208
30. Song J, Belin TR. Choosing an appropriate number of factors in factor analysis with incomplete data. Computational Statistics & Data Analysis. 2008 Mar 15; 52(7):3560-9.
31. Hakstian AR, Rogers WT, Cattell RB. The behavior of number-of-factors rules with simulated data. Multivariate Behavioral Research. 1982 Apr 1; 17(2):193-219. https://doi.org/10.1207/ s15327906mbr1702-3 PMID: 26810948
32. Buja A, Eyuboglu N. Remarks on parallel analysis. Multivariate behavioral research. 1992 Oct 1; 27 (4):509-40. https://doi.org/10.1207/s15327906mbr2704-2 PMID: 26811132
33. Horn JL, Engstrom R. Cattell's scree test in relation to Bartlett's chi-square test and other observations on the number of factors problem. Multivariate Behavioral Research. 1979 Jul 1; 14(3):283-300. https://doi.org/10.1207/s15327906mbr1403-1 PMID: 26821851
34. Borsboom D, Cramer AO, Schmittmann VD, Epskamp S, Waldorp LJ. The small world of psychopathology. PloS one. 2011 Nov 17; 6(11):e27407. https://doi.org/10.1371/journal.pone.0027407 PMID: 22114671
35. Borsboom D, Cramer AO. Network analysis: an integrative approach to the structure of psychopathology. Annual review of clinical psychology. 2013 Mar 28; 9:91-121. https://doi.org/10.1146/annurevclinpsy- 050212-185608 PMID: 23537483
36. Isvoranu AM, van Borkulo CD, Boyette LL, Wigman JT, Vinkers CH, Borsboom D. A Network Approach to Psychosis: Pathways Between Childhood Trauma and Psychotic Symptoms. Schizophrenia bulletin. 2016 May 10:sbw055.
37. McNally RJ, Robinaugh DJ, Wu GW, Wang L, Deserno MK, Borsboom D. Mental disorders as causal systems a network approach to posttraumatic stress disorder. Clinical Psychological Science. 2015 Nov 1; 3(6):836-49.
38. Fried EI, Bockting C, Arjadi R, Borsboom D, Amshoff M, Cramer AO, et al. From loss to loneliness: The relationship between bereavement and depressive symptoms. Journal of abnormal psychology. 2015 May; 124(2):256. https://doi.org/10.1037/abn0000028 PMID: 25730514
39. Dalege J, Borsboom D, van Harreveld F, van den Berg H, Conner M, van der Maas HL. Toward a formalized account of attitudes: The Causal Attitude Network (CAN) model. Psychological review. 2016 Jan; 123(1):2. https://doi.org/10.1037/a0039802 PMID: 26479706
40. Kossakowski JJ, Epskamp S, Kieffer JM, van Borkulo CD, Rhemtulla M, Borsboom D. The application of a network approach to Health-Related Quality of Life (HRQoL): introducing a new method for assessing HRQoL in healthy adults and cancer patients. Quality of Life Research. 2016 Apr 1; 25(4):781-92. https://doi.org/10.1007/s11136-015-1127-z PMID: 26370099
41. Van Der Maas HL, Dolan CV, Grasman RP, Wicherts JM, Huizenga HM, Raijmakers ME. A dynamical model of general intelligence: the positive manifold of intelligence by mutualism. Psychological review. 2006 Oct; 113(4):842. https://doi.org/10.1037/0033-295X.113.4.842 PMID: 17014305
42. Epskamp S, Maris G, Waldorp LJ, Borsboom D. Network psychometrics. Handbook of psychometrics. New York: Wiley. 2015.
43. Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological). 1996 Jan 1:267-88.
44. van Borkulo CD, Borsboom D, Epskamp S, Blanken TF, Boschloo L, Schoevers RA, et al. A new method for constructing networks from binary data. Scientific Reports. 2014 Aug 1; 4.
45. Epskamp S, Cramer AO, Waldorp LJ, Schmittmann VD, Borsboom D. qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software. 2012 May 24; 48(4):1-8.
46. Epskamp S, Fried EI. Estimating Regularized Psychological Networks Using qgraph. arXiv preprint arXiv:1607.01367. 2016 Sep 25.
47. Cramer AO, Sluis S, Noordhof A, Wichers M, Geschwind N, Aggen SH, et al. Dimensions of normal personality as networks in search of equilibrium: You can't like parties if you don't like people. European Journal of Personality. 2012 Jul 1; 26(4):414-31.
48. Costantini G, Epskamp S, Borsboom D, Perugini M, Mõttus R, Waldorp LJ, et al. State of the aRt personality research: A tutorial on network analysis of personality data in R. Journal of Research in Personality. 2015 Feb 28; 54:13-29.
49. Marsman M, Maris G, Bechger T, Glas C. Bayesian inference for low-rank Ising networks. Scientific reports. 2015; 5.
50. Chandrasekaran V, Parrilo PA, Willsky AS. Latent variable graphical model selection via convex optimization. InCommunication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference on 2010 Sep 29 (pp. 1610-1613). IEEE.
51. Epskamp S, Rhemtulla M, Borsboom D. Generalized Network Psychometrics: Combining Network and Latent Variable Models. arXiv preprint arXiv:1605.09288. 2016 May 30.
52. Pons P, Latapy M. Computing communities in large networks using random walks. InInternational Symposium on Computer and Information Sciences 2005 Oct 26 (pp. 284-293). Springer Berlin Heidelberg.
53. R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. 2016. URL http://www.R-project.org/.
54. Rosseel Y. lavaan: An R package for structural equation modeling. Journal of Statistical Software. 2012 May 24; 48(2):1-36.
55. Raven JC. Progressive matrices: A perceptual test of intelligence. London: HK Lewis. 1938.
56. Formann AK, Waldherr K, Piswanger K. Wiener Matrizen-Test 2 (WMT-2): Ein Rasch-skalierter sprachfreier Kurztest zur Erfassung der Intelligenz. Beltz Test; 2011.
57. Condon DM, Revelle W. The International Cognitive Ability Resource: Development and initial validation of a public-domain measure. Intelligence. 2014 Apr 30; 43:52-64.
58. Condon DM, Revelle W. Selected ICAR data from the SAPA-Project: Development and initial validation of a public-domain measure. Journal of Open Psychology Data. 2016 Jan 26; 4(1).
59. Revelle W. psych: Procedures for personality and psychological research. Northwestern University, Evanston. R package version. 2014 Jan;1(1).
60. Csardi G, Nepusz T. The igraph software package for complex network research. InterJournal, Complex Systems. 2006 Jan 11; 1695(5):1-9.
61. Cohen J. Statistical power analysis for the behavior science. Lawrance Eribaum Association. 1988.
62. Golino, HF, & Gomes, CM. Investigando estágios de desenvolvimento do raciocínio indutivo usando a análise fatorial confimatória, o Modelo Logístico Simples de Rasch e o modelo de teste logístico linear (Rasch Estendido). In H. F. Golino, C. M. Gomes, A. Amantes, & G. Coelho. Psicometria Contemporǎnea: Compreendendo os Modelos Rasch. São Paulo: Casa do Psicólogo/Pearson, 2015. 283-331.
63. Commons ML, Richards FA. Applying the general stage model. Beyond formal operations. 1984; 1:141-57.
64. Commons ML, Pekker A. Presenting the formal theory of hierarchical complexity. World Futures. 2008 Oct 15; 64(5-7):375-82.
65. Fischer KW. A theory of cognitive development: The control and construction of hierarchies of skills. Psychological review. 1980 Nov; 87(6):477.
66. Fischer K, Yan Z. The development of dynamic skill theory. Conceptions of development: Lessons from the laboratory. 2002:279-312.
67. Satorra A, Bentler PM. A scaled difference chi-square test statistic for moment structure analysis. Psychometrika. 2001 Dec 1; 66(4):507-14.
68. Epskamp S. semPlot: Path diagrams and visual analysis of various SEM packages' output (Version 1.0. 0.). http://CRAN.R-project.org/package=semPlot. 2014.
69. Yang Z, Algesheimer R, Tessone CJ. A Comparative Analysis of Community Detection Algorithms on Artificial Networks. Scientific Reports. 2016; 6.