A tutorial on regularized partial correlation networks

Psychological Methods

Volumn 23, Issue 4, 2018, Pages 617-634

  Epskamp, Sacha ^a   Fried, Eiko I ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Network modeling; Partial correlation networks; Regularization; Tutorial

Indexed keywords

HUMAN; PATHOPHYSIOLOGY; POSTTRAUMATIC STRESS DISORDER; PROCEDURES; PSYCHOLOGICAL MODEL; PSYCHOLOGY; STATISTICAL ANALYSIS; STATISTICAL MODEL;

DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, PSYCHOLOGICAL; MODELS, STATISTICAL; PSYCHOLOGY; STRESS DISORDERS, POST-TRAUMATIC;

EID: 85044464884     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/met0000167     Document Type: Article

References (110)

1. Abegaz, F., & Wit, E. (2013). Sparse time series chain graphical models for reconstructing genetic networks. Biostatistics, 14, 586-599
2. Abegaz, F., & Wit, E. (2015). SparseTSCGM: Sparse time series chain graphical models (R package version 2.2). Retrieved from https:// CRAN.R-project.org/package=SparseTSCGM
3. Agresti, A. (1990). Categorical data analysis. New York, NY: Wiley, Inc
4. Armour, C., Fried, E. I., Deserno, M. K., Tsai, J., & Pietrzak, R. H. (2017). A network analysis of DSM-5 posttraumatic stress disorder symptoms and correlates in us military veterans. Journal of Anxiety Disorders, 45, 49-59
5. Bastian, M., Heymann, S., Jacomy, M. (2009). Gephi: An open source software for exploring and manipulating networks. Icwsm, 8, 361-362
6. Borsboom, D. (2017). A network theory of mental disorders. World Psychiatry, 16, 5-13
7. Borsboom, D., & Cramer, A. O. J. (2013). Network analysis: An integrative approach to the structure of psychopathology. Annual Review of Clinical Psychology, 9, 91-121
8. Borsboom, D., Fried, E., Epskamp, S., Waldorp, L., van Borkulo, C., van der Maas, H., & Cramer, A. O. J. (2017). Replicability of psychopathology networks: The right question but the wrong answer. a comment on 'evidence that psychopathology symptom networks have limited replicability' by Forbes, Wright, Markon, and Krueger. Journal of Abnormal Psychology, 126, 989-999
9. Bos, F. M., Snippe, E., de Vos, S., Hartmann, J. A., Simons, C. J. P., van der Krieke, L., Wichers, M. (2017). Exploring the idiographic dynamics of mood and anxiety via network analysis. Journal of Abnormal Psychology, 126, 1044-1056
10. Bringmann, L. F., Vissers, N., Wichers, M., Geschwind, N., Kuppens, P., Peeters, F., Tuerlinckx, F. (2013). A network approach to psychopathology: New insights into clinical longitudinal data. PLoS ONE, 8, e60188
11. Chandrasekaran, V., Parrilo, P. A., & Willsky, A. S. (2012). Latent variable graphical model selection via convex optimization (with discussion). The Annals of Statistics, 40, 1935-1967
12. Chapman, B. P., Weiss, A., & Duberstein, P. R. (2016). Statistical learning theory for high dimensional prediction: Application to criterion-keyed scale development. Psychological Methods, 21, 603-620
13. Chen, J., & Chen, Z. (2008). Extended Bayesian information criteria for model selection with large model spaces. Biometrika, 95, 759-771
14. Chen, Y., Li, X., Liu, J., & Ying, Z. (2016). A fused latent and graphical model for multivariate binary data. arXiv preprint, arXiv, 1606.08925
15. Chernick, M. R. (2011). Bootstrap methods: A guide for practitioners and researchers. New York, NY: Wiley
16. Cohen, J. (1977). Statistical power analysis for the behavioral sciences. New York, NY: Academic Press
17. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum
18. Costantini, G., Epskamp, S., Borsboom, D., Perugini, M., Mõttus, R., Waldorp, L. J., & Cramer, A. O. J. (2015). State of the aRt personality research: A tutorial on network analysis of personality data in R. Journal of Research in Personality, 54, 13-29
19. Costantini, G., Richetin, J., Borsboom, D., Fried, E. I., Rhemtulla, M., & Perugini, M. (2015). Development of indirect measures of conscientiousness: Combining a facets approach and network analysis. European Journal of Personality, 29, 548-567
20. Costantini, G., Richetin, J., Preti, E., Casini, E., Epskamp, S., & Perugini, M. (2017). Stability and variability of personality networks. a tutorial on recent developments in network psychometrics. Personality and Individual Differences. Advance online publication. http://dx.doi.org/10.1016/j.paid.2017.06.011
21. Cox, D. R., & Wermuth, N. (1994). A note on the quadratic exponential binary distribution. Biometrika, 81, 403-408
22. Cramer, A. O. J., Sluis, S., Noordhof, A., Wichers, M., Geschwind, N., Aggen, S. H., Borsboom, D. (2012). Dimensions of normal personality as networks in search of equilibrium: You can't like parties if you don't like people. European Journal of Personality, 26, 414-431
23. Cramer, A. O. J., Waldorp, L., van der Maas, H., & Borsboom, D. (2010). Comorbidity: A network perspective. Behavioral and Brain Sciences, 33, 137-150
24. Csardi, G., & Nepusz, T. (2006). The igraph software package for complex network research. Retrieved from https://pdfs.semanticscholar.org/1d27/ 44b83519657f5f2610698a8ddd177ced4f5c.pdf
25. Deserno, M. K., Borsboom, D., Begeer, S., & Geurts, H. M. (2016). Multicausal systems ask for multicausal approaches: A network perspective on subjective well-being in individuals with autism spectrum disorder. Autism, 21, 960-971
26. Drton, M., & Perlman, M. D. (2004). Model selection for gaussian concentration graphs. Biometrika, 91, 591-602
27. Dziak, J. J., Coffman, D. L., Lanza, S. T., & Li, R. (2012). Sensitivity and specificity of information criteria. PeerJ Reprints. http://dx.doi.org/10.7287/peerj.preprints.1103v3
28. Efron, B. (1979). Bootstrap methods: Another look at the jackknife. The Annals of Statistics, 7, 1-26
29. Epskamp, S. (2015). graphicalVAR: Graphical VAR for experience sampling data (R package version 0.1.3). Retrieved from https://cran.rproject. org/web/packages/graphicalVAR/graphicalVAR.pdf
30. Epskamp, S. (2016). Regularized Gaussian psychological networks: Brief report on the performance of extended BIC model selection. arXiv preprint, p. arXiv:1606.05771
31. Epskamp, S. (Ed.). (2017). Discussion: The road ahead. Network Psychometrics (Doctoral Dissertation). Department of Psychological Methods, University of Amsterdam, Amsterdam, the Netherlands
32. Epskamp, S., Borsboom, D., & Fried, E. I. (2017). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods, 2017, 1-18
33. Epskamp, S., Cramer, A., Waldorp, L., Schmittmann, V. D., & Borsboom, D. (2012). qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48, 1-18
34. Epskamp, S., Kruis, J., & Marsman, M. (2017). Estimating psychopathological networks: Be careful what you wish for. PLoS ONE, 12, e0179891
35. Epskamp, S., Maris, G., Waldorp, L., & Borsboom, D. (2018). Network psychometrics. In P. Irwing, D. Hughes, & T. Booth (Eds.), Handbook of psychometrics. New York, NY: Wiley
36. Epskamp, S., Rhemtulla, M., & Borsboom, D. (2017). Generalized network psychometrics: Combining network and latent variable models. Psychometrika, 82, 904-927. http://dx.doi.org/10.1007/s11336-017-9557-x
37. Epskamp, S., Waldorp, L. J., Mõttus, R., & Borsboom, D. (2017). Discovering psychological dynamics in time-series data. arXiv preprint, arXiv, 1609.04156
38. Fisher, A. J., Reeves, J. W., Lawyer, G., Medaglia, J. D., & Rubel, J. A. (2017). Exploring the idiographic dynamics of mood and anxiety via network analysis. Journal of Abnormal Psychology, 126, 1044-1056
39. Forbes, M. K., Wright, A. G. C., Markon, K., & Krueger, R. (2017). Evidence that psychopathology symptom networks have limited replicability. Journal of Abnormal Psychology, 126, 969-988
40. Foygel, R., & Drton, M. (2010). Extended Bayesian information criteria for Gaussian graphical models. Advances in Neural Information Processing Systems, 23, 2020-2028
41. Foygel Barber, R., & Drton, M. (2015). High-dimensional Ising model selection with Bayesian information criteria. Electronic Journal of Statistics, 9, 567-607
42. Fried, E. I., & Cramer, A. O. J. (2017). Moving forward: Challenges and directions for psychopathological network theory and methodology. Perspectives on Psychological Science, 12, 999-1020. http://dx.doi.org/ 10.1177/1745691617705892
43. Fried, E. I., Eidhof, M. B., Palic, S., Costantini, G., Huisman-van Diujk, H. M., Bockting, C. L. M., Karstoft, K.-I. (in press). Replicability and generalizability of PTSD networks: A cross-cultural multisite study of PTSD symptoms in four trauma patient samples. Clinical Psychological Science
44. Fried, E. I., Epskamp, S., Nesse, R. M., Tuerlinckx, F., & Borsboom, D. (2016). What are 'good' depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. Journal of Affective Disorders, 189, 314-320
45. Fried, E. I., van Borkulo, C. D., Cramer, A. O. J., Lynn, B., Schoevers, R. A., & Borsboom, D. (2017). Mental disorders as networks of problems: A review of recent insights. Social Psychiatry and Psychiatric Epidemiology, 52, 1-10
46. Friedman, J. H., Hastie, T., & Tibshirani, R. (2008). Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9, 432-441
47. Friedman, J. H., Hastie, T., & Tibshirani, R. (2014). glasso: Graphical lasso-estimation of Gaussian graphical models (R package version 1.8). Retrieved from https://CRAN.R-project.org/package=glasso
48. Fruchterman, T., & Reingold, E. (1991). Graph drawing by force-directed placement. Software: Practice and Experience, 21, 1129-1164
49. Gentry, J., Long, L., Gentleman, R., Falcon, S., Hahne, F., Sarkar, D., & Hansen, K. (2011). Rgraphviz: Provides plotting capabilities for R graph objects (R package version 1.27.0). http://dx.doi.org/10.18129/B9.bioc.Rgraphviz
50. Golino, H. F., & Epskamp, S. (2017). Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research. PLoS ONE, 12, e0174035
51. Guyon, H., Falissard, B., & Kop, J.-L. (2017). Modeling psychological attributes in psychology-an epistemological discussion: Network analysis vs. latent variables. Frontiers in Psychology, 8, 798
52. Hamaker, E. L. (2012). Why researchers should think 'within-person': A paradigmatic rationale. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 43-61). New York, NY: Guilford
53. Haslbeck, J. M. B., & Waldorp, L. J. (2016). mgm: Structure estimation for time-varying mixed graphical models in high-dimensional data. arXiv preprint, arXiv, 1510.06871
54. Hastie, T., Tibshirani, R., & Friedman, J. (2001). The elements of statistical learning. New York, NY: Springer
55. Hastie, T., Tibshirani, R., & Wainwright, M. (2015). Statistical learning with sparsity: The lasso and generalizations. Boca Raton, FL: CRC Press
56. Holland, P. W., & Rosenbaum, P. R. (1986). Conditional association and unidimensionality in monotone latent variable models. The Annals of Statistics, 14, 1523-1543
57. Isvoranu, A. M., Borsboom, D., van Os, J., & Guloksuz, S. (2016). A network approach to environmental impact in psychotic disorders: Brief theoretical framework. Schizophrenia Bulletin, 42, 870-873
58. Isvoranu, A. M., van Borkulo, C. D., Boyette, L., Wigman, J. T. W., Vinkers, C. H., & Borsboom, D. (2016). A network approach to psychosis: Pathways between childhood trauma and psychotic symptoms. Schizophrenia Bulletin, 43, 187-196. http://dx.doi.org/10.1093/schbul/ sbw055
59. Jaya, E. S., Hillmann, T. E., Reininger, K. M., Gollwitzer, A., & Lincoln, T. M. (2016). Loneliness and psychotic symptoms: The mediating role of depression. Cognitive Therapy and Research, 41, 106-116
60. Knefel, M., Tran, U. S., & Lueger-Schuster, B. (2016). The association of posttraumatic stress disorder, complex posttraumatic stress disorder, and borderline personality disorder from a network analytical perspective. Journal of Anxiety Disorders, 43, 70-78
61. Koller, D., & Friedman, N. (2009). Probabilistic graphical models: Principles and techniques. Cambridge, MA: MIT Press
62. Kossakowski, J. J., Epskamp, S., Kieffer, J. M., van Borkulo, C. D., Rhemtulla, M., & Borsboom, D. (2015). The application of a network approach to health-related quality of life (HRQoL): Introducing a new method for assessing HRQoL in healthy adults and cancer patient. Quality of Life Research, 25, 781-792
63. Krämer, N., Schäfer, J., & Boulesteix, A.-L. (2009). Regularized estimation of large-scale gene association networks using graphical gaussian models. BMC Bioinformatics, 10(1), 1-24
64. Kruis, J., & Maris, G. (2016). Three representations of the Ising model. Scientific Reports, 6, 34175
65. Langley, D. J., Wijn, R., Epskamp, S., & Van Bork, R. (2015). Should I get that jab? Exploring influence to encourage vaccination via online social media. ECIS 2015 Research-in-Progress Papers (Paper 64). Retrieved from http://aisel.aisnet.org/ecis2015_rip/64?utm_source=aisel.aisnet.org%2Fecis2015_rip%2F64&utm_medium=PDF&utm_campaign= PDFCoverPages
66. Lauritzen, S. L. (1996). Graphical models. Oxford, UK: Clarendon Press
67. Levine, S. Z., & Leucht, S. (2016). Identifying a system of predominant negative symptoms: Network analysis of three randomized clinical trials. Schizophrenia Research, 178, 17-22
68. Liu, H., Lafferty, J. D., & Wasserman, L. (2009). The nonparanormal: Semiparametric estimation of high dimensional undirected graphs. The Journal of Machine Learning Research, 10, 2295-2328
69. Marsman, M., Maris, G., Bechger, T., & Glas, C. (2015). Bayesian inference for low-rank ISING networks. Scientific reports, 5(9050), 1-7
70. McNally, R. J. (2016). Can network analysis transform psychopathology? Behaviour Research and Therapy, 86, 95-104
71. McNally, R. J., Robinaugh, D. J., Wu, G. W., Wang, L., Deserno, M. K., & Borsboom, D. (2015). Mental disorders as causal systems a network approach to posttraumatic stress disorder. Clinical Psychological Science, 3, 836-849
72. Meinshausen, N., & Bühlmann, P. (2006). High-dimensional graphs and variable selection with the lasso. The Annals of Statistics, 34, 1436-1462
73. Molenaar, P. C. (2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement, 2, 201-218
74. Mõttus, R., & Allerhand, M. (2017). Why do traits come together? the underlying trait and network approaches. SAGE Handbook of Personality and Individual Differences, 1, 1-22
75. Murphy, K. P. (2012). Machine learning: A probabilistic perspective. Cambridge, MA: MIT Press
76. Muthén, B. (1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49, 115-132
77. Muthén, B. O. (1989). Factor structure in groups selected on observed scores. British Journal of Mathematical and Statistical Psychology, 42, 81-90
78. Olsson, U. (1979). Maximum likelihood estimation of the polychoric correlation coefficient. Psychometrika, 44, 443-460
79. Olsson, U., Drasgow, F., & Dorans, N. J. (1982). The polyserial correlation coefficient. Psychometrika, 47, 337-347
80. Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716-aac4716
81. Opsahl, T., Agneessens, F., & Skvoretz, J. (2010). Node centrality in weighted networks: Generalizing degree and shortest paths. Social Networks, 32, 245-251
82. Pan, J., Ip, E., & Dube, L. (2017). An alternative to post-hoc model modification in confirmatory factor analysis: The Bayesian lasso. Psychological Methods, 22, 687-704
83. Pearl, J. (2000). Causality: Models, reasoning, and inference. Cambridge, UK: Cambridge University Press
84. Pedersen, T. L. (2017). ggraph: An Implementation of grammar of graphics for graphs and networks (R package version 1.0.0). Retrieved from https://CRAN.R-project.org/package=ggraph
85. Pourahmadi, M. (2011). Covariance estimation: The glm and regularization perspectives. Statistical Science, 26, 369-387
86. R Core Team. (2016). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing
87. Rhemtulla, M., Fried, E. I., Aggen, S. H., Tuerlinckx, F., Kendler, K. S., & Borsboom, D. (2016). Network analysis of substance abuse and dependence symptoms. Drug and Alcohol Dependence, 161, 230-237
88. Rigdon, E. E., & Ferguson, C. E., Jr. (1991). The performance of the polychoric correlation coefficient and selected fitting functions in confirmatory factor analysis with ordinal data. Journal of Marketing Research, 28, 491-497
89. Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1-36
90. Rothman, A. J., Levina, E., & Zhu, J. (2010). Sparse multivariate regression with covariance estimation. Journal of Computational and Graphical Statistics, 19, 947-962
91. Schmittmann, V. D., Cramer, A. O. J., Waldorp, L. J., Epskamp, S., Kievit, R. A., & Borsboom, D. (2013). Deconstructing the construct: A network perspective on psychological phenomena. New Ideas in Psychology, 31, 43-53
92. Shannon, P., Markiel, A., Ozier, O., Baliga, N. S., Wang, J. T., Ramage, D., Ideker, T. (2003). Cytoscape: A software environment for integrated models of biomolecular interaction networks. Genome Research, 13, 2498-2504
93. Stevens, S. S. (1946). On the theory of scales of measurement. Science, New Series, 103, 677-680
94. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B, 58, 267-288
95. Van Bork, R. (2015, July). Latent variable and network model implications for partial correlation structures. Presented at 80th Annual Meeting of the Psychometric Society (IMPS), Bejing, China
96. van Borkulo, C. D., Borsboom, D., Epskamp, S., Blanken, T. F., Boschloo, L., Schoevers, R. A., & Waldorp, L. J. (2014). A new method for constructing networks from binary data. Scientific Reports, 4(5918), 1-10
97. van Borkulo, C. D., Boschloo, L., Borsboom, D., Penninx, B. W. J. H., Waldorp, L. J., & Schoevers, R. A. (2015). Association of symptom network structure with the course of depression. Journal of the American Medical Association psychiatry, 72, 1219-1226
98. Van Borkulo, C., Boschloo, L., Kossakowski, J., Tio, P., Schoevers, R., Borsboom, D., & Waldorp, L. (2017). Comparing network structures on three aspects: A permutation test. http://dx.doi.org/10.13140/RG.2.2.29455.38569
99. van Borkulo, C. D., & Epskamp, S. (2014). IsingFit: Fitting Ising models using the elasso method. R package version 0.2.0
100. Van Der Maas, H. L., Dolan, C. V., Grasman, R. P., Wicherts, J. M., Huizenga, H. M., & Raijmakers, M. E. (2006). A dynamical model of general intelligence: The positive manifold of intelligence by mutualism. Psychological review, 113, 842-861
101. Van Der Maas, H., Kan, K.-J., Marsman, M., & Stevenson, C. E. (2017). Network models for cognitive development and intelligence. Journal of Intelligence. Advance online publication. http://dx.doi.org/10.20944/ preprints201701.0107.v1
102. Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779-804
103. Wasserman, S., & Faust, K. (1994). Social network analysis: Methods and applications. New York, NY: Cambridge University Press
104. Weinberger, N. (2015). If intelligence is a cause, it is a within-subjects cause. Theory & Psychology, 25, 346-361
105. Wetzels, R., & Wagenmakers, E.-J. (2012). A default Bayesian hypothesis test for correlations and partial correlations. Psychonomic bulletin & review, 19, 1057-1064
106. Wickens, T. D. (1989). Multiway contingency tables analysis for the social sciences. Hillsdale, NJ: Erlbaum
107. Wild, B., Eichler, M., Friederich, H.-C., Hartmann, M., Zipfel, S., & Herzog, W. (2010). A graphical vector autoregressive modelling approach to the analysis of electronic diary data. BMC Medical Research Methodology, 10, 28
108. Zhao, P., & Yu, B. (2006). On model selection consistency of lasso. The Journal of Machine Learning Research, 7, 2541-2563
109. Zhao, T., Li, X., Liu, H., Roeder, K., Lafferty, J., & Wasserman, L. (2015). huge: High-dimensional undirected graph estimation (R package version 1.2.7). Retrieved from https://CRAN.R-project.org/package=huge
110. Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101, 1418-1429