Replicability and Generalizability of Posttraumatic Stress Disorder (PTSD) Networks: A Cross-Cultural Multisite Study of PTSD Symptoms in Four Trauma Patient Samples

Clinical Psychological Science

Volumn 6, Issue 3, 2018, Pages 335-351

  Fried, Eiko I ^a   Eidhof, Marloes B ^b   Palic, Sabina ^c   Costantini, Giulio ^d   Huisman van Dijk, Hilde M ^e   Bockting, Claudi L H ^b,f   Engelhard, Iris ^e,f   Armour, Cherie ^g   Nielsen, Anni B S ^h,i   Karstoft, Karen Inge ^h  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b Arq Psychotrauma Expert Group Diemen Oegstgeest   (Netherlands)

^c World Health Organisation   (Denmark)

^d UNIVERSITY OF MILANO BICOCCA   (Italy)

^e Academic Anxiety Center   (Netherlands)

^f UTRECHT UNIVERSITY   (Netherlands)

^g UNIVERSITY OF ULSTER   (United Kingdom)

^h Research and Knowledge Centre   (Denmark)

ⁱ UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

generalizability; network modeling; open materials; posttraumatic stress disorder; replicability

Indexed keywords

EID: 85043346366     PISSN: 21677026     EISSN: 21677034     Source Type: Journal    
DOI: 10.1177/2167702617745092     Document Type: Article

References (80)

1. Afzali M. H., Sunderland M., Batterham P. J., Carragher N., Calear A., Slade T., (2017). Network approach to the symptom-level association between alcohol use disorder and posttraumatic stress disorder. Social Psychiatry and Psychiatric Epidemiology, 52(3), 329–339. doi:10.1007/s00127-016-1331-3
2. Afzali M. H., Sunderland M., Teesson M., Carragher N., Mills K., Slade T., (2017). A network approach to the comorbidity between posttraumatic stress disorder and major depressive disorder: The role of overlapping symptoms. Journal of Affective Disorders, 208, 490–496. doi:10.1016/j.jad.2016.10.037
3. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
4. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
5. Armour C., Fried E. I., Deserno M. K., Tsai J., Pietrzak R. H., Southwick S. M., (2016). A network analysis of DSM-5 posttraumatic stress disorder symptoms and correlates in U.S. military veterans. Journal of Anxiety Disorders, 45, 49–59. doi:10.1016/j.janxdis.2016.11.008
6. Armour C., Műllerová J., Elhai J. D., (2015). A systematic literature review of PTSD’s latent structure in the Diagnostic and Statistical Manual of Mental Disorders: DSM-IV to DSM-5. Clinical Psychology Review, 44, 60–74. doi:10.1016/j.cpr.2015.12.003
7. Armour C., Tsai J., Durham T. A., Charak R., Biehn T. L., Elhai J. D., Pietrzak R. H., (2015). Dimensional structure of DSM-5 posttraumatic stress symptoms: Support for a hybrid Anhedonia and Externalizing Behaviors model. Journal of Psychiatric Research, 61, 106–113. doi:10.1016/j.jpsychires.2014.10.012
8. Beard C., Millner A. J., Forgeard M. J. C., Fried E. I., Hsu K. J., Treadway M.,.. Björgvinsson T., (2016). Network analysis of depression and anxiety symptom relations in a psychiatric sample. Psychological Medicine, 46(16), 3359–3369. doi:10.1017/S0033291716002300
9. Berger J. O., (2006). Bayes factors. In Kotz S., Balakrishnan N., Read C., Vidakovic B., Johnson N. L., (Eds.), Encyclopedia of statistical sciences (2nd ed., Vol. 1, pp. 378–386). Hoboken, NJ: Wiley.
10. Birkeland M. S., Heir T., (2017). Making connections: Exploring the centrality of posttraumatic stress symptoms and covariates after a terrorist attack. European Journal of Psychotraumatology, 8(Suppl. 3), 1333387. doi:10.1080/20008198.2017.1333387
11. Borsboom D., (2017). A network theory of mental disorders. World Psychiatry, 16, 5–13.
12. Borsboom D., Cramer A. O. J., (2013). Network analysis: An integrative approach to the structure of psychopathology. Annual Review of Clinical Psychology, 9, 91–121. doi:10.1146/annurevclinpsy-050212-185608
13. Borsboom D., Fried E. I., Epskamp S., Waldorp L. J., van Borkulo C. D., van der Maas H. L. J., Cramer A. O. J., (2017). False alarm? A comprehensive reanalysis of “Evidence that psychopathology symptom networks have limited replicability” by Forbes, Wright, Markon, and Krueger (2017). Journal of Abnormal Psychology, 126(7), 989–999.
14. Braakman M. H., Kortmann F. A. M., van den Brink W., (2009). Validity of “post-traumatic stress disorder with secondary psychotic features”: A review of the evidence. Acta Psychiatrica Scandinavica, 119(1), 15–24. doi:10.1111/j.1600-0447.2008.01252.x
15. Bradley R., Greene J., Russ E., Dutra L., Westen D., (2005). A multidimensional meta-analysis of psychotherapy for PTSD. The American Journal of Psychiatry, 162(2), 214–227. doi:10.1176/appi.ajp.162.2.214
16. Bringmann L. F., Vissers N., Wichers M., Geschwind N., Kuppens P., Peeters F... Tuerlinckx F., (2013). A network approach to psychopathology: New insights into clinical longitudinal data. PLoS One, 8(4), Article e60188. doi:10.1371/journal.pone.0060188
17. Bryant R. A., Creamer M., O’Donnell M., Forbes D., McFarlane A. C., Silove D., Hadzi-Pavlovic D., (2017). Acute and chronic posttraumatic stress symptoms in the emergence of posttraumatic stress disorder. JAMA Psychiatry, 74(2), 135–142. doi:10.1001/jamapsychiatry.2016.3470
18. Carlsson J., Sonne C., Silove D., (2014). From pioneers to scientists: Challenges in establishing evidence-gathering models in torture and trauma mental health services for refugees. The Journal of Nervous and Mental Disease, 202(9), 630–637. doi:10.1097/NMD.0000000000000175
19. Cole D. A., Cai L., Martin N. C., Findling R. L., Youngstrom E. A., Garber J... Forehand R., (2011). Structure and measurement of depression in youths: Applying item response theory to clinical data. Psychological Assessment, 23(4), 819–833. doi:10.1037/a0023518
20. Costantini G., Epskamp S., (2017). EstimateGroupNetwork: Perform the joint graphical lasso and selects tuning parameters. R package (Version 0.1.2) [Computer software]. Retrieved from https://cran.r-project.org/web/packages/EstimateGroupNetwork/index.html
21. Costantini G., Perugini M., (2017). Network analysis for psychological situations. In Funder D. C., Rauthmann J. F., Sherman R. A., (Eds.), The Oxford handbook of psychological situations. New York, NY: Oxford University Press. doi:10.1093/oxfordhb/9780190263348.013.16
22. Costantini G., Richetin J., Preti E., Casini E., Epskamp S., Perugini M., (2017). Stability and variability of personality networks. A tutorial on recent developments in network psychometrics. Personality and Individual Differences. Advance online publication. doi:10.1016/j.paid.2017.06.011
23. Cramer A. O. J., Waldorp L. J., van der Maas H. L. J., Borsboom D., (2010). Comorbidity: A network perspective. The Behavioral and Brain Sciences, 33(2–3), 137–150. doi:10.1017/S0140525X09991567
24. Danaher P., Wang P., Witten D. M., (2014). The joint graphical lasso for inverse covariance estimation across multiple classes. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 76(2), 373–397. doi:10.1111/rssb.12033
25. Engelhard I. M., van den Hout M. A., Lommen M. J. J., (2009). Individuals high in neuroticism are not more reactive to adverse events. Personality and Individual Differences, 47(7), 697–700. doi:10.1016/j.paid.2009.05.031
26. Epskamp S., Borsboom D., Fried E. I., (2017). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods. Advance online publication. doi:10.3758/s13428-017-0862-1
27. Epskamp S., Cramer A. O. J., Waldorp L. J., Schmittmann V. D., Borsboom D., (2012). qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48(4), 1–18.
28. Epskamp S., Fried E. I., (2017). A tutorial on regularized partial correlation networks. Psychological Methods. doi:arxiv.org/abs/1607.01367
29. Epskamp S., Kruis J., Marsman M., (2017). Estimating psychopathological networks: Be careful what you wish for. PLoS One, 12(6), Article e0179891. doi:10.1371/journal.pone.0179891
30. Epskamp S., Maris G., Waldorp L. J., Borsboom D., (2016). Network psychometrics. In Irwing P., Hughes D., Booth T., (Eds.), Handbook of psychometrics. New York, NY: Wiley. Retrieved from https://arxiv.org/abs/1609.02818
31. Epskamp S., Rhemtulla M., Borsboom D., (2017). Generalized network psychometrics: Combining network and latent variable models. Psychometrika, 82, 904–927. doi:10.1007/s11336-017-9557-x
32. Flory J. D., Yehuda R., (2015). Comorbidity between post-traumatic stress disorder and major depressive disorder: Alternative explanations and treatment considerations. Dialogues in Clinical Neuroscience, 17(2), 141–150.
33. Foa E. B., Cashman L., Jaycox L., Perry K., (1997). The validation of a self-report measure of posttraumatic stress disorder: The Posttraumatic Diagnostic Scale. Psychological Assessment, 9(4), 445–451. doi:10.1037/1040-3590.9.4.445
34. Forbes D., Lockwood E., Elhai J. D., Creamer M., Bryant R., McFarlane A... O’Donnell M., (2015). An evaluation of the DSM-5 factor structure for posttraumatic stress disorder in survivors of traumatic injury. Journal of Anxiety Disorders, 29, 43–51. doi:10.1016/j.janxdis.2014.11.004
35. Forbes M. K., Wright A. G. C., Markon K. E., Krueger R. F., (2017a). Evidence that psychopathology symptom networks have limited replicability. Journal of Abnormal Psychology, 126(7), 969–988.
36. Forbes M. K., Wright A. G. C., Markon E. K., Krueger R. F., (2017b). Further evidence that psychopathology networks have limited replicability and utility: Response to Borsboom et al. (2017) and Steinley et al. (2017). Journal of Abnormal Psychology, 126(7), 1011–1016.
37. Forbush K. T., Siew C. S. Q., Vitevitch M. S., (2016). Application of network analysis to identify interactive systems of eating disorder psychopathology. Psychological Medicine, 46(12), 2667–2677. doi:10.1017/S003329171600012X
38. Frewen P. A., Schmittmann V. D., Bringmann L. F., Borsboom D., (2013). Perceived causal relations between anxiety, posttraumatic stress and depression: Extension to moderation, mediation, and network analysis. European Journal of Psychotraumatology, 4, 20656. doi:10.3402/ejpt.v4i0.20656
39. Fried E. I., Cramer A. O. J., (2017). Moving forward: Challenges and directions for psychopathological network theory and methodology. Perspectives on Psychological Science, 12, 999–1020. doi:10.1177/1745691617705892
40. Fried E. I., Epskamp S., Nesse R. M., Tuerlinckx F., Borsboom D., (2016). What are “good” depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. Journal of Affective Disorders, 189, 314–320. doi:10.1016/j.jad.2015.09.005
41. Fried E. I., van Borkulo C. D., Cramer A. O. J., Boschloo L., Schoevers R. A., Borsboom D., (2017). Mental disorders as networks of problems: A review of recent insights. Social Psychiatry and Psychiatric Epidemiology, 52(1), 1–10. doi:10.1007/s00127-016-1319-z
42. Friedman J., Hastie T., Tibshirani R., (2008). Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9, 432–441. doi:10.1093/biostatistics/kxm045
43. Gaudiano B. A., Zimmerman M., (2010). Evaluation of evidence for the psychotic subtyping of post-traumatic stress disorder. The British Journal of Psychiatry, 197(4), 326–327. doi:10.1192/bjp.bp.110.078824
44. Gullion C. M., Rush A. J., (1998). Toward a generalizable model of symptoms in major depressive disorder. Biological Psychiatry, 44(10), 959–972. doi:10.1016/S0006-3223(98)00235-2
45. Haslbeck J. M. B., Fried E. I., (2017). How predictable are symptoms in psychopathological networks? A reanalysis of 18 published datasets. Psychological Medicine, 47(16), 2767–2776. doi:10.1017/S0033291717001258
46. Hayes A. M., Yasinski C., Ben Barnes J., Bockting C. L. H., (2015). Network destabilization and transition in depression: New methods for studying the dynamics of therapeutic change. Clinical Psychology Review, 41, 27–39. doi:10.1016/j.cpr.2015.06.007
47. Isvoranu A.-M., Borsboom D., van Os J., Guloksuz S., (2016). A network approach to environmental impact in psychotic disorder: Brief theoretical framework. Schizophrenia Bulletin, 42(4), 870–873. doi:10.1093/schbul/sbw049
48. Karstoft K. I., Andersen S. B., Bertelsen M., Madsen T., (2014). Diagnostic accuracy of the Posttraumatic Stress Disorder Checklist–Civilian Version in a representative military sample. Psychological Assessment, 26(1), 321–325. doi:10.1037/a0034889
49. Kelley L., Weathers F., McDevitt-Murphy M. E., Eakin D., Flood A., (2009). A comparison of PTSD symptom patterns in three types of civilian trauma. Journal of Traumatic Stress, 22(3), 227–235. doi:10.1002/jts
50. Kessler R. C., Sonnega A., Bromet E., Hughes M., Nelson C. B., (1995). Posttraumatic stress disorder in the National Comorbidity Survey. Archives of General Psychiatry, 52(12), 1048–1060. doi:10.1001/archpsyc.1995.03950240066012
51. Knefel M., Tran U. S., Lueger-Schuster B., (2016). The association of posttraumatic stress disorder, complex posttraumatic stress disorder, and borderline personality disorder from a network analytical perspective. Journal of Anxiety Disorders, 43, 70–78. doi:10.1016/j.janxdis.2016.09.002
52. Krueger R. F., Chentsova-Dutton Y. E., Markon K. E., Goldberg D., Ormel J., (2003). A cross-cultural study of the structure of comorbidity among common psychopathological syndromes in the general health care setting. Journal of Abnormal Psychology, 112(3), 437–447. doi:10.1037/0021-843X.112.3.437
53. Kruis J., Maris G., (2016). Three representations of the Ising model. Scientific Reports, 6, 34175. doi:10.1038/srep34175
54. Lauritzen S. L., (1996). Graphical models. Gloucestershire, England: Clarendon Press.
55. Marsella A. J., Matthew J., Friedman M. J., Gerrity E., Scurfield R. M., (1996). Ethnocultural aspects of post-traumatic stress disorders: Issues, research and applications. Washington, DC: American Psychological Association.
56. McNally R. J., (2009). Can we fix PTSD in DSM-V? Depression and Anxiety, 26(7), 597–600. doi:10.1002/da.20586
57. McNally R. J., (2016). Can network analysis transform psychopathology? Behaviour Research and Therapy. doi:10.1016/j.brat.2016.06.006
58. McNally R. J., Robinaugh D. J., Wu G. W. Y., Wang L., Deserno M. K., Borsboom D., (2015). Mental disorders as causal systems: A network approach to posttraumatic stress disorder. Clinical Psychological Science, 3(3), 836–849.
59. Mitchell K. S., Wolf E. J., Bovin M. J., Lee L. O., Green J. D., Raymond C... Marx B. P., (2017). Network models of DSM-5 posttraumatic stress disorder: Implications for ICD-11. Journal of Abnormal Psychology, 126(3), 355–366.
60. Mollica R., Caspi-Yavin Y., Bollini P., Truong T., Tor S., Lavelle J., (1992). The Harvard Trauma Questionnaire: Adapting a cross-cultural instrument for measuring torture, trauma and posttraumatic stress disorder in Iraqi refugees. The Journal of Nervous & Mental Disease, 180(2), 111–116.
61. Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. doi:10.1126/science.aac4716
62. Rhemtulla M., Fried E. I., Aggen S. H., Tuerlinckx F., Kendler K. S., Borsboom D., (2016). Network analysis of substance abuse and dependence symptoms. Drug and Alcohol Dependence, 161, 230–237. doi:10.1016/j.drugalcdep.2016.02.005
63. Richetin J., Preti E., Costantini G., De Panfilis C., (2017). The centrality of affective instability and identity in borderline personality disorder: Evidence from network analysis. PLoS One, 12(10), Article e0186695. doi:10.1371/journal.pone.0186695
64. Robinaugh D. J., Millner A. J., McNally R. J., (2016). Identifying highly influential nodes in the complicated grief network. Journal of Abnormal Psychology, 125(6), 747–757. doi:10.1037/abn0000181
65. Rubin D. C., Berntsen D., Bohni M. K., (2008). A memory-based model of posttraumatic stress disorder: Evaluating basic assumptions underlying the PTSD diagnosis. Psychological Review, 115(4), 985–1011. doi:10.1037/a0013397
66. Shafer A. B., (2006). Meta-analysis of the factor structures of four depression questionnaires: Beck, CES-D, Hamilton, and Zung. Journal of Clinical Psychology, 62(1), 123–146. doi:10.1002/jclp
67. Sjöström N., Waern M., Hetta J., (2007). Nightmares and sleep disturbances in relation to suicidality in suicide attempters. Sleep, 30(1), 91–95.
68. Spiller T. R., Schick M., Schnyder U., Bryant R. A., Nickerson A., Morina N., (2017). Symptoms of posttraumatic stress disorder in a clinical sample of refugees: A network analysis. European Journal of Psychotraumatology, 8(Suppl. 2), 1318032. doi:10.1080/20008198.2017.1318032
69. Steenkamp M. M., Litz B. T., Hoge C. W., Marmar C. R., (2015). Psychotherapy for military-related PTSD: A review of randomized clinical trials. Journal of the American Medical Association, 314(5), 489–500. doi:10.1001/jama.2015.8370
70. Sullivan C. P., Smith A. J., Lewis M., Jones R. T., (2016). Network analysis of PTSD symptoms following mass violence. Psychological Trauma: Theory, Research, Practice and Policy. doi:10.1037/tra0000237
71. Tackett J. L., Lilienfeld S. O., Patrick C. J., Johnson S. L., Krueger R. F., Miller J. D... Shrout P. E., (2017). It’s time to broaden the replicability conversation: Thoughts for and from clinical psychological science. Perspectives on Psychological Science, 12(5), 742–756. doi:10.1177/1745691614549257
72. van Borkulo C. D., Borsboom D., Epskamp S., Blanken T. F., Boschloo L., Schoevers R. A., Waldorp L. J., (2014). A new method for constructing networks from binary data. Scientific Reports, 4, 5918. doi:10.1038/srep05918
73. van Borkulo C. D., Boschloo L., Kossakowski J. J., Tio P., Schoevers R. A., Borsboom D... Boschloo L. (2017, March). Comparing network structures on three aspects (Working Paper). doi:10.13140/RG.2.2.29455.38569
74. Van Liempt S., Van Zuiden M., Westenberg H., Super A., Vermetten E. (2013). Impact of impaired sleep on the development of PTSD symptoms in combat veterans: A prospective longitudinal cohort study. Depression and Anxiety, 30(5), 469–474. doi:10.1002/da.22054
75. van Loo H. M., de Jonge P., Romeijn J.-W., Kessler R. C., Schoevers R. A. (2012). Data-driven subtypes of major depressive disorder: A systematic review. BMC Medicine, 10(1), 156. doi:10.1186/1741-7015-10-156
76. Verschuere B., van Ghesel Grothe A. S., Waldorp L., Watts A. L., Lilienfeld S. O., Edens J. F... Noordhof A., (2017). What features of psychopathy might be central? A network analysis of the Psychopathy Checklist-Revised (PCL-R) in three large samples. Journal of Abnormal Psychology. Advance online publication. doi:10.1037/abn0000315
77. Waszczuk M. A., Kotov R., Ruggero C., Gamez W., Watson D., (2017). Hierarchical structure of emotional disorders: From individual symptoms to the spectrum. Journal of Abnormal Psychology, 126(5), 613–634. doi:10.1037/abn0000264
78. Watts B. V., Schnurr P. P., Mayo L., Young-Xu Y., Weeks W. B., Friedman M. J., (2013). Meta-analysis of the efficacy of treatments for posttraumatic stress disorder. The Journal of Clinical Psychiatry, 74(6), e541–e550. doi:10.4088/JCP.12r08225
79. Weathers F. W., Litz B. T., Herman D. S., Huska J. A., Keane T. M., (1993, January). The PTSD Checklist (PCL): Reliability, validity, and diagnostic utility. Poster session presented at the annual convention of the International Society for Traumatic Stress Studies, San Antonio, TX. Retrieved from https://www.researchgate.net/publication/291448760_The_PTSD_Checklist_PCL_Reliability_validity_and_diagnostic_utility
80. Wisco B. E., Miller M. W., Wolf E. J., Kilpatrick D., Resnick H. S., Badour C. L... Friedman M. J., (2016). The impact of proposed changes to ICD-11 on estimates of PTSD prevalence and comorbidity. Psychiatry Research, 240, 226–233. doi:10.1016/j.psychres.2016.04.043