Validation of six short and ultra-short screening instruments for depression for people living with HIV in Ontario: Results from the Ontario HIV treatment network cohort study

PLoS ONE

Volumn 10, Issue 11, 2015, Pages

  Choi, Stephanie K Y ^a,b   Boyle, Eleanor ^c,d   Burchell, Ann N ^d   Gardner, Sandra ^a,d   Collins, Evan ^b,d,e,f,g   Grootendorst, Paul ^a,d   Rourke, Sean B ^a,d  

^a ONTARIO HIV TREATMENT NETWORK   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

^c UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^d UNIVERSITY OF TORONTO   (Canada)

^e UNIVERSITY HEALTH NETWORK   (Canada)

^f MCMASTER UNIVERSITY   (Canada)

^g ST MICHAEL'S HOSPITAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; CANADA; CENTER FOR EPIDEMIOLOGIC DEPRESSION SCALE; CLINICAL ASSESSMENT TOOL; COHORT ANALYSIS; CONTROLLED STUDY; CROSS-SECTIONAL STUDY; DEPRESSION; DEPRESSION ASSESSMENT; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST ACCURACY STUDY; DIAGNOSTIC VALUE; FEMALE; HUMAN; HUMAN IMMUNODEFICIENCY VIRUS INFECTION; INSTRUMENT VALIDATION; KESSLER PSYCHOLOGICAL DISTRESS SCALE; MAJOR CLINICAL STUDY; MALE; PATIENT HEALTH QUESTIONNAIRE; PREDICTIVE VALUE; SCREENING TEST; SENSITIVITY AND SPECIFICITY; VALIDATION STUDY; AREA UNDER THE CURVE; CLINICAL TRIAL; COMPLICATION; DEPRESSIVE DISORDER, MAJOR; EPIDEMIOLOGY; INFORMATION PROCESSING; MASS SCREENING; MIDDLE AGED; MULTICENTER STUDY; ONTARIO; PROCEDURES; PSYCHOLOGICAL RATING SCALE; PSYCHOLOGY; PSYCHOMETRY; QUESTIONNAIRE; RECEIVER OPERATING CHARACTERISTIC; REPRODUCIBILITY; STATISTICAL MODEL;

ADULT; AREA UNDER CURVE; COHORT STUDIES; CROSS-SECTIONAL STUDIES; DATA COLLECTION; DEPRESSIVE DISORDER, MAJOR; FEMALE; HIV INFECTIONS; HUMANS; MALE; MASS SCREENING; MIDDLE AGED; MODELS, STATISTICAL; ONTARIO; PSYCHIATRIC STATUS RATING SCALES; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; ROC CURVE; SURVEYS AND QUESTIONNAIRES;

EID: 84958811350     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0142706     Document Type: Article

References (53)

1. Williams P, Narciso L, Browne G, Roberts J, Weir R, Gafni A. The prevalence, correlates, and costs of depression in people living with HIV/AIDS in Ontario: implications for service directions. AIDS Educ Prev. 2005; 17(2):119-30. PMID: 15899750
2. Pence BW, Miller WC, Whetten K, Eron JJ, Gaynes BN. Prevalence of DSM-IV-defined mood, anxiety, and substance use disorders in an HIV clinic in the Southeastern United States. J Acquir Immune Defic Syndr. 2006; 42(3):298-306. PMID: 16639343
3. Bing EG, Burnam M a, Longshore D, Fleishman J a, Sherbourne CD, London a S, et al. Psychiatric disorders and drug use among human immunodeficiency virus-infected adults in the United States. Arch Gen Psychiatry. 2001; 58(8):721-8. PMID: 11483137
4. Parhami I, Fong TW, Siani A, Carlotti C, Khanlou H. Documentation of psychiatric disorders and related factors in a large sample population of HIV-positive patients in California. AIDS Behav. 2013; 17 (8):2792-801. doi: 10.1007/s10461-012-0386-8 PMID: 23247363
5. Burnam MA, Bing EG, Morton SC, Sherbourne C, Fleishman JA, London AS, et al. Use of mental health and substance abuse treatment services among adults with HIV in the United States. Archives of general psychiatry. 2001; 58(8):729-36. PMID: 11483138
6. Vitiello B, Burnam MA, Bing EG, Beckman R, Shapiro MF. Use of psychotropic medications among HIV-infected patients in the United States. Am J Psychiatry. 2003; 160(3):547-54. PMID: 12611837
7. Cook JA, Burke-Miller JK, Grey DD, Cocohoba J, Liu C, Schwartz RM, et al. Do HIV-positive women receive depression treatment that meets best practice guidelines? AIDS Behav. 2014; 18(6):1094-102. doi: 10.1007/s10461-013-0679-6 PMID: 24402689
8. Asch SM, Kilbourne AM, Gifford AL, Burnam MA, Turner B, Shapiro MF, et al. Underdiagnosis of Depression in HIV: who are we missing? Journal of general internal medicine. 2003; 18(6): 450-60 PMID: 12823652
9. Leserman J. HIV disease progression: depression, stress, and possible mechanisms. Biol Psychiatry. 2003; 54(3):295-306. PMID: 12893105
10. Cruess DG, Douglas SD, Petitto JM, Leserman J, Ten Have T, Gettes D, et al. Association of depression, CD8+ T lymphocytes, and natural killer cell activity: implications for morbidity and mortality in Human immunodeficiency virus disease. Curr Psychiatry Rep. 2003; 5(6):445-50. PMID: 14609499
11. Leserman J, Petitto JM, Gu H, Gaynes BN, Barroso J, Golden RN, et al. Progression to AIDS, a clinical AIDS condition and mortality: psychosocial and physiological predictors. Psychol Med. 2002; 32 (6):1059-73. PMID: 12214787
12. Leserman J, Petitto JM, Golden RN, Gaynes BN, Gu H, Perkins DO, et al. Impact of stressful life events, depression, social support, coping, and cortisol on progression to AIDS. Am J Psychiatry. 2000; 157(8):1221-8. PMID: 10910783
13. Cook JA, Grey D, Burke J, Cohen MH, Gurtman AC, Richardson JL, et al. Depressive symptoms and AIDS-related mortality among a multisite cohort of HIV-positive women. Am J Public Health. 2004; 94 (7):1133-40. PMID: 15226133
14. Ickovics JR, Hamburger ME, Vlahov D, Schoenbaum EE, Schuman P, Boland RJ, et al. Mortality, CD4 Cell Count Decline, and Depressive Symptoms Among HIV-Seropositive Women. JAMA J Am Med Assoc. 2001; 285(11):1466-1474.
15. Jia H, Uphold CR, Wu S, Reid K, Findley K, Duncan PW. Health-related quality of life among men with HIV infection: effects of social support, coping, and depression. AIDS Patient Care STDS. 2004; 18 (10):594-603. PMID: 15630787
16. Kaaya S, Eustache E, Lapidos-Salaiz I, Musisi S, Psaros C, Wissow L. Grand challenges: Improving HIV treatment outcomes by integrating interventions for co-morbid mental illness. PLoS Med. 2013; 10 (5):e1001447. doi: 10.1371/journal.pmed.1001447 PMID: 23700389
17. National Collaborating Centre for Mental Health. Depression in adults with a chronic physical health problem. Treatment and management Treatment and management [NICE Clinical Guidelines, no. 91]. London (UK); 2009.
18. Ramasubbu R, Beaulieu S, Taylor V. TThe CANMAT task force recommendations for the management of patients with mood disorders and comorbid medical conditions: diagnostic, assessment, and treatment principles. Annals of clinical psychiatry. 2012; 24(1):82-90. PMID: 22303524
19. U.S. preventive services task force. Screening for depression in adults: U.S. preventive services task force recommendation statement. Ann Intern Med. 2009; 151(11):784-92. doi: 10.7326/0003-4819-151-11-200912010-00006 PMID: 19949144
20. Meader N, Mitchell AJ, Chew-Graham C, Goldberg D, Rizzo M, Bird V, et al. Case identification of depression in patients with chronic physical health problems: a diagnostic accuracy meta-analysis of 113 studies. British Journal of General Practice; 2011; 61(593):e808-20. doi: 10.3399/bjgp11X613151 PMID: 22137418
21. Akena D, Joska J, Obuku EA, Amos T, Musisi S, Stein DJ. Comparing the accuracy of brief versus long depression screening instruments which have been validated in low and middle income countries: a systematic review. BMC Psychiatry. 2012; 12:187. doi: 10.1186/1471-244X-12-187 PMID: 23116126
22. Tsai AC. Reliability and validity of depression assessment among persons with HIV in sub-Saharan Africa: systematic review and meta-analysis. J Acquir Immune Defic Syndr. 2014; 66(5):503-11. doi: 10.1097/QAI.0000000000000210 PMID: 24853307
23. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001; 16(9):606-13. PMID: 11556941
24. Radloff LS. The CES-D Scale: A Self-Report Depression Scale for Research in the General Population. Appl Psychol Meas. 1977; 1(3):385-401.
25. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SLT, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002; 32(6):959-76. PMID: 12214795
26. Brooks RT. Factor Structure and Interpretation of the K10. Psychol Assess. 18(1):62-70. PMID: 16594813
27. Baillie AJ. Predictive gender and education bias in Kessler's psychological distress Scale (k10). Soc Psychiatry Psychiatr Epidemiol. 2005; 40(9):743-8. PMID: 16142511
28. Rourke SB, Gardner S, Burchell AN, Raboud J, Rueda S, Bayoumi AM, et al. Cohort profile: the Ontario HIV Treatment Network Cohort Study (OCS). Int J Epidemiol. 2013; 42(2):402-11. doi: 10.1093/ije/dyr230 PMID: 22345312
29. Sheehan D V, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998; 59 Suppl 2:22-33.
30. Sheehan D, Lecrubier Y, Harnett Sheehan K, Janavs J, Weiller E, Keskiner A, et al. The validity of the Mini International Neuropsychiatric Interview (MINI) according to the SCID-P and its reliability. Eur Psychiatry. 1997; 12(5):232-41.
31. Lecrubier Y. The Mini International Neuropsychiatric Interview (MINI). A short diagnostic structured interview: reliability and validity according to the CIDI. Eur Psychiatry. 1997; 12(5):224-231.
32. Kalichman SC, Rompa D, Cage M. Distinguishing between overlapping somatic symptoms of depression and HIV disease in people living with HIV-AIDS. J Nerv Ment Dis. 2000; 188(10):662-70. PMID: 11048815
33. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988; 44(3):837-45. PMID: 3203132
34. Janes H, Pepe MS. Adjusting for covariate effects on classification accuracy using the covariateadjusted receiver operating characteristic curve. Biometrika. 2009; 96(2):371-82. PMID: 22822245
35. Vittinghoff E. Regression methods in biostatistics: linear, logistic, survival, and repeated measures models. Springer; 2005.
36. Schäfer H. Constructing a cut-off point for a quantitative diagnostic test. Stat Med. 1989; 8(11):1381-91. PMID: 2692111
37. Vermont J, Bosson JL, François P, Robert C, Rueff A, Demongeot J. Strategies for graphical threshold determination. Comput Methods Programs Biomed. 1991; 35(2):141-50. PMID: 1914452
38. Bohning D, Bohning W, Holling H. Revisiting youden ' s index as a useful measure of the misclassification error in meta-analysis of diagnostic studies. Stat Methods Med Res. 2008; 17(6): 543-54. doi: 10.1177/0962280207081867 PMID: 18375457
39. Gallop RJ, Crits-Christoph P, Muenz LR, Tu XM. Determination and interpretation of the optimal operating point for ROC curves derived through generalized linear models. Understanding Statistics. 2003; 2 (4): 219-242.
40. Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PMM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003; 56(11):1129-35. PMID: 14615004
41. Youden WJ. Index for rating diagnostic tests. Cancer. 1950; 3(1):32-5. PMID: 15405679
42. Böhning D, Holling H, Patilea V. A limitation of the diagnostic-odds ratio in determining an optimal cutoff value for a continuous diagnostic test. Stat Methods Med Res. 2011; 20(5):541-50. doi: 10.1177/0962280210374532 PMID: 20639268
43. Janes H, Longton G, Pepe M. Accommodating Covariates in ROC Analysis. Stata J. 2009; 9(1):17-39. PMID: 20046933
44. Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983; 148(3):839-43. PMID: 6878708
45. Efron B, Tibshirani RJ. An Introduction to the Bootstrap. CRC Press; 1994
46. StataCorp. Statistical Software. College Station, TX: Stata StataCorp LP; 2013.
47. Obuchowski NA, McClish DK. Sample size determination for diagnostic accuracy studies involving binormal ROC curve indices. Stat Med. 1997; 16(13):1529-42. PMID: 9249923
48. Akena D, Joska J, Obuku EA, Stein DJ. Sensitivity and specificity of clinician administered screening instruments in detecting depression among HIV-positive individuals in Uganda. AIDS Care. 2013; 25 (10):1245-52. doi: 10.1080/09540121.2013.764385 PMID: 23398282
49. Spies G, Kader K, Kidd M, Smit J, Myer L, Stein DJ, et al. Validity of the K-10 in detecting DSM-IVdefined depression and anxiety disorders among HIV-infected individuals. AIDS Care. 2009; 21 (9):1163-8. doi: 10.1080/09540120902729965 PMID: 20024776
50. Manea L, Gilbody S, McMillan D. Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis. CMAJ. 2012; 184(3):E191-6. doi: 10.1503/cmaj. 110829 PMID: 22184363
51. Khamseh ME, Baradaran HR, Javanbakht A, Mirghorbani M, Yadollahi Z, Malek M. Comparison of the CES-D and PHQ-9 depression scales in people with type 2 diabetes in Tehran, Iran. BMC Psychiatry. 2011; 11(1):61.
52. Hermanns N, Kulzer B, Krichbaum M, Kubiak T, Haak T. How to screen for depression and emotional problems in patients with diabetes: comparison of screening characteristics of depression questionnaires, measurement of diabetes-specific emotional problems and standard clinical assessment. Diabetologia. 2006; 49(3):469-77. PMID: 16432706
53. Raboud J, Su D, Burchell AN, Gardner S, Walmsley S, Bayoumi AM, et al. Representativeness of an HIV cohort of the sites from which it is recruiting: results from the Ontario HIV Treatment Network (OHTN) cohort study. BMC Med Res Methodol. 2013; 13(1):31.