Establishing a common metric for depressive symptoms: Linking the BDI-II, CES-D, and PHQ-9 to PROMIS Depression

Psychological Assessment

Volumn 26, Issue 2, 2014, Pages 513-527

  Choi, Seung W ^a   Schalet, Benjamin ^b   Cook, Karon F ^b   Cella, David ^b  

^a CTB MCGRAW HILL   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

BDI II; Beck Depression Inventory II; Center for epidemiologic studies depression scale; CES D; Linking; Patient health questionnaire; Patient reported outcomes measurement information system depression; PHQ 9; PROMIS

Indexed keywords

ADULT; ARTICLE; BECK DEPRESSION INVENTORY; CENTER FOR EPIDEMEOLIC STUDY DEPRESSION SCALE; CONTROLLED STUDY; DEPRESSION; DISEASE ASSOCIATION; DISEASE SEVERITY; FEMALE; HUMAN; INTERMETHOD COMPARISON; MALE; MIDDLE AGED; NAMED INVENTORIES, QUESTIONNAIRES AND RATING SCALES; NATIONAL HEALTH ORGANIZATION; ORGANIZATIONAL DOWNSIZING; ORGANIZATIONAL EFFICIENCY; OUTCOME ASSESSMENT; PATIENT REPORTED OUTCOME MEASUREMENT INFORMATION SYSTEM; PHYSICIAN ATTITUDE; PROCESS DEVELOPMENT; PROFESSIONAL COMPETENCE; PROFESSIONAL KNOWLEDGE; PSYCHOMETRY; RATING SCALE; SCORING SYSTEM; SYNDROME DELINEATION; DEPRESSIVE DISORDER; PSYCHOLOGICAL RATING SCALE; QUESTIONNAIRE; REPRODUCIBILITY; STATISTICS AND NUMERICAL DATA;

DEPRESSIVE DISORDER; FEMALE; HUMANS; MALE; MIDDLE AGED; PSYCHIATRIC STATUS RATING SCALES; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SURVEYS AND QUESTIONNAIRES;

EID: 84901818592     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0035768     Document Type: Article

References (83)

1. Albano, T. (2011). equate: Statistical methods for test score equating (R Package Version 1.1-4) [Computer software]. Retrieved from http://cran.r-project.org/web/packages/equate/vignettes/equatevignette.pdf.
2. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
3. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.
4. Baguley, T. (2009). Standardized or simple effect size: What should be reported? British Journal of Psychology, 100, 603-617. doi:10.1348/000712608X377117.
5. Beck, A. T. (1967). Depression: Causes and treatment. Philadelphia, PA: University of Pennsylvania Press.
6. Beck, A. T., Rush, A. J., Shaw, B. F., & Emery, G. (1979). Cognitive therapy of depression. New York, NY: Guilford Press.
7. Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation.
8. Bock, R. D., & Mislevy, R. J. (1982). Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6, 431-444. doi:10.1177/014662168200600405.
9. Brennan, R. (2004). Linking with Equivalent Group or Single Group Design (LEGS; Version 2.0) [Computer software]. Iowa City, IA: University of Iowa, Center for Advanced Studies in Measurement and Assessment (CASMA).
10. Buysse, D. J., Yu, L., Moul, D. E., Germain, A., Stover, A., Dodds, N. E., Pilkonis, P. A. (2010). Development and validation of patientreported outcome measures for sleep disturbance and sleep-related impairments. Sleep, 33, 781-792.
11. Cai, L., Thissen, D., & du Toit, S. (2011). IRTPRO 2.01 [Computer software]. Lincolnwood, IL: Scientific Software International.
12. Cella, D., Choi, S., Rosenbloom, S., Surges Tatum, D., Garcia, S., Lai, J.-S., Gershon, R. (2008). A novel IRT-based case-ranking approach to derive expert standards for symptom severity. Quality of Life Research, 17(Suppl. 1), A-32.
13. Cella, D., Gershon, R., Bass, M., & Rothrock, N. (2013). PROMIS Depression Scoring Manual. Retrieved from http://www.assessmentcenter.net/documents/PROMIS%20Depression%20Scoring%20Manual.pdf.
14. Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Hays, R. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. Journal of Clinical Epidemiology, 63, 1179-1194. doi:10.1016/j.jclinepi.2010.04.011.
15. Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Rose, M. (2007). The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH roadmap cooperative group during its first two years. Medical Care, 45, S3-S11. doi:10.1097/01.mlr.0000258615.42478.55.
16. Chen, W.-H., Revicki, D. A., Lai, J., Cook, K. F., & Amtmann, D. (2009). Linking pain items from two studies onto a common scale using item response theory. Journal of Pain and Symptom Management, 38, 615-628. doi:10.1016/j.jpainsymman.2008.11.016.
17. Chen, W. H., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265-289. doi:10.3102/10769986022003265.
18. Choi, S. W. (2009). Firestar: Computerized adaptive testing simulation program for polytomous IRT models. Applied Psychological Measurement, 33, 644-645. doi:10.1177/0146621608329892.
19. Choi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., & Cella, D. (2010). Efficiency of static and computer adaptive short forms compared to full length measures of depressive symptoms. Quality of Life Research, 19, 125-136. doi:10.1007/s11136-009-9560-5.
20. Cook, K. F., Kallen, M. A., & Amtmann, D. (2009). Having a fit: Impact of number of items and distribution of data on traditional criteria for assessing IRT's unidimensionality assumption. Quality of Life Research, 18, 447-460. doi:10.1007/s11136-009-9464-4.
21. Demyttenaere, K., & De Fruyt, J. (2003). Getting what you ask for: On the selectivity of depression rating scales. Psychotherapy and Psychosomatics, 72, 61-70. doi:10.1159/000068690.
22. DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45(Suppl. 1), S12-S21. doi:10.1097/01.mlr.0000254567.79743.e2.
23. Dorans, N. J. (2004). Equating, concordance, and expectation. Applied Psychological Measurement, 28, 227-246. doi:10.1177/0146621604265031.
24. Dorans, N. J. (2007). Linking scores from multiple health outcome instruments. Quality of Life Research, 16(1 Suppl.), 85-94. doi:10.1007/s11136-006-9155-3.
25. Dorans, N. J., & Holland, P. W. (2000). Population invariance and the equatability of tests: Basic theory and the linear case. Journal of Educational Measurement, 37, 281-306. doi:10.1111/j.1745-3984.2000.tb01088.x.
26. Dum, M., Pickren, J., Sobell, L. C., & Sobell, M. B. (2008). Comparing the BDI-II and the PHQ-9 with outpatient substance abusers. Addictive Behaviors, 33, 381-387. doi:10.1016/j.addbeh.2007.09.017.
27. Fischer, H. F., Tritt, K., Klapp, B. F., & Fliege, H. (2011). How to compare scores from different depression scales: Equating the Patient Health Questionnaire (PHQ) and the ICD-10-Symptom Rating (ISR) using item response theory. International Journal of Methods in Psychiatric Research, 20, 203-214. doi:10.1002/mpr.350.
28. Fisher, W. P., Jr., Eubanks, R. L., & Marier, R. L. (1997). Equating the MOS SF36 and the LSU HSI physical functioning scales. Journal of Outcome Measurement, 1, 329-362.
29. Fries, J. F., Cella, D., Rose, M., Krishnan, E., & Bruce, B. (2009). Progress in assessing physical function in arthritis: PROMIS short forms and computerized adaptive testing. Journal of Rheumatology, 36, 2061-2066. doi:10.3899/jrheum.090358.
30. Gershon, R. C., Rothrock, N., Hanrahan, R., Bass, M., & Cella, D. (2010). The use of PROMIS and assessment center to deliver patient-reported outcome measures in clinical research. Journal of Applied Measurement, 11, 304-314.
31. Gershon, R. C., Wagster, M. V., Hendrie, H. C., Fox, N. A., Cook, K. F., & Nowinski, C. J. (2013). NIH Toolbox for assessment of neurological and behavioral function. Neurology, 80(11, Suppl. 3), S2-S6.
32. Gibbons, L. E., Feldman, B. J., Crane, H. M., Mugavero, M., Willig, J. H., Patrick, D., Crane, P. K. (2011). Migrating from a legacy fixedformat measure to CAT administration: Calibrating the PHQ-9 to the PROMIS depression measures. Quality of Life Research, 20, 1349-1357. doi:10.1007/s11136-011-9882-y.
33. Gibbons, L. E., Feldman, B. J., Crane, H. M., Mugavero, M., Willig, J. H., Patrick, D., Crane, P. K. (2013). Erratum to: Migrating from a legacy fixed-format measure to CAT administration: Calibrating the PHQ-9 to the PROMIS depression measures. Quality of Life Research, 22, 459-460. doi:10.1007/s11136-012-0313-5.
34. Haebara, T. (1980). Equating logistic ability scales by a weighted least squares method. Japanese Psychological Research, 22, 144-149.
35. Hamilton, M. (1960). A rating scale for depression. Journal of Neurology, Neurosurgery, & Psychiatry, 23, 56-62. doi:10.1136/jnnp.23.1.56.
36. Hepner, K. A., Hunter, S. B., Edelen, M. O., Zhou, A. J., & Watkins, K. (2009). A comparison of two depressive symptomatology measures in residential substance abuse treatment clients. Journal of Substance Abuse Treatment, 37, 318-325. doi:10.1016/j.jsat.2009.03.005.
37. Holland, P. W. (2007). A framework and history for score linking. In N. J. Dorans, M. Pommerich, & P. W. Holland (Eds.), Linking and aligning scores and scales (pp. 5-30). New York, NY: Springer.
38. Holzner, B., Bode, R. K., Hahn, E. A., Cella, D., Kopp, M., Sperner-Unterweger, B., & Kemmler, G. (2006). Equating EORTC QLQ-C30 and FACT-G scores and its use in oncological research. European Journal of Cancer, 42, 3169-3177. doi:10.1016/j.ejca.2006.08.016.
39. Hopwood, C. J., & Donnellan, M. B. (2010). How should the internal structure of personality inventories be evaluated? Personality and Social Psychology Review, 14, 332-346. doi:10.1177/1088868310361240.
40. Kelly, M. A. R., Morse, J. Q., Stover, A., Hofkens, T., Huisman, E., Shulman, S., Pilkonis, P. A. (2011). Describing depression: Congruence between patient experiences and clinical assessments. British Journal of Clinical Psychology, 50, 46-66. doi:10.1348/014466510X493926.
41. Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking: Methods and practices. doi:10.1007/978-1-4757-4310-4.
42. Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9 validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606-613. doi:10.1046/j.1525-1497.2001.016009606.x.
43. Kuhl, E. A., Kupfer, D. J., & Regier, D. A. (2011). Patient-centered revisions to the DSM-5. Virtual Mentor, 13, 873-879. doi:10.1001/virtualmentor.2011.13.12.stas1-1112.
44. Kung, S., Alarcon, R. D., Williams, M. D., Poppe, K. A., Moore, M. J., & Frye, M. A. (2012). Comparing the Beck Depression Inventory-II (BDIII) and Patient Health Questionnaire (PHQ-9) depression measures in an integrated mood disorders practice. Journal of Affective Disorders, 145, 341-343. doi:10.1016/j.jad.2012.08.017.
45. Lance, C. E., Butts, M. M., & Michels, L. C. (2006). The sources of four commonly reported cutoffcriteria: What did they really say? Organizational Research Methods, 9, 202-220. doi:10.1177/1094428105284919.
46. Liu, H., Cella, D., Gershon, R., Shen, J., Morales, L. S., Riley, W., & Hays, R. D. (2010). Representativeness of the PROMIS Internet panel. Journal of Clinical Epidemiology, 63, 1169-1178. doi:10.1016/j.jclinepi.2009.11.021.
47. Liu, Y., & Thissen, D. (2012). Identifying local dependence with a score test statistic based on the bifactor logistic model. Applied Psychological Measurement, 36, 670-688. doi:10.1177/0146621612458174.
48. Lord, F. M. (1982). The standard error of equipercentile equating. Journal of Educational and Behavioral Statistics, 7, 165-174. doi:10.3102/10769986007003165.
49. Lord, F. M., & Wingersky, M. S. (1984). Comparison of IRT true-score and equipercentile observed-score "equatings". Applied Psychological Measurement, 8, 453-461. doi:10.1177/014662168400800409.
50. Löwe, B., Kroenke, K., & Gräfe, K. (2005). Detecting and monitoring depression with a two-item questionnaire (PHQ-2). Journal of Psychosomatic Research, 58(2), 163-171.
51. Marsh, H. W., Hau, K. T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoffvalues for fit indices and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling, 11, 320-341. doi:10.1207/s15328007sem1103_2.
52. McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.
53. McHorney, C. A., & Cohen, A. S. (2000). Equating health status measures with item response theory: Illustrations with functional status items. Medical Care, 38(9 Suppl.), II-43-II-59. doi:10.1097/00005650-200009002-00008.
54. Milette, K., Hudson, M., Baron, M., & Thombs, B. D. (2010). Comparison of the PHQ-9 and CES-D depression scales in systemic sclerosis: Internal consistency reliability, convergent validity and clinical correlates. Rheumatology, 49, 789-796. doi:10.1093/rheumatology/kep443.
55. Muthén, L. K., & Muthén, B. O. (2006). Mplus [Computer software]. Los Angeles, CA: Muthén & Muthén.
56. Myers, J. K., & Weissman, M. M. (1980). Use of a self-report symptom scale to detect depression in a community sample. American Journal of Psychiatry, 137, 1081-1084.
57. Naughton, M. J., & Wiklund, I. I. (1993). A critical review of dimensionspecific measures of health-related quality of life in cross-cultural research. Quality of Life Research, 2, 397-432. doi:10.1007/BF00422216.
58. Noonan, V. K., Cook, K. F., Bamer, A. M., Choi, S. W., Kim, J., & Amtmann, D. (2012). Measuring fatigue in persons with multiple sclerosis: Creating a crosswalk between the Modified Fatigue Impact Scale and the PROMIS Fatigue Short Form. Quality of Life Research, 21, 1123-1133. doi:10.1007/s11136-011-0040-3.
59. Orlando, M., Sherbourne, C. D., & Thissen, D. (2000). Summed-score linking using item response theory: Application to depression measurement. Psychological Assessment, 12, 354-359. doi:10.1037/1040-3590.12.3.354.
60. Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., & Cella, D. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, anxiety, and anger. Assessment, 18, 263-283. doi:10.1177/1073191111411667.
61. Pilkonis, P. A., Choi, S. W., Salsman, J. M., Butt, Z., Moore, T. L., Lawrence, S. M., Cella, D. (2013). Assessment of self-reported negative affect in the NIH Toolbox. Psychiatry Research, 206, 88-97. doi:10.1016/j.psychres.2012.09.034.
62. Quilty, L. C., & Bagby, R. (2008). The assessment of depressive severity: A review. Directions in Psychiatry, 28, 135-146.
63. Radloff, L. S. (1977). The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385-401. doi:10.1177/014662167700100306.
64. Radloff, L. S., & Locke, B. Z. (1986). The Community Mental Health Assessment Survey and the CES-D Scale. In M. M. Weissman, J. K. Myers, & C. E. Ross (Eds.), Community surveys of psychiatric disorders (pp. 177-189). New Brunswick, NJ: Rutgers University Press.
65. R Core Development Team. (2011). R: A language and environment for statistical computing [Computer software]. Retrieved from http://www.r-project.org/.
66. Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Cella, D. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(Suppl. 1), S22-S31. doi:10.1097/01.mlr.0000250483.85507.04.
67. Reinsch, C. H. (1967). Smoothing by spline functions. Numerische Mathematik, 10, 177-183. doi:10.1007/BF02162161.
68. Reise, S. P., Cook, K. F., & Moore, T. M. (in press). Evaluating the impact of multidimensionality on unidimensional item response theory model parameters. In S. P. Reise & D. A. Revicki (Eds.), Multivariate Applications Series: Handbook of item response theory modeling: Applications to typical performance assessment. New York, NY: Routledge/Taylor & Francis Group.
69. Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013). Multidimensionality and structural coefficient bias in structural equation modeling: A bifactor perspective. Educational and Psychological Measurement, 73, 5-26. doi:10.1177/0013164412449831.
70. Revelle, W. (2013). psych: Procedures for personality and psychological research (R Package Version 1.2.8) [Computer software]. Retrieved from http://cran.r-project.org/web/packages/psych/index.html.
71. Revicki, D. A., Chen, W., Harnam, N., Cook, K. F., Amtmann, D., Callahan, L. F., Keefe, F. J. (2009). Development and psychometric analysis of the PROMIS pain behavior item bank. Pain, 146, 158-169. doi:10.1016/j.pain.2009.07.029.
72. Schmid, J. J., & Leiman, J. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61. doi:10.1007/BF02289209.
73. Shean, G., & Baldwin, G. (2008). Sensitivity and specificity of depression questionnaires in a college-age sample. Journal of Genetic Psychology, 169, 281-292. doi:10.3200/GNTP.169.3.281-292.
74. Stocking, M. L., & Lord, F. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210. doi:10.1177/014662168300700208.
75. Thissen, D., Chen, W.-H., & Bock, R. D. (2003). Multilog 7.03 [Computer software]. Lincolnwood, IL: Scientific Software International.
76. Thissen, D., Varni, J. W., Stucky, B. D., Liu, Y., Irwin, D. E., & DeWalt, D. A. (2011). Using the PEDSQL™ 3.0 asthma module to obtain scores comparable with those of the PROMIS Pediatric Asthma Impact Scale (PAIS). Quality of Life Research, 20, 1497-1505. doi:10.1007/s11136-011-9874-y.
77. Titov, N., Dear, B. F., McMillan, D., Anderson, T., Zou, J., & Sunderland, M. (2011). Psychometric comparison of the PHQ-9 and BDI-II for measuring response during treatment of depression. Cognitive Behaviour Therapy, 40, 126-136. doi:10.1080/16506073.2010.550059.
78. Tritt, K., Heymann, F., Zaudig, M., Zacharias, I., Söllner, W., & Loew, T. H. (2008). Entwicklung des Fragebogens 'ICD-10-Symptomrating' (ISR) [Development of the questionnaire 'ICD-10-Symptom Rating' (ISR)]. Zeitschrift für Psychosomatische Medizin und Psychotherapie, 54, 425-434.
79. Weeks, J. P. (2010). Plink: An R package for linking mixed-format tests using IRT-based methods. Journal of Statistical Software, 35, 1-33.
80. Weissman, M. M., Sholomskas, D., Pottenger, M., Prusoff, B. A., & Locke, B. Z. (1977). Assessing depressive symptoms in five psychiatric populations: A validation study. American Journal of Epidemiology, 106, 203-214.
81. World Health Organization. (2007). Constitution of the World Health Organization: Basic documents (46th ed.). Geneva, Switzerland: Author.
82. Zimmerman, M., & Coryell, W. (1994). Screening for major depressive disorder in the community: A comparison of measures. Psychological Assessment, 6, 71-74. doi:10.1037/1040-3590.6.1.71.
83. ωh: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70, 123-133. doi:10.1007/s11336-003-0974-7.