Measuring individual significant change on the Beck Depression Inventory-II through IRT-based statistics

Psychotherapy Research

Volumn 23, Issue 5, 2013, Pages 489-501

  Brouwer, Danny ^a,b   Meijer, Rob R ^a   Zevalkink, Jolien ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b Netherlands Psychoanalytic Institute   (Netherlands)

Author keywords

BDI II; depression; individual change; item response theory; statistical methodology; test development; Z test

Indexed keywords

ADULT; ANXIETY DISORDER; ARTICLE; DEPRESSION; FEMALE; HUMAN; MALE; MOOD DISORDER; PSYCHOLOGICAL ASPECT; PSYCHOLOGICAL MODEL; PSYCHOLOGICAL RATING SCALE; PSYCHOTHERAPY; REMISSION; STATISTICS; TREATMENT OUTCOME; ANXIETY DISORDERS; MOOD DISORDERS; PSYCHOLOGY; STATISTICS AND NUMERICAL DATA;

ADULT; ANXIETY DISORDERS; DEPRESSION; FEMALE; HUMANS; MALE; MODELS, PSYCHOLOGICAL; MOOD DISORDERS; PSYCHIATRIC STATUS RATING SCALES; PSYCHOTHERAPY; REMISSION INDUCTION; TREATMENT OUTCOME;

EID: 84883454629     PISSN: 10503307     EISSN: 14684381     Source Type: Journal    
DOI: 10.1080/10503307.2013.794400     Document Type: Article

References (66)

1. Al-Turkait, F.A. and Ohaeri, J.U. 2010. Dimensional and hierarchical models of depression using the Beck Depression Inventory-II in an Arab college student sample. BMC Psychiatry, 10: 60 - 74. doi: 10.1186/1471-244X-10-60
2. American Psychiatric Association. 2000. Diagnostic and statistical manual of mental disorders (), 4th ed. TR. Washington, DC: Task Force.
3. Arnau, R.C., Meagher, M.W., Norris, M.P. and Bramson, R. 2001. Psychometric evaluation of the Beck Depression Inventory-II with primary care medical patients. Health Psychology, 20: 112 - 119. doi: 10.1037/0278-6133.20.2.112
4. Atkins, D.C., Bedics, J.D., McGlinchey, J.B. and Beauchaine, T.P. 2005. Assessing clinical significance: Does it matter which method we use?. Journal of Consulting and Clinical Psychology, 73: 982 - 989. doi: 10.1037/0022-006X.73.5.982
5. Bauer, S., Lambert, M.J. and Nielsen, S.L. 2004. Clinical significance methods: A comparison of statistical techniques. Journal of Personality Assessment, 82: 60 - 70. doi: 10.1207/s15327752jpa8201_11
6. Beck, A.T., Steer, R.A. and Brown, G.K. 1996. Manual for the Beck Depression Inventory-II, San Antonio, TX: Psychological Corporation.
7. Beck, A.T., Steer, R.A., Brown, G.K. and van der Does, A.J.W. 2002. BDI-II-NL Handleiding [BDI-II-Dutch manual], Lisse, the Netherlands: Psychological Corporation.
8. Binder, P., Holgersen, H. and Nielsen, G.H. 2010. What is a "good outcome" in psychotherapy? A qualitative exploration of former patients' point of view. Psychotherapy Research, 20: 285 - 294. doi: 10.1080/10503300903376338
9. Bock, R.D. and Mislevy, R.J. 1982. Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6: 431 - 444. doi: 10.1177/014662168200600405
10. Brouwer, D., Meijer, R.R., & Zevalkink, J. 2013. On the factor structure of the Beck Depression Inventory-II: G is the key. Psychological Assessment, 25, 136 - 145. doi: 10.1037/a0029228.
11. Buckley, T.C., Parker, J.D. and Heggie, J. 2001. A psychometric evaluation of the BDI-II in treatment seeking substance abusers. Journal of Substance Abuse Treatment, 20: 197 - 204. doi: 10.1016/S0740-5472(00)00169-0
12. Cai, L., Thissen, D. and du Toit, S. 2011. IRTPRO 2.1 for Windows, Chicago: Scientific Software International.
13. Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S.,. Hays, R.D. on behalf of the PROMIS Cooperative Group. 2010. Initial item banks and first wave testing of the Patient-Reported Outcomes Measurement Information System (PROMIS) network: 2005-2008. Journal of Clinical Epidemiology, 63 (11), 1179 - 1194 doi: 10.1016/j.jclinepi.2010.04.011
14. Christensen, L. and Mendoza, J.L. 1986. A method of assessing change in a single subject: An alteration of the RC index. Behavior Therapy, 15: 305 - 308. doi: 10.1016/S0005-7894(86)80060-0
15. Cole, D.A., Cai, L., Martin, N.C., Findling, R.L., Youngstrom, E.A., Garber, J., &. Forehand, R. 2011. Structure and measurement of depression in youths: Applying item response theory to clinical data. Psychological Assessment, 23, 819 - 833. doi: 10.1037/a0023518.
16. Collins, L.M. 1996. Is reliability obsolete? A commentary on 'Are simple gain scores obsolete'. Applied Psychological Measurement, 20: 289 - 292. doi: 10.1177/014662169602000308
17. Cronbach, L.J. and Furby, L. 1970. How we should measure 'change' - or should we?. Psychological Bulletin, 74: 68 - 80. doi: 10.1037/h0029382
18. Doucette, A. and Wolf, A.W. 2009. Questioning the measurement precision of psychotherapy research. Psychotherapy Research, 19: 374 - 389. doi: 10.1080/10503300902894422
19. Dozois, D.J.A., Dobson, K.S. and Ahnberg, J.L. 1998. A psychometric evaluation of the Beck Depression Inventory-II. Psychological Assessment, 10: 83 - 89. doi: 10.1037/1040-3590.10.2.83
20. Dumenci, L. and Achenbach, T.M. 2008. Effects of estimation methods on making trait-level inferences from ordered categorical items for assessing psychopathology. Psychological Assessment, 20: 55 - 62. doi: 10.1037/1040-3590.20.1.55
21. Embretson, S.E. and Reise, S.P. 2000. Item response theory for psychologists, Mahwah, NJ: Erlbaum.
22. Emons, W.H.M., Meijer, R.R. and Denollet, J. 2007. Negative affectivity and social inhibition in cardiovascular disease: Evaluating Type D personality and its assessment using item response theory. Journal of Psychosomatic Research, 63: 27 - 39. doi: 10.1016/j.jpsychores.2007.03.010
23. Finkelman, M., Weiss, D. and Kim-Kang, G. 2010. Item selection and hypothesis testing for the adaptive measurement of change. Applied Psychological Measurement, 34: 238 - 254. doi: 10.1177/0146621609344844
24. Gershon, R.C., Rothrock, N.E., Hanrahan, R.T., Jansky, L.J., Harniss, M. and Riley, W. 2010. The development of a clinical outcomes survey research application: Assessment Center. Quality of Life Research, 19: 677 - 85. doi: 10.1007/s11136-010-9634-4
25. Guo, J. and Drasgow, F. 2010. Identifying cheating on unproctored Internet tests: The z-test and the likelihood ratio test. International Journal of Selection and Assessment, 18: 351 - 364. doi: 10.1111/j.1468-2389.2010.00518.x
26. Hiller, W., Schindler, A.C. and Lambert, M.J. 2012. Defining response and remission in psychotherapy research: A comparison of the RCI and the method of percent improvement. Psychotherapy Research, 22: 1 - 11. doi: 10.1080/10503307.2011.616237
27. Jacobson, N.S., Follette, W.C. and Revenstorf, D. 1984. Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance. Behavior Therapy, 15: 336 - 352. doi: 10.1016/S0005-7894(84)80002-7
28. Jacobson, N.S., Roberts, L.J., Berns, S.B. and McGlinchey, J.B. 1999. Methods for defining and determining the clinical significance of treatment effects: Description, application, and alternatives. Journal of Consulting and Clinical Psychology, 67: 300 - 307. doi: 10.1037/0022-006X.67.3.300
29. Jacobson, N.S. and Truax, P. 1991. Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59: 12 - 19. doi: 10.1037/0022-006X.59.1.12
30. Kendall, P.C., Marrs-Garcia, A., Nath, S. and Sheldrick, R.C. 1999. Normative comparisons for the evaluation of clinical significance. Journal of Consulting and Clinical Psychology, 67: 285 - 299. doi: 10.1037/0022-006X.67.3.285
31. Lambert, M.J. 2007. Presidential address: What we have learned from a decade of research aimed at improving psychotherapy outcome in routine care. Psychotherapy Research, 17: 1 - 14. doi: 10.1080/10503300601032506
32. Lambert, M.J. and Ogles, B.M. 2009. Using clinical significance in psychotherapy outcome research: The need for a common procedure and validity data. Psychotherapy Research, 19: 493 - 501. doi: 10.1080/10503300902849483
33. Lambert, M.J., Whipple, J.L., Hawkins, E.J., Vermeersch, D.A., Nielsen, S.L. and Smart, D.W. 2003. Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10: 288 - 301. doi: 10.1093/clipsy.bpg025
34. Liu, H.H., Cella, D., Gershon, R., Shen, J., Morales, L.S., Riley, W. and Hays, R.D. 2010. Representativeness of the PROMIS Internet panel. Journal of Clinical Epidemiology, 63: 1169 - 1178. doi: 10.1016/j.jclinepi.2009.11.021
35. Maassen, G.H. 2001. The unreliable change of reliable change indices. Behaviour Research and Therapy, 39: 495 - 498. doi: 10.1016/S0005-7967(00)00029-2
36. McGlinchey, J.B., Atkins, D.C. and Jacobson, N.S. 2002. Clinical significant methods: Which one to use and how useful are they?. Behavior Therapy, 33: 529 - 550. doi: 10.1016/S0005-7894(02)80015-6
37. Meijer, R.R. and Baneke, J.J. 2004. Analyzing psychopathology items: A case for nonparametric item response theory. Psychological Methods, 9: 354 - 368. doi: 10.1037/1082-989X.9.3.354
38. Meijer, R.R. and Egberink, I.J.L. 2011. An item response theory analysis of Harter's Self-Perception Profile for Children or why strong clinical scales should be distrusted. Assessment, 18: 201 - 212. doi: 10.1177/1073191110367778
39. Mellenbergh, G.J. 1999. A note on simple gain score precision. Applied Psychological Measurement, 23: 87 - 89.
40. Mellenbergh, G.J. and Van den Brink, W.P. 1998. The measurement of individual change. Pschychological Methods, 3: 470 - 485. doi: 10.1037/1082-989X.3.4.470
41. Molenaar, I.W., & Sijtsma, K. 2000. MSP5 for Windows. User's manual. Groningen, the Netherlands: ProGAMMA.
42. Ogles, B.M., Lunnen, K.M. and Bonesteel, K. 2001. Clinical significance: History, application and current practice. Clinical Psychology Review, 21: 421 - 446. doi: 10.1016/S0272-7358(99)00058-6
43. Osman, A., Barrios, F.X., Gutierrez, P.M., Williams, J.E. and Bailey, J. 2008. Psychometric properties of the Beck Depression Inventory-II in nonclinical adolescent samples. Journal of Psychopathology and Behavioral Assessment, 64: 83 - 102.
44. Osman, A., Downs, W.R., Barrios, F.X., Kopper, B.A., Guttierrez, P.M. and Chiros, C.E. 1997. Factor structure and psychometric characteristics of the Beck Depression Inventory-II. Journal of Psychopathology and Behavioral Assessment, 19: 359 - 376. doi: 10.1007/BF02229026
45. Percevic, R., Lambert, M.J. and Kordy, H. 2006. What is the predictive value of responses to psychotherapy for its future course? Empirical explorations and consequences for outcome monitoring. Psychotherapy Research, 16: 364 - 373. doi: 10.1080/10503300500485524
46. Purpura, D.J., Wilson, S.B., & Lonigan, C.J. 2010. Attention-deficit/hyperactivity disorder symptoms in preschool children: Examining psychometric properties using item response theory. Psychological Assessment, 22, 546 - 558. doi: 10.1037/a0019581.
47. Quilty, L.C., Zhang, A.Z. and Bagby, R.M. 2010. The latent symptom structure of the Beck Depression Inventory-II in outpatients with major depression. Psychological Assessment, 22: 603 - 608. doi: 10.1037/a0019698
48. Reise, S.P. and Haviland, M.G. 2005. Item response theory and the measurement of clinical change. Journal of Personality Assessment, 84: 228 - 238. doi: 10.1207/s15327752jpa8403_02
49. Reise, S.P. and Henson, J. 2003. A discussion of modern versus traditional psychometrics as applied to personality assessment scales. Journal of Personality Assessment, 81: 93 - 103. doi: 10.1207/S15327752JPA8102_01
50. Reise, S.P. and Waller, N.G. 2009. Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5: 27 - 48. doi: 10.1146/annurev.clinpsy.032408.153553
51. Reise, S.P., and Yu, J. 1990. Parameter recovery in the graded response model using MULTILOG. Journal of Educational Measurement, 27, 133 - 144. doi: 10.1111/j.1745-3984.1990.tb00738.x.
52. Rothrock, N.E., Hays, R.D., Spritzer, K., Yount, S.E., Riley, W. and Cella, D. 2010. Relative to the general US population, chronic diseases are associated with poorer health-related quality of life as measured by the Patient-Reported Outcomes Measurement Information System (PROMIS). Journal of Clinical Epidemiology, 63: 1195 - 1204. doi: 10.1016/j.jclinepi.2010.04.012
53. Samejima, F. 1969. Estimation of latent ability using a response pattern of graded scores. Psychometrika, Monograph 17.
54. Samejima, F. 1997. " Graded response model ". In Handbook of modern item response theory, Edited by: van der Linden, W.J. and Hambleton, R.K. 85 - 100. New York: Springer.
55. Santor, D.A. and Ramsay, J.O. 1998. Progress in the technology of measurement: Applications of Item Response models. Psychological Assessment, 10: 345 - 359. doi: 10.1037/1040-3590.10.4.345
56. Sinharay, S. 2010. How often do subscores have added value? Results from operational and simulated data. Journal of Educational Measurement, 47: 150 - 174. doi: 10.1111/j.1745-3984.2010.00106.x
57. Speer, D.C. and Greenbaum, P.E. 1995. Five methods for computing significant individual client change and improvement rates: Support for an individual growth curve approach. Journal of Consulting and Clinical Psychology, 63: 1043 - 1048.
58. Steer, R.A., Ball, R., Ranieri, W.F. and Beck, A.T. 1999. Dimensions of the Beck Depression Inventory-II in clinically depressed outpatients. Journal of Clinical Psychology, 55: 117 - 128. doi: 10.1002/(SICI)1097-4679(199901)55:1%3C117::AID-JCLP12%3E3.0.CO;2-A
59. Thissen, D., Chen, W.H. and Bock, R.D. 2003. MULTILOG (version 7) [computer software], Lincolnwood, IL: Scientific Software International.
60. Thomas, M.L. 2011. The value of item response theory in clinical assessment: A review. Assessment, 18: 291 - 307. doi: 10.1177/1073191110374797
61. Valkonen, J., Hänninen, V. and Lindfors, O. 2011. Outcomes of psychotherapy from the perspective of the users. Psychotherapy Research, 21: 227 - 240. doi: 10.1080/10503307.2010.548346
62. Walters, G.D., Hagman, B.T. and Cohn, A.M. 2011. Toward a hierarchical model of criminal thinking: Evidence from item response theory and confirmatory factor analysis. Psychological Assessment, 23: 925 - 936. doi: 10.1037/a0024017
63. Ward, L.C. 2006. Comparison of factor structure models for the Beck Depression Inventory-II. Psychological Assessment, 18: 81 - 88. doi: 10.1037/1040-3590.18.1.81
64. Williams, R.H. and Zimmerman, D.W. 1996. Are simple gain scores obsolete?. Applied Psychological Measurement, 20: 59 - 69. doi: 10.1177/014662169602000106
65. Wise, E.A. 2004. Methods for analyzing psychotherapy outcomes: A review of clinical significance, reliable change, and recommendations for future directions. Journal of Personality Assessment, 82: 50 - 59. doi: 10.1207/s15327752jpa8201_10
66. Wu, J., King, K.M., Witkiewitz, K., Racz, S.J. and McMahon, R.J. 2012. Item analysis and differential item functioning of a brief conduct problem screen. Psychological Assessment, 24: 444 - 454. doi: 10.1037/a0025831