Evaluation of Computerized Adaptive Tests (CATs) for longitudinal monitoring of depression, anxiety, and stress reactions

Journal of Affective Disorders

Volumn 190, Issue , 2016, Pages 846-853

  Devine, Janine ^a   Fliege, Herbert ^b   Kocalevent, Rüya ^c   Mierke, Annett ^a   Klapp, Burghard F ^a   Rose, Matthias ^a,d  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b Federal Foreign Office (FFO)   (Germany)

^c UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

^d UNIVERSITY OF MASSACHUSETTS MEDICAL SCHOOL   (United States)

Author keywords

Computer Adaptive Test; Item Response Theory; Mental health; Monitor; Questionnaire; Sensitivity to change

Indexed keywords

ADJUSTMENT DISORDER; ADULT; ANXIETY DISORDER; ARTICLE; COMPUTERIZED ADAPTIVE TESTING; CONTROLLED STUDY; DEPRESSION; DISSOCIATIVE DISORDER; EATING DISORDER; FEMALE; HOSPITAL PATIENT; HUMAN; LONGITUDINAL STUDY; MAJOR CLINICAL STUDY; MALE; MENTAL DISEASE; MENTAL HEALTH; MENTAL PATIENT; PATIENT HEALTH QUESTIONNAIRE 9; PATIENT MONITORING; PITTSBURGH SLEEP QUALITY INDEX; PRIORITY JOURNAL; SELF EVALUATION; SENSITIVITY ANALYSIS; SOMATOFORM DISORDER; STRESS; TEST RETEST RELIABILITY; ADOLESCENT; AGED; AMBULATORY MONITORING; ANXIETY; COMPUTER ASSISTED DIAGNOSIS; EVALUATION STUDY; MENTAL STRESS; MIDDLE AGED; PROCEDURES; REPRODUCIBILITY; VERY ELDERLY; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; AGED, 80 AND OVER; ANXIETY; DEPRESSION; DIAGNOSIS, COMPUTER-ASSISTED; FEMALE; HUMANS; LONGITUDINAL STUDIES; MALE; MIDDLE AGED; MONITORING, AMBULATORY; REPRODUCIBILITY OF RESULTS; SELF-ASSESSMENT; STRESS, PSYCHOLOGICAL; YOUNG ADULT;

EID: 84949604121     PISSN: 01650327     EISSN: 15732517     Source Type: Journal    
DOI: 10.1016/j.jad.2014.10.063     Document Type: Article

References (77)

1. M. Adler, J. Hetta, G. Isacsson, and U. Brodin An item response theory evaluation of three depression assessment instruments in a clinical sample BMC.Med.Res Methodol. 12 2012 84
2. S.H. Aggen, M.C. Neale, and K.S. Kendler DSM criteria for major depression: evaluating symptom patterns using latent-trait item response models Psychol. Med. 35 2005 475 487
3. A. Agrawal, J.I. Nurnberger Jr., and M.T.m Lynskey Item response modeling of DSM-IV mania symptoms in two representative US epidemiological samples Psychol. Med. 40 2010 1549 1558
4. M. Anatchkova, M. Rose, J. Ware, and J.B. Bjorner Evaluation of a role functioning computer adaptive test (RF-CAT) Qual. Life Res. 22 5 2013 1085 1092
5. S. Balsis, M.E. Gleason, C.M. Woods, and T.F. Oltmanns An item response theory analysis of DSM-IV personality disorder criteria across younger and older age groups Psychol. Aging 22 2007 171 185
6. D.E. Beaton, C. Bombardier, J.N. Katz, and J.G. Wright A taxonomy for responsiveness J. Clin. Epidemiol. 54 2001 1204 1217
7. K.B. Bevans, G. Diamond, and S. Levy Screening for adolescents' internalizing symptoms in primary care: item response theory analysis of the behavior health screen depression, anxiety, and suicidal risk scales J. Dev. Behav. Pediatr. 33 2012 283 290
8. J. Becker, H. Fliege, R.D. Kocalevent, J.B. Bjorner, M. Rose, O.B. Walter, and B.F. Klapp Functioning and validity of a Computerized Adaptive Test to measure anxiety (A-CAT) Depress. Anxiety 25 2008 E182 E194
9. J.B. Bjorner, M. Kosinski, and J.E. Ware Jr. Using item response theory to calibrate the Headache Impact Test (HIT) to the metric of traditional headache scales Qual. Life Res. 12 2003 981 1002
10. D. Brouwer, R.R. Meijer, and J. Zevalkink Measuring individual significant change on the Beck Depression Inventory-II through IRT-based statistics Psychother. Res. 23 2013 489 501
11. N. Carragher, L. Mewton, T. Slade, and M. Teesson An item response analysis of the DSM-IV criteria for major depression: findings from the Australian National Survey of Mental Health and Wellbeing J. Affect. Disord. 130 1-2 2011 92 98
12. S.M. Castro, C. Trentini, and J. Riboldi Item response theory applied to the Beck Depression Inventory Rev. Bras. Epidemiol. 13 2010 487 501
13. K.S. Chan, M. Orlando, B. Ghosh-Dastidar, N. Duan, and C.D. Sherbourne The interview mode effect on the Center for Epidemiological Studies Depression (CES-D) scale: an item response theory analysis Med. Care 42 2004 281 289
14. A.L. Cheville, K.J. Yost, D.R. Larson, S.K. Dos, M.M. OByrne, M.T. Chang, T.M. Therneau, F.E. Diehn, and P. Yang Performance of an item response theory-based computer adaptive test in identifying functional decline Arch. Phys. Med. Rehabil. 93 2012 1153 1160
15. R.A. Childs, W.G. Dahlstrom, S.M. Kemp, and A.T. Panter Item response theory in personality assessment: a demonstration using the MMPI-2 depression scale Assessment 7 2000 37 54
16. S.W. Choi, S.P. Reise, P.A. Pilkonis, R.D. Hays, and D. Cella Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms Qual. Life Res. 19 1 2010 125 136
17. S.W. Choi, B. Schalet, K.F. Cook, and D. Cella Establishing a common metric for depressive symptoms: linking the BDI-II, CES-D, and PHQ-9 to PROMIS depression Psychol. Assess. 26 2014 513 527
18. G. Cumming, and S. Finch A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions Educ. Psychol. Meas. 61 2001 633 649
19. S.E.Embretson, and S.P. Reise Item Response Theory for Psychologists 2000 Lawrence Erlbaum Associates London
20. K.R. Evans, T. Sills, D.J. DeBrota, S. Gelwicks, N. Engelhardt, and D. Santor An Item Response analysis of the Hamilton Depression Rating Scale using shared data from two pharmaceutical companies J. Psychiatr. Res. 38 2004 275 284
21. H.F. Fischer, N. Schirmer, K. Tritt, B.F. Klapp, and H. Fliege Retest-reliability and sensitivity to change of the ICD-10-Symptom-Rating (ISR) in different samples Psychother. Psychosom. Med. Psychol. 61 2011 162 169
22. H.F. Fischer, K. Tritt, B.F. Klapp, and H. Fliege How to compare scores from different depression scales: equating the Patient Health Questionnaire (PHQ) and the ICD-10-Symptom Rating (ISR) using Item Response Theory Int. J Methods Psychiatr. Res 20 2011 203 214
23. H. Fliege, J. Becker, O.B. Walter, J.B. Bjorner, B.F. Klapp, and M. Rose Development of a computer-adaptive test for depression (D-CAT) Qual. Life Res. 14 2005 2277 2291
24. H. Fliege, J. Becker, O.B. Walter, M. Rose, J.B. Bjorner, and B.F. Klapp Evaluation of a computer-adaptive test for the assessment of depression (D-CAT) in clinical application Int. J. Methods Psychiatr. Res. 18 2009 23 36
25. H. Fliege, M. Rose, P. Arck, O.B. Walter, R.D. Kocalevent, C. Weber, and B.F. Klapp The Perceived Stress Questionnaire (PSQ) reconsidered: validation and reference values from different clinical and healthy adult samples Psychosom. Med. 67 2005 78 88
26. M.J. Forjaz, C. Rodriguez-Blazquez, and P. Martinez-Martin Rasch analysis of the hospital anxiety and depression scale in Parkinsons disease Mov. Disord. 24 2009 526 532
27. T.M. Fragoso, and M. Curi Improving psychometric assessment of the beck depression inventory using multidimensional item response theory Biom. J. 55 2013 527 540
28. H. Gelhorn, C. Hartman, J. Sakai, S. Mikulich-Gilbertson, M. Stallings, S. Young, S. Rhee, R. Corley, J. Hewitt, C. Hopfer, and T. Crowley An item response theory analysis of DSM-IV conduct disorder J. Am. Acad. Child Adolesc. Psychiatry 48 2009 42 50
29. L.E. Gibbons, B.J. Feldman, H.M. Crane, M. Mugavero, J.H. Willig, D. Patrick, J. Schumacher, M. Saag, M.M. Kitahata, and P.K. Crane Migrating from a legacy fixed-format measure to CAT administration: calibrating the PHQ-9 to the PROMIS depression measures Qual. Life Res. 20 9 2011 1349 1357
30. R.D. Gibbons, D.J. Weiss, D.J. Kupfer, E. Frank, A. Fagiolini, V.J. Grochocinski, D.K. Bhaumik, A. Stover, R.D. Bock, and J.C. Immekus Using computerized adaptive testing to reduce the burden of mental health assessment Psychiatr. Serv. 59 2008 361 368
31. R.D. Gibbons, D.J. Weiss, P.A. Pilkonis, E. Frank, T. Moore, J.B. Kim, and D.J. Kupfer Development of a computerized adaptive test for depression Arch. Gen. Psychiatry 69 2012 1104 1112
32. R.D. Gibbons, D.J. Weiss, P.A. Pilkonis, E. Frank, T. Moore, J.B. Kim, and D.J. Kupfer Development of the CAT-ANX: a Computerized Adaptive Test for Anxiety Am. J. Psychiatry 171 2014 187 194
33. V. Guillen, B. Santos, L. Ylla, A. Bulbena, J. Bilbao, E. Fernandez, I.P. de Lazarraga, A.M. Gonzalez-Pinto, and A. Gonzalez-Pinto Depressive dimensions and item response analysis of the Hamilton Depression Rating Scale-17 in eating disorders Compr. Psychiatry 53 2012 396 402
34. S.M. Haley, M. Fragala-Pinkham, and P. Ni Sensitivity of a computer adaptive assessment for measuring functional mobility changes in children enrolled in a community fitness programme Clin. Rehabil. 20 2006 616 622
35. S.M. Haley, B. Gandek, H. Siebens, R.M. Black-Schaffer, S.J. Sinclair, W. Tao, W.J. Coster, P. Ni, and A.M. Jette Computerized adaptive testing for follow-up after discharge from inpatient rehabilitation: II. Participation outcomes Arch. Phys. Med. Rehabil. 89 2008 275 283
36. S.M. Haley, H. Siebens, W.J. Coster, W. Tao, R.M. Black-Schaffer, B. Gandek, S.J. Sinclair, and P. Ni Computerized adaptive testing for follow-up after discharge from inpatient rehabilitation: I. Activity outcomes Arch. Phys. Med. Rehabil. 87 2006 1033 1042
37. D.L. Hart, Y.C. Wang, P.W. Stratford, and J.E. Mioduski A computerized adaptive test for patients with hip impairments produced valid and responsive measures of function Arch. Phys. Med. Rehabil. 89 2008 2129 2139
38. D.L. Hart, Y.C. Wang, P.W. Stratford, and J.E. Mioduski Computerized adaptive test for patients with foot or ankle impairments produced valid and responsive measures of function Qual. Life Res. 17 2008 1081 1091
39. D.L. Hart, D. Deutscher, M.W. Werneke, Y.C. Wang, P.W. Stratford, and J.E. Mioduski Implementing computerized adaptive tests in routine clinical practice: experience implementing CATs J. Appl. Meas. 11 3 2010 288 303
40. D.L. Hart, M.W. Werneke, Y.C. Wang, P.W. Stratford, and J.E. Mioduski Computerized adaptive test for patients with lumbar spine impairments produced valid and responsive measures of function Spine 35 2010 2157 2164
41. D.L. Hart, P.W. Stratford, M.W. Werneke, D. Deutscher, and Y.C. Wang Lumbar computerized adaptive test and Modified Oswestry Low Back Pain Disability Questionnaire: relative validity and important change J. Orthop. Sports Phys. Ther. 42 2012 541 551
42. D.E. Irwin, B. Stucky, M.M. Langer, D. Thissen, E.M. Dewitt, J.S. Lai, J.W. Varni, K. Yeatts, and D.A. DeWalt An item response analysis of the pediatric PROMIS anxiety and depressive symptoms scales Qual. Life Res. 19 2010 595 607
43. A.M. Jette, S.M. Haley, P. Ni, S. Olarsch, and R. Moed Creating a computer adaptive test version of the late-life function and disability instrument J. Gerontol. A: Biol. Sci. Med. Sci. 63 11 2008 1246 1256
44. R.D. Kocalevent, M. Rose, J. Becker, O.B. Walter, H. Fliege, J.B. Bjorner, D. Kleiber, and B.F. Klapp An evaluation of patient-reported outcomes found computerized adaptive testing was efficient in assessing stress perception J. Clin. Epidemiol. 62 278-287 2009 287
45. S. Levenstein, C. Prantera, V. Varvo, and et al. Development of the Perceived Stress Questionnaire: a new tool for psychosomatic research J. Psychosom. Res. 37 1993 19 32
46. W.J. Linden, and R.K. Hambleton Handbook of Modern Item Response Theory 1996 Springer Berlin
47. B. Löwe, O. Decker, S. Muller, E. Brahler, D. Schellberg, W. Herzog, and P.Y. Herzberg Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population Med. Care 46 2008 266 274
48. B. Löwe, R.L. Spitzer, S. Zipfel, and W. Herzog PHQ-D. Gesundheitsfragebogen für Patienten. Manual Komplettversion und Kurzform. (Authorized German Verion of the "Prime MD Patient Health Questionnaire (PHQ)") 2002 Pfitzer Heidelberg
49. J.B. McGlinchey, and M. Zimmerman Examining a dimensional representation of depression and anxiety disorders' comorbidity in psychiatric outpatients with item response modeling J. Abnorm. Psychol. 116 2007 464 474
50. K. Milette, M. Hudson, M. Baron, and B.D. Thombs Comparison of the PHQ-9 and CES-D depression scales in systemic sclerosis: internal consistency reliability, convergent validity and clinical correlates Rheumatology 49 2010 789 796
51. A.J. Mitchell, A.B. Smith, Z. Al salihy, T.A. Rahim, M.Q. Mahmud, and A.S. Muhyaldin Redefining diagnostic symptoms of depression using Rasch analysis: testing an item bank suitable for DSM-V and computer adaptive testing. Aust N.Z. J. Psychiatry 45 2011 846 852
52. E. Muraki A generalized partial credit model W.J. Linden, R.K. Hambleton, Handbook of Modern Item Response Theory 1997 Springer Berlin 153 164
53. W.E. Narrow, D.E. Clarke, S.J. Kuramoto, H.C. Kraemer, D.J. Kupfer, L. Greiner, and D.A. Regier DSM-5 field trials in the United States and Canada, Part III: development and reliability testing of a cross-cutting symptom assessment for DSM-5 Am. J. Psychiatry 170 1 2013 71 82
54. R. Nuevo, G. Dunn, C. Dowrick, J.L. Vazquez-Barquero, P. Casey, O.S. Dalgard, V. Lehtinen, and J.L. Ayuso-Mateos Cross-cultural equivalence of the Beck Depression Inventory: a five-country analysis from the ODIN study J. Affect. Disord. 114 2009 156 162
55. T.M. Olino, L. Yu, D.L. McMakin, E.E. Forbes, J.R. Seeley, P.M Lewinsohn, and P.A. Pilkonis Comparisons across depression assessment instruments in adolescence and young adulthood: an item response theory study using two linking methods J. Abnorm. Child Psychol. 41 8 2013 1267 1277
56. M. Orlando, and G.N. Marshall Differential item functioning in a Spanish translation of the PTSD checklist: detection and evaluation of impact Psychol. Assess. 14 2002 50 59
57. M.C. Paap, R.R. Meijer, J. Van Bebber, G. Pedersen, S. Karterud, F.M. Hellem, and I.R. Haraldsen A study of the dimensionality and measurement precision of the SCL-90-R using item response theory Int. J. Methods Psychiatr. Res. 20 2011 e39 e55
58. P.A. Pilkonis, S.W. Choi, S.P. Reise, A.M. Stover, W.T. Riley, and D. Cella Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS): depression, anxiety, and anger Assessment 18 3 2011 263 283
59. P.A. Pilkonis, L. Yu, N.E. Dodds, K.L. Johnston, C.C. Maihoefer, and S.M. Lawrence Validation of the depression item bank from the Patient-Reported Outcomes Measurement Information System (PROMIS) in a three-month observational study J. Psychiatr. Res. 56 2014 112 119
60. P. Rebollo, I. Castejon, J. Cuervo, G. Villa, E. Garcia-Cueto, H. Diaz-Cuervo, P.C. Zardain, J. Muniz, and J. Alonso Validation of a computer-adaptive test to evaluate generic health-related quality of life Health Qual. Life Outcomes 8 2010 147
61. B.B. Reeve, R.D. Hays, J.B. Bjorner, K.F. Cook, P.K. Crane, J.A. Teresi, D. Thissen, D.A. Revicki, D.J. Weiss, R.K. Hambleton, H. Liu, R. Gershon, S.P. Reise, J.S. Lai, and D. Cella Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS) Med.Care 45 2007 S22 S31
62. M. Rose, and A. Bezjak Logistics of collecting patient-reported outcomes (PROs) in clinical practice: an overview and practical examples Qual. Life Res. 18 2009 125 136
63. M. Rose, J.B. Bjorner, J. Becker, J.F. Fries, and J.E. Ware Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS) J. Clin. Epidemiol. 61 2008 17 33
64. M. Rose, M. Anatchkova, J. Fletcher, A.E. Blank, J. Bjorner, B. Löwe, T.S. Rector, and J.E. Ware Short and precise patient self-assessment of heart failure symptoms using a computerized adaptive test Circ. Heart Fail. 5 3 2012 331 339
65. M. Rose, J.B. Bjorner, F. Fischer, M. Anatchkova, B. Gandek, B.F. Klapp, and J.E. Ware Computerized adaptive testing-ready for ambulatory monitoring? Psychosom. Med. 74 2012 338 348
66. M. Rose, J.B. Bjorner, B. Gandek, B. Bruce, J.F. Fries, and J.E. Ware Jr. The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency J. Clin. Epidemiol. 67 2014 516 526
67. M. Rose, O.B. Walter, H. Fliege, J. Becker, V. Hess, and B.F. Klapp Seven years of experience using Personal Digital Assistants (PDA) for psychometric diagnostics in 6000 inpatients and polyclinic patients H.B. Bludau, A. Koop, Mobile Computing in Medicine, GI-Edition Lecture Notes in Informatics, P-15 2002 Köllen Verlag Berlin, Germany 35 44 http://www.researchgate.net/publication/220784232-7-years-of-experience-using-Personal-Digital-Assistants-%28PDA%29-for-psychometric-diagnostics-in-6000-inpatients-and-polyclinic-patients
68. B.D. Schalet, K.F. Cook, S.W. Choi, and D. Cella Establishing a common metric for self-reported anxiety: linking the MASQ, PANAS, and GAD-7 to PROMIS anxiety J. Anxiety Disord. 28 2013 88 96
69. N. Smits, P. Cuijpers, and A. van Straten Applying computerized adaptive testing to the CES-D scale: a simulation study Psychiatry Res. 188 2011 147 155
70. R.L. Spitzer, K. Kroenke, J.B. Williams, and B. Lowe A brief measure for assessing generalized anxiety disorder: the GAD-7 Arch. Intern. Med. 166 2006 1092 1097
71. M. Sunderland, M.J. Hobbs, G. Andrews, and M.G. Craske Assessing DSM-IV symptoms of panic attack in the general population: an item response analysis J. Affect. Disord. 143 2012 187 195
72. I. Wahl, B. Lowe, J.B. Bjorner, F. Fischer, G. Langs, U. Voderholzer, S.A. Aita, N. Bergemann, E. Brahler, and M. Rose Standardization of depression measurement:a common metric was developed for 11 self-report depression measures J. Clin. Epidemiol. 67 1 2014 73 86
73. H. Wainer, N.J. Dorans, R. Flaugher, B.F. Green, R.J. Mislevy, L. Steinberg, and D. Thissen Computerized Adaptive Testing: A Primer 2000 Lawrence Erlbaum Associates Hillsdale
74. O.B. Walter, J. Becker, H. Fliege, J. Bjorner, M. Kosinski, M. Walter, B.F. Klapp, and M. Rose [Entwicklungsschritte für einen computeradaptiven Test zur Erfassug von Angst (A-CAT)]. Developmental steps for a computer-adapted test for anxiety Diagnostica 51 2 2005 88 100
75. O.B. Walter, J. Becker, J.B. Bjorner, H. Fliege, B.F. Klapp, and M. Rose Development and evaluation of a computer adaptive test for 'Anxiety' (Anxiety-CAT) Qual. Life Res. 16 Suppl. 1 2007 S143 S155
76. Ware,J.E., Jr., Bjorner,J.B., Kosinski,M., 1999. Dynamic Health Assessment: The Search for More Practical and More Precise Outcome Measures. Quality of Life Newsletter, January, pp. 11-13.
77. J.E. Ware Jr., M. Kosinski, J.B. Bjorner, M.S. Bayliss, A. Batenhorst, and C.G. Dahlof Tepper S, Dowson A: Applications of computerized adaptive testing (CAT) to the assessment of headache impact Qual. Life Res. 12 2003 935 952