Functioning and validity of a computerized adaptive test to measure anxiety (A-CAT)

Depression and Anxiety

Volumn 25, Issue 12, 2008, Pages

  Becker, Janine ^a   Fliege, Herbert ^a   Kocalevent, Rüya Daniela ^a,b   Bjorner, Jakob B ^c,d   Rose, Matthias ^c,d   Walter, Otto B ^e   Klapp, Burghard F ^a  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b FREIE UNIVERSITÄT BERLIN   (Germany)

^c QualityMetric Incorporated   (United States)

^d Health Assessment Lab   (United States)

^e UNIVERSITY OF MÜNSTER   (Germany)

Author keywords

Anxiety; Computerized adaptive test (CAT); Item response theory (IRT); Measurement; Questionnaire; Validity

Indexed keywords

ADULT; AGED; ANXIETY; ARTICLE; BECK ANXIETY INVENTORY; COMPUTERIZED ADAPTIVE TEST TO MEASURE ANXIETY; CONVERGENT VALIDITY; DISCRIMINANT VALIDITY; FEMALE; FUNCTIONAL ASSESSMENT; GERMANY; HOSPITAL ANXIETY AND DEPRESSION SCALE; HUMAN; ITEM RESPONSE THEORY; LONG TERM CARE; MAJOR CLINICAL STUDY; MALE; PERSONAL DIGITAL ASSISTANT; PRIORITY JOURNAL; PSYCHOLOGIC TEST; QUESTIONNAIRE; RELIABILITY; SCORING SYSTEM; STATE TRAIT ANXIETY INVENTORY; THEORY; TREATMENT OUTCOME; VALIDITY;

ADOLESCENT; ADULT; AGED; ANXIETY DISORDERS; COMORBIDITY; COMPUTERS, HANDHELD; DEPRESSIVE DISORDER; DIAGNOSIS, COMPUTER-ASSISTED; FEMALE; HUMANS; MALE; MENTAL DISORDERS; MIDDLE AGED; MODELS, STATISTICAL; PERSONALITY INVENTORY; PSYCHOMETRICS; PSYCHOPHYSIOLOGIC DISORDERS; REPRODUCIBILITY OF RESULTS; SOFTWARE; YOUNG ADULT;

EID: 57349168593     PISSN: 10914269     EISSN: 15206394     Source Type: Journal    
DOI: 10.1002/da.20482     Document Type: Article

References (101)

1. Ohayon MM. Anxiety disorders: prevalence, comorbidity and outcomes. J Psychiatr Res 2006;40:475-476.
2. Somers JM, Goldner EM, Waraich P, Hsu L. Prevalence and incidence studies of anxiety disorders: a systematic review of the literature. Can J Psychiatry 2006;51:100-113.
3. Starcevic V. Review: worldwide lifetime prevalence of anxiety disorders is 16.6%, with considerable heterogeneity between studies. Evid Based Ment Health 2006;9:115.
4. Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry 2005;62:617-627.
5. Narrow WE. The numbers count: mental disorders in America: A summary of statistics describing the prevalence of mental disorders in America. NIMH Report (www.nimh.nih.gov/publicat/numbers.cfm) 2001;24:185-195.
6. Mergl R, Seidscheck I, Allgaier AK, Moller HJ, Hegerl U, Henkel V. Depressive, anxiety, and somatoform disorders in primary care: prevalence and recognition. Depress Anxiety; 2006.
7. Sherbourne CD, Jackson CA, Meredith LS, Camp P, Wells KB. Prevalence of comorbid anxiety disorders in primary care outpatients. Arch Fam Med 1996;5:27-34.
8. Barsky AJ, Cleary PD, Coeytaux RR, Ruskin JN. Psychiatric disorders in medical outpatients complaining of palpitations. J Gen Intern Med 1994;9:306-313.
9. Dahl AA, Haaland CF, Mykletun A, Bremnes R, Dahl O, Klepp O, et al. Study of anxiety disorder and depression in long-term survivors of testicular cancer. J Clin Oncol 2005;23:2389-2395.
10. Katon W, Von Korff M, Lin E, Walker E, Simon G.E, Bush T, et al. Collaborative management to achieve treatment guidelines. Impact on depression in primary care. J Am Med Assoc 1995;273:1026-1031.
11. Stein MB, Asmundson GJ, Ireland D, Walker JR. Panic disorder in patients attending a clinic for vestibular disorders. Am J Psychiatry 1994;151:1697-1700.
12. Walker EA, Roy-Byrne PP, Katon WJ, Li L, Amos D, Jiranek G. Psychiatric illness and irritable bowel syndrome: a comparison with inflammatory bowel disease. Am J Psychiatry 1990;147:1656-1661.
13. DuPont RL, Rice DP, Miller LS, Shiraki SS, Rowland CR, Harwood HJ. Economic costs of anxiety disorders. Anxiety 1996;2:167-172.
14. Balon R. Mood, anxiety, and physical illness: body and mind, or mind and body? Depress Anxiety 2006;23:377-387.
15. Barger SD, Sydeman SJ. Does generalized anxiety disorder predict coronary heart disease risk factors independently of major depressive disorder? J Affect Disord 2005;88:87-91.
16. Bittner A, Goodwin RD, Wittchen HU, Beesdo K, Hofler M, Lieb R. What characteristics of primary anxiety disorders predict subsequent major depressive disorder? J Clin Psychiatry 2004;65:618-626.
17. Fleishman JA, Cohen JW, Manning WG, Kosinski M. Using the SF-12 health status measure to improve predictions of medical expenditures. Med Care 2006;44:I54-I63.
18. Hadjistavropoulos HD, Asmundson GJ, Kowalyk KM. Measures of anxiety: is there a difference in their ability to predict functioning at three-month follow-up among pain patients? Eur J Pain 2004;8:1-11.
19. Hornbrook MC, Goodman MJ. Assessing relative health plan risk with the RAND-36 health survey. Inquiry 1995;32:56-74.
20. Nease Jr DE, Volk RJ, Cass AR. Does the severity of mood and anxiety symptoms predict health care utilization? J Fam Pract 1999;48:769-777.
21. Spielberger CD. Manual for the State-Trait Anxiety Inventory (STAI). PaloAlto, CA: Consulting Psychologists Press; 1983.
22. Beck AT, Steer RA. Beck Anxiety Inventory. BAI. San Antonio: The Psychological Cooperation; 1993.
23. Hermann Ch, Buss U, Snaith RP. Hospital Anxiety and Depression Scale: HADS. Bern: Verlag Hans Huber; 1995.
24. Zung WW. A rating instrument for anxiety disorders. Psychosomatics 1971;12:371-379.
25. Nunnally JC, Bernstein C. Psychometric theory. (2nd ed.) New York: McGraw-Hill; 1994.
26. Embretson S, Reise SP. Item Response Theory for Psychologists. Mahwah: Lawrence Earlbaum Associates, Publishers; 2000.
27. Hambleton RK, Swaminathan H, Rogers HJ. Fundamentals of item response theory. Newbury Park, California: Sage Publications, Inc.; 1991.
28. van der Linden WJ. Hambleton RK. Handbook of modern item response theory. Berlin: Springer; 1997.
29. Gershon R.C. Computer adaptive testing. J Appl Meas 2005;6:109-127.
30. Meijer RR, Nering ML. Computerized adaptive testing. Overview and introduction. Appl Psychol Meas 1999;23:187-194.
31. Wainer H, Dorans NJ, Eignor D, et al. Computer-adaptive testing: a primer. Mahwah, NJ: Lawrence Erlbaum Associates; 2000.
32. Bjorner JB, Kosinski M, Ware Jr JE. Using item response theory to calibrate the Headache Impact Test (HIT) to the metric of traditional headache scales. Qual Life Res 2003;12:981-1002.
33. Kim Y, Pilkonis PA, Frank E, Thase ME, Reynolds CF. Differential functioning of the Beck depression inventory in late-life patients: use of item response theory. Psychol Aging 2002;17:379-391.
34. Hammond SM. An IRT investigation of the validity of non-patient analogue research using the Beck Depression Inventory. Eur J Psychol Assess 1995;11:14-20.
35. Santor DA, Ramsay JO, Zuroff DC. Nonparametric item analysis of the Beck Depression Inventory: evaluating gender item bias and response option weights. Psychol Assess 1994;6:255-270.
36. Cooke DJ, Michie C. An item response theory analysis of the Hare Psychopathy Checklist - Revised. Psychol Assess 1997;9:3-14.
37. Walter O, Becker J, Fliege H, Bjorner JB, Kosinski M, Klapp BF, et al. Developmental steps for a computer adaptive test for anxiety (A-CAT). Diagnostica 2005;51:88-100.
38. Cook KF, Taylor PW, Dodd BG, Teal CR, McHorney CA. Evidence-based practice for equating health status items: sample size and IRT model. J Appl Meas 2007;8:175-189.
39. Dorans NJ. Linking scores from multiple health outcome instruments. Qual Life Res 2007;16:85-94.
40. Jones RN, Fonda SJ. Use of an IRT-based latent variable model to link different forms of the CES-D from the Health and Retirement Study. Soc Psychiatry Psychiatr Epidemiol 2004;39:828-835.
41. Orlando M, Sherbourne CD, Thissen D. Summed-score linking using item response theory: application to depression measurement. Psychol Assess 2000;12:354-359.
42. Reise SP, Henson JM. Computerization and adaptive administration of the NEO PI-R. Assessment 2000;7:347-364.
43. Zhu W. Test equating: what, why, how? Res Q Exerc Sport 1998;69:11-23.
44. Gibbons RD, Clark DC, Kupfer DJ. Exactly what does the Hamilton Depression Rating Scale measure? J Psychiatr Res 1993;27:259-273.
45. Rose M, Bjorner J, Becker J, Fries J, Ware JE. Evaluation of a preliminary physical function item bank supports the expected advantages of the patient-reported outcomes measurement information system (PROMIS). J Clinical Epidemiol 2008;61:17-33.
46. Ware Jr JE, Bjorner JB, Kosinski M. Dynamic health assessment: the search for more practical and more precise outcome measures. Qual Life Newsl 1999;January:11-13.
47. Butcher JN, Keller LS, Bacon SF. Current developments and future directions in computerized personality assessment. J Consult Clinical Psychol 1985;53:803-815.
48. Becker J. Computergestuetztes Adaptives Testen (CAT) von Angst entwickelt auf der Grundlage der Item Response Theorie (IRT) [Computerized Adaptive Testing (CAT) of anxiety based on Item Response Theory (IRT)]. Berlin, Germany: Free University of Berlin; 2004.
49. Becker J, Walter OB, Fliege H, Rose M, Klapp BF. A computer adaptive test for measuring anxiety. Psychother Psychosom Med Psychol 2004;53:99.
50. Dilling H, Mombour W, Schmidt MH. Internationale Klassifikation psychischer Störungen. ICD-10 Kapitel V (F). Klinisch-diagnostische Leitlinien (3rd ed.) Bern: Huber; 1999.
51. Hoerhold M, Klapp BF. Testung der Invarianz und der Hierarchie eines mehrdimensionalen Stimmungsmodells auf der Basis von Zweipunkterhebungen an Patienten- und Studentenstichproben. Z Med Psychol 1993;2:27-35.
52. Ware Jr JE, Bjorner JB, Kosinski M. Practical implications of item response theory and computerized adaptive testing: a brief summary of ongoing studies of widely used headache impact scales. Med Care 2000;38:II73-II82.
53. Ware Jr JE, Kosinski M, Bjorner JB, Bayliss MS, Batenhorst A, Dahlof CG, et al Applications of computerized adaptive testing (CAT) to the assessment of headache impact. Qual Life Res 2003;12:935-952.
54. Bock RD, Mislevy RJ. Adaptive EAP estimation of ability in a microcomputer environment. Appl Psychol Meas 1982;12:261-280.
55. Margraf J, Ehlers A. Beck Angst Inventar (Beck Anxiety Inventory, original version by A.T. Beck and R.A. Stern). Göttingen: Hogrefe; 2007.
56. Laux L, Glanzmann P, Schaffner P, Spielberger CD. STAI State-Trait-Angstinventar (Spielberger, C.D, Gorsuch, R.L, Lushene, R.E, 1970). Test manual. Weinheim: Beltz; 1981.
57. Rose M, Walter OB, Fliege H, Becker J, Hess V. 7 years of experience using Personal Digital Assistants (PDA) for psychometric diagnostics in 6000 inpatients and polyclinic patients. In: Bludau HB, Koop A, editors. Mobile computing in medicine. GI-edition lecture notes in informatics, P-15. Köllen: Verlag; 2002:35-44.
58. Gardner W, Kelleher KJ, Pajer KA. Multidimensional adaptive testing for mental health problems in primary care. Med Care 2002;40:812-823.
59. Kobak KA, Greist JH, Jefferson JW, Katzelnick DJ. Computer-administered clinical rating scales. A rev. Psychopharmacol (Berl) 1996;127:291-301.
60. Allenby A, Matthews J, Beresford J, McLachlan SA. The application of computer touch-screen technology in screening for psychosocial distress in an ambulatory oncology setting. J Cancer Care (Engl) 2002;11:245-253.
61. Carlson LE, Speca M, Hagen N, Taenzer P. Computerized quality-of-life screening in a cancer pain clinic. J Palliat Care 2001;17:46-52.
62. Sigle J, Porzsolt F. Practical aspects of quality-of-life measurement: design and feasibility study of the quality-of-life recorder and the standardized measurement of quality of life in an outpatient clinic. Cancer Treat Rev 1996;22:75-89.
63. Simms LJ, Clark LA. Validation of a computerized adaptive version of the Schedule for Nonadaptive and Adaptive Personality (SNAP). Psychol Assess 2005;17:28-43.
64. Velikova G, Brown JM, Smith AB, Selby PJ. Computer-based quality of life questionnaires may contribute to doctor-patient interactions in oncology. Br J Cancer 2002;86:51-59.
65. Wilkie DJ, Judge MK, Berry DL, Dell J, Zong S, Gilespie R. Usability of a computerized PAINReportIt in the general public with pain and people with cancer pain. J Pain Symptom Manage 2003;25:213-224.
66. Wilson AS, Kitas GD, Carruthers DM, Reay C, Skan J, Harris S, et al. Computerized information-gathering in specialist rheumatology clinics: an initial evaluation of an electronic version of the Short Form 36. Rheumatology (Oxford) 2002;41:268-273.
67. Hornke LF. Benefits form computerized adaptive testins as seen in simulation studies. Eur J Psychol Assess 1999;15:91-98.
68. Ware Jr JE, Gandek B, Sinclair SJ, Bjorner JB. Item response theory and computerized adaptive testing: implications for outcomes measurement in rehabilitation. Rehabil Psychol 2005;50:71-78.
69. Bayliss MS, Dewey JE, Dunlap I, Batenhorst AS, Cady R, Diamond ML, et al. A study of the feasibility of internet administration of a computerized health survey: The Headache Impact Test (HITTM). Qual Life Res 2003;12:953-961.
70. Gardner W, Shear K, Kelleher KJ, Pajer KA, Mammen O, Buysse D, et al. Computerized adaptive measurement of depression: a simulation study. BMC Psychiatry 2004;4:1-11.
71. Kosinski M, Bjorner JB, Ware Jr JE, Sullivan E, Straus WL. An evaluation of a patient-reported outcomes found computerized adaptive testing was efficient in assessing osteoarthritis impact. J Clin Epidemiol 2006;59:715-723.
72. Schwartz C, Welch G, Santiago-Kelley P, Bode R, Sun X. Computerized adaptive testing of diabetes impact: a feasibility study of Hispanics and non-Hispanics in an active clinic population. Qual Life Res 2006;15:1503-1518.
73. Blankstein KR. The sensation seeker and anxiety reactivity: relationships between the sensation-seeking scales and the activity preference questionnaire. J Clin Psychol 1975;31:677-681.
74. Enns MW, Cox BJ, Parker JD, Guertin JE. Confirmatory factor analysis of the Beck Anxiety and Depression Inventories in patients with major depression. J Affect Dis 1998;47:195-200.
75. Cox BJ, Cohen E, Direnfeld DM, Swinson RP. Does the Beck Anxiety Inventory measure anything beyond panic attack symptoms? Behav Res Ther 1996;34:949-954.
76. Creamer M, Foran J, Bell R. The Beck Anxiety Inventory in a non-clinical sample. Behav Res Ther 1995;33:477-485.
77. Forbey JD, Ben Porath YS. Computerized adaptive personality testing: a review and illustration with the MMPI-2 Computerized Adaptive Version. Psychol Assess 2007;19:14-24.
78. Brown TA, Campbell LA, Lehman CL, Grisham JR, Mancill RB. Current and lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample. J Abnorm Psychol 2001;110:585-599.
79. Mineka S, Watson D, Clark LA. Comorbidity of anxiety and unipolar mood disorders. Ann Rev Psychol 1998;49:377-412.
80. Roy-Byrne PP, Stang P, Wittchen HU, Ustun B, Walters EE, Kessler RC. Lifetime panic-depression comorbidity in the National Comorbidity Survey: association with symptoms, impairment, course and helpseeking. Br J Psychiatry 2000;176:229-235.
81. Barlow DH, Chorpita BF, Turovsky J. Fear, panic, anxiety and disorders of emotion. Nebr Symp Motiv 1996;43:251-328.
82. Cannon MF, Weems CF. Do anxiety and depression cluster into distinct groups? A test of tripartite model predictions in a community sample of youth. Depress Anxiety 2006;23:453-460.
83. Watson D, Clark LA, Weber K, Assenheimer JS, Strauss ME, McCormick RA. Testing a tripartite model: II. Exploring the symptom structure of anxiety and depression in student, adult, and patient samples. J Abnorm Psychol 1995;104:15-25.
84. Fries JF, Bruce B, Cella D. The promise of PROMIS: using item response theory to improve assessment of patient-reported outcomes. Clin Exp Rheumatol 2005;23:S53-S57.
85. Fliege H, Becker J, Walter OB, Bjorner JB, Klapp BF, Rose M. Development of a computer-adaptive test for depression (D-CAT). Qual Life Res 2005;14:2277-2291.
86. Kocalevent RD, Walter O, Becker J, Fliege H, Klapp BF, Bjorner JB, et al. Stress-CAT - a computer adaptive test for the measurement of stress experience (Abstract). Psychother Psychosom Med Psychol 2005;55:136.
87. Kubinger KD, Wurst E. Adaptives Intelligenz Diagnostikum 2. AID2. Göttingen: Beltz; 2000.
88. Handel RW, Ben-Porath YS, Watt M. Computerized adaptive assessment with the MMPI-2 in a clinical setting. Psychol Assess 1999;11:369-380.
89. Roper BL, Ben Porath YS, Butcher JN. Comparability of computerized adaptive and conventional testing with the MMPI-2. J Pers Assess 1991;57:278-290.
90. Lai JS, Cella D, Chang CH, Bode RK, Heinemann AW. Item banking to improve, shorten and computerize self-reported fatigue: an illustration of steps to create a core item bank from the FACIT-Fatigue Scale. Qual Life Res 2003;12:485-501.
91. Bode RK, Cella D, Lai JS, Heinemann AW. Developing an initial physical function item bank from existing sources. J Appl Meas 2003;4:124-136.
92. Siebens H, Andres PL, Pengsheng N, Coster WJ, Haley SM. Measuring physical function in patients with complex medical and postsurgical conditions: a computer adaptive approach. Am J Phys Med Rehabil 2005;84:741-748.
93. Haley SM, Raczek AE, Coster WJ, Dumas HM, Fragala-Pinkham MA. Assessing mobility in children using a computer adaptive testing version of the pediatric evaluation of disability inventory. Arch Phys Med Rehabil 2005;86:932-939.
94. Hoyer J, Becker ES, Neumer S, Soeder U, Margraf J. Screening for anxiety in an epidemiological sample: predictive accuracy of questionnaires. J Anxiety Disord 2002;16:113-134.
95. Espallargues M, Valderas JM, Alonso J. Provision of feedback on perceived health status to health care professionals: a systematic review of its impact. Med Care 2000;38:175-186.
96. Greenhalgh J, Long AF, Flynn R. The use of patient reported outcome measures in routine clinical practice: lack of impact or lack of theory? Soc Sci Med 2005;60:833-843.
97. Brown MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, editors. Testing structural equation models. Newbury Park, CL: Sage; 1993:136-162.
98. MacCallum RC, Brwon MW, Sugawara HM. Power analysis and determination of sample size for covariance structure modeling. Psychol Methods 1996;1:130-149.
99. Chang CH, Reeve BB. Item response theory and its applications to patient-reported outcomes measurement. Eval Health Prof. Sep 2005;28(3)264-282
100. Edelen M, Reeve BB. Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research 2007;16(1)5-18
101. Fliege H, Becker J, Walter OB, Rose M, Bjorner JB, Klapp BF. (2008). Evaluation of a computer-adaptive test for the assessment of depression (D-CAT) in clinical application. [in review 2008].