Using computerized adaptive testing to reduce the burden of mental health assessment

Psychiatric Services

Volumn 59, Issue 4, 2008, Pages 361-368

  Gibbons, Robert D ^a,b   Weiss, David J ^c   Kupfer, David J ^d   Frank, Ellen ^d,e   Fagiolini, Andrea ^d   Grochocinski, Victoria J ^d   Bhaumik, Dulal K ^a,b   Stover, Angela ^d   Bock, R Darrell ^a   Immekus, Jason C ^f  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^b Departments of Psychiatry and Biostatistics at the University

^c UNIVERSITY OF MINNESOTA   (United States)

^d UNIVERSITY OF PITTSBURGH   (United States)

^e Department of Psychology ^*

^f CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; AGORAPHOBIA; ANXIETY DISORDER; ARTICLE; AUTOMATION; COMPUTERIZED ADAPTIVE TESTING; CORRELATION ANALYSIS; HEALTH EDUCATION; HUMAN; MAJOR CLINICAL STUDY; MENTAL HEALTH; MOOD DISORDER; OBSESSIVE COMPULSIVE DISORDER; OUTPATIENT CARE; PSYCHOLOGIC ASSESSMENT; SOCIAL PHOBIA; STATISTICAL SIGNIFICANCE; ADOLESCENT; BIPOLAR DISORDER; COMPUTER ASSISTED DIAGNOSIS; FEMALE; MALE; MENTAL DISEASE; MIDDLE AGED; PANIC; PHOBIA; QUESTIONNAIRE; REPRODUCIBILITY; TIME;

ADOLESCENT; ADULT; AGED; AGORAPHOBIA; ANXIETY DISORDERS; BIPOLAR DISORDER; DIAGNOSIS, COMPUTER-ASSISTED; FEMALE; HUMANS; MALE; MENTAL DISORDERS; MIDDLE AGED; MOOD DISORDERS; OBSESSIVE-COMPULSIVE DISORDER; PANIC DISORDER; PHOBIC DISORDERS; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS; TIME FACTORS;

EID: 85047681528     PISSN: 10752730     EISSN: 15579700     Source Type: Journal    
DOI: 10.1176/ps.2008.59.4.361     Document Type: Article

References (59)

1. Schaeffer GA, Bridgeman B, Golub-Smith ML, et al: Comparabihty of Paper-and-Pencil and Computer Adaptive Test Scores on the GRE General test. GRE Board Professional Report 95-08P and ETS Research Report 98-38. Princeton, NJ, Educational Testing Service, 1998
2. Wainer H: CATs: whither and whence. Psicologica 21:121-133, 2000
3. Fliege H, Becker J, Walter OB, et al: Development of a computer-adaptive test for depression (D-CAT). Quality of Life Research 4:2277-2291, 2004
4. Ware JE, Bjorner JB, Kosinski MA: Practical implications of item response theory and computerized adaptive testing: a brief summary of ongoing studies of widely used headache impact scales. Medical Care 38:73-82, 2000
5. Weiss DJ: Adaptive testing by computer. Journal of Consulting and Clinical Psychology 53:774-789, 1985
6. Weiss DJ: Computerized adaptive testing for effective and efficient measurement in counseling and education. Measurement and Evaluation in Counseling and Development 37:70-84, 2004
7. Fliege H, Becker J, Walter OB, et al: Development of a computer-adaptive test for depression (D-CAT). Quality of Life Research 14:2277-2291, 2005
8. Gardner W, Shear K, Kelleher KJ, et al: Computerized adaptive measurement of depression: a simulation study. BMC Psychiatry 4:13, 2004
9. Walter OB, Becker J, Bjorner JB, et al: Development and evaluation of a computer adaptive test for "Anxiety" (Anxiety-CAT). Quality of Life Research 16(suppl 1):143-155, 2007
10. Petersen, MA, Groenvold M, Aaronson N, et al: Multidimensional computerized adaptive testing of the EORTC QLQ-C30: basic developments and evaluations. Quality of Life Research 15:315-329, 2006
11. Bock RD, Aitkin M: Marginal maximum likelihood estimation of item parameters: application of an EM algorithm. Psychometrika 46:443-459, 1981
12. Bock RD, Gibbons RD, Muraki E: Full-information item factor analysis. Applied Psychological Measurement 12:261-280, 1988
13. Hambleton RK, Swaminathan H: Item Response Theory: Principles and Applications. Boston, Kluwer-Nijhoff, 1985
14. Embretson S, Reise S: Item Response Theory for Psychologists. Mahwah, NJ, Erlbaum, 2000
15. Gibbons RD, Hedeker D: Full-information item bifactor analysis. Psychometrika 57:423-436, 1992
16. Holzinger KJ, Swineford F: The bifactor method. Psychometrika 2:41-54, 1937
17. Gibbons RD, Bock RD, Hedeker D, et al: Full-information item bifactor analysis of graded response data. Applied Psychological Measurement 31:4-19, 2007
18. Kingsbury GG, Weiss DJ: An Alternate-Forms Reliability and Concurrent Validity Comparison of Bayesian Adaptive and Conventional Ability Tests. Research Report 80-5. Minneapolis, University of Minnesota, Computerized Adaptive Testing Laboratory, 1980
19. Kingsbury GG, Weiss DJ: A comparison of item response theory - based adaptive mastery testing and a sequential mastery testing procedure, in New Horizons in Testing: Latent Trait Theory and Computerized Adaptive Testing. Edited by Weiss DJ. New York, Academic Press, 1983
20. McBride JR, Martin JR: Reliability and validity of adaptive ability tests in a military setting, in New Horizons in Testing: Latent Trait Theory and Computerized Adaptive Testing. Edited by Weiss DJ. New York, Academic Press, 1983
21. Manual for the MicroCAT Testing System, 3rd ed. St Paul, Minn, Assessment Systems Corp, 1987
22. The FastTEST Professional Testing System. St Paul, Minn, Assessment Systems Corp, 2001
23. Brown JM, Weiss DJ: An Adaptive Testing Strategy for Achievement Test Batteries. Research Report 77-6. Minneapolis, Minn, University of Minnesota, Computerized Adaptive Testing Laboratory, 1977
24. Andrich D: A rating formulation for ordered response categories. Psychometrika 43:561-571, 1978
25. Andrich D: Application of a psychometric rating model to ordered categories which are scored with successive integers. Applied Psychological Measurement 2:581-594, 1978
26. Andrich D: The application of an unfolding model of the item response theory type to the measurement of attitude. Applied Psychological Measurement 12:33-51, 1988
27. Muraki E: Fitting a polytomous item response model to Likert-type data. Applied Psychological Measurement 14:59-71, 1990
28. Samejima F: Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement 17:1-68, 1969
29. Baek SG: Computerized adaptive testing using the partial credit model for attitude measurement, in Objective Measurement: Theory Into Practice, vol 4. Edited by Wilson M, Engelhard Jr G, Draney K. Norwood, NJ, Ablex, 1997
30. Dodd BG, DeAyala RJ, Koch WR: Computerized adaptive testing with polytomous items. Applied Psychological Measurement 19:5-22, 1995
31. Reise SP, Waller NG: Fitting the two-parameter model to personality data. Applied Psychological Measurement 15:45-58, 1991
32. Cassano GB, Michelini S, Shear MK, et al: The panic-agoraphobic spectrum: a descriptive approach to the assessment and treatment of subtle symptoms. American Journal of Psychiatry 154(suppl 6):27-38, 1997
33. Frank E, Cassano GB, Shear MK, et al: The spectrum model: a more coherent approach to the complexity of psychiatric symptomatology. CNS Spectrums 3:23-34,1998
34. Cassano GB, Banti S, Mauri M, et al: Internal consistency and discriminant validity of the Structured Clinical Interview for Panic-Agoraphobic Spectrum (SCI-PAS). International Journal of Methods in Psychiatric Research 8:138-145, 1999
35. Cyranowski JM, Shear MK, Rucci P, et al: Adult separation anxiety: psychometric properties of a new structured clinical interview. Journal of Psychiatric Research 36:77-86, 2002
36. Dell'Osso L, Armani A, Rucci P, et al: Measuring mood spectrum disorder: comparison of interview (SCI-MOODS) and self-report (MOODS-SR) instruments. Comprehensive Psychiatry 42:69-73, 2002
37. Shear MK, Frank E, Rucci P, et al: Panicagoraphobic spectrum: reliability and validity of assessment instruments. Journal of Psychiatry Research 35:59-66, 2001
38. Dell'Osso L, Rucci P, Cassano GB, et al: Measuring social phobia and obsessive-compulsive disorders: comparison of interviews and self-report instruments. Comprehensive Psychiatry 43:81-87, 2002
39. Frank E, Shear MK, Rucci P, et al: Cross-cultural validity of the Structured Clinical Interview for Panic-Agoraphobic Spectrum. Social Psychiatry and Psychiatric Epidemiology 40:283-290, 2005
40. Frank E, Grochocinski VJ, Spanier CA, et al: Interpersonal psychotherapy and anti-depressant medication: evaluation of a sequential treatment strategy in women with recurrent major depression. Journal of Clinical Psychiatry 61:51-57, 2000
41. Frank E, Cyranowski JM, Rucci P, et al: Clinical significance of lifetime panic spectrum symptoms in the treatment of patients with bipolar I disorder. Archives of General Psychiatry 59:905-912, 2002
42. Rucci P, Cassano GB, Frank E, et al: The mood spectrum in unipolar and bipolar patients. Bipolar Disorders 1:77-78, 2003
43. Cassano GB, Dell'Osso L, Frank E, et al: The bipolar spectrum: a clinical reality in search of diagnostic criteria and an assessment measure. Journal of Affective Disorders 54:319-328, 1999
44. Cassano GB, Rucci P, Frank E, et al: The mood spectrum in unipolar and bipolar disorder: arguments for a unitary approach. American Journal of Psychiatry 161:1264-1269, 2004
45. Dew MA, Martire LM, Hall M: Depression: epidemiology and risk factors, in Advances in the Management and Treatment of Depression. Edited by Potokar J, Thase ME. London, Dunitz, 2003
46. Merikangas KR: Anxiety disorders: epidemiology, in Comprehensive Textbook of Psychiatry, 8th ed. Edited by Sadock BJ, Sadock VA. Philadelphia, Lippincott Williams and Wilkins, 2005
47. Kessler RC, McGonagle KA, Zhao S, et al: Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States. Archives of General Psychiatry 51:8-19, 1994
48. Kessler RC, Berglund P, Demier O, et al: The epidemiology of major depressive disorder: results from the National Comorbidity Survey Replication (NCS-R). JAMA 289:3095-3105, 2003
49. Kessler RC, Chiu WT, Jin R, et al: The epidemiology of panic attacks, panic disorder, and agoraphobia in the National Comorbidity Survey Replication. Archives of General Psychiatry 63:415-424, 2006
50. Cochran WG, Cox GM: Experimental Designs. New York, Wiley, 1957
51. Weiss DJ: Manual for POSTSIM: Post-Hoc Simulation of Computerized Adaptive Testing. St Paul, Minn, Assessment Systems Corp, 2005
52. Santor D, Ramsay J, Zuroff D: Nonparametric item analyses of the Beck Depression Inventory: evaluating gender item bias and response option weights. Psychological Assessment 6:255-270, 1994
53. Cooke DJ, Kosson DS, Michie C: Psychopathy and ethnicity: structural, item, and test generalizability of the Psychopathy Checklist Revised (PCL-R) in Caucasian and African-American participants. Psychological Assessment 13:531-542, 2001
54. Gibbons RD, Clark DC, Cavanaugh SV: Application of modem psychometric theory in psychiatric research. Journal of Psychiatric Research 19:43-55, 1985
55. Gibbons RD, Clark DC, Kupfer DJ: Exactly what does the Hamilton Depression Rating Scale measure? Journal of Psychiatric Research 27:259-273, 1993
56. Eisen SV, Normand S-LT, Belanger AJ, et al: The revised Behavior and Symptom Identification Scale (BASIS-24): reliability and validity. Medical Care 42:1230-1241, 2004
57. Gardner W, Shear K, Kelleher KJ, et al: Computerized adaptive measurement of depression: a simulation study. BMC Psychiatry 4:13-23, 2004
58. Gardner W, Kelleher KJ, Pajer KA: Multidimensional adaptive testing for mental health problems in primary care. Medical Care 40:812-823, 2002
59. Reise SP, Morizot J, Hays RD: The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research 16:19-31, 2007