Using Item and Test Information to Optimize Targeted Assessments of Psychological Distress

Assessment

Volumn 21, Issue 6, 2014, Pages 679-693

  Böhnke, Jan R ^a   Lutz, Wolfgang ^b  

^a UNIVERSITY OF YORK   (United Kingdom)

^b UNIVERSITY OF TRIER   (Germany)

Author keywords

item information; item response theory; patient reported outcome; patient focused research; research practitioner network; short forms

Indexed keywords

ADULT; DIAGNOSIS; FEMALE; HUMAN; MALE; MASS SCREENING; MENTAL STRESS; PHYSIOLOGIC MONITORING; PROCEDURES; QUESTIONNAIRE; REPRODUCIBILITY; THEORETICAL MODEL;

ADULT; FEMALE; HUMANS; MALE; MASS SCREENING; MODELS, THEORETICAL; MONITORING, PHYSIOLOGIC; REPRODUCIBILITY OF RESULTS; STRESS, PSYCHOLOGICAL; SURVEYS AND QUESTIONNAIRES;

EID: 84921515161     PISSN: 10731911     EISSN: 15523489     Source Type: Journal    
DOI: 10.1177/1073191114529152     Document Type: Article

References (90)

1. Adams R. J.,Wu M. L.,Wilson M.The Rasch rating model and the disordered threshold controversy.Educational and Psychological Measurement. 2012;72:547-573
2. BabcockB.WeissD. J. (2009). Termination criteria in computerized adaptive tests: Variable-length CATs are not biased. Paper presented at the 2009 GMAC (R) Conference on CAT. Retrieved from http://www.psych.umn.edu/psylabs/|catcentral/pdf%20files/cat09babcock.pdf
3. Barkham M.,Margison F.,Leach C.,Lucock M.,Mellor-Clark J.,Evans C.,..McGrath G.Service profiling and outcomes benchmarking using the CORE-OM: Toward practice-based evidence in the psychological therapies.Journal of Consulting and Clinical Psychology. 2001;69:184-196
4. Barlow D. H.What’s new about evidence-based assessment?.Psychological Assessment. 2005;17:308-311
5. Beck A. T.,Ward C. H.,Mendelson M.,Mock J.,Erbaugh J.An inventory for measuring depression.Archives of General Psychiatry. 1961;4:561-571
6. Bilbao A.,Las Hayas C.,Forero C. G.,Padierna A.,Martín J.,Quintana J. M.Cross-validation study using item response theory: The Health-Related Quality of Life for Eating Disorders Questionnaire–Short Version.Assessment. 2013;:
7. Bond T. G.,Fox C. M.Applying the Rasch model: Fundamental measurement in the human sciences. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.Mahwah, NJ: Lawrence Erlbaum; 2007:
8. Boswell J. F.,Kraus D. R.,Miller S. D.,Lambert M. J.Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions.Psychotherapy Research. 2013;:
9. Brouwer D.,Meijer R. R.,Zevalkink J.Measuring individual significant change on the Beck Depression Inventory–II through IRT-based statistics.Psychotherapy Research. 2013a;:
10. Brouwer D.,Meijer R. R.,Zevalkink J.On the factor structure of the Beck Depression Inventory–II: G is the key.Psychological Assessment. 2013b;25:136-145
11. Brown A.,Ford T.,Deighton J.,Wolpert M.Satisfaction in child and adolescent mental health services: Translating users’ feedback into measurement.Administration and Policy in Mental Health. 2012;:
12. Buja A.,Eyuboglu N.Remarks on parallel analysis.Multivariate Behavioral Research. 1992;27:509-540
13. Carlier I. V. E.,Meuldijk D.,Van Vliet I. M.,Van Fenema E.,Van der Wee N. J. A.,Zitman F. G.Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory.Journal of Evaluation in Clinical Practice. 2012;18:104-110
14. Castonguay L. G.,Barkham M.,Lutz W.,McAleavey A.Bergin and Garfield’s handbook of psychotherapy and behavior change. (2013). Practice-oriented research: Approaches and applications. In LambertM. J. (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 85-133). Hoboken, NJ: Wiley.Lambert M. J., ed. Hoboken, NJ: Wiley; 2013:85-133.
15. Cella D.,Gershon R.,Lai J.-S.,Choi S.The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment.Quality of Life Research. 2007;16:133-141
16. Choi S.,Reise S. P.,Pilkonis P.,Hays R.,Cella D.Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms.Quality of Life Research. 2010;19:125-136
17. Choi S. W.,Gibbons L. E.,Crane P. K.lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations.Journal of Statistical Software. 2011;39 (8): 1-30
18. Cole D. A.,Cai L.,Martin N. C.,Findling R. L.,Youngstrom E. A.,Garber J.,..Forehand R.Structure and measurement of depression in youths: Applying item response theory to clinical data.Psychological Assessment. 2011;23:819-833
19. Crane P.,Gibbons L.,Ocepek-Welikson K.,Cook K.,Cella D.,Narasimhalu K.,..Teresi J.A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression.Quality of Life Research. 2007;16:69-84
20. Croudace T. J.,Böhnke J. R.Item bank measurement of depression: Will one dimension work?.Journal of Clinical Epidemiology. 2014;67:4-6
21. Cuijpers P.,Smits N.,Donker T.,ten Have M.,de Graaf R.Screening for mood and anxiety disorders with the five-item, the three-item, and the two-item Mental Health Inventory.Psychiatry Research. 2009;168:250-255
22. Derogatis L. R.SCL-90, administration, scoring, and procedures. Manual 1 for the r(evised) version and other instruments of the Psychopathology Rating Scale series. Baltimore, MD: Johns Hopkins University School of Medicine; 1977:
23. DeSalvo K.,Fisher W.,Tran K.,Bloser N.,Merrill W.,Peabody J.Assessing measurement properties of two single-item general health measures.Quality of Life Research. 2006;15:191-201
24. Diener E.Subjective well-being: The science of happiness and a proposal for a national index.American Psychologist. 2000;55:34-43
25. Doucette A.,Wolf A. W.Questioning the measurement precision of psychotherapy research.Psychotherapy Research. 2009;19:374-389
26. Dumenci L.,Achenbach T. M.Effects of estimation methods on making trait-level inferences from ordered categorical items for assessing psychopathology.Psychological Assessment. 2008;20:55-62
27. Emons W. H. M.,Sijtsma K.,Meijer R. R.On the consistency of individual classification using short scales.Psychological Methods. 2007;12:105-120
28. Ey S.,Hersen M.Psychological assessment in clinical practice: A pragmatic guide. Hersen M., ed. New York, NY: Brunner-Routledge; 2004:3-20.
29. First M. B.,Spitzer R. L.,Gibbon M.,Williams J. B. W.Structured clinical interview for DSM-IV Axis I disorders, clinician version (SCID-CV). Washington, DC: American Psychiatric Press; 1996:
30. Fliege H.,Becker J.,Walter O.,Bjorner J.,Klapp B.,Rose M.Development of a computer-adaptive test for depression (D-CAT).Quality of Life Research. 2005;14:2277-2291
31. Fowler J. C.Suicide risk assessment in clinical practice: Pragmatic guidelines for imperfect assessments.Psychotherapy. 2012;49:81-90
32. Gilbody S. M.,House A. O.,Sheldon T. A.Psychiatrists in the UK do not use outcomes measures.British Journal of Psychiatry. 2002;180:101-103
33. Grawe K.Neuropsychotherapy. How the neurosciences inform effective psychotherapy. Mahwah, NJ: Lawrence Erlbaum; 2007:
34. Green B. F.,Bock R. D.,Humphreys L. G.,Linn R. L.,Reckase M. D.Technical guidelines for assessing computerized adaptive tests.Journal of Educational Measurement. 1984;21:347-360
35. Grissom G. R.,Lyons J. S.,Lutz W.Standing on the shoulders of a giant: Development of an outcome management system based on the dose model and phase model of psychotherapy.Psychotherapy Research. 2002;12:397-412
36. Hahn E.,DeVellis R.,Bode R.,Garcia S.,Castel L.,Eisen S.Measuring social health in the Patient-Reported Outcomes Measurement Information System (PROMIS): Item bank development and testing.Quality of Life Research. 2010;19:1035-1044
37. Halstead J. E.,Leach C.,Rust J.The development of a brief distress measure for the evaluation of psychotherapy and counseling (sPaCE).Psychotherapy Research. 2007;17:656-672
38. Hambleton R. K.Good practices for identifying differential item functioning.Medical Care. 2006;44:S182-S188
39. Hart D. L.,Werneke M. W.,George S. Z.,Deutscher D.Single-item screens identified patients with elevated levels of depressive and somatization symptoms in outpatient physical therapy.Quality of Life Research. 2012;21:257-268
40. Hawkins D. M.The problem of overfitting.Journal of Chemical Information and Computer Sciences. 2004;44:1-12
41. Hays R. D.,Morales L. S.,Reise S. P.Item response theory and health outcomes measurement in the 21st century.Medical Care. 2000;39:II28-II42
42. Holman R.,Glas C. A. W.,de Haan R. J.Power analysis in randomized clinical trials based on item response theory.Controlled Clinical Trials. 2003;24:390-410
43. Howard K. I.,Lueger R. J.,Maling M. S.,Martinovich Z.A phase model of psychotherapy outcome: Causal mediation of change.Journal of Consulting and Clinical Psychology. 1993;61:678-685
44. Irwin D.,Stucky B.,Langer M.,Thissen D.,DeWitt E.,Lai J.-S.,..DeWalt D.An item response analysis of the pediatric PROMIS anxiety and depressive symptoms scales.Quality of Life Research. 2010;19:595-607
45. Kessler R. C.,Andrews G.,Colpe L. J.,Hiripi E.,Mroczek D. K.,Normand S.-L. T.,..Zaslavsky A. M.Short screening scales to monitor population prevalences and trends in non-specific psychological distress.Psychological Medicine. 2002;32:959-976
46. Klein J. P.,Berger T.,Schröder J.,Späth C.,Meyer B.,Caspar F.,..Moritz S.The EVIDENT-trial: Protocol and rationale of a multicenter randomized controlled trial testing the effectiveness of an online-based psychological intervention.BMC Psychiatry. 2013;13:1-10
47. Klotsche J.,Ferger D.,Pieper L.,Rehm J.,Wittchen H-U.A novel nonparametric approach for estimating cut-offs in continuous risk indicators with application to diabetes epidemiology.BMC Medical Research Methodology. 2009;9:63
48. Lambert M. J.Psychotherapy outcome and quality improvement: Introduction to the special section on patient-focused research.Journal of Consulting and Clinical Psychology. 2001;69:147-149
49. Lambert M. J.,Burlingame G. M.,Umphress V.,Hansen N. B.,Vermeersch D. A.,Clouse G. C.,Yanchar S. C.The reliability and validity of the outcome questionnaire.Clinical Psychology and Psychotherapy. 1996;3:249-258
50. Locke B. D.,Buzolitz J. S.,Lei P.-W.,Boswell J. F.,McAleavey A. A.,Sevig T. D.,..Hayes J. A.Development of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62).Journal of Counseling Psychology. 2011;58:97-109
51. Lorenzo-Seva U.,Ferrando P. J.FACTOR: A computer program to fit the exploratory factor analysis model.Behavioral Research Methods, Instruments and Computers. 2006;38:88-91
52. Lorenzo-Seva U.,Timmerman M. E.,Kiers H. A. L.The Hull method for selecting the number of common factors.Multivariate Behavioral Research. 2011;46:340-364
53. Lüttinger P.,Riede T.Der Mikrozensus: Amtliche Daten für die Sozialforschung.ZUMA Nachrichten. 1997;21 (41): 19-43
54. LutzW.BöhnkeJ. R. (2008). Der Fragebogen zur Evaluation von Psychotherapieverläufen (FEP-2): Validierung und Manual [The Questionnaire for the Evaluation of Psychotherapy: Validation and manual]. Trierer Psychologische Berichte, 35(3). Retrieved from http://www.uni-trier.de/fileadmin/fb1/PSY/tripsyberichte/2008_35_3.pdf
55. Lutz W.,Schürch E.,Stulz N.,Böhnke J. R.,Schöttke H.,Rogner J.,Wiedl K. H.Entwicklung und psychometrische Kennwerte des Fragebogens zur Evaluation von Psychotherapieverläufen (FEP).Diagnostica. 2009;55:106-116
56. Mair P.,Hatzinger R.Extended Rasch modeling: The eRm package for the application of IRT models in R.Journal of Statistical Software. 2007;20 (9): 1-20
57. Masters G. N.A Rasch model for partial credit scoring.Psychometrika. 1982;47:149-174
58. McAleavey A. A.,Nordberg S. S.,Hayes J. A.,Castonguay L. G.,Locke B. D.,Lockard A. J.Clinical validity of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62): Further evaluation and clinical applications.Journal of Counseling Psychology. 2012;59:575-590
59. Meijer R. R.,de Vries R. M.,van Bruggen V.An evaluation of the Brief Symptom Inventory–18 using item response theory: Which items are most strongly related to psychological distress?.Psychological Assessment. 2011;23:193-202
60. Mellenbergh G. J.Measurement precision in test score and item response models.Psychological Methods. 1996;1:293-299
61. Miller S. D.,Duncan B. L.,Sorrell R.,Brown G. S.The partners for change outcome management system.Journal of Clinical Psychology. 2005;61:199-208
62. Mitchell A. J.,McGlinchey J. B.,Young D.,Chelminski I.,Zimmerman M.Accuracy of specific symptoms in the diagnosis of major depressive disorder in psychiatric out-patients: Data from the MIDAS project.Psychological Medicine. 2009;39:1107-1116
63. Newnham E. A.,Page A. C.Bridging the gap between best evidence and best practice in mental health.Clinical Psychology Review. 2010;30:127-142
64. Osterlind S. J.,Everson H. T.Differential item functioning. (2009). Differential item functioning (2nd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2009:
65. Pallant J. F.,Tennant A.An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS).British Journal of Clinical Psychology. 2007;46:1-18
66. Penfield R. D.DIFAS: Differential item functioning analysis system.Applied Psychological Measurement. 2005;29:150-151
67. Penfield R. D.,Algina J.A generalized DIF effect variance estimator for measuring unsigned differential test functioning in mixed format tests.Journal of Educational Measurement. 2006;43:295-312
68. Poston J. M.,Hanson W. E.Meta-analysis of psychological assessment as a therapeutic intervention.Psychological Assessment. 2010;22:203-212
69. R Core Team. (2013). R: A language and environment for statistical computing (Version 3.0.1). Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org
70. Radloff L. S.The CES-D scale: A self-report depression scale for research in the general population.Applied Psychological Measurement. 1977;1:385-401
71. Reise S. P.,Haviland M. G.Item response theory and the measurement of clinical change.Journal of Personality Assessment. 2005;84:228-238
72. Reise S. P.,Waller N. G.How many IRT parameters does it take to model psychopathology items?.Psychological Methods. 2003;8:164-184
73. Reise S. P.,Waller N. G.Item response theory and clinical measurement.Annual Review of Clinical Psychology. 2009;5:27-48
74. Riley W.,Rothrock N.,Bruce B.,Christodolou C.,Cook K.,Hahn E.,Cella D.Patient-reported outcomes measurement information system (PROMIS) domain names and definitions revisions: Further evaluation of content validity in IRT-derived item banks.Quality of Life Research. 2010;19:1311-1321
75. Rizopoulos D.ltm: An R package for latent variable modeling and item response analysis.Journal of Statistical Software. 2006;17 (5): 1-25
76. Robin X.,Turck N.,Hainard A.,Tiberti N.,Lisacek F.,Sanchez J-C.,Muller M.pROC: An open-source package for R and S+ to analyze and compare ROC curves.BMC Bioinformatics. 2011;12:77
77. Schürch E.,Lutz W.,Böhnke J. R.Identifikation abweichender Antwortmuster im „Fragebogen zur Evaluation von Psychotherapieverläufen” mithilfe der Rasch-Analyse.Zeitschrift für Klinische Psychologie und Psychotherapie. 2009;38:135-144
78. Schwarzer R.Optimism, vulnerability, and self-beliefs as health-related cognitions: A systematic overview.Psychology & Health. 1994;9:161-180
79. Shimokawa K.,Lambert M. J.,Smart D. W.Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system.Journal of Consulting and Clinical Psychology. 2010;78:298-311
80. Slade M.What outcomes to measure in routine mental health services, and how to assess them: A systematic review.Australian and New Zealand Journal of Psychiatry. 2002;36:743-753
81. Strauss B. M.,Lutz W.,Steffanowski A.,Wittmann W. W.,Boehnke J. R.,Rubel J.,..Kirchmann H.Benefits and challenges in practice-oriented psychotherapy research in Germany: The TK and the QS-PSY-BAY projects of quality assurance in outpatient psychotherapy.Psychotherapy Research. 2013;:
82. Tasca G. A.,Gallop R.Multilevel modeling of longitudinal data for psychotherapy researchers: I. The basics.Psychotherapy Research. 2009;19:429-437
83. Thissen D.,Orlando M.Test scoring. Thissen D.Wainer H., ed. Mahwah, NJ: Lawrence Erlbaum Associates; 2001:73-140.
84. Thomas M. L.The value of item response theory in clinical assessment: A review.Assessment. 2011;18:291-307
85. Timmerman M. E.,Lorenzo-Seva U.Dimensionality assessment of ordered polytomous items with parallel analysis.Psychological Methods. 2011;16:209-220
86. Van der Elst W.,Ouwehand C.,van Rijn P.,Lee N.,Van Boxtel M.,Jolles J.The Shortened Raven Standard Progressive Matrices: Item response theory–based psychometric analyses and normative data.Assessment. 2013;20:48-59
87. Wahl I.,Löwe B.,Bjorner J. B.,Fischer F.,Langs G.,Voderholzer U.,..Rose M.Standardization of depression measurement: a common metric was developed for 11 self-report depression measures.Journal of Clinical Epidemiology. 2014;67:73-86
88. Computerized adaptive testing: A primer. (2000). Computerized adaptive testing: A primer (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.Wainer H., ed. Mahwah, NJ: Lawrence Erlbaum; 2000:
89. Yamazaki S.,Fukuhara S.,Green J.Usefulness of five-item and three-item Mental Health Inventories to screen for depressive symptoms in the general population of Japan.Health and Quality of Life Outcomes. 2005;3:48
90. Zinbarg R. E.,Revelle W.,Yovel I.,Li W.Cronbach’s α, Revelle’s β, and McDonald’s ωH: Their relations with each other and two alternative conceptualizations of reliability.Psychometrika. 2005;70:123-133