Rewards of bridging the divide between measurement and clinical theory: Demonstration of a bifactor model for the Brief Symptom Inventory

Psychological Assessment

Volumn 24, Issue 1, 2012, Pages 101-113

  Thomas, Michael L ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Bifactor model; Clinical assessment; Model based assessment; Multidimensional item response theory

Indexed keywords

ADULT; ARTICLE; BIFACTOR MODEL; BRIEF SYMPTOM INVENTORY; CONSTRUCT VALIDITY; CONTROLLED STUDY; CRITERION RELATED VALIDITY; DEPRESSION; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST ACCURACY STUDY; DSM-IV-TR; FEMALE; GENERALIZED ANXIETY DISORDER; HOSTILITY; HUMAN; INTERMETHOD COMPARISON; MAJOR CLINICAL STUDY; MALE; MEASUREMENT; MENTAL DISEASE; MODEL; OBSESSIVE COMPULSIVE DISORDER; OUTPATIENT; PANIC; PARANOIA; PHOBIA; PSYCHOLOGIC ASSESSMENT; PSYCHOSIS; SENSITIVITY AND SPECIFICITY; SOMATIZATION; SOMATOFORM DISORDER; THEORY; DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS; EVALUATION; FACTORIAL ANALYSIS; METHODOLOGY; PSYCHOLOGICAL ASPECT; PSYCHOLOGICAL RATING SCALE; PSYCHOLOGICAL THEORY; PSYCHOMETRY; SELF REPORT; STANDARD; STATISTICAL MODEL; STATISTICS;

ADULT; DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; MALE; MENTAL DISORDERS; MODELS, STATISTICAL; PSYCHIATRIC STATUS RATING SCALES; PSYCHOLOGICAL THEORY; PSYCHOMETRICS; SELF REPORT; SENSITIVITY AND SPECIFICITY;

EID: 84863083940     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0024712     Document Type: Article

References (81)

1. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
2. Batchelder, W. H. (2010). Cognitive psychometrics: Using multinomial processing tree models as measurement tools. In S. E. Embretson (Ed.), Measuring psychological constructs: Advances in model-based approaches (pp. 71-93). Washington, DC: American Psychological Association. doi:10.1037/12074-004
3. Beck, A. T., Ward, C. H., Mendelson, M., Mock, J., & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4, 561-571.
4. Beer, M. D. (1996). Psychosis: A history of the concept. Comprehensive Psychiatry, 37, 273-291. doi:10.1016/S0010-440X(96)90007-3
5. Ben-Porath, Y. S., & Tellegen, A. (2008). MMPI-2-RF: Manual for administration, scoring, and interpretation. Minneapolis, MN: University of Minnesota Press.
6. Boulet, J., & Boss, M. W. (1991). Reliability and validity of the Brief Symptom Inventory. Psychological Assessment, 3, 433-437. doi: 10.1037/1040-3590.3.3.433
7. Box, G. E. P., & Draper, N. R. (1987). Empirical model-building and response surfaces. New York, NY: Wiley.
8. Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
9. Brown, T. A., Chorpita, B. F., & Barlow, D. H. (1998). Structural relationships among dimensions of the DSM-IV anxiety and mood disorders and dimensions of negative affect, positive affect, and autonomic arousal. Journal of Abnormal Psychology, 107, 179-192. doi:10.1037/ 0021-843X.107.2.179
10. Caldwell, A. B. (2006). Maximal measurement or meaningful measurement: The interpretive challenges of the MMPI-2 Restructured Clinical (RC) scales. Journal of Personality Assessment, 87, 193-201. doi: 10.1207/s15327752jpa8702_09
11. de la Torre, J., & Patz, R. J. (2005). Making the most of what we have: A practical application of multidimensional item response theory in test scoring. Journal of Educational and Behavioral Statistics, 30, 295-311. doi:10.3102/10769986030003295
12. DeMars, C. E. (2006). Application of the bi-factor multidimensional item response theory model to testlet-based tests. Journal of Educational Measurement, 43, 145-168. doi:10.1111/j.1745-3984.2006.00010.x
13. Derogatis, L. R. (1993). BSI, Brief Symptom Inventory: Administration, scoring, and procedures manual (4th ed.). Minneapolis, MN: National Computer Systems.
14. Derogatis, L. R., & Cleary, P. A. (1977). Confirmation of the dimensional structure of the SCL-90: A study in construct validation. Journal of Clinical Psychology, 33, 981-989. doi:10.1002/1097-4679(197710)33:4<981::AID-JCLP2270330412>3.0.CO;2-0
15. Derogatis, L. R., & Melisaratos, N. (1983). The Brief Symptom Inventory: An introductory report. Psychological Medicine, 13, 595-605. doi: 10.1017/S0033291700048017
16. Embretson, S. (1998). A cognitive design system approach to generating valid tests: Application to abstract reasoning. Psychological Methods, 3, 380-396. doi:10.1037/1082-989X.3.3.380
17. Embretson, S. E., & Hershberger, S. L. (Eds.). (1999). The new rules of measurement: What every psychologist and educator should know. Mahwah, NJ: Erlbaum.
18. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
19. Fox, J. (2010). Bayesian item response modeling. New York, NY: Springer doi:10.1007/978-1-4419-0742-4
20. Gibbons, R. D., Bock, R. D., Hedeker, D., Weiss, D. J., Segawa, E., Bhaumik, D. K., ... Stover, A. (2007). Full-information item bifactor analysis of graded response data. Applied Psychological Measurement, 31, 4-19. doi:10.1177/0146621606289485
21. Gibbons, R. D., & Hedeker, D. R. (1992). Full-information item bi-factor analysis. Psychometrika, 57, 423-436. doi:10.1007/BF02295430
22. Gibbons, R. D., Rush, A. J., & Immekus, J. C. (2009). On the psychometric validity of the domains of the PDSQ: An illustration of the bi-factor item response theory model. Journal of Psychiatric Research, 43, 401-410. doi:10.1016/j.jpsychires.2008.04.013
23. Gibbons, R. D., Weiss, D. J., Kupfer, D. J., Frank, E., Fagiolini, A., Grochocinski, V. J., ... Immekus, J. C. (2008). Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatric Services, 59, 361-368. doi:10.1176/appi.ps.59.4.361
24. Goodman, W. K., Price, L. H., Rasmussen, S. A., Mazure, C., Fleischmann, R., Hill, C. L., ... Charney, D. S. (1989). The Yale-Brown Obsessive Compulsive Scale: I. Development, use, and reliability. Archives of General Psychiatry, 46, 1006-1011.
25. Gordon, R. M. (2006). False assumptions about psychopathology, hysteria and the MMPI-2 Restructured Clinical scales. Psychological Reports, 98, 870-872. doi:10.2466/pr0.98.3.870-872
26. Gough, H. G. (1956). California Psychological Inventory. Palo Alto, CA: Consulting Psychologists Press.
27. Hathaway, S. R., & McKinley, J. C. (1940). A multiphasic personality schedule (Minnesota): I. Construction of the schedule. Journal of Psychology: Interdisciplinary and Applied, 10, 249-254. doi:10.1080/ 00223980.1940.9917000
28. Hayes, J. A. (1997). What does the Brief Symptom Inventory measure in college and university counseling center clients? Journal of Counseling Psychology, 44, 360-367. doi:10.1037/0022-0167.44.4.360
29. Heinrich, R. K., & Tate, D. G. (1996). Latent variable structure of the Brief Symptom Inventory in a sample of persons with spinal cord injuries. Rehabilitation Psychology, 41, 131-147. doi:10.1037/0090- 5550.41.2.131
30. Holzinger, K. J., & Swineford, F. (1937). The bifactor method. Psychometrika, 2, 41-54. doi:10.1007/BF02287965
31. Kellett, S., Beail, N., Newman, D. W., & Hawes, A. (2004). The factor structure of the Brief Symptom Inventory: Intellectual disability evidence. Clinical Psychology & Psychotherapy, 11, 275-281. doi: 10.1002/cpp.410
32. Kendler, K. S., Prescott, C. A., Myers, J., & Neale, M. C. (2003). The structure of genetic and environmental risk factors for common psychiatric and substance use disorders in men and women. Archives of General Psychiatry, 60, 929-937. doi:10.1001/archpsyc.60.9.929
33. Krueger, R. F. (1999). The structure of common mental disorders. Archives of General Psychiatry, 56, 921-926. doi:10.1001/archpsyc.56.10.921
34. Krueger, R. F. (2002). Psychometric perspectives on comorbidity. In J. E. Helzer & J. J. Hudziak (Eds.), Defining psychopathology in the 21st century: DSM-V and beyond (pp. 41-54). Arlington, VA: American Psychiatric Association.
35. Krueger, R. F., & Finger, M. S. (2001). Using item response theory to understand comorbidity among anxiety and unipolar mood disorders. Psychological Assessment, 13, 140-151. doi:10.1037/1040- 3590.13.1.140
36. Krueger, R. F., Markon, K. E., Patrick, C. J., Benning, S. D., & Kramer, M. D. (2007). Linking antisocial behavior, substance use, and personality: An integrative quantitative model of the adult externalizing spectrum. Journal of Abnormal Psychology, 116, 645-666. doi:10.1037/ 0021-843X.116.4.645
37. Lachar, D. (1974). The MMPI: Clinical assessment and automated interpretation. Los Angeles, CA: Western Psychological Services.
38. Lanyon, R. I., & Goodstein, L. D. (1997). Personality assessment (3rd ed.). New York, NY: Wiley.
39. Levy, R., Mislevy, R., & Sinharay, S. (2009). Posterior predictive model checking for multidimensionality in item response theory. Applied Psychological Measurement, 33, 519-537. doi:10.1177/0146621608329504
40. Loevinger, J. (1954). The attenuation paradox in test theory. Psychological Bulletin, 51, 493-504. doi:10.1037/h0058543
41. Loutsiou-Ladd, A., Panayiotou, G., & Kokkinos, C. M. (2008). A review of the factorial structure of the Brief Symptom Inventory (BSI): Greek evidence. International Journal of Testing, 8, 90-110. doi:10.1080/ 15305050701808680
42. Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000). WinBUGS-A Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10, 325-337. doi:10.1023/A: 1008929526011
43. Maser, J. D., & Cloninger, C. R. (1990). Comorbidity of mood and anxiety disorders. Washington, DC: American Psychiatric Association.
44. McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.
45. Meehl, P. E. (1950). Configural scoring. Journal of Consulting Psychology, 14, 165-171. doi:10.1037/h0058049
46. Michie, C., & Cooke, D. J. (2006). The structure of violent behavior: A hierarchical model. Criminal Justice and Behavior, 33, 706-737. doi: 10.1177/0093854806288941
47. Millon, T. (1983). Millon Clinical Multiaxial Inventory manual (3rd ed.). Minneapolis, MN: National Computer Systems.
48. Mineka, S., Watson, D., & Clark, L. A. (1998). Comorbidity of anxiety and unipolar mood disorders. Annual Review of Psychology, 49, 377-412. doi:10.1146/annurev.psych.49.1.377
49. Mislevy, R. J., Levy, R., Kroopnick, M., & Rutstein, D. (2008). Evidentiary foundations of mixture item response theory models. In G. R. Hancock & K. M. Samuelsen (Eds.), Advances in latent variable mixture models (pp. 149-175). Charlotte, NC: Information Age.
50. Mulaik, S. A., & Quartetti, D. A. (1997). First order or higher order general factor? Structural Equation Modeling, 4, 193-211. doi:10.1080/ 10705519709540071
51. Muthén, B., & Asparouhov, T. (2010). Bayesian SEM: A more flexible representation of substantive theory. Manuscript submitted for publication.
52. Nichols, D. S. (2006). The trials of separating bath water from baby: A review and critique of the MMPI-2 Restructured Clinical scales. Journal of Personality Assessment, 87, 121-138. doi:10.1207/s15327752jpa8702_02
53. Nunnally, J. C. (1967). Psychometric theory. New York, NY: McGrawHill.
54. Patz, R., & Junker, B. (1999). A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24, 146-178.
55. R Development Core Team. (2008). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org
56. Reckase, M. D. (2009). Multidimensional item response theory. New York, NY: Springer. doi:10.1007/978-0-387-89976-3
57. Reise, S. P., Moore, T. M., & Haviland, M. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92, 544-559. doi:10.1080/00223891.2010.496477
58. Reise, S. P., Morizot, J., & Hays, R. D. (2007). The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research, 16, 19-31.
59. Reynolds, C. R. (2010). Measurement and assessment: An editorial view. Psychological Assessment, 22, 1-4. doi:10.1037/a0018811
60. Rindskopf, D., & Rose, T. (1988). Some theory and applications of confirmatory second-order factor analysis. Multivariate Behavioral Research, 23, 51-67. doi:10.1207/s15327906mbr2301_3
61. Rubin, H. (1948). The Minnesota Multiphasic Personality Inventory as a diagnostic aid in a veterans hospital. Journal of Consulting Psychology, 12, 251-254. doi:10.1037/h0055299
62. Rupp, A. A., Templin, J., & Henson, R. A. (2010). Diagnostic measurement: Theory, methods, and applications. New York, NY: Guilford Press.
63. Samejima, F. (1997). The graded response model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 85-100). New York, NY: Springer.
64. Schmid, J., & Leiman, J. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61. doi:10.1007/BF02289209
65. Simms, L. J., Grös, D. F., Watson, D., & O'Hara, M. W. (2008). Parsing the general and specific components of depression and anxiety with bifactor modeling. Depression and Anxiety, 25, E34-E46. doi:10.1002/ da.20432
66. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society, Series B, 64, 583-639. doi:10.1111/1467- 9868.00353
67. Strauss, M. E., & Smith, G. T. (2009). Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology, 5, 1-25. doi:10.1146/annurev.clinpsy.032408.153639
68. Tackett, J. L., Quilty, L. C., Sellbom, M., Rector, N. A., & Bagby, R. M. (2008). Additional evidence for a quantitative hierarchical model of mood and anxiety disorders for DSM-V: The context of personality structure. Journal of Abnormal Psychology, 117, 812-825. doi:10.1037/ a0013795
69. Tellegen, A., Ben-Porath, Y. S., McNulty, J. L., Arbisi, P. A., Graham, J. R., & Kaemmer, B. (2003). The MMPI-2 Restructured Clinical (RC) Scales: Development, validation, and interpretation. Minneapolis, MN: University of Minnesota Press.
70. Tellegen, A., Ben-Porath, Y. S., Sellbom, M., Arbisi, P. A., McNulty, J. L., & Graham, J. R. (2006). Further evidence on the validity of the MMPI-2 Restructured Clinical (RC) Scales: Addressing questions raised by Rogers, Sewell, Harrison, and Jordan and Nichols. Journal of Personality Assessment, 87, 148-171. doi:10.1207/s15327752jpa8702_04
71. Thomas, M. L. (2010). The value of item response theory in clinical assessment: A review. Assessment. Advance online publication. doi: 10.1177/1073191110374797
72. Thomas, M. L., & Locke, D. E. C. (2010). Psychometric properties of the MMPI-2-RF Somatic Complaints scale. Psychological Assessment, 22, 492-503. doi:10.1037/a0019229
73. van Os, J. J., Linscott, R. J., Myin-Germeys, I. I., Delespaul, P. P., & Krabbendam, L. L. (2009). A systematic review and meta-analysis of the psychosis continuum: Evidence for a psychosis proneness-persistenceimpairment model of psychotic disorder. Psychological Medicine, 39, 179-195. doi:10.1017/S0033291708003814
74. Waller, N. G. (1999). Searching for structure in the MMPI. In S. E. Embretson (Ed.), Measuring psychological constructs: Advances in model-based approaches (pp. 185-217). Washington, DC: American Psychological Association.
75. Wang, W., Chen, P., & Cheng, Y. (2004). Improving measurement precision of test batteries using multidimensional item response models. Psychological Methods, 9, 116-136. doi:10.1037/1082-989X.9.1.116
76. Watson, D. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM-V. Journal of Abnormal Psychology, 114, 522-536. doi:10.1037/0021-843X.114.4.522
77. Welsh, G. S. (1956). Factor dimensions A and R. In G. S. Welsh & W. G. Dahlstrom (Eds.), Basic readings on the MMPI in psychology and medicine (pp. 264-281). Minneapolis, MN: University of MinnesotaPress.
78. Wetzler, S. (1990). The Millon Clinical Multiaxial Inventory (MCMI): A review. Journal of Personality Assessment, 55, 445-464. doi:10.1207/s15327752jpa5503&45
79. Yao, L., & Boughton, K. A. (2007). A multidimensional item response modeling approach for improving subscale proficiency estimation and classification. Applied Psychological Measurement, 31, 83-105. doi: 10.1177/0146621606291559
80. Yen, W. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187- 213. doi:10.1111/j.1745-3984.1993.tb00423.x
81. Yung, Y., Thissen, D., & McLeod, L. (1999). On the relationship between the higher-order factor model and the hierarchical factor model. Psychometrika, 64, 113-128. doi:10.1007/BF02294531