Using reliability generalization methods to explore measurement error: An illustration using the MMPI-2 PSY-5 scales

Journal of Personality Assessment

Volumn 88, Issue 3, 2007, Pages 264-275

  Rouse, Steven V ^a  

^a PEPPERDINE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGGRESSION AND DISCONSTRAINT SCALE; HUMAN; MEASUREMENT ERROR; MINNESOTA MULTIPHASIC PERSONALITY INVENTORY 2; NEGATIVE EMOTIONALITY SCALE; PERSONALITY PSYCHOPATHOLOGY 5 SCALE; PERSONALITY TEST; PSYCHOANALYSIS; RATING SCALE; RELIABILITY; REVIEW; SCORING SYSTEM;

EID: 34250379132     PISSN: 00223891     EISSN: None     Source Type: Journal    
DOI: 10.1080/00223890701293908     Document Type: Review

References (75)

1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (AERA/APA/NCME). (1985). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
2. *Almagor, M., & Nevo, B. (1996). The MMPI-2: Translation and first steps in its adaptation into Hebrew. In J. N. Butcher (Ed), International adaptations of the MMPI-2 (pp. 487-505). Minneapolis: University of Minnesota Press.
3. *Arbisi, P. A., Ben-Porath, Y. S., & McNulty, J. L. (2003). MMPI-2 empirical correlates in inpatient psychiatric settings. Unpublished manuscript.
4. Arnau, R. C., Handel, R. W., & Archer, R. P. (2005). Principle components analyses of the MMPI-2 PSY-5 scales: Identification of facet subscales. Assessment, 12, 186-198.
5. Bagby, R. M., Ryder, A. G., Ben-Dat, D., Bacchiochi, J., & Parker, J. D. A. (2002). Validation of the dimensional factor structure of the Personality Psychopathology Five in clinical and nonclinical samples. Journal of Personality Disorders, 16, 304-316.
6. Barnes, L. L. B., Harp, D., & Jung, W. S. (2002). Reliability generalization of scores on the Spielberger State-Trait Anxiety Inventory. Educational and Psychological Measurement, 62, 603-618.
7. Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory. San Antonio, TX: Psychological Corporation.
8. Bem, S. L. (1981). Bem Sex Role Inventory: Professional manual. Palo Alto, CA: Consulting Psychologists Press.
9. *Berning, L. C., & Weed, N. C. (1999, April). Relative external validity of the MMPI-2 substance abuse scales. Poster session presented at the 34th annual symposium on Recent Developments in the Use of the MMPI, MMPI-2, and MMPI-A, Huntington Beach, CA.
10. Butcher, J. N. (Ed.). (1996). International adaptations of the MMPI-2. Minneapolis: University of Minnesota Press.
11. *Butcher, J. N. (1997). MMPI-2 user's guide. The Minnesota report: Reports for forensic settings. Minneapolis, MN: Pearson Assessments.
12. *Butcher, J. N. (1998). The Butcher Treatment Planning Inventory: Manual. San Antonio, TX: The Psychotogical Corporation.
13. *Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, Y. S., Dahlstrom, W. G., & Kaemmer, B. (2001). Minnesota Multiphasic Personality Inventory-2: Manual for administration and scoring (Rev. ed.). Minneapolis: University of Minnesota Press.
14. *Butcher, J. N., Graham, J. R., Dahlstrom, W. G., & Bowman, E. (1990). The MMPI-2 with college students. Journal of Personality Assessment, 54, 1-15.
15. *Butcher, J. N., Jeffrey, T., Cayton, T. G., Colligan, S., DeVore, J., & Minnegawa, R. (1990). A study of active duty military personnel with the MMPI-2. Military Psychology, 2, 47-61.
16. *Byravan, A. (1997). Structure of personality disorders from a five-factor model perspective, and the relative superiority of the MMPI-2 PSY-5, NEO-PI-R, and the 16 PF Fifth Edition scales for predicting personality disorders. Dissertation Abstracts International, 57(10), 6635. (UMI No. 9708742)
17. Capraro, M. M., Capraro, R. M., & Henson, R. K. (2001). Measurement error of scores on the Mathematics Anxiety Rating Scale across studies. Educational and Psychological Measurement, 61, 373-386.
18. *Capraro, R. M., & Capraro, M. M. (2002). Myers-Briggs Type Indicator score reliability across studies: A meta-analytic reliability generalization study. Educational and Psychological Measurement, 62, 590-602.
19. Caruso, J. C., (2000). Reliability generalization of the NEO Personality Scales. Educational and Psychological Measurement, 60, 236-254.
20. Caruso, J. C., & Edwards, S. (2001). Reliability generalization of the Junior Eysenck Personality Questionnaire. Personality and Individual Differences, 31, 173-184.
21. *Cheung, F. M., Weizheng, S., & Zhang, J. (1996). The Chinese MMPI-2: Research and applications in Hong Kong and the People's Republic of China. In J. N. Butcher (Ed.), International adaptations of the MMPI-2 (pp. 137-161). Minneapolis: University of Minnesota Press.
22. Costa, P. T., & McCrae, R. R. (1992). Neo-Pl, revised: Technical manual. Odessa, FL: Psychological Assessment Resources.
23. *Egger, J. I. M., De Mey, H. R. A., Derksen, J. J. L., & van der Staak, C. P. F. (2003). Cross-cultural replication of the five-factor model and comparison of the NEO-PI-R and MMPI-2 PSY-5 scales in a Dutch psychiatric sample. Psychological Assessment, 15, 81-88.
24. *Gillet, I., Simon, M., Guelfi, J. D., Brun-Eberentz, A., Monier, C., Seunevel, F., et al. (1996). The MMPI-2 in France. In J. N. Butcher (Ed.), International adaptations of the MMPI-2 (pp. 395-416). Minneapolis: University of Minnesota Press.
25. *Graham, J. R., & Butcher, J. N. (1988, March). Differentiating schizophrenic and major affective disorders with the revised form of the MMPI. Paper presented at the 23rd annual symposium on Recent Developments in the Use of the MMPI, S1. Pelersburg, FL.
26. *Greene, R. L. (2000). MMPI-2: An interpretive manual. Needham Heights, MA: Allyn & Bacon.
27. *Han, K. (1996). The Korean MMPI-2. In J. N. Butcher (Ed.), International adaptations of the MMPI-2 (pp. 88-136). Minneapolis: University of Minnesota Press.
28. *Han, K., Weed, N. C., Calhoun, R., & Butcher, J. N. (1995). Psychometric characteristics of the MMPI-2 Cook-Medley Hostility scale. Journal of Personality Assessment, 65, 567-585.
29. *Han, K., Weed, N. C., & McNeal, T. P. (1996). Measuring conscientiousness with the MMPI-2. Journal of Personality Assessment, 67, 354-363.
30. Harkness, A. R., & McNulty, J. L. (1994). The Personality Psychopathology Five (PSY-5): Issue from the pages of a diagnostic manual instead of a dictionary. In S. Strack & M. Lorr (Eds.), Differentiating normal and abnormal personality (pp. 291-315). New York: Springer.
31. Harkness, A. R., & McNulty, J. L. (2006). An overview of personality: The MMPI-2 Personality Psychopathology (PSY-5) scales. In J. J. Butcher (Ed.), MMPI-2: A practitioner's guide (pp. 73-97). Washington, DC: American Psychological Association.
32. Harkness, A. R., McNulty, J. L., & Ben-Porath, Y. S. (1995). The Personality Psychopathology Five (PSY-5): Constructs and MMPI-2 scales. Psychological Assessment, 7, 104-114.
33. Hathaway, S. R., & McKinley, J. C. (1943). The Minnesota Multiphasic Personality Inventory. Minneapolis: University of Minnesota Press.
34. Henson, R. K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-189.
35. Henson, R. K., & Hwang, D. (2002). Variability and prediction of measurement error in Kolb's Learning Style Inventory scores: A reliability generalization study. Educational and Psychological Measurement, 62, 712-727.
36. Henson, R. K., Kogan, L. R., & Vacha-Haase, T. (2001). A reliability generalization study of the Teacher Efficacy Scale and related instruments. Educational and Psychological Measurement, 61, 404-420.
37. Henson, R. K., & Thompson, B. (2002). Characterizing measurement error in scores across studies: Some recommendations for conducting "reliability generalization" studies. Measurement and Evaluation in Counseling and Development, 35, 113-126.
38. *Hjemboe, S., & Butcher, J. N. (1991). Couples in marital distress: A study of personality factors as measured by the MMPI-2. Journal of Personality Assessment, 57, 216-237.
39. Hogan, T. P., Benjamin, A., & Brezinski, K. L. (2000). Reliability methods: A note on the frequency of use of various types. Educational and Psychological Measurement, 60, 523-531.
40. Keiffer, K. M., & Reese, R. J. (2002). A reliability generalization study of the Geriatric Depression Scale. Educational and Psychological Measurement, 62, 969-994.
41. *Koscheyev, V. S., & Leon, G. R. (1996). The Russian translation and preliminary adaptation of the MMPI-2. In J. N. Butcher (Ed.), International adaptations of the MMPI-2 (pp. 385-394). Minneapolis: University of Minnesota Press.
42. *Kurokawa, N. K. S. (1998). Development and validation of MMPI-2 scales to assess contemporary coping constructs. Unpublished doctoral dissertation. University of Mississippi, Oxford, MS.
43. *Long, B., Rouse, S. V., Nelson, R. O., & Butcher, J. N (2004). The MMPI-2 in sexual harassment and discrimination litigation. Journal of Clinical Psychology, 60, 643-657.
44. *Lufi, D., Okasha, S., & Cohen, A. (2004). Test anxiety and its effect on the personality of students with learning disabilities. Learning Disability Quarterly, 27, 176-184.
45. *Miach, P. P., Berah, E. F., Butcher, J. N., & Rouse, S. V. (2000). Utility of the MMPI-2 in assessing gender dysphoric patients. Journal of Personality Assessment, 75, 268-279.
46. *Miller, M. W., Kaloupek, D. G., Dillon, A. L., & Keane, T. M. (2004). Externalizing and internalizing subtypes of combat-related PTSD: A replication and extension using the PSY-5 scales. Journal of Abnormal Psychology, 113, 636-645.
47. Myers, I. B., & McCauley, M. H. (1989). Manual: A guide to the development and use of the Myers-Briggs Type Indicator. Palo Alto. CA: Consulting Psychologists Press.
48. Neugarten, B. L., Havighurst, R. J., & Tobin, S. S. (1961). The measurement of life satisfaction. Journal of Gerontology, 16, 134-143.
49. *Pancheri, P., Sirigatti, S., & Biondi, M. (1996). Adaptation of the MMPI-2 in Italy. In J. N. Butcher (Ed.), International adaptations of the MMPI-2 (pp. 416-441). Minneapolis: University of Minnesota Press.
50. Petroskey, L. J., Ben-Porath, Y. S., & Stafford K. P. (2003). Correlates of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) Personality Psychopathology Five (PSY-5) scales in a forensic setting. Assessment, 10, 393-399.
51. Reese, R. J., Keiffer, K. M., & Briggs, B. K. (2002). A reliability generalization study of select measures of adult attachment style. Educational and Psychological Measurement, 62, 619-646.
52. Rissetti, F. J., Himmel, E., & Gonzales-Moreno, J. A. (1996). Use of the MMPI-2 in Chile: Translation and adaptation. In J. N. Butcher (Ed.), International adaptations of the MMPI-2 (pp. 416-441). Minneapolis: University of Minnesota Press.
53. Rosenherg, M. (1965). Society and the adolescent self-image. Princeton, NJ: Princeton University Press.
54. Rosenthal, R. (1979). The "file drawer" problem and tolerance for null results. Psychological Bulletin, 86, 638-641.
55. Rouse, S. V. (1997). The construct validity of the MMPI-2 PSY-5 scales in a clinical sample. Dissertation Abstracts International, 58(5-B), 2737. (UMI No. 9734734)
56. Rouse, S. V., Finger, M. S., & Butcher J. N. (1999). Advances in clinical personality measurement: An item response theory analysis of the MMPI-2 PSY-5 scales. Journal of Personality Assessment, 72, 282-307.
57. Schulze, R. (2004), Meta-analyses: A comparison of approaches. Cambridge, MA: Hogrefe & Huher.
58. *Sharpe, J. P., & Desai, S. (2001). The Revised NEO Personality Inventory and the MMPI-2 Psychopathology Five in the prediction of aggression. Personality and Individual Differences, 31, 505-518.
59. *Sloore, H., Derksen, J., De May, H., & Hellenbosch, G. (1996). The Flemish/Dutch version of the MMPI-2: Development and adaptation of the inventory for Belgium and the Netherlands. In J. N. Butcher (Ed.), International adaptations of the MMPI-2 (pp. 329-349). Minneapolis: University of Minnesota Press.
60. *Stransky, J. L. (2006). The Usefulness of MMPI-2 Restructured Clinical (RC) Scale 4 in assessing substance abuse. Unpublished doctoral dissertation. Central Michigan University, Mt. Pleasant, MI.
61. Streiner, D. L. (2003). Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment, 80, 99-103.
62. Thompson, B. (1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837-847.
63. Thompson, B. (2003). Understanding reliability and coefficient alpha, really. In B. Thompson (Ed.), Score reliability: Contemporary thinking on reliability issues (pp. 3-23). Thousand Oaks, CA: Sage.
64. Thompson, B., & Vacha-Haase, T. (2000). Psychometrics is datametrics: The test is not reliable. Educational and Psychological Measurement, 60, 174-195.
65. Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6-20.
66. Vacha-Haase, T., Henson, R. K., & Caruso, J. C. (2002a). Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62, 562-569.
67. Vacha-Haase, T., Henson, R. K., & Caruso, J. C. (Eds.). (2002b). Reliability generalization (RG) as a measurement meta-analytic method [Special issue]. Educational and Psychological Measurement, 62(4).
68. Vacha-Haase, T., Kogan, L. R., Tani, C. R., & Woodall, R. A. (2001). Reliability generalization: Exploring variation of reliability coefficients of MMPI clinical scale scores. Educational and Psychological Measurement, 61, 45-59.
69. Vacha-Haase, T., Kogan, L. R., & Thompson, B. (2000). Sample composition and variabilities in published studies versus those in test manuals: Validity of score reliability inductions. Educational and Psychological Measurement, 60, 509-522.
70. *Vendrig, A. A., Derksen, J. J. L., & De Mey, H. R. (2000). MMPI-2 Personality Psychopathology Five (PSY-5) and the prediction of treatment outcome for patients with chronic hack pain. Journal of Personality Assessment, 74, 423-438.
71. Viswesvaran, C., & Ones, D. S. (2000). Measurement error in "Big Five factors" personality assessment: Reliability generalization across studies and measures. Educational and Psychological Measurement, 60, 224-235.
72. Wallace, K. A., & Wheeler, A. J. (2002). Reliability generalization of the Life Satisfaction Index. Educational and Psychological Measurement, 62, 674-684.
73. Wilkinson, L., & the American Psychological Association Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
74. Wygant, D. B., Sellbom, M., Graham, J. R., & Schenk, P. W. (2006). Incremental validity of the MMPI-2 PSY-5 scales in assessing self-reported personality disorder criteria. Assessment, 13, 178-186.
75. Yin, P., & Fan, X. (2000). Assessing the reliability of Beck Depression Inventory scores: Reliability Generalization across studies. Educational and Psychological Measurement, 60, 201-223.