Standardizing procedures for calculating Rorschach interrater reliability: Conceptual and empirical foundations

Journal of Personality Assessment

Volumn 66, Issue 2, 1996, Pages 308-320

  McDowell, Claude ^a   Acklin, Marvin W ^a  

^a NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIAGNOSTIC ACCURACY; DIAGNOSTIC VALUE; INTERMETHOD COMPARISON; PERSONALITY DISORDER; PERSONALITY TEST; PSYCHOMETRY; REVIEW; STANDARDIZATION;

EID: 0029984488     PISSN: 00223891     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15327752jpa6602_9     Document Type: Review

References (38)

1. Acklin, M. W., & McDowell, C. (1995). Standardizing procedures for calculating Rorschach interrater reliability: Procedural strategies. Manuscript in preparation.
2. Acklin, M. W., McDowell, C , & Orndorff, S. (1992). Statistical power and the Rorschach Test: 1975-1991. Journal of Personality Assessment, 59, 366-379.
3. Anastasi, A. (1988). Psychological testing (6th ed.). New York: Macmillan.
4. Bakeman, R., & Gottman, J. M. (1987). Observing interaction: An introduction to sequential analysis. Cambridge, England: Cambridge University Press.
5. Bartko, J J , & Carpenter, W. T. (1976). On the methods and theory of reliability. The Journal of Nervous and Mental Disease, 161, 307-317.
6. Bijou, S. W., Peterson, R. S., Harris, S. R., Allen, K E., & Johnston, M. S. (1969). Methodology for experimental studies of young children in natural settings. Psychological Record, 19, 17-210.
7. Block, W. E (1962). Psychometric aspects of the Rorschach Technique. Journal of Protective Techniques and Personality Assessment, 26, 162-222.
8. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-4-6.
9. Cohen, J. (1988). Statistical power for the social sciences. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
10. Cronbach, L. J. (1949). Statistical methods applied to Rorschach scores: A review. Psychological Bulletin, 46, 393-429.
11. DeCato, C. M. (1983). Rorschach reliability: Cross-validation. Perceptual and Motor Skills, 56, 11-14.
12. DeCato, C. M. (1984). Rorschach reliability: Toward a training model for interscorer agreement. Journal of Personality Assessment, 48, 58-64.
13. Dynastat. (1988) Dynastat's kappa program. Eugene, OR: Author
14. Exner, J. E. (1968). The Rorschach systems. New York: Wiley.
15. Exner, J. E. (1991). The Rorschach: A comprehensive system Volume 2: Interpretations. New York: Wiley
16. Exner, J. E. (1993). The Rorschach: A comprehensive system. Volume 1: Basic foundations (3rd ed.). New York. Wiley
17. Exner, J. E., & Weiner, I. B. (1995). The Rorschach: A comprehensive system. Volume 3: Assessment of children and adolescents (2nd ed.). New York: Wiley.
18. Ferguson, G. A. (1976). Statistical analysis in psychology and education (4th ed.). New York: McGraw-Hill.
19. Fleiss, J L (1971) Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378-382.
20. Gacono, C., Meloy, J. R., & Berg, J. (1992). Object relations, defensive operations, and affective states in narcissistic, borderline, and antisocial personalities. Journal of Personality Assessment, 59, 32-49.
21. Hawkins, R. P., & Dotson, V. A. (1975). Reliability scores that elude: In Alice in Wonderland's trip through the misleading characteristics of interobserver agreement scores in interval recording. In E. Ramp & G Semb (Eds.), Behavior analysis: Areas of research applications (pp. 359-376). Englewood Cliffs, NJ: Prentice-Hall.
22. Haynes, S. N. (1978). Principles of behavioral assessment New York: Gardner.
23. Hubert, L. (1977). Kappa revisited. Psychological Bulletin, 84, 289-297.
24. Jensen, A. R. (1959). The reliability of projective techniques: Review of the literature. Acta Psychologica, 16, 108-136
25. Landis, R. J., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
26. Meloy, J. R. (1991, Fall-Winter). Rorschach testimony. The Journal of Psychiatry and Law, 221-234.
27. Morgan, L., & Viglione, D. J (1992) Sexual disturbances, Rorschach sexual responses, and mediating factors. Psychological Assessment, 4(4), 530-536.
28. Parker, K. (1983). A meta-analysis of the reliability and validity of the Rorschach. Journal of Personality Assessment, 47, 227-231.
29. Repp, A. C., Deitz, D. E., Boles, S. M., Deitz, S. M., & Repp, C. S. (1976). Differences among common methods for calculating interobserver agreement. Journal of Applied Behavioral Analysis, 9, 109-113.
30. Rorschach, H. (1942). Psychodiagnostics. New York: Grune & Stratton.
31. Rossi, J. (1983, April). Inadequate statistical power: A source of artifactual controversy. Paper presented at the meeting of the Eastern Psychological Association, Baltimore.
32. Rossi, J. (1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58, 646-655.
33. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Journal of Consulting and Clinical Psychology, 105, 309-316
34. Suen, H. K., & Ary, D. (1989). Analyzing quantitative observation data. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
35. Suen, H. K., & Lee, P S. C. (1985). Effects of the use of percentage agreement on behavioral observation: A reassessment. Journal of Psychopathology and Behavioral Assessment, 7, 221-234.
36. Tinsley, H. E. A., & Weiss, D. J. (1975). Interrater reliability and agreement of subjective judgements. Journal of Counseling Psychology, 22, 358-376.
37. Weiner, I. B. (1991). Editor's note: Interscorer agreement in Rorschach research. Journal of Personality Assessment, 56, 1.
38. Welkowitz, J., Ewen, R. B., & Cohen, J. (1982). Introductory Statistics for the Behavioral Sciences (3rd ed.). New York: Academic.