Statement validity assessment: Inter-rater reliability of criteria-based content analysis in the mock-crime paradigm

Legal and Criminological Psychology

Volumn 10, Issue 2, 2005, Pages 225-245

  Gödert, Heinz Werner ^a   Gamer, Matthias ^a   Rill, Hans Georg ^a   Vossel, Gerhard ^a  

^a JOHANNES GUTENBERG UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CORRELATION ANALYSIS; CRIME; FORENSIC PSYCHIATRY; FORENSIC SCIENCE; HUMAN; INTERPERSONAL COMMUNICATION; OBSERVER VARIATION; PRIORITY JOURNAL; RELIABILITY; REVIEW; SIMULATION; THEFT;

EID: 25444486670     PISSN: 13553259     EISSN: None     Source Type: Journal    
DOI: 10.1348/135532505X52680     Document Type: Review

References (59)

1. Akehurst, L., Köhnken, G., & Höfer, E. (2001). Content credibility of accounts derived from live and video presentations. Legal and Criminological Psychology, 6, 65-83.
2. Anson, D. A., Golding, S. L., & Gully, K. J. (1993). Child sexual abuse allegations: Reliability of criteria-based content analysis. Law and Human Behavior, 17, 331-341.
3. Arntzen, F. (1993). Psychologie der Zeugenaussage. [Psychology of witness testimony] (3rd ed). München: Beck.
4. Bartko, J. J. (1966). The intraclass correlation coefficient as a measure of reliability. Psychological Reports, 19, 3-11.
5. Ben-Shakhar, G., & Furedy, J. J. (1990). Theories and applications in the detection of deception: A psychophysiological and international perspective. New York: Springer.
6. Cohen, J. (1968). Weighted Kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213-220.
7. Cohen, J. (1972). Weighted Chi Square: An extension of the Kappa method. Educational and Psychological Measurement, 32, 61-74.
8. Conger, A. J. (1980). Integration and generalization of Kappas for multiple raters. Psychological Bulletin, 88, 322-328.
9. Crocker, L. M., & Algina, J. (1986). Introduction to classical and modern test theory. Orlando: Holt, Rinehart and Winston.
10. Finn, R. H. (1970). A note on estimating the reliability of categorical data. Educational and Psychological Measurement, 30, 71-76.
11. Fleiss, J. L. (1981). Statistical methods for rates and proportions (2nd ed). New York: Wiley.
12. Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33, 613-619.
13. Frick, T., & Semmel, M. I. (1978). Observer agreement and reliabilities of classroom observational measures. Review of Educational Research, 48, 157-184.
14. Gamer, M. (2005). irr: Various coefficients of interrater reliability and agreement. R package version 0.5. http://www.r-project.org.
15. Höfer, E., Krause, S., Petersen, R., Sievers, K., & Köhnken, G. (1999). Zur Reliabüität der Realkennzeichen in der Glaubwürdigkeitsbegutachtung [Reliability of reality criteria for credibility assessment]. Paper presented at the 8. Arbeitstagung der Fachgruppe Rechtspsychologie der Deutschen Gesellschaft für Psychologie. Universität Erlangen-Nürnberg, Germany.
16. Horowitz, S. W., Lamb, M. E., Esplin, P. W., Boychuk, T. D., Krispin, O., & Reiter-Lavery, L. (1997). Reliability of criteria-based content analysis of child witness statements. Legal and Criminological Psychology, 2, 11-21.
17. Kleiner, M. (2002). Handbook of polygraph testing. New York: Academic Press.
18. Kozlowski, S. W. J., & Hattrup, K. (1992). A disagreement about within-group agreement: Disentangling issues of consistency versus consensus. Journal of Applied Psychology, 77, 161-167.
19. Köhnken, G. (1990). Glaubwürdigkeit: Untersuchungen zu einem psychologischen Konstrukt [Credibility: Studies on a psychological construct]. München: Psychologie Verlags Union.
20. Köhnken, G., Schimossek, E., Aschermann, E., & Höfer, E. (1995). The cognitive interview and the assessment of the credibility of adults' statements. Journal of Applied Psychology, 80, 671-684.
21. Krahé, B., & Kundrotas, S. (1992). Glaubwü rdigkeitsbeurteilung bei Vergewaltigungsanzeigen: Ein aussagenanalytisches Feldexperiment [Statement Validity Assessment in trials for rape: A field experiment]. Zeitschrift für Experimentelle und Angewandte Psychologie, 39, 598-620.
22. Krause, S. (1997). Konzeption und Evaluation der Validität des Kieler Trainingsprogrammes zur Beurteilung der Glaubwürdigkeit von Zeugenaussagen (KTBG) [Development and validation of the Kiel Training Program for Statement Validity Assessment]. Unpublished diploma thesis, Christian-Albrecht-Universitat Kiel, Germany.
23. Lamb, M. E., Sternberg, K. J., Esplin, P. W., Hershkowitz, I., Orbach, Y., & Hovav, M. (1997). Criterion-based content analysis: A field validation study. Child Abuse and Neglect, 21, 255-264.
24. Littmann, E., & Szewczyk, H. (1983). Zu einigen Kriterien und Ergebnissen forensisch-psychologischer Glaubwürdigkeitsbegutachtung von sexuell mißbrauchten Kindern und Jugendlichen [Some criteria and empirical findings concerning credibility assessment of sexually abused children]. Forensia, 4, 55-72.
25. Lykken, D. T. (1998). A tremor in the blood: Uses and abuses of the lie detector (2nd ed). New York: Plenum Press.
26. MacLaren, V. V. (2001). A quantitative review of the Guilty Knowledge Test. Journal of Applied Psychology, 86, 674-683.
27. Maxwell, A. E. (1977). Coefficients of agreement between observers and their interpretation. British Journal of Psychiatry, 130, 79-83.
28. McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46.
29. Parker, A. D., & Brown, J. (2000). Detection of deception: Statement Validity Analysis as a means of determining truthfulness or falsity of rape allegations. Legal and Criminological Psychology, 5, 237-259.
30. Petersen, R. (1997). Konzeption und Evaluation der Rehabilität des Kieler Trainings-programmes zur Beurteilung der Glaubwürdigkeit von Zeugenaussagen (KTBG) [Development and reliability evaluation of the Kiel Training Program for Statement Validity Assessment]. Unpublished diploma thesis, Christian-Albrecht-Universität Kiel, Germany.
31. Porter, S., & Yuille, J. C. (1995). Credibility assessment of criminal suspects through statement analysis. Psychology, Crime and Law, 1, 319-331.
32. Porter, S., & Yuille, J. C. (1996). The language of deceit: An investigation of the verbal clues in the interrogation context. Law and Human Behavior, 20, 443-458.
33. Raskin, D. C., & Esplin, P. W. (1991). Statement validity assessment: Interview procedures and content analysis of children's statements of sexual abuse. Behavioral Assessment, 13, 265-291.
34. R Development Core Team. (2004). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, http://www.r-project.org.
35. Ruby, C. L., & Brigham, J. C. (1997). The usefulness of the criteria-based content analysis technique in distinguishing between truthful and fabricated allegations: A critical review. Psychology, Public Policy, and Law, 3, 705-737.
36. Ruby, C. L., & Brigham, J. C. (1998). Can criteria-based content analysis distinguish between true and false statements of African-American speakers? Law and Human Behavior, 22, 369-388.
37. Scheinberger, R. (1993). Inhaltliche Realkennzeichen in Aussagen von Erwachsenen [Content-related reality criteria in adults' statements]. Unpublished diploma thesis, Freie Universität Berlin, Germany.
38. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
39. Sporer, S. L. (1997). The less travelled road to truth: Verbal cues in deception detection in accounts of fabricated and self-experienced events. Applied Cognitive Psychology, 11, 373-397.
40. Steller, M. (1989). Recent developments in statement analysis. In J. Yuille (Ed.), Credibility assessment (pp. 135-154). Dordrecht: Kluwer.
41. Steller, M., & Köhnken, G. (1989). Criteria-based statement analysis. Credibility assessment of children's statements in sexual abuse cases. In D. C. Raskin (Ed.), Psychological methods in criminal investigation and evidence (pp. 217-245). New York: Springer.
42. Steller, M., Wellershaus, P., & Wolf, T. (1988). Empirical validation of criteria-based content analysis. Paper presented at the NATO Advanced Study Institute on Credibility Assessment, Maratea, Italy.
43. Steller, M., Wellershaus, P., & Wolf, T. (1992). Realkennzeichen in Kinderaussagen: Empirische Grundlagen der kriterienorientierten Aussageanalyse [Reality criteria in children's Statements: Empirical basis of Criteria-Based Content Analysis]. Zeitschrift für Experimentelle und Angewandte Psychologie, 39, 151-179.
44. Tye, M. C., Amato, S. L., Honts, C. R., Devitt, M. K., & Peters, D. (1999). The willingness of children to lie and the assessment of credibility in an ecologically relevant laboratory setting. Applied Developmental Science, 3, 92-109.
45. Undeutsch, U. (1967). Beurteilung der Glaubhaftigkeit von Zeugenaussagen. [Assessing the validity of testimonial statements]2E In U. Undeutsch (Ed.), Handbuck der Psychologie. Band 11: Forensische Psychologie, (pp. 26-181). Göttingen: Hogrefe.
46. Undeutsch, U. (1984). Courtroom evaluation of eyewitness testimony. International Review of Applied Psychology, 33, 51-67.
47. Undeutsch, U. (1989). The development of statement reality analysis. In J. Yuille (Ed.), Credibility assessment (pp. 101-120). Dordrecht: Kluwer.
48. Vrij, A. (2000). Detecting lies and deceit: The psychology of lying and the implications for professional practice. Chichester: Wiley.
49. Vrij, A., & Akehurst, L. (1998). Verbal communication and credibility: Statement validity assessment. In A. Memon, A. Vrij, & R. Bull (Eds.), Psychology and law: Truthfulness, accuracy, and credibility (pp. 3-31). London: McGraw-Hill.
50. Vrij, A., Akehurst, L., Soukara, S., & Bull, R. (2002). Will the truth come out? The effect of deception, age, status, coaching, and social skills on CBCA scores. Law and Human Behavior, 26, 261-283.
51. Vrij, A., Edward, K., & Bull, R. (2001a). People's insight into their own behaviour and speech content while lying. British Journal of Psychology, 92, 373-389.
52. Vrij, A., Edward, K., & Bull, R. (2001b). Stereotypical verbal and nonverbal responses while deceiving others. Personality and Social Psychology Bulletin, 27, 899-909.
53. Vrij, A., Edward, K., Roberts, K. P., & Bull, R. (2000). Detecting deceit via analysis of verbal and nonverbal behavior. Journal of Nonverbal Behavior, 24, 239-263.
54. Vrij, A., Kneller, W., & Mann, S. (2000). The effect of informing liars about criteria-based content analysis on their ability to deceive CBCA-raters. Legal and Criminological Psychology, 5, 57-70.
55. Wellershaus, P. (1992). Glaubhaftigkeit kindlicher Zeugenaussagen [Credibility of children's testimonial statements]. Psychomed, 4, 20-24.
56. Wellershaus, P., & Wolf, T. (1989). Kriterienorientierte Aussageanalyse. Empirische Überprüfung der diagnostischen Leistungsfähigkeit inhaltlicher Realkennzeichen zur Trennung wahrer von unwahren Zeugenaussagen [Criteria-based content analysis: Empirical evaluation of the diagnostic capability of content-related reality criteria for the differentiation of truthful and fabricated testimonial statements]. Unpublished diploma thesis, Christian-Albrecht-Universität Kiel, Germany.
57. Wolf, P., & Steller, M. (1997). Realkennzeichen in Aussagen von Frauen [Reality criteria in women's statements]. In L. Greuel, T. Fabian, & M. Stadler (Eds.), Psychologie der Zeugenaussage (pp. 121-130). Weinheim: Psychologie Verlags Union.
58. Yuille, J. C., & Cutshall, J. (1989). Analysis of the Statements of victims, witnesses, and suspects. In J. Yuille (Ed.), Credibility assessment (pp. 175-191). Dordrecht: Kluwer.
59. Zaparniuk, J., Yuille, J. C., & Taylor, S. (1995). Assessing the credibility of true and false statements. International Journal of Law and Psychiatry, 18, 343-352.