Squibs and Discussions: Assessing Agreement on Classification Tasks: The Kappa Statistic

Computational Linguistics

Volumn 22, Issue 2, 1996, Pages 248-254

  Carletta, Jean ^a,b  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b Human Communication Research Centre   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); LINGUISTICS;

CLASSIFICATION TASKS; COGNITIVE SCIENCE; CONTENT ANALYSIS; KAPPA STATISTIC; RELIABILITY MEASURE;

RELIABILITY ANALYSIS;

EID: 1542609528     PISSN: 08912017     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (15)

1. Berry, C. C. 1992. The kappa statistic. Journal of the American Medical Association, 268(18):2513.
2. Cahn, Janet. 1992. An investigation into the correlation of cue phrase, unfilled pauses, and the structuring of spoken discourse. In Proceedings of the IRCS Workshop on Prosody in Natural Speech (IRCS Report 92-37), August.
3. Greene, John O. and Joseph N. Cappella. 1986. Cognition and talk: The relationship of semantic units to temporal patterns of fluency in spontaneous speech. Language and Speech, 29(2):141-157.
4. Goldman, L. R. 1992. The kappa statistic - in reply. Journal of the American Medical Association, 268(18):2513-4.
5. Grosz, Barbara and Candace Sidner. 1986. Attentions, intentions, and the structure of discourse. Computational Linguistics, 12(3):175-204.
6. Kowtko, Jacqueline C., Stephen D. Isard, and Gwyneth M. Doherty. 1992. Conversational games within dialogue. Technical Report HCRC/RP-31, Human Communication Research Centre, University of Edinburgh, June.
7. Kraemer, Helena Chmura. 1980. Extension of the kappa coefficent. Biometrics, 36:207-216.
8. Krippendorff, Klaus. 1980. Content Analysis: An introduction to its Methodology. Sage Publications.
9. Litman, Diane and Julia Hirschberg. 1990. Disambiguating cue phrases in text and speech. In Proceedings of the Thirteenth International Conference on Computational Linguistics (COLING-90), volume 2, pages 251-256.
10. Passonneau, Rebecca J. and Diane J. Litman. 1993. Intention-based segmentation: human reliability and correlation with linguistic cues. In Proceedings of the 31st Annual Meeting of the ACL, pages 148-155, June.
11. Rodrigues, Irene Pimenta and Josè Gabriel P. Lopes. 1992. Temporal structure of discourse. In Proceedings of the Fourteenth International Conference on Computational Linguistics (COLING-92), volume 1, pages 331-337.
12. Silverman, Kim, Mary Beckman, John Pitrelli, Mari Ostendorf, Colin Wightman, Patti Price, Janet Pierrehumbert, and Julia Hirschberg. 1992. TOBI: A standard for labeling English prosody. In International Conference on Speech and Language Processing (ICSLP), volume 2, pages 867-870.
13. Siegel, Sidney and N. J. Castellan, Jr. 1988. Nonparametric Statistics for the Behavioral Sciences. Second edition. McGraw-Hill.
14. Soeken, K. and P. Prescott. 1986. Issues in the use of kappa to assess reliability. Medical Care, 24:733-743.
15. Weber, Robert Philip. Basic Content Analysis. Sage Publications.