An annotation scheme for agreement analysis

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 1, Issue , 2006, Pages 201-204

  Toh, Siew Leng ^a   Yang, Fan ^a   Heeman, Peter A ^a  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

Agreement; Annotation scheme; Dialogue; Inter coder reliability

Indexed keywords

COMPUTER SIMULATION; CONTRACTS;

ANNOTATION SCHEME; DIALOGUE; LIMITED DOMAINS; RESEARCH INTERESTS;

COMPUTER APPLICATIONS;

EID: 44949224967     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Lance A. Ramshaw, "A three-level model for plan exploration," in Proceedings of 29th ACL, Berkeley CA, 1991, pp. 36-46.
2. Matthew Purver, Patrick Ehlen, and John Niekrasz, "Detecting action items in multi-party meetings: Annotation and initial experiments," in The 3rd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI 2006), Washington, DC, 2006.
3. E. Shriberg, R. Dhillon, S. Bhagat, J. Ang, and H. Carvey, "The ICSI meeting recorder dialog act corpus," in Proceedings of the 5th SIGdial Workshop on Discourse and Dialogue, 2004.
4. Susan E. Strayer, Peter A. Heeman, and Fan Yang, "Reconciling control and discourse structure," in Current and New Directions in Discourse and Dialogue, J. Van Kuppevelt and R. W. Smith, Eds., chapter 14, pp. 305-323. Kluwer Academic Publishers, 2003.
5. Adam Janin, Don Baron, Jane Edwards, Dan Ellis, David Gelbart, Nelson Morgan, Barbara Peskin, Thilo Pfau, Elizabeth Shriberg, Andreas Stolcke, and Chuck Wooters, "The ICSI meeting corpus," in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003.
6. Peter A. Heeman, Fan Yang, Andrew L. Kun, and Alexander Shyrokov, "Conventions in human-human multithreaded dialogues: A preliminary study," in Proceedings of Intelligent User Interface (short paper session), San Diego CA, 2005, pp. 293-295.
7. J. R. Searle, Speech acts: An essay in the philosophy of language, Cambridge University Press, Cambridge, 1969.
8. Jean Carletta, Amy Isard, Stephen Isard, Jacqueline C. Kowtko, Gwyneth Doherty-Sneddon, and Anne H. Anderson, "The reliability of a dialogue structure coding scheme," Computational Linguistics, vol. 23, no. 1, pp. 13-31, 1997.
9. David R. Traum and Elizabeth A. Hinkelman, "Conversation acts in task-oriented spoken dialogue," Computational Intelligence, vol. 8, no. 3, pp. 575-599, 1992, Special Issue: Computational Approaches to Non-Literal Language.
10. Mark G. Core and James F. Allen, "Coding dialogues with the DAMSL annotation scheme," in Working Notes: AAAI Fall Symposium on Communicative Action in Humans and Machines, Cambridge, 1997, pp. 28-35.
11. Rebecca Bates, Patrick Menning, Elizabeth Willingham, and Chad Kuyper, "Meeting acts: A labeling system for group interaction in meetings," in Proceedings of EUROSPEECH, 2005.
12. Fan Yang, Peter A. Heeman, Kristy Hollingshead, and Susan E. Strayer, "Dialogueview: Annotating dialogues in multiple views with abstraction," Natural Language Engineering, To appear in 2007.
13. Jean Carletta, "Assessing agreement on classification tasks: The kappa statistic," Computational Linguistics, vol. 22, no. 2, pp. 249-254, 1997.