Using the Amazon Mechanical Turk to transcribe and annotate meeting speech for extractive summarization

Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, Mturk 2010 at the 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2010 - Proceedings

Volumn , Issue , 2010, Pages 99-107

  Marge, Matthew ^a   Banerjee, Satanjeev ^a   Rudnicky, Alexander I ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMAZON'S MECHANICAL TURKS; EXTRACTIVE SUMMARIZATIONS; HIGH QUALITY; MECHANICAL TURKS; SPONTANEOUS SPEECH; SUMMARIZATION SYSTEMS;

SPEECH;

EID: 84974625774     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. S. Banerjee and A. I. Rudnicky. 2007. Segmenting meetings into agenda items by extracting implicit supervision from human note-taking. In Proceedings of IUI.
2. S. Banerjee and A. I. Rudnicky. 2009. Detecting the noteworthiness of utterances in human meetings. In Proceedings of SIGDial.
3. C. Bennett and A. I. Rudnicky. 2002. The Carnegie Mellon Communicator corpus. In Proceedings of ICSLP.
4. J. G. Fiscus. 1997. A post-processing system to yield word error rates: Recognizer Output Voting Error Reduction (ROVER). In Proceedings of ASRU Workshop.
5. M. Galley. (2006). A skip-chain conditional random field for ranking meeting utterances by im portance. In Proceedings of EMNLP.
6. A. Gruenstein, I. McGraw, and A. Sutherland. 2009. A self-transcribing speech corpus: collecting continuous speech with an online educational game. In Proceedings of SLaTE Workshop.
7. F. Liu and Y. Liu. 2008. Correlation between ROUGE and human evaluation of extractive meeting summaries. In Proceedings of ACL-HLT.
8. M. Marge, S. Banerjee, and A. I. Rudnicky. 2010. Using the Amazon Mechanical Turk for transcription of spoken language. In Proceedings of ICASSP.
9. S. Novotney and C. Callison-Burch. 2010. Cheap, fast and good enough: Automatic speech recognition with non-expert transcription. In Proceedings of NAACL.
10. G. Penn and X. Zhu. 2008. A critical reassessment of evaluation baselines for speech summarization. In Proceedings of ACL-HLT.
11. B. Roy and D. Roy. 2009. Fast transcription of unstructured audio recordings. In Proceedings of In terspeech.