Shared task: Crowdsourced accessibility elicitation of Wikipedia articles

Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, Mturk 2010 at the 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2010 - Proceedings

Volumn , Issue , 2010, Pages 41-44

  Novotney, Scott ^a   Callison Burch, Chris ^a  

^a Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CROWDSOURCING; NATURAL LANGUAGE PROCESSING SYSTEMS;

BEST PRACTICES; CONVERSATIONAL SPEECH; LOW LITERACIES; MECHANICAL TURKS; SIMPLE++; SPEECH RESOURCES; SPEECH TRANSCRIPTIONS; TEST BED; WIKIPEDIA ARTICLES; WORKERS';

SPEECH TRANSMISSION;

EID: 85025668615     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (6)

1. Chris Callison-Burch. 2009. Fast, Cheap, and Creative: Evaluating Translation Quality Using Amazons Mechanical Turk. EMNLP.
2. Matthew Marge, Satanjeev Banerjee, and Alexander Rudnicky. 2010. Using the amazon mechanical turk for transcription of spoken language. ICASSP, March.
3. Ian McGraw, Alexander Gruenstein, and Andrew Sutherland. 2009. A self-labeling speech corpus: Collecting spoken words with an online educational game. In INTERSPEECH.
4. Ian McGraw, Chia ying Lee, Lee Hetherington, and Jim Glass. 2010. Collecting Voices from the Crowd. LREC, May.
5. Scott Novotney and Chris Callison-Burch. 2010. Cheap, Fast and Good Enough: Automatic Speech Recognition with Non-Expert Transcription. NAACL, June.
6. Rion Snow, Brendan O'Connor, Daniel Jurafsky, and Andrew Y. Ng. 2008. Cheap and fast-but is it good?: evaluating non-expert annotations for natural language tasks. In EMNLP.