Creating a Bi-lingual entailment corpus through translations with Mechanical Turk: $100 for a 10-day rush

Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, Mturk 2010 at the 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2010 - Proceedings

Volumn , Issue , 2010, Pages 212-216

  Negri, Matteo ^a   Mehdad, Yashar ^a,b  

^a FONDAZIONE BRUNO KESSLER   (Italy)

^b UNIVERSITY OF TRENTO   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; TRANSLATION (LANGUAGES);

AMAZON'S MECHANICAL TURKS; COST EFFECTIVE; MECHANICAL TURKS; TEXTUAL ENTAILMENT; WORKERS';

COST EFFECTIVENESS;

EID: 85041194337     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (7)

1. V. Ambati, S. Vogel and J. Carbonell 2010. Active Learning and Crowd-Sourcing for Machine Translation. To appear in Proceedings of LREC 2010.
2. C. Callison-Burch 2009. Fast, Cheap, and Creative: Evaluating Translation Quality Using Amazon's Mechanical Turk. In Proceedings of EMNLP 2009.
3. I. Dagan and O. Glickman 2004. Probabilistic Textual Entailment: Generic Applied Modeling of Language Variability. In Proceedings of the PASCAL Workshop of Learning Methods for Text Understanding and Mining.
4. M. Marge, S. Banerjee and A. Rudnicky 2010. Using the Amazon Mechanical Turk for Transcription of Spoken Language. In Proceedings of the 2010 IEEE International Conference on Acoustics, Speech and Spoken Language (ICASSP 2010).
5. Y. Mehdad, M. Negri, and M. Federico 2010. Towards Cross-Lingual Textual Entailment. To appear in Proceedings of NAACL HLT 2010.
6. R. Mihalcea and C. Strapparava 2009. The Lie Detector: Explorations in the Automatic Recognition of Deceptive Language. In Proceedings of ACL 2009.
7. R. Snow, B. O'Connor, D. Jurafsky, and A. Y. Ng 2008. Cheap and Fast - but is it Good? Evaluating Non-expert Annotations for Natural Language Tasks. In Proceedings of EMNLP 2008.