Crowdsourcing the acquisition of natural language corpora: Methods and observations

2012 IEEE Workshop on Spoken Language Technology, SLT 2012 - Proceedings

Volumn , Issue , 2012, Pages 73-78

  Wang, William Yang ^a   Bohus, Dan ^a   Kamar, Ece ^a   Horvitz, Eric ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

crowdsourcing; language understanding; natural language elicitation methods; spoken dialog

Indexed keywords

CROWDSOURCING; ELICITATION METHODS; FRAME SEMANTICS; LANGUAGE UNDERSTANDING; NATURAL LANGUAGE PROCESSING APPLICATIONS; NATURAL LANGUAGES; PERFORMANCE MEASURE; RESEARCH CHALLENGES; SPOKEN DIALOG;

LINGUISTICS; SEMANTICS; SPEECH RECOGNITION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84874230762     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SLT.2012.6424200     Document Type: Conference Paper

References (13)

1. Marge, M., S. Banerjee and A. I. Rudnicky, "Using the Amazon Mechanical Turk for Transcription of Spoken Language", In Proc. of ICASSP, 2010.
2. Yang, Z., B. Li, Y. Zhu, I. King, G. Levow, and H.M. Meng, Collection of user judgments on spoken dialog system with crowdsourcing, In Proc. of SLT, 2010.
3. Lane, I., M. Eck, K. Rottmann and A. Waibel, Tools for Collecting Speech Corpora via Mechanical-Turk., In Proc. Of Creating Speech and Language Data with Amazon's Mechanical Turk, 2010.
4. Alonso, O., D. E. Rose, and B. Stewart. Crowdsourcing for relevance evaluation, In Proc. of SIGIR Forum 42, 2008.
5. Zaidan, O., C. Callison-Burch, Crowdsourcing Translation: Professional Quality from Non-Professionals, In Proc. of ACL, 2011.
6. Burrows, S., M. Potthast, and B. Stein. Paraphrase Acquisition via Crowdsourcing and Machine Learning. In ACM TIST (to appear), 2012.
7. Dolan, W. B., C. Brockett. Automatically Constructing a Corpus of Sentential Paraphrases. In Proc. of The Third International Workshop on Paraphrasing, 2005.
8. Ward, W., and B. Pellom, The CU Communicator System, In Proc. of IEEE ASRU, 1999.
9. Gandhe, S., D. DeVault, A. Roque, B. Martinovski, R. Artstein, A. Leuski, J. Gerten, and D. Traum, From Domain Specification to Virtual Humans: An integrated approach to authoring tactical questioning characters, In Proc. of Interspeech, 2008.
10. Aleven, V., Sewall, J., McLaren, B. M., & Koedinger, K. R. Rapid authoring of intelligent tutors for real world and experimental use. In Proc. of ICALT, 2006.
11. Allen, J. F., B. W. Miller, E. K. Ringger, and T. Sikorski. 1996. A robust system for natural spoken dialog, In Proc. of the ACL. 1996.
12. Gorin, A. L., G. Riccardi, J. H. Wright, How may I help you? In Speech Communication, 1997.
13. Lathrop, B. et al. A Wizard of Oz framework for collecting spoken human-computer dialogs: An experiment procedure for the design and testing of natural language in-vehicle technology systems, In Proc. ITS, 2004.