Using crowdsourcing to provide prosodic annotations for non-native speech

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 3069-3072

  Evanini, Keelan ^a   Zechner, Klaus ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Boundary tone; Crowdsourcing; Prosodic annotation; Stress

Indexed keywords

BOUNDARY TONE; CORPUS OF SPONTANEOUS SPEECH; CROWDSOURCING; NON-NATIVE; NON-NATIVE SPEAKERS; PROSODIC ANNOTATION;

COMPUTER APPLICATIONS; COMPUTER SIMULATION; STRESSES;

EXPERIMENTS;

EID: 84865777590     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (8)

1. M. Marge, S. Banerjee, and A. I. Rudnicky, "Using the amazon mechanical turk for transcription of spoken lanugage," in Proc. ICASSP, 2010.
2. J. Tetreault, E. Filatova, and M. Chodorow, "Rethinking grammatical error annotation and evaluation with the amazon mechanical turk," in Proc. NAACL HTL Fifth Workshop on Innovative Use of NLP for Building Educational Applications, 2010.
3. R. Snow, B. O'Connor, D. Jurafsky, and A. Y. Ng, "Cheap and fast - but is it good? evaluating non-expert annotations for natural language tasks," in Proc. EMNLP, 2008.
4. C. J. Mayo, "Prosodic transcription of glasgow english: an evaluation study of glatobi," Master's thesis, University of Edinburgh, 1996.
5. J. Buhmann, J. Caspers, V. J. van Heuven, H. Hoekstra, J.-P. Martens, and M. Swerts, "Annotation of prominent words, prosodic boundaries and segmental lengthening by non-expert transcribers in the spoken dutch corpus," in Proc. LREC, 2002.
6. Y. Mo, J. Cole, and E.-K. Lee, "Naive listeners' prominence and boundary perception," in Proc. Speech Prosody, 2008.
7. T.-J. Yoon, S. Chavarría, J. Cole, and M. Hasegawa-Johnson, "Intertranscriber reliability of prosodic labeling on telephone conversation using ToBI," in Proc. Interspeech, 2004.
8. F. Hönig, A. Batliner, K. Weilhammer, and E. Nöth, "How many labellers? modelling inter-labeller agreement and system performance for the automatic assessment of non-native prosody," in Proc. ISCA Workshop on Speech and Language Technology in Education, 2010.