Deriving perceptual gradation of L2 English mispronunciations using crowdsourcing and the WorkerRank algorithm

Proceedings of the 2012 International Conference on Speech Database and Assessments, Oriental COCOSDA 2012

Volumn , Issue , 2012, Pages 145-150

  Wang, Hao ^a   Meng, Helen ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

CAPT; Crowdsourcing; mispronunciation gradation; WorkerRank

Indexed keywords

CAPT; CONTROL PROCEDURES; CROWDSOURCING; FOUR-POINT; MISPRONUNCIATION GRADATION; NON-NATIVE; PAGERANK ALGORITHM; WORKERRANK;

ERRORS;

ALGORITHMS;

EID: 84874275177     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSDA.2012.6422468     Document Type: Conference Paper

References (13)

1. Neri, A., et al, "The pedagogy-technology interface in Computer Assisted Pronunciation Training" Computer Assisted Language Learning, 15: 441-467, 2002.
2. Ellis, R, "Corrective Feedback and Teacher Development", L2 Journal, 1: 3-18, 2009.
3. Witt, S and Young, S, "Language Learning Based on Non-Native Speech Recognition", Proc. EUROSPEECH1997: 633-636, Rhodes, Greece, 1997.
4. Neri, A, Cucchiarini, C, and Strik, H, "Segmental errors in Dutch as a second language: how to establish priorities for CAPT", Proc. InSTIL/ICALL Symposium, 2004.
5. McGraw, I., Glass, J., Seneff, S., "Growing a Spoken Language Interface on Amazon Mechanical Turk", Proc. Interspeech2011, Florence, 2011.
6. Kunath, S. A. and Weinberger, S. H., "The wisdom of the crowd's ear: speech accent rating and annotation with Amazon Mechanical Turk", Proc. CSLDAMT '10, Association for Computational Linguistics, June 2010.
7. Peabody, M. A., "Methods for pronunciation assessment in computer aided language learning", [dissertation], US-MA: Massachusetts Institute of Technology; 2011.
8. Bucholz, S., et al., "Crowdsourcing preference tests and how to detect cheating", Proc. Interspeech2011, Florence, 2011.
9. Watkins, M. W. and Pacheco, M., "Interobserver Agreement in behavior research: Importance and Calculation", Journal of Behavioral Education, 10(4): 205-212, December 2000. (Pubitemid 33369587)
10. Shoukri, M.M., Measures of interobserver agreement, 2004.
11. Bland, M., "Measurement in Health and Disease: Assessing Agreement Using Cohen's Kappa", M. Sc. Course Material: Measurement in Health and Disease, Department of Health Sciences at University of York, 22 Jul. 2008, http://www-users.york.ac.uk/~mb55/msc/clinimet/week4/kappa.htm, 9 Jul. 2012.
12. Page, L., Brin, S., Motwani, R., and Winograd, T., "The pagerank citation ranking: Bringing order to the web", Technical report, Stanford Digital Library Technologies Project, 1998.
13. Ienco, D., Meo, R., Botta, M., "Using PageRank in Feature Selection", In SEBD, 93-100, 2008.