Children's Oral Reading Corpus (CHOREC): Description and assessment of annotator agreement

Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

Volumn , Issue , 2008, Pages 998-1005

  Cleuren, Leen ^a   Duchateau, Jacques ^a   Ghesquière, Pol ^a   Van Hamme, Hugo ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

TRANSCRIPTION;

ELEMENTARY SCHOOLS; KAPPA VALUES; PHONETIC TRANSCRIPTIONS; READING ERRORS; READING STRATEGIES; SPACE PROJECTS;

ERRORS;

EID: 84906221210     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Bayerl, P. S., & Paul, K. I. (2007). Identifying sources of disagreement: Generalizability theory in manual annotation studies. Computational Linguistics, 33(1), 3-8.
2. Cicchetti, D. V. (1972). A new measure of agreement between rank ordered variables. In Proceedings of the 80th Annual Convention of the American Psychological Association (pp. 17-18).
3. Cleuren, L., Duchateau, J., Sips, A., Ghesquière, P., & Van hamme, H. (2006). Developing an automatic assessment tool for children's oral reading. In Proceedings of Interspeech (pp. 817-820). Pittsburgh, USA.
4. Cohen, J. (1960). A cofficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37-46.
5. Cucchiarini, C. (1996). Assessing transcription agreement: methodological aspects. Clinical Linguistics and Phonetics, 10(2), 131-155.
6. Dilley, L., Breen, M., Bolivar, M., Kraemer, J., & Gibson, E. (2006). A comparison of inter-transcriber reliability for two systems of prosodic annotation: RaP (Rhythm and Pitch) and ToBI (Tones and Break Indices). In Proceedings of Interspeech (pp. 317-320). Pittsburgh, USA.
7. Kazemzadeh, A., You, H., Iseli, M., Jones, B., Cui, X., Heritage, M., et al. (2005). TBALL data collection: The making of a young children's speech corpus. In Proceedings of Interspeech (pp. 1581-1584). Lisbon, Portugal.
8. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
9. Mostow, J., & Aist, G. (2001). Evaluating tutors that listen: An overview of project LISTEN. In K. D. Forbus & P. J. Feltovich (Eds.), Smart machines in education: The coming revolution in educational technology (pp. 169-234).
10. Mostow, J., Beck, J., Winter, S., Wang, S., & Tobin, B. (2002). Predicting oral reading miscues. In Proceedings of the Seventh International Conference on Spoken Language Processing (pp. 1221-1224). Denver, CO.
11. Pitt, M. A., Johnson, K., Hume, E., Kiesling, S., & Raymond, W. (2005). The Buckeye corpus of conversational speech: Labeling conventions and a test of transcriber reliability. Speech Communication, 45, 89-95.
12. Wise, B., Cole, R., van Vuuren, S., Schwartz, S., Snyder, L., Ngampatipatpong, N., et al. (2005). Learning to read with a virtual tutor: Foundations to literacy. In C. Kinzer & L. Verhoeven (Eds.), Interactive literacy education: Facilitating literacy environments through technology.
13. Yoon, T.-J., Chavarria, S., Cole, J., & Hasegawa-Johnson, M. (2004). Intertranscriber reliability of prosodic labeling on telephone conversation using ToBI. In Proceedings of Interspeech (pp. 2729-2732). Jeju Island, Korea.