Establishing a methodology for benchmarking speech synthesis for Computer-Assisted Language Learning (CALL)

Language Learning and Technology

Volumn 9, Issue 3, 2005, Pages 99-120

  Handley, Zöe ^a   Hamel, Marie Josée ^b  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b DALHOUSIE UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 24944590699     PISSN: 10943501     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (53)

1. Anderson, A. (2000, April). Spanish for business professionals. The CALICO Review. Retrieved January 31, 2005, from http://calico.org/CALICO_Review/ review/sbp.htm
2. Begag, A. (1990). Les voleurs d'écriture [The stolen writings]. Paris: Editions du Seuil.
3. Cai, J.-Y., Nerurkar, A., & Wu, M.-Y. (1998). Making benchmarks uncheatable. Proceedings of the IEEE International Computer Performance and Dependability Symposium (IPDS'98; pp. 216-226). Durham, NC: IEEE Computer Society.
4. Celce-Murcia, M., Brinton, D. M., & Goodwin, J. M. (1996). Teaching pronunciation: A reference for teachers of English to speakers of other languages. Cambridge, England: Cambridge University Press.
5. Chapelle, C. A. (1998). Multimedia CALL: Lessons to be learned from instructed SLA. Language Learning & Technology, 2(1), 22-34. Retrieved January 31, 2005, from http://llt.msu.edu/vol2num1/article1/
6. Chapelle, C. (2001a). Innovative language learning: Achieving the vision. ReCALL, 23(10), 3-14
7. Chapelle, C. (2001b). Computer applications in second language acquisition: Foundations for teaching testing and research. Cambridge, England: Cambridge University Press.
8. Codling, S. (1998). Benchmarking. Aldershot, England: Gower.
9. Cohen, R. (1993). The use of voice synthesizer in the discovery of the written language by young children. Computers in Educations, 21(1/2), 25-30.
10. Colotte, V., Laprie, Y., & Bonneau, A. (2001). Perceptual experiments on enhanced and slowed down speech sentences for second language acquisition. Proceedings of the European Conference on Speech Communication and Technology (pp. 469-473). Bonn: ISCA.
11. de Pijper, J. R. (1997). High-quality message-to-speech generation in a practical application. In J. P. H. van Santen, R. W. Sproat, J. P. Olive, & J. Hirschberg (Eds.), Progress in speech synthesis (pp. 575-586). New York: Springer Verlag.
12. EAGLES (Expert Advisory Group on Language Engineering Standards). (1999). EAGLES evaluation of natural language processing systems. Final Report. EAGLES Document EAG-II-EWG-PR.1. Copenhagen: Center for Sprogteknologi.
13. Egan, B. K., & LaRocca, S. A. (2000). Speech recognition in language learning: A must. In proceedings of InSTIL 2000 (pp. 4-9). Dundee, England: University of Abertay Dundee.
14. Ehsani, F., & Knodt, E. (1998). Speech technology in computer-aided language learning: Strengths and limitations of a new CALL paradigm. Language Learning & Technology, 2(1), 45-60. Retrieved January 31, 2005, from http://llt.msu.edu/vol2num1/article3/
15. Ellis, R. (1994). The study of second language acquisition. Oxford, England: Oxford University Press.
16. ELSE (Evaluation in Language and Speech Engineering). (1999, June). A blueprint for a general infrastructure for natural language processing systems evaluation using semi-automatic quantitative black box approach in a multilingual environment. (Report no. D1.1). Retrieved January 31, 2005, from http://m17.limsi.fr/TLP/ELSE/
17. Feldman, D. M. (1977). Measuring auditory discrimination of suprasegmental features of Spanish. IRAL, 11, 195-209.
18. Francis, A. L., & Nusbaum, H. C. (1999). Evaluating the quality of synthetic speech. In D. Gardner-Bonneau (Ed.), Human factors and voice interactive systems (pp. 63-97). Boston, MA: Kluwer Academic Publishers.
19. Garant-Viau, C. (1994). La portée des sons [The significance/importance of sounds]. Québec: Université Laval.
20. Gaudinat, G., & Wehrli, E. (1997). Analyse syntaxique et synthèse de la parole: le projet FIPSvox [Syntactic analysis and speech synthesis: The FIPSvox project]. TAL, 38(1), 121-134
21. Grace, R. (1996). The benchmark book. London: Prentice Hall.
22. Gray, T. (1984). Talking computers in the classroom. In G. Bristow (Ed.), Electronic speech synthesis (pp. 234-259). London: McGraw-Hill.
23. Hamel, M.-J. (1998). Les outils de TALN dans SAFRAN [NLP tools in SAFRAN]. ReCALL Journal, 10(1), 79-85
24. Hamel, M.-J. (2003a). Re-using natural language processing tools in CALL: The experience of SAFRAN. Unpublished doctoral thesis. University of Manchester Institute of Science and Technology, UK.
25. Hamel, M.-J. (2003b). FreeText: A "Smart" multimedia Web-based computer assisted language learning environment for learners of French. In Proceedings of m-ICTE2003, volume III (pp. 1661-1665), Badajoz, Spain.
26. Hetzel, B. (1993). Making software measurement work: Building an effective measurement program. Boston: QED Publishing Group.
27. Hincks, R. (2002). Speech synthesis for teaching lexical stress. TMH-QPSR, 44, 153-165
28. Hirschman, L., & Thompson, H. S. (1996). Overview of evaluation in speech and natural language processing. In R. A. Cole, J. Mariani, H. Uszkoreit, A. Zaenen, & V. Zue (Eds.), Survey of the state of the art in human language technology (pp. 175-181). Cambridge, England: Cambridge University Press. http://cslu.cse.ogi.edu/HLTsurvey/
29. Huang, X, Acero, X., & Hon, H.-W. (2001). Spoken language processing: A guide to theory, algorithm, and system development. Upper Saddle River, NJ: Prentice Hall.
30. Kenworthy, J. (1987). Teaching English pronunciation. London: Longman.
31. Knoerr, H. (2000). Pratique intonative et utilisation d'un logiciel de visualisation dans un cours de prononciation en Français langue seconde: Une etude descriptive [Intonation training using visualisation software in a pronunciation class for learners of French as a second language: A case study]. Revue Canadienne de Linguistique Appliquée, 3(1-2), 123-140
32. LeBel, J.-G. (1990). Traité de correction phonétique ponctuelle [Treatise of ad hoc phonetic correction]. Laval Canada: Les Editions de la Facultédes Lettres, UniversitéLaval.
33. Lindgaard, G. (1994). Usability testing and system evaluation: A guide for designing useful computer systems. London: Chapman & Hall
34. Mercier, G., Guyomard, M., Siroux, J., Bramoullé A., Gourmelon, H., Guillou, A., & Lavannant, P. (2000). Courseware for Breton spelling pronunciation and intonation learning. In Proceedings of InSTIL 2000 (pp. 145-148). Dundee, England: University of Abertay Dundee.
35. Myers, M. J. (2000). Voice recognition software used to learn pronunciation. In Proceedings of InSTIL 2000 (pp. 98-101). Dundee, England: University of Abertay, Dundee.
36. Oxford-Hachette. (2003). Oxford-Hachet French Dictionary on CD-ROM (Verions 2.0). Oxford, England: Oxford University Press.
37. Pennington, M. C. (1996). Phonology in English language teaching: An international approach. London: Longman.
38. Protopapas, A., & Calhoun, B. (2000). Adaptive phonetic training for second-language learners. In Proceedings of InSTIL 2000 (pp. 31-38). Edinburgh, Scotland.
39. Raux, A., & Eskenazi, M. (2004). Using task-oriented spoken dialogues for language learning: Potential, practical application and challenges. In R. Delmonte, P. Delcloque, & S. Tonelli (Eds.), Proceedings of the InSTIL/ICALL 2004 Symposium (pp. 147-150). Venice, Italy.
40. Ralston, A., Reilly, E. D., & Hemmdinger, D. (Eds.). (2000). Encyclopedia of computer science. London: Nature Publishing Group.
41. Santiago-Oriola, C. (1999). Vocal synthesis in a computerized dictation exercise. In Proceedings of EUROSPEECH'99 (Vol. 1, pp. 191-194), Budapest.
42. Seneff, S., Wang, C., & Zhang, J. (2004). Spoken conversation interaction for language learning. In R. Delmonte, P. Delcloque, & S. Tonelli (Eds.), Proceedings of the InSTIL/ICALL 2004 Symposium (pp. 151-154), Venice, Italy.
43. Sherwood, B. (1981). Speech synthesis applied to language teaching. Studies in Language Learning, 3, 175-181.
44. th International Conference on Software Engineering (pp. 74-83), Portland, OR.
45. Skrelin, P., & Volskaya, N. (1998). Application of new technologies in the development of education programs. In S. Jager, J. Nerbonne, & A. van Essen (Eds.), Language Teaching and Language Technology (pp. 21-24). Lisse, The Netherlands: Swets and Zeitlinger.
46. Sobkowiack, W. (1998). Speech in EFL CALL. In K. Cameron (Ed.), Multimedia CALL: Theory and practice (pp. 23-34). Exeter, England: Elm Bank.
47. Sparck Jones, K., & Galliers, J. R. (1996). Evaluating natural language processing systems: An analysis and review. London: Springer.
48. Stratil, M., Burkhardt, D., Jarratt, P., & Yandle, J. (1987) Computer-aided language learning with speech synthesis: User reactions. Programmed Learning and Educational Technology, 24(4), 309-316.
49. Stratil, M., Weston, G., & Burkhardt, D. (1987). Exploration of foreign language speech synthesis. Literary and Linguistic Computing, 2(2), 116-119.
50. Talk to Me French: The Conversation Method (Version 3.5) from Auralog http://www.auralog.fr
51. Thomas, C., Levinson, M., & Lessard, G. (2004). Experiments in prosody for the oral generation of French. In R. Delmonte, P. Delcloque, & S. Tonelli (Eds.), Proceedings of the InSTIL/ICALL 2004 symposium (pp. 123-126), Venice, Italy.
52. Ur, P. (1984). Teaching listening comprehension. Cambridge, England: Cambridge University Press.
53. van Bezooijen, R., & van Heuven, V. J. (1997). Assesment of synthesis systems. In D. Gibbon, R. Moore, & R. Winski (Eds.), Handbook of standards and resources for spoken language systems (Vol. 3, pp. 481-563). New York: Mouton de Gruyter.