Rhythmic unit extraction and modelling for automatic language identification

Speech Communication

Volumn 47, Issue 4, 2005, Pages 436-456

  Rouas, Jean Luc ^a   Farinas, Jérôme ^a   Pellegrino, François ^b   André Obrecht, Régine ^a  

^a IRIT   (France)

^b Institut des Sciences de l'Homme   (France)

Author keywords

Asian languages; European languages; Language identification; Rhythm modelling; Rhythm typology

Indexed keywords

ACOUSTICS; ALGORITHMS; STRESS ANALYSIS;

ASIAN LANGUAGES; EUROPEAN LANGUAGES; LANGUAGE IDENTIFICATION; RHYTHM MODELING;

SPEECH COMMUNICATION;

EID: 27644531433     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2005.04.012     Document Type: Article

References (86)

1. D. Abercrombie Elements of General Phonetics 1967 Edinburgh University Press Edinburgh
2. Adami, A.G., Hermansky, H., 2003. Segmentation of speech for speaker and language recognition. In: Proc. Eurospeech, Geneva, pp. 841-844.
3. R. André-Obrecht A new statistical approach for automatic speech segmentation IEEE Trans. Acoust. Speech Signal Process. 36 1 1988
4. Antoine, F., Zhu, D., Boula de Mareüil, P., Adda-Decker, M., 2004. Approches Segmentales multilingues pour 1'identification automatique de la langue: phones et syllabes. In: Proc. Journées d'Etude de la Parole, Fes, Morocco.
5. M. Barkat-Defradas, I. Vasilescu, and F. Pellegrino Stratégies perceptuelles et identification automatique des langues Revue PArole 25/26 2003 1 37
6. T. Berg Productive and perceptual constraints on speech error correction Psychol. Res. 54 1992 114 126
7. Bernd Möbius, 1998. Word and syllable models for German text-to-speech synthesis. In: Proceedings of the Third International Workshop on Speech Synthesis, Jenolan Caves, Australia, pp. 59-64.
8. Besson, M., Schön, D., 2001. Comparison between language and music. In: Zatorre, R., Peretz, I. (Eds.), "The biological foundations of music". Annals of The New York Academy of Sciences, Vol. 930.
9. Z.S. Bond, and V. Stockmal Distinguishing samples of spoken Korean from rhythmic and regional competitors Lang. Sci. 24 2002 175 185
10. B. Boysson-Bardies, M.M. Vihman, L. Roug-Hellichius, C. Durand, I. Landberg, and F. Arao Material evidence of infant selection from the target language: A cross-linguistic study C. Ferguson L. Menn C. Stoel-Gammon Phonological Development: Models, Research, Implications 1992 York Press Timonium, MD
11. Campione, E., Véronis, J., 1998. A multilingual prosodic database. In: Proc. ICSLP'98, Sydney, Australia.
12. A. Content, N. Dumay, and U.H. Frauenfelder The role of syllable structure in lexical segmentation in French Proc. Workshop on Spoken Word Access Processes 2000 Nijmegen The Netherlands
13. A. Content, R.K. Kearns, and U.H. Frauenfelder Boundaries versus onsets in syllabic segmentation J. Memory Lang. 45 2 2001
14. D. Crystal A Dictionary of Linguistics and Phonetics third ed. 1990 Blackwell London
15. Cummins, F., Gers, F., Schmidhuber, J., 1999. Language identification from prosody without explicit features. In: Proc. EUROSPEECH'99.
16. A. Cutler Prosody and the word boundary problem Morgan Demuth Signal to Syntax: Bootstrapping from Speech to Grammar in Early Acquisition 1996 Lawrence Erlbaum Associates Mahwah, NJ
17. A. Cutler, and D. Norris The role of strong syllables in segmentation for lexical access J. Exp. Psychol.: Human Perception Perform. 1988 14
18. R.M. Dauer Stress-timing and syllable-timing reanalyzed J. Phonet. 11 1983
19. P. Delattre, and C. Olsen Syllabic features and phonic impression in english, german, french and spanish Lingua 22 1969 160 175
20. P.F. Dominey, and F. Ramus Neural network processing of natural language: I. Sensitivity to serial, temporal and abstract structure in the infant Lang. Cognitive Process. 15 1 2000
21. R. Drullman, J.M. Festen, and R. Plomp Effect of reducing slow temporal modulation on speech reception JASA 95 5 1994
22. Fakotakis, N., Georgila, K., Tsopanoglou, A., 1997. Continuous HMM text-independent speaker recognition system based on vowel spotting. In: 5th European Conference on Speech Communication and Technology (Eurospeech), Rhodes, Greece, September 1997, vol. 5, pp. 2247-2250.
23. Ferragne, E., Pellegrino, F. Rhythm in read British english: Interdialect variability. In: Proc. INTERSPEECH/ICSLP 2004, Jeju, Korea, October 2004.
24. V. Fromkin Speech Errors as Linguistic Evidence 1973 Mouton Publishers The Hague
25. Fujimura, O., 1975. Syllable as a unit of speech recognition. IEEE Trans. on ASSP ASSP-23 (1), 82-87, 02/1975.
26. Galves, A., Garcia, J., Duarte, D., Galves, C., 2002. Sonority as a basis for rhythmic class discrimination. In: Proc. Speech Prosody 2002 Conference, 11-13 April.
27. Ganapathiraju, A., 1999. The webpage of the Syllable Based Speech Recognition Group, Available from: 〈 http://www.clsp.jhu.edu/ws97/syllable/ 〉, last visited July 2002.
28. Gauvain, J.-L., Messaoudi, A., Schwenk, H., 2004. Language recognition using phone lattices. In: Proc. International Conference on Spoken Language Processing, Jeju island, Korea.
29. Grabe, E., Low, E.L., 2002. Durational variability in speech and the rhythm class hypothesis, Papers in Laboratory Phonology 7, Mouton.
30. Greenberg, S., 1996. Understanding speech understanding-towards a unified theory of speech perception. In: Proc. ESCA Tutorial and Advanced Research Workshop on the Auditory Basis of Speech Perception, Keele, England.
31. Greenberg, S., 1997. On the origins of speech intelligibility in the real world. In: Proc. ESCA Workshop on Robust Speech Recognition for Unknown Communication Channels, Pont-á-Mousson, France.
32. Greenberg, S., 1998. Speaking in shorthand-A syllable-centric perspective for understanding pronunciation variation. In: Proc. ESCA Workshop on Modelling Pronunciation Variation for Automatic Speech Recognition, Kekrade, The Netherlands.
33. Greenberg, S., Carvey, H.M., Hitchcock, L., 2002. The relation of stress accent to pronunciation variation in spontaneous American English discourse. In: Proc. 2001 ISCA Workshop Prosody and Speech Processing, Red Bank, NJ, USA, 2002, pp. 53-56.
34. Hamdi, R., Barkat-Defradas, M., Ferragne, E., Pellegrino, F. Speech timing and rhythmic structure in Arabic dialects: A comparison of two approaches. In: Proc. INTERSPEECH/ICSLP 2004, Jeju, Korea, 2004.
35. Howitt, A.W., 2000. Vowel landmark detection. In: 6th International Conference on Spoken Language Processing (ICSLP), Beijing, China.
36. W. Jestead, S.P. Bacon, and J.R. Lehman Forward masking as a function of frequency, masker level and signal delay JASA 74 4 1982
37. Keller, E., Zellner, B., 1997. Output requirements for a high-quality speech synthesis system: The case of disambiguation. In: Proc. MIDDIM-96, 12-14 August 96, pp. 300-308.
38. Kern, S., Davis, B.L., Koçbas D., Kuntay A., Zink I. Crosslinguistic "universals" and differences in babbling. In: OMLL-Evolution of language and languages, European Science Foundation, in press.
39. Kitazawa, S., 2002. Periodicity of Japanese accent in continuous speech. In: Speech Prosody, Aix en Provence, France, April 2002.
40. Komatsu, M., Arai, T., Sugawara, T., 2004. Perceptual discrimination of prosodic types. In: Proc. Speech Prosody, Nara, Japan, 2004, pp. 725-728.
41. I. Kopecek Speech recognition and syllable segments Proc. Workshop on Text, Speech and Dialogue-TSD'99 Lectures Notes in Artificial Intelligence 1692 1999 Springer-Verlag
42. P. Ladefoged A Course in Phonetics 1975 Harcourt Brace Jovanovich New York p. 296
43. W. Levelt, and L. Wheeldon Do speakers have access to a mental syllabary Cognition 1994 50
44. Li, K.P., 1994. Automatic language identification using syllabic spectral features. In: Proc. IEEE ICASSP'94, Adelaide, Australia.
45. A.M. Liberman, and I.G. Mattingly The motor theory of speech perception revised Cognition 1985 21
46. Y. Linde, A. Buzo, and R.M. Gray An algorithm for vector quantizer IEEE Trans. Comm. 28 January 1980
47. P. MacNeilage The frame/content theory of evolution of speech production Brain Behavior. Sci. 21 1998 499 546
48. P.P. MacNeilage, and B.L. Davis Evolution of speech: The relation between ontogeny and phytogeny J.R. Hurford C. Knight M.G. Studdert-Kennedy The Evolutionary Emergence of Language 2000 Cambridge University Press Cambridge 146 160
49. P.P. MacNeilage, B.L. Davis, A. Kinney, and C.L. Maryear The motor core of speech: A comparison of serial organization patterns in infants and languages Child Develop. 71 2000 153 163
50. Martin, A.F., Przybocki., M.A., 2003. NIST 2003 language recognition evaluation. In: Proc. Eurospeech, Geneva, pp. 1341-1344.
51. D.W. Massaro Preperceptual images, processing time and perceptual units in auditory perception Psychol. Rev. 79 2 1972
52. J. Mehler, J.Y. Dommergues, U. Frauenfelder, and J. Segui The syllable's role in speech segmentation J. Verbal Learning Verbal Behavior 1981 20
53. J. Mehler, E. Dupoux, T. Nazzi, and G. Dehaene-Lambertz Coping with linguistic diversity: The infant's viewpoint Morgan Demuth Signal to Syntax: Bootstrapping from Speech to Grammar in Early Acquisition 1996 Lawrence Erlbaum Associates Mahwah, NJ
54. Mirghafori, N., Fosler, E., Morgan, N., 1995. Fast speakers in large vocabulary continuous speech recognition: Analysis & antidotes. In: Proc. Eurospeech'95, Madrid, Spain.
55. Muthusamy, Y.K., Jain, N., Cole, R.A., 1994. Perceptual benchmarks for automatic language identification. In: Proc. IEEE ICASSP'94, Adelaide, Australia.
56. Nagarajan, T., Murthy, H.A., 2004. Language identification using parallel syllable-like unit recognition. In: Proc. Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Montreal, Canada, pp. 401-404.
57. T. Nazzi, and F. Ramus Perception and acquisition of linguistic rhythm by infants Speech Comm. 41 1-2 2003 233 243
58. Nowlan, S., 1991. Soft Competitive Adaptation: Neural Network Learning Algorithm based on fitting Statistical Mixtures, PhD Thesis, School of Computer Science, Carnegie Mellon Univ.
59. Ohala, J.J., Gilbert, B., 1979. On listeners' ability to identify languages by their prosody. In: Leon & Rossi (Eds.), Problémes de prosodie, vol. 2, Hurtubise HMH.
60. D. O'Shaugnessy Speech Communication. Human and Machine 1987 Addison Wesley Reading, MA, USA
61. F. Pellegrino, and R. André-Obrecht Automatic language identification: An alternative approach to phonetic modelling Signal Process. 80 7 2000 1231 1244
62. Pellegrino, F., Farinas, J., Rouas, J-.L., 2004. Autom atic estimation of speaking rate in multilingual spontaneous speech. In: Proc. Speech Prosody 2004, Nara, Japan, March 2004.
63. Pfau, T., Ruske, G., 1998. Estimating the speaking rate by vowel detection. In: Proc. IEEE ICASSP'98, Seattle, WA, USA.
64. Pfitzinger, H., Burger, S., Heid, S., 1996. Syllable detection in read and spontaneous speech. In: 4th International Conference on Spoken Language Processing, Philadelphia, vol. 2, pp. 1261-1264.
65. F. Ramus Language discrimination by newborns: Teasing apart phonotactic, rhythmic, and intonational cues Ann. Rev. Lang. Acquis. 2 2002 85 115
66. Ramus, F., 2002b. Acoustic correlates of linguistic rhythm: Perspectives. In: Proc. Speech Prosody 2002, Aix-en-Provence, France.
67. F. Ramus, and J. Mehler Language identification with suprasegmental cues: A study based on speech resynthesis J. Acoust. Soc. Amer. 105 1 1999
68. F. Ramus, M. Nespor, and J. Mehler Correlates of linguistic rhythm in the speech signal Cognition 73 3 1999
69. D.A. Reynolds Speaker identification and verification using Gaussian mixture speaker models Speech Comm. 17 1-2 1995 91 108
70. Rouas, J-.L., Farinas, J., Pellegrino, F., Regine André-Obrecht, 2003. Modeling prosody for language identification on read and spontaneous speech. In: Proc. ICASSP'2003, Hong Kong, China, pp. 40-43.
71. Rouas, J-.L., Farinas, J., Pellegrino, F., Regine André-Obrecht, 2004. Evaluation automatique du débit de la parole sur des données multilingues spontanées. In: actes des XXVémes JEP, Fés, Maroc, April 2004.
72. Shastri, L., Chang, S., Greenberg, S., 1999. Syllable detection and segmentation using temporal flow neural networks. In: Proc. ICPhS'99, San Francisco, CA, USA.
73. Singer, E., Torres-Carrasquillo, P.A., Gleason, T.P., Campbell, W.M., Reynolds, D.A., 2003. Acoustic, phonetic, and discriminative approaches to automatic language identification. In: Proc. Eurospeech, Geneva, pp. 1345-1348.
74. Stockmal, V., Muljani, D., Bond, Z.S., 1996. Perceptual features of unknown foreign languages as revealed by multi-dimensional scaling. In: Proc. ICSLP, Philadelphia, pp. 1748-1751.
75. V. Stockmal, D. Moates, and Z.S. Bond Same talker, different language Appl. Psycholinguistics 21 2000 383 393
76. Taylor, P.A., King, S., Isard, S.D., Wright, H., Kowtko, J., 1997. Using intonation to constrain language models in speech recognition. In: Proc. Eurospeech 97, Rhodes, Greece.
77. Thymé-Gobbel, A., Hutchins, S.E., 1999. Prosodic features in automatic language identification reflect language typology. In: Proc. ICPhS'99, San Francisco, CA, USA.
78. Todd, N.P., Brown, G.J., 1994. A computational model of prosody perception. In: Proc. ICSLP'94, Yokohama, Japan.
79. Vallée, N., Boë, L.J., Maddieson, I., Rousset, L., 2000. Des lexiques aux syllabes des langues du monde-Typologies et structures. In: Proc. JEP 2000, Aussois, France.
80. Vasilescu, I., Pellegrino, F., Hombert, J., 2000. Perceptual features for the identification of romance languages. In: Proc. ICSLP'2000, Beijing.
81. Verhasselt, J.P., Martens, J-.P., 1996. A fast and reliable rate of speech detector. In: Proc. ISCLP'96, Philadelphia, PA, USA.
82. J. Weissenborn B. Höhle Approaches to Bootstrapping. Phonological, Lexical, Syntactic and Neurophysiological Aspects of Early Language Acquisition, Vol. 1, Acquisition and Language Disorders 23 2001 John Benjamins Publishing Company 299
83. Wu, S-.L., 1998. Incorporating information from syllable-length time scales into automatic speech recognition, Report TR-98-014 of the International Computer Science Institute, Berkeley, CA, USA.
84. Zellner Keller, B., 2002. Revisiting the status of speech rhythm. In: Bernard Bel, Isabelle Marlien (Eds.), Proc. Speech Prosody 2002 Conf., 11-13 April 2002, pp. 727-730.
85. B. Zellner Keller, and E. Keller Representing speech rhythm E. Keller G. Bailly A. Monaghan J. Terken M. Huckvale Improvements in Speech Synthesis 2001 John Wiley Chichester
86. M.A. Zissman, and K.M. Berkling Automatic language identification Speech Comm. 35 1-2 2001 115 124