Prosodic and accentual information for automatic speech recognition

IEEE Transactions on Speech and Audio Processing

Volumn 11, Issue 4, 2003, Pages 321-333

  Milone, Diego H ^a   Rubio, Antonio J ^b  

^a UNIVERSIDAD NACIONAL DEL LITORAL   (Argentina)

^b Investigadora del Instituto de Investigación de Estudios de las Mujeres y de Género UGR   (Spain)

Author keywords

Accentuation; Continuous speech recognition; Language models; Prosody

Indexed keywords

MARKOV PROCESSES; SPEECH PROCESSING; STATISTICAL METHODS;

ACCENTUATION;

CONTINUOUS SPEECH RECOGNITION;

EID: 0042093525     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2003.814368     Document Type: Article

References (68)

1. L. E. Alarcos, Gramática de la Lengua Española. Madrid: Espasa Calpe, 1999, pp. 52-68.
2. L. M. Arslan and I. H. L. Hansen, "Language accent classification in American English," Speech Commun., vol. 18, pp. 353-367, 1996.
3. K. Bartkova and D. Jouvet, "Selective prosodic post-processing for improving recognition of French telephone numbers," in Proc. 7th Eur. Conf. Speech Communication and Technology, vol. 1, 1999, pp. 267-270.
4. A. Batliner, A. Kießling, R. Kompe, H. Niemann, and E. Nöth, "Tempo and its change in spontaneous speech," in Proc. 5th Eur. Conf. Speech Commun. Technology, vol. 2, 1997, pp. 763-766.
5. A. Bonafonte, I. Esquerra, A. Febrer, and F. Vallverdu, "A bilingual text-to-speech system in Spanish and Catalan," in Proc. 5th Eur. Conf. Speech Commun. Technol., vol. 5, 1997, pp. 2455-2458.
6. L. Bosch and N. Gallés, "The role of prosody in infants' native-language discrimination abilities: the case of two phonologically close languages," in Proc. 5th Eur. Conf. Speech Commun. Technol., vol. 1, 1997, pp. 231-234.
7. C. Brindöpke, G. A. Fink, and F. Kummert, "A comparative study of HMM-based approaches for the automatic recognition of perceptually relevant aspects of spontaneous German speech melody," in Proc. 7th Eur. Conf. Speech Commun. Technol., vol. 2, 1999, pp. 699-702.
8. C. Brindöpke, G. A. Fink, F. Kummert, and G. Sagerer, "A HMM-based recognition system for perceptive relevant pitch movements of spontaneous German speech," in 5th Int. Conf. Spoken Language Processing, 1998, Prosody and Emotion 6.
9. D. Busdhtein, "Robust parametric modeling of durations in hidden Markov models," IEEE Trans. Speech Audio Processing, vol. 4, no. 3, 1996.
10. J. E. Cahn, "A computational memory and processing model for prosody," in Proc. 5th Int. Conf. Spoken Language Processing, 1998, Prosody and Emotion 2.
11. E. Campione and J. Véronis, "A statistical study of pitch target points in five languages," in Proc. 5th Int. Conf. Spoken Language Processing, 1998, Prosody and Emotion 5.
12. F. Casacuberta, R. García, J. Llisterri, C. Nadeu, J. M. Prado, and A. Rubio, "Development of a Spanish corpora for the speech research," in Proc. Workshop on International Co-Operation and Standardization of Speech Databases and Speech I/O Assessment Methods, September 26-28, 1991, CEC DGXIII, ESCA and ESPRIT PROJECT 2589 "SAM".
13. J. Caspers, "Testing the meaning of four Dutch pitch accent types," in Proc. 5th Eur. Conf. Speech Commun. Technol., vol. 2, 1997, pp. 863-866.
14. S.-H. Chen, S.-H. Hwang, and Y.-R. Wang, "An RNN-based prosodic information synthesizer for Mandarin text-to-speech," IEEE Trans. Speech Audio Processing, vol. 6, no. 3, 1998.
15. T.-H. Chiang, Y.-C. Lin, and K.-Y. Su, "On jointly learning the parameters in a character synchronous integrated speech and language model," IEEE Trans. Speech Audio Processing, vol. 4, no. 3, 1996.
16. L. Chih-Heng, W. Chien-Hsing, T. Pei-Yih, and W. Hsin-Min, "Frameworks for recognition of Mandarin syllables with tones using sub-syllabic units," Speech Commun., vol. 18, pp. 175-190, 1996.
17. G. Chung and S. Seneff, "Improvements in speech understanding accuracy through the integration of hierarchical linguistic, prosodic, and phonological constraints in the Jupiter domain," in Proc. 5th Int. Conf. Spoken Language Processing, Spoken Language Understanding Systems, vol. 1, 1998.
18. J. R. Deller, J. G. Proakis, and J. H. Hansen, Discrete-Time Processing of Speech Signals. Englewood Cliffs, NJ: Prentice-Hall, 1987.
19. A. J. M. Garrido, Modelización de Patrones Melódicos del Español para la Síntesis y el Reconocimiento Del habla: Departement de Filologia Espanyola, Facultad de Filosofia i Lletres, Universitat Autònoma de Barcelona, 1991.
20. K. Hirose and K. Iwano, "Detection of prosodic word boundaries by statistical modeling of mora transitions of fundamental frequency contours and its use for continuous speech recognition," in Proc. IEEE 25th Int. Conf. Acoustics, Speech, Signal Processing, vol. 3, 2000, pp. 1763-1766.
21. S. Hoskins, "The prosody of broad and narrow focus in English: Two experiments," in Proc. 5th Eur. Conf. Speech Commun. Technol., vol. 2, 1997, pp. 791-794.
22. J. J. Humphries and P. C. Woodland, "The use of accent-specific pronunciation dictionaries in acoustic model training," in Proc. IEEE 23rd Int. Conf. Acoustics, Speech, Signal Processing, vol. 1, 1998, pp. 317-320.
23. R. M. Iyer and M. Ostendorf, "Modeling long distance dependence in language: Topic mixtures versus dynamic cache models," IEEE Trans. Speech Audio Processing, vol. 7, no. 1, 1999.
24. F. Jelinek, Statistical Methods for Speech Recognition. Cambridge, MA: MIT Press, 1999.
25. J. C. Junqua and J. P. Haton, Robustness In Automatic Speech Recognition: Fundamentals and Applications. Norwell, MA: Kluwer, 1996.
26. T. Kohonen, The Self-Organizing Map. New York: Springer-Verlag, 1995.
27. G. P. M. Laan, "The contribution of intonation, segmental durations, and spectral features to the perception of a spontaneous and a read speaking style," Speech Commun., vol. 22, pp. 43-65, 1997.
28. S.-W. Lee and K. Hirose, "Dynamic beam-search strategy using prosodic-syntactic information," in Workshop on Automatic Speech Recognition and Understanding, 1999, pp. 189-192.
29. T. Lee and C. Ching, "Cantonese syllable recognition using neural networks," IEEE Trans. Speech Audio Processing, vol. 7, no. 4, 1999.
30. C. Lieske, J. Bos, M. Emele, B. Gambäck, and C. J. Rupp, "Giving prosody a meaning," in Proc. 5th Eur. Conf. Speech Commun. Technol., vol. 3, 1997, pp. 1431-1434.
31. L. A. Liporace, "Maximum likelihood estimation for multivariate stochastic observations of Markov chains," IEEE Trans. Inform. Theory, vol. IT-28, no. 5, 1982.
32. R. P. Lippmann, "Speech recognition by machines and humans," Speech Commun., vol. 22, pp. 1-15, 1997.
33. E. López, J. Caminero, I. Cortázar, and L. Hernández, "Improvement on connected numbers recognition using prosodie information," in Proc. 5th Eur. Conf. Speech Commun. Technol., 1998, Prosody and Emotion 2.
34. E. López-Gonzalo, J. M. Rodríguez-García, L. Hernández-Gómez, and J. M. Villar, "Automatic corpus-based training of rules for prosodic generation in text-to-speech," in Proc. 5th Eur. Conf. Speech Commun. Technol., vol. 5, 1997, pp. 2515-2518.
35. V. Lublinskaja and C. Sappok, "Speaker attribution of successive utterances: The role of discontinuities in voice characteristics and prosody," Speech Commun., vol. 19, pp. 145-159, 1996.
36. D. Michie, D. J. Spiegelhalter, and C. C. Taylor, Machine Learning, Neural and Statistical Classification. London, U.K.: Ellis Horwood, 1994.
37. D. H. Milone, J. C. Sáez, G. Simón, and H. L. Rufiner, "Self-Organizing neural tree networks," in Proc. 20th Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society, vol. 20, 1998.
38. _, "Árboles de redes neuronales autoorganizativas," Revista Mexicana de Ingeniería Biomédica, vol. 29, no. 4, 1998.
39. D. H. Milone, J. J. Merelo, and H. L. Rufiner, "Evolutionary algorithm for speech segmentation," in Proc. of 2002 IEEE World Congress on Evolutionary Computation, May 2002.
40. L. Molloy and S. Isard, "Suprasegmental duration modeling with elastic contraints in automatic speech recognition," in Proc. 5th Int. Conf. Spoken Language Processing, 1998, Hidden Markov Model Techniques 3.
41. A. M. Noll, "Cepstrum pitch determination," J. Acoust. Soc. Amer., vol. 41, pp. 293-309, 1967.
42. E. Nöth, A. Batliner, A. Kießling, R. Kompe, and H. Niemann, "Verb-mobil: The use of prosody in the linguistic components of a speech understanding system," IEEE Trans. Speech Audio Processing, vol. 8, no. 5, 2000.
43. O. Gábor and N. Géza, "Prosody generation for German CTS/TTS systems (from theoretical intonation patterns to practical realization)," Speech Commun., vol. 21, pp. 37-60, 1997.
44. C. Pallier, A. Cutler, and N. Sebastián-Gallés, "Prosodic structure and phonetic processing:'A cross-linguistic study," in Proc. 5th Eur. Conf. Speech Commun. Technol., vol. 4, 1997, pp. 2131-2134.
45. L. C. W. Pols, X. Wang, and L. F. M. Bosch, "Modeling of phone duration (using the TIMIT database) and its potential benefit for ASR," Speech Commun., vol. 19, pp. 161-176, 1996.
46. T. Portele and B. Heuft, "Toward a prominence-based synthesis system," Speech Commun., vol. 21, pp. 61-72, 1997.
47. G. Potamianos and F. Jelinek, "A study of n-gram and decision tree letter language modeling methods," Speech Commun., vol. 24, pp. 171-192, 1998.
48. S. Potisuk, M. P. Harper, and J. Gandour, "Classification of Thai tone sequences in syllable-segmented speech using the analysis-by-synthesis method," IEEE Trans. Speech Audio Processing, vol. 7, no. 1, 1999.
49. A. Quilis, Tratado de Fonología y Fonética Españolas. Madrid, Spain: Editorial Credos, 1993.
50. L. R. Rabiner and B. Gold, Theory and Application of Digital Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1975.
51. L. R. Rabiner and B. H. Juang, "An introduction to hidden Markov models," IEEE ASSP Mag., Jan. 1986.
52. _, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
53. 0 patterns," Speech Commun., vol. 18, pp. 21-46, 1996.
54. N. K. Ross and M. Ostendorf, "A dynamical system model for generating fundamental frequency for speech synthesis," IEEE Trans. Speech Audio Processing, vol. 7, no. 3, 1999.
55. M. Rossi, "Is syntactic structure prosodically retrievable?," in Proc. 5th Eur. Conf. Speech Commun. Technol., 1997.
56. M. K. Sönrnez, L. Heck, M. Weintraub, and E. Shriberg, "A lognormal tied mixture model of pitch for prosody based speaker recognition," in Proc. of 5th Eur. Conf. Speech Commun. Technol., vol. 3, 1997, pp. 1391-1394.
57. A. Stolcke, E. Shriberg, D. Hakkani-Tür, and G. Tür, "Modeling the prosody of hidden events for improved word recognition," in Proc. 7th Eur. Conf. Speech Commun. Technol., vol. 1, 1999, pp. 311-314.
58. M. Swerts and M. Ostendorf, "Prosodic and lexical indications of discourse structure in human-machine interactions," Speech Commun., vol. 22, pp. 25-41, 1997.
59. M. I. Torres and P. Iparraguirre, "Acoustic parameters for place of articulation identification and classification of Spanish unvoiced stops," Speech Commun., vol. 18, pp. 369-379, 1996.
60. Van Kuijk and L. Boves, "Acoustic characteristics of lexical stress in continuous telephone speech," Speech Commun., vol. 27, pp. 95-111, 1999.
61. J. P. H. Van Santen, "Prosodic modeling in text-to-speech synthesis," in Proc. 5th Eur. Conf. Speech Commun. Technol., 1997.
62. H. Vereecken, A. Vorstermans, J. P. Martens, and B. Van Coile, "Improving the phonetic annotation by means of prosodic phrasing," in Proc. 5th Eur. Conf. Speech Commun. Technol., vol. 1, 1997, pp. 179-182.
63. J. Véronis, P. Di Cristo, F. Courtois, and C. Chaumette, "A stochastic model of intonation for text-to-speech synthesis," Speech Commun., vol. 26, pp. 233-244, 1998.
64. C. Wang and S. Seneff, "A study of tones and tempo in continuous Mandarin digit strings and their application in telephone quality speech recognition," in Proc. 5th Int. Conf. Spoken Language Processing, 1998, Prosody and Emotion 2.
65. V. Warnke, F. Gallwitz, A. Batliner, J. Buckow, R. Huber, E. Nöth, and A. Höthker, "Integrating multiple knowledge sources for word hypotheses graph interpretation," in Proc, 7th Eur. Conf. Speech Commun. Technol., vol. 1, 1999, pp. 235-238.
66. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and L. Lang, "Phoneme recognition using time-delay neural networks," IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, no. 3, 1989.
67. S.-L. Wu, B. E. D. Kingsbury, N. Morgan, and S. Greenberg, "Incorporating information from syllable-length time scales into automatic speech recognition," in Proc. IEEE 23rd Int. Conf. Acoustics, Speech, Signal Processing, vol. 2, 1998, pp. 721-724.
68. M. Yaeger-Dror, "Register as a variable in prosodic analysis: The case of the English negative," Speech Commun., vol. 19, pp. 39-60, 1996.