Simultaneous recognition of words and prosody in the Boston University Radio Speech Corpus

Speech Communication

Volumn 46, Issue 3-4, 2005, Pages 418-439

  Hasegawa Johnson, Mark ^a   Chen, Ken ^a   Cole, Jennifer ^a   Borys, Sarah ^a   Kim, Sung Suk ^a   Cohen, Aaron ^a   Zhang, Tong ^a   Choi, Jeung Yoon ^a   Kim, Heejin ^a   Yoon, Taejin ^a   Chavarria, Sandra ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Automatic speech recognition; Prosody

Indexed keywords

ACOUSTIC PROPERTIES; MATHEMATICAL MODELS; PHONOGRAPHS; RADIO COMMUNICATION; STATISTICAL METHODS;

BAYESIAN NETWORK MODEL; PITCH; PROSODIC TRANSCRIPTIONS; PROSODY;

SPEECH RECOGNITION;

EID: 21844465704     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2005.01.009     Document Type: Conference Paper

References (60)

1. Batliner, A., Kießling, A., Kompe, R., Niemann, H., Nöth, E., 1997. Can we tell apart intonation from prosody (if we look at accents and boundaries)? In: Proc. ESCA Intonation Workshop, Athens, pp. 39-42.
2. M. Beckman The parsing of prosody Language Cognitive Processes 11 1 1996 17 67
3. Beckman, M.E., Elam, G.A., 1994. Guidelines for ToBI labelling. Technical report, Ohio State University. Available from < http://www.ling.ohio-state.edu/research/phonetics/E_ToBI/singer_tobi.html>.
4. Borys, S., 2003. Recognition of prosodic factors and detection of landmarks for automatic speech recognition, bachelor's thesis, University of Illinois at Urbana-Champaign.
5. E. Charniak Statistical Language Learning 1994 MIT Press Cambridge, MA
6. Chavarria, S., Yoon, T., Cole, J., Hasegawa-Johnson, M., 2004. Acoustic differentiation of ip and IP boundary levels: Comparison of L- and L-L% in the switchboard corpus. In Proc. SpeechProsody, Nara, Japan.
7. Chen, K., Hasegawa-Johnson, M., 2003. Improving the robustness of prosody dependent language modeling based on prosody syntax cross-correlation. In: IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).
8. Chen, K., Hasegawa-Johnson, M., 2004. How prosody improves word recognition. In: Proc. SpeechProsody, Nara, Japan.
9. Chen, K., Borys, S., Hasegawa-Johnson, M., 2003a. Prosody dependent speech recognition with explicit duration modeling at intonational phrase boundaries. In: Proc. EUROSPEECH, Geneva, pp. 393-396.
10. Chen, K., Hasegawa-Johnson, M., Kim, S.-S., 2003b. An intonational phrase boundary and pitch accent dependent speech recognizer. In: Internat. Conf. on Syst., Cybernet., Intell. (SCI). Orlando, FL.
11. Chen, K., Hasegawa-Johnson, M., Cohen, A., 2004a. An automatic prosody labeling system using ANN-based syntactic prosodic model and GMM-based acoustic prosodic model. In: Proc. ICASSP.
12. Chen, K., Hasegawa-Johnson, M., Cohen, A., Cole, J., 2004b. A maximum likelihood prosody recognizer. In: Proc. SpeechProsody, Nara, Japan.
13. Chen, K., Hasegawa-Johnson, M., Cohen, A., Borys, S., Kim, S.-S., Cole, J., Choi, J.-Y., in press. Prosody dependent speech recognition on radio news. IEEE Trans. Speech Audio Process.
14. Choi, H., Cole, J., Kim, H., 2003. Acoustic evidence for the effect of accent on CV coarticulation in radio news speech. In: Proc Texas Linguistics Conf. Univ Texas at Austin.
15. Cohen, A., 2004. A survey of machine learning methods for predicting prosody in radio speech. Master's thesis, University of Illinois at Urbana-Champaign.
16. Cole, J., Choi, H., Kim, H., Hasegawa-Johnson, M., 2003. The effect of accent on the acoustic cues to stop voicing in radio news speech. In: Internat. Conf. Phonet. Sci.
17. T.H. Crystal, and A.S. House Segmental druations in connected-speech signals: Current results J. Acoust. Soc. Amer. 83 1988 1553 1573
18. K. DeJong The supraglottal articulation of prominence in English: Linguistic stress as localized hyperarticulation J. Acoust. Soc. Amer. 89 1 1995 369 382
19. L. Dilley, S. Shattuck-Hufnagel, and M. Ostendorf Glottalization of word-initial vowels as a function of prosodic structure J. Phonet. 24 1996 423 444
20. J.D. Ferguson Variable duration models for speech J. Ferguson Proc. Symp. Applic. hidden Markov Models to Text and Speech 1980 Princeton University Press Princeton, NJ 143 179
21. Ferrer, L., Shriberg, E., Stolcke, A., 2003. A prosody-based approach to end-of-utterance detection that does not require speech recognition. In: Proc. ICASSP. pp. 608-611.
22. C. Fougeron, and P.A. Keating Articulatory strengthening at edges of prosodic domains J. Acoust. Soc. Amer. 101 6 1997 3728 3740
23. H. Fujisaki, and K. Hirose Analysis of voice fundamental frequency contours for declarative sentence of Japanese J. Acoust. Soc. Jpn. 5 4 1984 233 242
24. Godfrey, J., Holliman, E., McDaniel, J., 1992. SWITCHBOARD: telephone speech corpus for research and development. In: Proc. ICASSP. pp. 517-520.
25. Greenberg, S., Hitchcock, L., May 2001. Stress-accent and vowel quality in the Switchboard corpus. In: NIST Large Vocabulary Continuous Speech Recognition Workshop, Linthicum Heights, MD.
26. Hahn, L., 1999. Native speakers' reactions to non-native stress in english discourse. Ph.D. Thesis, University of Illinois at Urbana-Champaign.
27. Hasegawa-Johnson, M., Cole, J., Shih, C., Chen, K., Cohen, A., Chavarria, S., Kim, H., Yoon, T., Borys, S., Choi, J.-Y., 2004. Speech recognition models of the interdependence among syntax, prosody, and segmental acoustics. In: HLT/NAACL Workshop on Linguist. Other Higher-Level Knowledge Speech Process.
28. 0 control rules using statistical analysis J.P.H. van Santen R.W. Sproat J.P. Olive J. Hirschberg Progress in Speech Synthesis 1997 Springer-Verlag New York 333 346
29. Hirschberg, J., Nakatani, C., 1998. Acoustic indicators of topic segmentation. In: Proc. Internat. Conf. on Spoken Language Process.
30. Hombert, J., 1978. Consonant types, vowel quality and tone. In: Fromkin, V. (Ed.), Tone: A Linguistic Survey. pp. 77-112.
31. S. Katagiri, B.-H. Juang, and C.-H. Lee Pattern recognition using a family of design algorithms based upon the generalized probabilistic descent method Proc. IEEE 86 11 1998 2345 2373
32. Kent, and Netsell Effects of stress contrasts on certain articulatory parameters Phonetica. 24 1971 23 44
33. S.-S. Kim Time-delay recurrent neural network for temporal correlations and prediction Neurocomputing 20 1998 253 263
34. Kim, H., Cole, J., Choi, H., Hasegawa-Johnson, M., 2004a. The effect of accent on acoustic cues to stop voicing and place of articulation in radio news speech. In: Proc. SpeechProsody, Nara, Japan.
35. S.-S. Kim, M. Hasegawa-Johnson, and K. Chen Automatic recognition of pitch movements using multi-layer perceptron and time-delay recursive neural network IEEE Signal Process. Lett. 11 7 2004 645 648
36. D.H. Klatt Linguistic uses of segmental duration in english: Acoustic and perceptual evidence J. Acoust. Soc. Amer. 59 5 1976 1208 1221
37. R. Kompe Prosody in Speech Understanding Systems 1997 Springer-Verlag Berlin
38. K.-F. Lee, and H.-W. Hon Speaker-independent phone recognition using hidden Markov models IEEE Trans. Acoust., Speech, Signal Process. 37 11 1989 1641 1648 November
39. Liu, Y., Shriberg, E., Stolcke, A., 2003. Automatic disfluency identification in conversational speech using multiple knowledge sources. In: Proc. EUROSPEECH.
40. M.K. Omar, and M. Hasegawa-Johnson Approximately independent factors of speech using non-linear symplectic transformation IEEE Trans. Speech and Audio Process. 11 6 2003 660 671
41. M. Ostendorf, P. Price, and S. Shattuck-Hufnagel The Boston University Radio News Corpus Linguistic Data Consortium 1995
42. M. Ostendorf, and K. Ross A multi-level model for recognition of intonation labels Computing Prosody: Computational Models for Processing Spontaneous Speech 1997 Springer-Verlag, Inc. New York
43. Ostendorf, M., Shafran, I., Shattuck-Hufnagel, S., Carmichael, L., Byrne, W., 2002. A prosodically labeled database of spontaneous speech. In: Proc. ISCA Tutorial Res. Workshop on Prosody in Speech Recognition Understand., Red Bank, NJ.
44. Pitrelli, J.F., Beckman, M., Hirschberg, J., 1994. Evaluation of prosodic transcription labeling reliability in the TOBI framework. In: Proc. Internat. Conf. Spoken Language Process.
45. P. Price, M. Ostendorf, S. Shattuck-Hufnagel, and C. Fong The use of prosody in syntactic disambiguation J. Acoust. Soc. Amer. 90 6 1991 2956 2970 Dec.
46. Ren, Y., Kim, S.-S., Hasegawa-Johnson, M., Cole, J., 2004. Speaker-independent automatic detection of pitch accent. In: Proc. SpeechProsody, Nara, Japan.
47. Shriberg, E., Stolcke, A., 2004. Direct modeling of prosody: An overview of applications in automatic speech processing. In: Proc. SpeechProsody.
48. Silverman, K., Beckman, M., Pitrelli, J., Ostendorf, M., Wightman, C., Price, P., Pierrehumbert, J., Hirschberg, J., 1992. TOBI: A standard for labeling English prosody. In: Proc. Internat. Conf. Spoken Language Process.
49. A.M.C. Sluijter, V.J. van Heuven, and J.J.A. Pacilly Spectral balance as a cue in the perception of linguistic stress J. Acoust. Soc. Amer. 101 1997 503 513
50. Sönmez, K., Shriberg, E., Heck, L., Weintraub, M., 1998. Modeling dynamic prosodic variation for speaker verification. In: Proc. Internat. Conf. Spoken Language Process., pp. 3189-3192.
51. Stolcke, A., Shriberg, E., Hakkani-Tür, D., Tür, G., 1999. Modeling the prosody of hidden events for improved word recognition. In: Proc. EUROSPEECH, pp. 307-310.
52. P. Taylor Analysis and synthesis of intonation using the Tilt model J. Acoust. Soc. Amer. 107 3 2000 1697 1714
53. D. van Kuijk, and L. Boves Acoustic characteristics of lexical stress in continuous telephone speech Speech Comm. 27 1999 95 111
54. Vergyri, D., Stolcke, A., Gadde, V.R., Ferrer, L., Shriberg, E., 2003. Prosodic knowledge sources for automatic speech recognition. In: Proc. ICASSP.
55. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K.J. Lang Phoneme recognition using time-delay neural networks Trans. Acoust. Speech Sig. Proc. 37 1989 328 339
56. C. Wightman, and M. Ostendorf Automatic labeling of prosodic patterns IEEE Trans. Speech Audio Process. 2 4 1994 469 481 Oct.
57. C. Wightman, S. Shattuck-Hufnagel, and M.O. Patti Price Segmental durations in the vicinity of prosodic phrase boundaries J. Acoust. Soc. Amer. 91 3 1992 1707 1717 March
58. Yoon, T., Chavarria, S., Cole, J., Hasegawa-Johnson, M., 2004. Intertranscriber reliability of prosodic labeling on telephone conversation using tobi. In: Proc. Internat. Conf. Spoken Language Process.
59. S. Young, G. Evermann, T. Hain, D. Kershaw, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. Woodland The HTK Book 2002 Cambridge University Engineering Department Cambridge, UK
60. V. Zue, S. Seneff, and J. Glass Speech database development at MIT: TIMIT and beyond Speech Comm. 9 1990 351 356