Automatic prosodic event detection using acoustic, lexical, and syntactic evidence

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 1, 2008, Pages 216-228

  Ananthakrishnan, Sankaranarayanan ^a   Narayanan, Shrikanth S ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Accent; Prominence; Prosodic phrase boundary; Prosody recognition; Prosody syntax interface; Spoken language processing; Stress

Indexed keywords

ACCENT; PROMINENCE; PROSODIC PHRASE BOUNDARY; PROSODY RECOGNITION; PROSODY-SYNTAX INTERFACE; SPOKEN LANGUAGE PROCESSING;

ACOUSTICS; INFORMATION THEORY; LINGUISTICS; SOFTWARE AGENTS; SPEECH ANALYSIS; SYNTACTICS;

SPEECH RECOGNITION;

EID: 60849083145     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2007.907570     Document Type: Article

References (31)

1. J. Terken, T. Hermes, M. Ostendorf, and N. Campbell, Prosody: Theory and Experiment Norwell, MA: Kluwer, 2000, ch. 4,9,10.
2. R. Kompe, Prosody in Speech Understanding Systems. New York: Springer-Verlag, 1997.
3. E. Shriberg and A. Stolcke, "Prosody modeling for automatic speech recognition and understanding,"in Proc. ISCA Workshop Prosody in Speech Recognition and Understanding, 2001, pp. 13-16.
4. K. Silverman, M. Beckman, J. Pittelli, M. Ostendorf, C. Wightman, P. Price, J. Pierrehumbert. and J. Hirschberg, "ToBI: A standard scheme for labeling prosody," in Proc. Int. Conf. Spoken Lang. Process., 1992, pp. 867-869.
5. M. Beckman and G. Elam, "Guidelines for ToBI Labeling." [Online]. Available: http://www.ling.ohio-state.edu/research/phonetics/E-ToBl
6. C. Wightman, "ToBI or not ToBI?," in Proc. Speech Prosody Conf, 2002. pp. 25-30.
7. D. Hirst and A. Di Crista, Intonation Systems: A Suivey of Twenty Languages, D. Hirst and A. Di Crista, Eds. Cambridge, U.K.: Cambridge Univ. Press. 1998.
8. "ToBI: The Ohio State University Department of Linguistics," The Ohio State Univ., Columbus, 1999 [Online], Available: http://www.ling.ohio- state.edu/~tobi
9. E. Grabe, F. Nolan, and K. Farrar, "IViE-A comparative transcription system for intonational variation in English," in Proc. Int. Conf. Spoken Lang. Process., 1998. pp. 1259-1262.
10. P. Taylor, "The TILT intonation model," in Proc. Int. Conf. Spoken Lang. Process., 1998, vol. 4, pp. 1383-1386.
11. C. Wightman and M. Ostendorf, "Automatic labeling of prosodic patterns," IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 469-481, Oct. 1994.
12. K. Ross and M. Ostendorf, "Prediction of abstract prosodic labels for speech synthesis," Comput. Speech Lang., vol. 10, pp. 155-185, 1996.
13. A. Syrdal, J. Hirschberg, J. McGory, and M. Beckman, "Automatic ToBI prediction and alignment to speed manual labeling of prosody," Speech Commun., vol. 33, pp. 135-151, 2001.
14. K. Chen, M. Hasegawa-Johnson, and A. Cohen, "An automatic prosody labeling system using ANN-based syntactic-prosodic model and GMM-based acoustic-prosodic model," in Proc. Int. Conf. Acoust., Speech, Signal Process., 2004, vol. 1, pp. 509-512.
15. S. Ananthakrishnan and S. Narayanan, "An automatic prosody recognizer using a coupled multi-stream acoustic model and a syntactic-prosodic language model," in Proc. Int. Conf. Acoust, Speech, Signal Process., 2005, vol. 1, pp. 269-272.
16. M. Ostendorf, P. Price, and S. Shattuck-Hufnagel, "The Boston University Radio News Corpus," 1995.
17. D. Kahn, "Syllable-based generalizations in English phonology," Ph.D. dissertation, Univ. Massachusetts, Boston, 1976.
18. C. Wightman, "Segmental durations in the vicinity of prosodic phrase boundaries," J. Acoust. Soc. Amer., pp. 1707-1717, 1992.
19. S. Arnfield, "Prosody and syntax in corpus-based analysis of spoken English," Ph.D. dissertation, School Comput. Studies, Univ. Leeds, Leeds, U.K., 1994.
20. J. R. Quinlan, "Induction of decision trees," in Machine Learning. Norwell, MA: Kluwer, 1986, vol. 1, pp. 81-106.
21. I. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, 2nd ed. San Mateo, CA: Morgan Kaufmann, 2005.
22. W. Mendenhall and T. Sincich, Statistics for Engineering and the Sciences, 4th ed. Englewood Cliffs, NJ: Prentice-Hall, 1995.
23. R. Duda, P. Hart, and D. Stork, Pattern Classification, 2nd ed. New York: Wiley-Interscience, 2000.
24. C. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1996.
25. J. Bilmes and K. Kirchhoff, "Factored language models and generalized parallel backoff," in Proc. HLT/NAACL, 2003, pp. 4-6.
26. "The CMU Pronunciation Dictionary." [Online]. Available: http://www.speech.cs.cmu.edu/cgi-bin/cmudict
27. A. Stolcke, "SRILM-An extensible language modeling toolkit," in Proc. Int. Conf. Spoken Lang. Process., 2002, pp. 901-904.
28. M. Mohri and M. Riley, "Weighted finite-state transducers in speech recognition (tutorial)," in Proc. Int. Conf. Spoken Lang. Process., 2002.
29. G.-A. Levow, "Unsupervised and semi-supervised learning of tone and pitch accent," in Proc. HLT/NAACL, Jun. 2006, pp. 224-231.
30. S. Ananthakrishnan and S. Narayanan, "Combining acoustic, lexical, and syntactic evidence for automatic unsupervised prosody labeling," in Proc. Int. Conf. Spoken Lang. Process., 2006, pp. 297-300.
31. M. Hasegawa-Johnson, J. Cole, C. Shih, K. Chen, A. Cohen, S. Chavarria, H. Kim, T. Yoon, S. Borys. and J.-Y. Choi, "Speechrecognition models of the interdependence among syntax, prosody and segmental acoustics," in Proc. HLT/NAACL, 2004, pp. 56-63.