Robust speech rate estimation for spontaneous speech

IEEE Transactions on Audio, Speech and Language Processing

Volumn 15, Issue 8, 2007, Pages 2190-2201

  Wang, Dagen ^a,b   Narayanan, Shrikanth S ^a  

^a University of Southern California ^*  (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Rich speech transcription; Speech prosody; Speech rate estimation; Spontaneous speech processing

Indexed keywords

ACOUSTIC FEATURES; ALGORITHM PARAMETERS; AUTOMATED APPROACHES; CORRELATION COEFFICIENTS; DIRECT METHODS; EXPERIMENTAL EVALUATIONS; GROUND TRUTHS; MANUAL SEGMENTATIONS; MONTE CARLO SIMULATIONS; NOVEL COMPONENTS; OPTIMAL SETTINGS; PARAMETER SENSITIVITIES; PHONETIC SEGMENTATIONS; RICH SPEECH TRANSCRIPTION; ROBUST SPEECH; ROBUSTNESS ISSUES; SIGNAL CORRELATIONS; SPEECH PROSODY; SPEECH RATE ESTIMATION; SPONTANEOUS SPEECH PROCESSING; SUBBANDS; SWITCHBOARD CORPORA; TEMPORAL CORRELATIONS; TEMPORAL SIGNALS;

ELECTRIC SWITCHBOARDS; ESTIMATION; LEARNING ALGORITHMS; LEARNING SYSTEMS; MONTE CARLO METHODS; SENSITIVITY ANALYSIS; SIGNAL ANALYSIS; SPEECH PROCESSING; SPEECH TRANSMISSION;

TRANSCRIPTION;

EID: 64149099088     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2007.905178     Document Type: Article

References (54)

1. M. Richardson, M. Hwang, and A. D. H. AceroX, "Improvements on speech recognition for fast talkers," in Proc. Eurospeech, Budapest, Hungary, 1999, vol. 1, pp. 411-414.
2. S. Greenberg, "The switchboard transcription project," Tech. Rep., 1996 Johns Hopkins CLSP Workshop on Innovative Techniques for Large Vocabulary Continuous Speech Recognition, Baltimore, MD, 1997.
3. F. J. K. Beinum and M. E. van Donzel, "Relationship between discourse structure and dynamic speech rate," in Proc. Int. Conf. Spoken Lang. Process., Philadelphia, PA, 1996, vol. 3, pp. 1724-1727.
4. N. Mirghafori, E. Fosler, and N. Morgan, "Fast speakers in large vocabulary continuous speech recognition: Analysis and antidotes," in Proc. Eurospeech'95, Madrid, Spain, Sep. 1995, pp. 491-494.
5. F. Martinez, D. Tapias, and J. Alvarez, "Towards speech rate independence in large vocabulary continuous speech recognition," in Proc. ICASSP, Seattle, WA, May 1998, pp. 725-728.
6. E. Shriberg, A. Stolcke, D. Hakkani-Tur, and G. Tur, "Prosody-based automatic segmentation of speech into sentences and topics," Speech Commun. (Special Issue Accessing Information in Spoken Audio), vol. 32, no. 1-2, pp. 127-154, 2000.
7. D. Byron, E. Shriberg, and A. Stolcke, "Automatic punctuation and disfluency detection in multi-party meetings using prosodic and lexical cues," in Proc. Int. Conf. Spoken Lang. Process., Denver, CO, 2002, vol. 2, pp. 949-952.
8. F. Tamburini, "Automatic prosodic prominence detection in speech using acoustic features: An unsupervised system," in Proc. Eurospeech' 03, Geneva, Switzerland, 2003, pp. 129-132.
9. N. Morgan and E. Fosler-Lussier, "Combining multiple estimators of speaking rate," in Proc. ICASSP, 1998, vol. 2, pp. 729-732.
10. H. Nanjo and T. Kawahara, "Speaking-rate dependent decoding and adaptation for spontaneous lecture speech recognition," in Proc. ICASSP, 2002, pp. 725-728.
11. M. Siegler, "Measuring and compensating for the effects of speech rate in large vocabulary continuous speech recognition," Carnegie Melon Univ., Pittsburgh, PA, Masters Rep., 1995.
12. N. Morgan, E. Fosler, and N. Mirghafori, "Speech recognition using on-line estimation of speaking rate," in Proc. Eurospeech, Rhodes, Greece, 1997, pp. 2079-2082.
13. S. Kitazawa, H. Ichikawa, S. Kobayashi, and Y. Nishinuma, "Extraction and representation rhythmic components of spontaneous speech," in Proc. Eurospeech, Rhodes, Greece, 1997, pp. 641-644.
14. quot;Speech filing system." [Online]. Available: http://www.phon. ucl.ac.uk/resource/sfs/
15. T. Pfau, R. Faltlhauser, and G. Ruske, "A combination of speaker normalization and speech rate normalization for automatic speech recognition," in Proc. Int. Conf. Spoken Lang. Process., Beijing, China, 2000, vol. 4, pp. 362-365.
16. S. Nooteboom, "The prosody of speech: Melody and rhythm," in The Handbook of Phonetic Sciences, I. W. Hardcastle and J. Laver, Eds. Oxford, U.K.: Blackwell, 1997, pp. 640-673.
17. H. V. Poor, An Introduction to Signal Detection and Estimation. New York: Springer-Verlag, 1985.
18. S. Narayanan and D. Wang, "Speech rate estimation via temporal correlation and selected sub-band correlation," in Proc. ICASSP, Philadelphia, PA, Mar. 2005, pp. 413-416.
19. A. Stolcke, K. Ries, N. Coccaro, E. Shriberg, R. Bates, D. Jurafsky, P. Taylor, R. Martin, C. Van Ess-Dykema, and M. Meteer, "Dialogue act modeling for automatic tagging and recognition of conversational speech," Comput. Ling., vol. 26, no. 3, pp. 339-373, 2000.
20. H. R. Pfitzinger, S. Burger, and S. Heid, "Syllable detection in read and spontaneous speech," in Proc. ICSLP'96, Philadelphia, PA, 1996, vol. 2, pp. 1261-1264.
21. D.Wang and S. Narayanan, "An unsupervised quantitative measure for word prominence in spontaneous speech," in Proc. ICASSP, Philadelphia, PA, Mar. 2005, pp. 377-380.
22. J. N. Holmes, "The JSRU channel vocoder," IEEE Proc. F. Commun, Radar Signal Process, vol. 127, no. 1, pp. 53-60, 1980.
23. D. Jurafsky, R. Bates, N. Coccaro, R. Martin, M. Meteer, K. Ries, E. Shriberg, A. Stolcke, P. Taylor, and C. V. Ess-Dykema, "Automatic detection of discourse structure for speech recognition and understanding," in Proc. IEEE Workshop Speech Recognition and Understanding, Santa Barbara, CA, Dec. 1997, pp. 88-95.
24. B. Zellner, "Fast and slowspeech rate:Acharacterisation for french," in Proc. Int. Conf. Spoken Lang. Process., Sydney, Australia, Dec. 1998, vol. 7, pp. 3159-3163.
25. J. Zheng, H. Franco, and A. Stolcke, "Rate-dependent acoustic modeling for large vocabulary conversational speech recognition," in Proc. ISCA Tutorial and Research Workshop on Automatic Speech Recognition: Challenges for the New Millennium, Paris, France, 2000, pp. 145-149.
26. D. O'Shaughnessy, "Timing patterns in fluent and disfluent spontaneous speech," in Proc. ICASSP, 1995, vol. 1, pp. 600-603.
27. C.Weinstein, S. McCandless, L. Mondshein, and V. Zue, "Asystem for acoustic-phonetic analysis of continuous speech," IEEE Trans. Acoust. Speech, Signal Process., vol. ASSP-23, no. 1, pp. 54-67, Feb. 1975.
28. H. Kasuya and H. Wakita, "An approach to segmenting speech into vowel- and nonvowel-like syllables," IEEE Trans. Acoust. Speech, Signal Process., vol. ASSP-27, no. 4, pp. 319-327, Aug. 1979.
29. P. Mermelstein, "Automatic segmentation of speech into syllabic units," J. Acoust. Soc. Amer., vol. 58, no. 4, pp. 880-883, Oct. 1975.
30. M. Medress, T. Diller, D. Kloker, L. Lutton, H. Oredson, and T. Skinner, "An automatic word spotting system for conversational speech," in Proc. ICASSP'78, 1978, pp. 712-717.
31. L. Rabiner, "On the application of energy contours to the recognition of connected word sequences," T Bell Labs Tech. J., vol. 63, no. 9, pp. 1981-1995, Nov. 1984.
32. E. Zwicker, E. E. Terhardt, and E. Paulus, "Automatic speech recognition using psychoacoustic models," J. Acoust. Soc. Amer., vol. 65, no. 2, pp. 487-498, Feb. 1979.
33. W. Reichl and G. Ruske, "Syllable segmentation of continuous speech with artificial neural networks," in Proc. Eurospeech'93, Berlin, Germany, Sep. 1993, vol. 3, pp. 1771-1774.
34. P. Green, N. Kew, and D. Miller, "Speech representations in the SYLK recognition project," in Visual Representations of Speech Signals, M. Cook, S. Beet, and M. Crawford, Eds. New York: Wiley, 1993.
35. H. Hermansky and N. Morgan, "RASTA processing of speech," IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 578-589, Oct. 1994.
36. W. Fisher, V. Zue, V, J. Bernstein, and D. Pallet, "An acoustic-phonetic database," in J. Acoust. Soc. Amer. Suppl. A, 1986, vol. 81, pp. 592-600.
37. P. Roach, English Phonetics and Phonology. A Practical Course, Third ed. Cambridge, U.K.: Cambridge Univ. Press, 2000.
38. W. M. Fisher, "Syllabification software," in The Spoken Natural Language Processing Group. Gaithersburg, MD: National Inst. Standards Technol., 1997.
39. J. Godfrey, E. Holliman, and J. McDaniel, "SWITCHBOARD: Telephone speech corpus for research and development," in Proc. ICASSP'92, 1992, pp. 517-520.
40. Handbook of the International Phonetic Association. Cambridge, U.K.: Cambridge Univ. Press, 1999.
41. A. W. Howitt, "Automatic Syllable Detection for Vowel Landmarks," Ph.D. dissertation, Mass. Inst. Technol., Cambridge, MA, 2000.
42. A. Berthold and A. Jameson, J. Kay, Ed., "Interpreting symptoms of cognitive load in speech input," in Proc. 7th Int. Conf. UM99, User Modeling, 1999, pp. 235-244.
43. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, and N. L. Dahlgren, DARPA TIMIT Acoustic-Phonetic Continuous Speech Corpus. Vienna, Austria: Springer, 1993.
44. J. L. Miller, F. Grosjean, and L. Concetta, "Articulation Rate and Its Variability in Spontaneous Speech: A Reanalysis and Some Implications," Phonetica, vol. 41, pp. 215-225, 1984.
45. D. Wang and S. Narayanan, "An acoustic measure for word prominence in spontaneous speech," IEEE Trans. Speech, Audio, Language Process., vol. 15, no. 2, pp. 690-701, Feb. 2007.
46. D. Talkin, "A robust algorithm for pitch tracking (RAPT)," in Proc. ICASSP, 1983, pp. 1352-1355.
47. I. Young, J. Gerbrands, and L. v. Vliet, "Fundamentals of image processing," Delft Univ. Technol., The Netherlands, 1998 [Online]. Available: http://www.ph.tn.tudelft.nl/Courses/FIP/noframes/fip.html
48. A. Bell, D. Jurafsky, E. Fosler-Lussier, C. G. M. Gregory, and D. Gildea, "Effects of disfluencies, predictability, and utterance position on word form variation in English conversation," J. Acoust. Soc. Amer. 113, pp. 1001-1024, 2003.
49. C. Fougeron and P. Keating, "Articulatory strengthening at the edges of prosodic domains," J. Acoust. Soc. Amer. 101, pp. 3728-3740, 1997.
50. R. Dauer, "Stress-timing and syllable-timing reanalyzed," J. Phonetics 11, pp. 51-62, 1983.
51. R. Dauer, "Phonetic and phonological components of language rhythm," in Proc. Int. Congr. Phonetic Sci. 5, 1987, pp. 447-450.
52. G. Clements, "The sonority cycle and syllable organization," in Phonologica 1988,W. Dressler, H. Luschutzky, O. Pfeiffer, and J. Rennison, Eds. Cambridge, U.K.: Cambridge Univ. Press, 1992, pp. 63-76.
53. J. Blevins, "The syllable in phonological theory," in Handbook of Phonological Theory , J. Goldsmith, Ed. Oxford, U.K.: Blackwell, 1996, pp. 35-59.
54. N. Mirghafori, E. Fosler, and N. Morgan, "Towards robust-ness to fast speech in ASR," in Proc. ICASSP, 1996, vol. 1, pp. 335-338.