Improved features and models for detecting edit disfluencies in transcribing spontaneous mandarin speech

IEEE Transactions on Audio, Speech and Language Processing

Volumn 17, Issue 7, 2009, Pages 1263-1278

  Lin, Che Kuang ^a   Lee, Lin Shan ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Edit disfluency; Interruption point detection; Prosody; Speech recognition; Spontaneous speech

Indexed keywords

CHINESE CHARACTERS; CONDITIONAL RANDOM FIELD; DISFLUENCIES; EDIT DISFLUENCY; IMPROVED MODELS; INTERRUPTION POINT DETECTION; MAXIMUM ENTROPY; PROBABILISTIC FRAMEWORK; PROSODIC FEATURES; PROSODIC MODELING; PROSODIC STATE; PROSODY; RECOGNITION ACCURACY; SPEECH CORPORA; SPEECH PROSODY; SPONTANEOUS SPEECH;

DECISION TREES; TRANSCRIPTION;

SPEECH RECOGNITION;

EID: 68549130583     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2014792     Document Type: Article

References (41)

1. J. G. Kahn, M. Ostendorf, and C. Chelba, "Parsing conversational speech using enhanced segmentation," in Proc. HLT/NAACL, 2004, pp. 121-128.
2. S. Strassel, "Simple metadata annotation specification V6.2," Linguistic Data Consortium, 2004 [Online]. Available: http://www.ldc. upenn.edu/Projects/MDE/Guidelines/SimpleMDE V6.2.pdf
3. S.-C. Tseng and Y.-F. Liu, "Annotation of Mandarin Conversational Dialogue Corpus," Academia Sinica, CKIP Tech. Rep.-01, 2002.
4. S. Furui, M. Nakamura, T. Ichiba, and K. Iwano, "Analysis and recognition of spontaneous speech using corpus of spontaneous japanese," Speech Commun., vol. 47, pp. 208-219, 2005.
5. H. Soltau, B. Kingsbury, L. Mangu, D. Povey, G. Saon, and G. Zweig, "The IBM 2004 conversational telephony system for rich transcription," in Proc. IEEE ICASSP, 2005, pp. 205-208.
6. T. Hain, P. C. Woodland, G. Evermann, M. J. F. Gales, X. Liu, G. L. Moore, D. Povey, and L. Wang, "Automatic transcription of conversational telephone speech," IEEE Trans. Speech Audio Process., vol. 13, no. 6, pp. 1173-1185, Nov. 2005.
7. C. Barras, X. Zhu, S. Meignier, and J.-L. Gauvain, "Multistage speaker diarization of broadcast news," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1505-1512, Sep. 2006.
8. S. E. Tranter and D. A. Reynolds, "An overview of automatic speaker diarization systems," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1557-1565, Sep. 2006.
9. Y. Liu, E. Shriberg, A. Stolcke, D. Hillard, M. Ostendorf, and M. Harper, "Enriching speech recognition with automatic detection of sentence boundaries and disfluencies," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1526-1540, Sep. 2006.
10. M. Lease, M. Johnson, and E. Charniak, "Recognizing disfluencies in conversational speech," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1566-1573, Sep. 2006.
11. J.-F. Yeh and C.-H. Wu, "Edit disfluency detection and correction using a cleanup language model and an alignment model," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1574-1583, Sep. 2006.
12. P. Heeman and J. Allen, "Speech repairs, intonational phrases and discourse markers: Modeling speakers' utterances in spoken dialogue," Comput. Linguist., vol. 25, pp. 527-571, 1999.
13. E. Charniak and M. Johnson, "Edit detection and parsing for transcribed speech," in Proc. NAACL, 2001, pp. 118-126.
14. m. Johnson and e. Charniak, "a TAG-based noisy channel model of speech repairs," in Proc. ACL, 2004.
15. M. Honal and T. Schultz, "Automatic disfluency removal on recognized spontaneous speech - Rapid adaptation to speaker dependent disfluencies," in Proc. ICASSP, 2005, pp. 969-972.
16. M. Honal and T. Schultz, "Corrections of disfluencies in spontaneous speech using a noisy channel approach," in Proc. Eurospeech, 2003, pp. 2781-2784.
17. C. Nakatani and J. Hirschberg, "A corpus-based study of repair cues in spontaneous speech," J. Acoust. Soc. Amer., pp. 1603-1616, 1994.
18. E. Shriberg, "Phonetic consequences of speech disfluency," in Proc. Int. Conf. Phonetics Sci., 1999, pp. 619-622.
19. R. Lickley, "Juncture cues to disfluency," in Proc. ICSLP, 1996, pp. 2478-2481.
20. G. Savova and J. Bachenko, "Prosodic features of four types of disfluencies," in Proc. DiSS, 2003, pp. 91-94.
21. E. Shriberg and A. Stolcke, "A prosody-only decision-tree model for disfluency detection," in Proc. Eurospeech, 1997, pp. 2383-2386.
22. E. Shriberg, A. Stolcke, D. Hakkani-Tur, and G. Tur, "Prosody-based automatic segmentation of speech into sentences and topics," Speech Commun., pp. 127-154, 2000.
23. Y. Liu, A. Stolcke, E. Shriberg, and M. Harper, "Comparing HMM, maximum entropy, and conditional random fields for disfluency detection," in Proc. Eurospeech, 2005, pp. 3313-3316.
24. Y. Liu, E. Shriberg, A. Stolcke, and M. Harper, "Structural metadata research in the ears program," presented at the icassp, 2005, pp. 957-960, unpublished.
25. Y. Liu, E. Shriberg, and A. Stolcke, "Automatic disfluency identification in conversational speech using multiple knowledge sources," in Proc. Eurospeech, 2003, pp. 957-960.
26. Y. Liu, E. Shriberg, A. Stolcke, and M. Harper, "Using machine learning to cope with imbalanced classes in natural speech: Evidence from sentence boundary and disfluency detection," in Proc. ICSLP, 2004, pp. 1525-1528.
27. M. Snover, B. Dorr, and R. Schwartz, "A lexically-driven algorithm for disfluency detection," in Proc. HLT/NAACL, 2004, pp. 157-160.
28. J. Kim, S. Schwarm, and M. Ostendorf, "Detecting structural metadata with decision trees and transformation-based learning," in Proc. HLT/ NAACL, 2004.
29. A. L. Berger, S. A. Della Pietra, and V. J. Della Pietra, "A maximum entropy approach to natural language processing," Comput. Linguist., vol. 22, pp. 39-72, 1996.
30. R. H. Ryrd, P. Lu, and J. Nocedal, "A limited memory algorithm for bound constrained optimization," SIAM J. Sci. Statist. Comput., vol. 16, no. 5, pp. 1190-1208, 1995.
31. S. Chen and R. Rosenfeld, A Gaussian Prior for Smoothing Maximum Entropy Models Carnegie Mellon Univ., Pittsburgh, PA, 1999, Tech. Rep..
32. H. Chipman, E. I. George, and R. E. McCulloch, "Bayesian CART model search," J. Amer. Statist. Assoc., vol. 93, no. 443, pp. 935-947, 1998.
33. C.-Y. Tseng, S.-H. Pin, Y.-L. Lee, H.-M. Wang, and Y.-C. Chen, "Fluent speech prosody: Framework and modeling," Speech Commun., vol. 46, no. 3-4, pp. 284-309, July 2005, Special Issue on Quantitative Prosody Modeling for Natural Speech Description and Generation.
34. T. Hofmann, "Probabilistic latent semantic analysis," in Uncertainty Artif. Intell., 1999, pp. 289-296.
35. K. Daniels and C. Giraud-Carrier, "Learning the threshold in hierarchical agglomerative clustering," in Proc. ICMLA, 2006, pp. 270-278.
36. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," 2001 [Online]. Available: www.csie.ntu.edu.tw/∼cjlin/libsvm.
37. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. ICML, 2001, pp. 282-289.
38. S.-C. Tseng, "Processing spoken mandarin corpora," Traitement Automatique des Langues, vol. 45, no. 2, pp. 89-108, Special Issue: Spoken Corpus Processing.
39. Y.-C. Hsieh, Y.-T. Huang, C.-C. Wang, and L.-S. Lee, "Improved spoken document retrieval with dynamic key term lexicon and probabilistic latent semantic analysis (PLSA)," in Proc. ICASSP, 2006, pp. 961-964.
40. "Rich Transcription (RT-04F)," Evaluation Plan 2004 [Online]. Available: http://www.nist.gov/speech/tests/rt/rt2004/fall/docs/rt04f-eval-plan- v14.doc
41. F. Wilcoxon, "Individual comparisons by ranking methods," Biometrics, vol. 1, pp. 80-83, 1945.