Edit disfluency detection and correction using a cleanup language model and an alignment model

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 5, 2006, Pages 1574-1583

  Yeh, Jui Feng ^b   Wu, Chung Hsien ^a,b  

^a IEEE   (Taiwan)

^b NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Edit disflucncy; Language model; Potential interruption point (IP) detection; Rich transcription

Indexed keywords

EDIT DISFLUCNCY; LANGUAGE MODELS; POTENTIAL INTERRUPTION POINT (IP) DETECTION; RICH TRANSCRIPTION;

BIT ERROR RATE; MATHEMATICAL MODELS; OPTIMIZATION; SPEECH PROCESSING; WORD PROCESSING;

FORMAL LANGUAGES;

EID: 34047266604     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2006.878267     Document Type: Article

References (43)

1. W. Byrne, D. Doermann, M. Franz, S. Gustman, J. Hajic, D. Oard, M. Picheny, J. Psutka, B. Ramabhadran, D. Soergel, T. Ward, and Z. Wei-Jin, "Automatic recognition of spontaneous speech for access to multilingual oral history archives," IEEE Trans. Speech Audio Process., vol. 12, no. 4, pp. 420-435, Jul. 2004.
2. D. Jones, F. Wolf, E. Gibson, E. Williams, E. Fedorenko, D. Reynods, and M. Zissman, "Measuring the readability of automatic speech-to-text transcripts," in Proc. Eurospeech, 2003, pp. 1585-1588.
3. Y. Liu, "Structural event detection for rich transcription of speech," Ph.D. dissertation, Purdue Univ., West Lafayette, IN, 2004.
4. E. Shriberg, "Preliminaries to a theory of speech disfluencies," Ph.D., Dept. Psychol., Univ. California, Berkeley, 1994.
5. S. Strassel. (2004) Simple Metadata Annotation Specification Version 6.2. Linguistic Data Consortium. [Online]. Available: http://www.ldc.upenn.edu/ Projects/MDE
6. C.-H. Wu and G.-L. Yan, "Speech act modeling and verification of spontaneous speech with disfluency in a spoken dialogue system," IEEE Trans. Speech Audio Process., vol. 13, no. 3, pp. 330-344, May 2005.
7. E. Shriberg, A. Stolcke, D. Hakkani-Tur, and G. Tur, "Prosody-based automatic segmentation of speech into sentences and topics," Speech Commun., vol. 32, no. 1-2, pp. 127-154, 2000.
8. J. Bear, J. Dowding, and E. Shriberg, "Integrating multiple knowledge sources for detecting and correction of repairs in human computer dialog," in Proc. ACL, 1992, pp. 56-63.
9. E. Shriberg, L. Ferrer, S. Kajarekar, A. Venkataraman, and A. Stolcke, "Modeling prosodic feature sequences for speaker recognition," Speech Commun., pp. 455-472, 2005.
10. G. Savova and J. Bachenko, "Prosodic features of four types of disfluencies," in Proc. DiSS, 2003, pp. 91-94.
11. H. Soltau, B. Kingsbury, L. Mangu, D. Povey, G. Saon, and G. Zweig, "The IBM2004 conversational telephony system forrichtranscription, "inProc. IEEE Int. Conf. Acoustics, Speech, Signal Process.,2005, pp. 205-208.
12. J. Kim, S. E. Schwarm, and M. Ostendorf, "Detecting structural metadata with decision trees and transformation-based learning," in Proc. HLT/NAACL, 2004, pp. 137-144.
13. S. Furui, M. Nakamura, T. Ichiba, and K. Iwano, "Analysis and recognition of spontaneous speech using corpus of spontaneous Japanese," Speech Commun., vol. 47, pp. 208-219, 2005.
14. E. Charniak and M. Johnson, "Edit detection and parsing for transcribed speech," in Proc. NAACL, 2001, pp. 118-126.
15. M. Johnson and E. Charniak, "A tag-based noisy channel model of speech repairs," in Proc. ACL, 2004, pp. 33-39.
16. M. Lease, E. Charniak, and M. Johnson, "Parsing and its applications for conversational speech," in Proc. ICASSP, 2005, pp. 961-964.
17. M. Johnson, E. Charniak, and M. Lease, "An improved model for recogizing disfluencies in conversational speech," in Proc. Rich Transcription 2004 Fall Workshop, 2004.
18. P. Heeman and J. Allen, "Speech repairs, intonational phrases and discourse markers: Modeling speakers' utterances in spoken dialogue," Comput. Ling., vol. 25, pp. 527-571, 1999.
19. P. A. Heeman, K. Loken-Kim, and J. F. Allen, "Combining the detection and correction of speech repairs," in Proc. 4th Int. Conf. Spoken Lang. Process., Oct. 1996, pp. 358-361.
20. M. Honal and T. Schultz, "Automatic disfluency removal on recognized spontaneous speech-Rapid adaptation to speaker dependent dislfuencies," in Proc. ICASSP, 2005, pp. 969-972.
21. _, "Corrections of disfluencies in spontaneous speech using a noisy-channel approach," in Proc. Eurospeech, 2003, pp. 2781-2784.
22. M. Snover, B. Dorr, and R. Schwartz, "A lexically-driven algorithm for disfluency detection," in Proc. HLT/NAACL, 2004, pp. 157-160.
23. T. Hain, P. C. Woodland, G. Evermann, M. J. F. Gales, X. Liu, G. L. Moore, D. Povey, and L. Wang, "Automatic transcription of conversational telephone speech," IEEE Trans. Speech Audio Process., vol. 13, no. 6, pp. 1173-1185, Nov. 2005.
24. H. Soltau, H. Yu, F. Metze, C. Fugen, J. Qin, and S.-C. Jou, "The 2003 ISL rich transcription system for conversational telephony speech," in Proc. Acoust., Speech, Signal Process., 2004, pp. 17-21.
25. M. Harper, B. J. Dorr, J. Hale, B. Roark, I. Shafran, M. Lease, Y. Liu, M. Snover, L. Yung, A. Krasnyanskaya, and R. Stewart, "Final report on parsing and spoken structural event detection," in Proc. Johns Hopkins Summer Workshop, 2005, pp. 1-116.
26. Y. Liu, A. Stolcke, E. Shriberg, and M. Harper, "Using conditional random fields for sentence boundary detection in speech," in Proc. 43nd Annu. Meeting Assoc. Computat. Ling., 2005, pp. 451-458.
27. J. Huang and G. Zweig, "Maximum entropy model for punctuation annotation from speech," in Proc. ICSLP, pp. 917-920.
28. Y. Liu, E. Shriberg, A. Stolcke, and M. Harper, "Comparing HMM, maximum entropy, and conditional random fields for disfluency detection," in Proc. Eurospeech, 2005, pp. 3313-3316.
29. Y. Liu, E. Shriberg, A. Stolcke, B. Peskin, J. Ang, D. Hillard, M. Ostendort, M. Tomalin, P. I. Woodland, and M. Harper, "Structural metadata research in the ears program," presented at the ICASSP, invited paper, 2005, pp. 957-960.
30. A. Stolcke, E. Shriberg, R. Bates, M. Ostendorf, D. Hakkani, M. Plauche, G. Tur, and Y. Lu, "Automatic detection of sentence boundaries and disfluencies based on recognized words," in Proc. Int. Conf. Spoken Lang. Process., 1998, pp. 2247-2250.
31. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum-likelihood from incomplete data via the EM algorithm," J. R. Statist Soc. B, pp. 1-39, 1977.
32. Y. Liu, Q. Liu, and S. Lin, "Log-linear models for word alignment," in Proc. 43rd Annu. Meeting Assoc. Comput. Ling., 2005, pp. 459-466.
33. A. Stolcke and E. Shriberg, "Statistical language modeling for speech disfluencies," in Proc. ICASSP, vol. 1, 1996, pp. 405-408.
34. S. F. Chen and J. Goodman, "An empirical study of smoothing techniques for language modeling," Center Res. Comput. Technol., Harvard Univ., Cambridge, MA, Tech. Rep. TR-10-98, 1998.
35. H. Ney, S. Niessen, F. J. Och, H. Sawaf, C. Tilhnmm, and S. Vogel, "Algorithms for statistical translation of spoken language," IEEE Trans. Speech Audio Process., vol. 8, no. 1, pp. 24-36, Jan. 2000.
36. Z. Wu and M. Palmer, "Verb semantics and lexical selection," in Proc. 32nd ACL, 1994, pp. 133-138.
37. S.-C. Tseng and Y.-F. Liu, "Annotation of Mandarin Conversational Dialogue Corpus," Academia Sinica, CKIP Tech. Rep.-01, 2002.
38. A. Venkataraman, A. Stolcke, W. Wang, D. Vergyri, V. R. R. Gadde, and J. Zheng, "An efficient repair procedure for quick transcriptions," in Proc. Int. Conf. Spoken Lang. Process., Jeju Island, Korea, Oct. 2004, pp. 1961-1964.
39. S. J. Young, G. Evermann, T. Hain, D. Kershaw, G. L. Moore, J. J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. C. Woodland, The HTK Book. Cambridge, U.K: Cambridge Univ. Press, 2003.
40. MAT Speech Database - TCC-300 [Online]. Available: http://rocling.iis. sinica.edu.tw/ROCLING/MAT/Tcc_300brief.htm
41. Rich Transcription (RT-04F) Evaluation Plan (2004). [Online]. Available: http://www.nist.gov/speech/tests/rt/rt2004/fall/docs/rt04f-eval-plan-vl4.doc
42. C.-K. Lin, S.-C. Tseng, and L.-S. Lee, "Important and new features with analysis for disfluency interruption point (IP) detection in spontaneous mandarin speech," in Proc. DiSS, 2005, pp. 117-121.
43. M. Snover, R. Schwartz, B. Dorr, and J. Makhoul, "RT-S: Surface rich transcription scoring, methodology, and initial results," in Proc. DARPA Rich Transcription Workshop, 2004.