Advances in unsupervised audio classification and segmentation for the broadcast news and NGSW corpora

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 3, 2006, Pages 907-919

  Rongqing, Huang ^a,b,c   Hansen, John H L ^a,b,c  

^a IEEE   (United States)

^b UNIVERSITY OF COLORADO   (United States)

^c UNIVERSITY OF TEXAS AT DALLAS   (United States)

Author keywords

Audio classification; Audio segmentation; Bayesian information criterion; Broadcast news transcription; Feature analysis; Feature processing; Gaussian mixture model (GMM) networks; Noisy environments; Rich transcription; Speaker segmentation

Indexed keywords

AUDIO CLASSIFICATION; AUDIO SEGMENTATION; BAYESIAN INFORMATION CRITERION; BROADCAST NEWS TRANSCRIPTION; FEATURE ANALYSIS; FEATURE PROCESSING; NOISY ENVIRONMENTS; RICH TRANSCRIPTION; SPEAKER SEGMENTATION; WEIGHTED GMM NETWORKS (WGN);

ALGORITHMS; CLASSIFICATION (OF INFORMATION); FILTER BANKS; GAUSSIAN DISTRIBUTION; SPEECH RECOGNITION;

ACOUSTIC SIGNAL PROCESSING;

EID: 34047274787     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.858057     Document Type: Article

References (41)

1. A. Adami, S. Kajarekar, and H. Hermansky, "A new speaker change detection method for two-speaker segmentation," in Proc. ICASSP, vol. 4, Orlando, FL, 2002, pp. 13-17.
2. J. Ajmera and I. McCowan, "Speech/music discrimination using entropy and dynamism features in a HMM classification framework," IDIAP, Martigny, Switzerland, Tech. Rep. IDIAP-RR 01-26, 2001.
3. T. Anderson, An Introduction to Multivariate Statistical Analysis. New York: Wiley, 1958, pp. 101-125.
4. M. Cettolo and M. Federico, "Model selection criteria for acoustic segmentation," in Proc. ISCA ITRW ASR2000 Workshop, Paris, France, Sep. 2000, pp. 221-227.
5. S. Chen and P. Gopalakrishnan, "Speaker, environment and channel change detection and clustering via the Bayesian information criterion," in Proc. Broadcast News Transcr. Under. Workshop, Lansdowne, VA, 1998, pp. 127-132.
6. J. R. Deller, J. H. L. Hansen, and J. G. Proakis, Discrete-time processing of speech signals, 2nd ed. New York: IEEE Press, 2000, pp. 245-251.
7. S. Dharanipragada and B. Rao, "M VDR-based feature extraction for robust speech recognition," in Proc. ICASSP 2001, vol. 1, Salt Lake City, UT, 2001, pp. 7-11.
8. M. J. F. Gales and S. J. Young, "Cepstral parameter compensation for HMM recognition in noise," Speech Commun., vol. 12, pp. 231-239, 1993.
9. J.-L. Gauvain, L. Lamel, and G. Adda, "Partitioning arid transcription of broadcast news data," in Proc. ICSLP, vol. 2, Sydney, Australia, Dec 1998, pp. 1335-1338.
10. J.-L. Gauvain, L. Lamel, and G. Adda, "The LIMSI broadcast news transcription system," Speech Commun., vol. 37, pp. 89-108, 2002.
11. A. H. Gray Jr. and J. D. Markel, "Distance measures for speech processing," IEEE Trans. Acoust., Speech Signal Process., vol. ASSP-24, no. 5, pp. 380-391, Oct. 1976.
12. T. Hain, S. Johnson, A. Tuerk, P. Woodland, and S. Young, "Segment generation and clustering in the HTK broadcast news transcription system," in DARPA Broadcast News Transcr. Under. Workshop, Lansdowne, VA, 1998, pp. 133-137.
13. J. H. L. Hansen, X. Zhang, M. Akbacak, U. Yapanel, B. Pellom, W. Ward, and P. Angkititrakul, "CU-Move: Advanced in in-vehicle speech systems for route navigation," in DSP for In-Vehicle and Mobile Systems, H. Abut, J. H. L. Hansen, and K. Takeda, Eds. New York: Springer-Verlag, 2004.
14. J. H. L. Hansen and L. Arslan, "Robust feature estimation and objective quality assessment for noisy speech recognition using the credit card corpus," IEEE Trans. Speech Audio Process., vol. 3, no. 3, pp. 169-184, May 1995.
15. M. Harris, X. Aubert, R. Haeb-Umbach, and P. Beyerlein, "A study of broadcast news audio stream segmentation and segment clustering," EuroSpeech, vol. 3, pp. 1027-1030, Sep 1999.
16. S. Johnson, "Speaker tracking," M.S. thesis, Eng. Dept., Cambridge Univ., U.K., 1997.
17. I. T. Jolliffe, Principal Component Analysis. New York: Springer-Verlag, 1986.
18. B. Kedem, "Spectral analysis and discrimination by zero-crossings," Proc. IEEE, vol. 74, no. 11, pp. 1477-1493, Nov. 1986.
19. J. F. Kaiser, "Some useful properties of teager's energy operator," in Proc. ICASSP, vol. 3, Minneapolis, MN, Apr. 1993, pp. 149-152.
20. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Comput. Speech Lang., vol. 9, pp. 171-185, 1995.
21. S. Z. Li, "Content-based audio classification and retrieval using the nearest feature line method," IEEE Trans. Speech Audio Process., vol. 8, no. 5, pp. 619-625, Sep. 2000.
22. L. Lu, H. Zhang, and H. Jiang, "Content analysis for audio classification and segmentation," IEEE Trans. Speech Audio Process., vol. 10, no. 7, pp. 504-516, Oct. 2002.
23. L. Lu and H. Zhang, "Speaker change detection and tracking in real-time news broadcasting analysis," in Proc. ACM Multimedia, Juan-les-Pins, France, Dec. 2002, pp. 602-610.
24. S. Nicholson, B. Milner, and S. Cox, "Evaluating feature set performance using the f-ratio and j-measures," in Proc. EuroSpeech, vol. 1, Rhodes, Greece, Sep. 1997, pp. 413-416.
25. The National Gallery of the Spoken Word (NGSW). [Online] Available: http://www.ngsw.org/
26. L. R. Rabiner and R. W. Schafer, Digital signal processing of speech signals. Englewood Cliffs, NJ: Prentice-Hall, 1978.
27. J. Saunders, "Real time discrimination of broadcast speech/music," in Proc. ICASSP, vol. 2, Atlanta, GA, May 1996, pp. 993-996.
28. E. Scheirer and M. Slaney, "Construction and evaluation of a robust multifeature speech/music discriminator," in Proc. ICASSP, vol. 2, Munich, Germany, 1997, pp. 1331-1334.
29. M. Siegler, U. Jain, B. Raj, and R. M. Stem, "Automatic segmentation, classification and clustering of broadcast news audio," in Proc. DARPA Speech Recognition Workshop, Chantilly, VA, 1997, pp. 97-99.
30. R. M. Stem, "Specification of the 1996 Hub4 broadcast news evaluation," in Proc. DARPA Speech Recognition Workshop, Chantilly, VA, 1997, pp. 3-6.
31. SpeechFind, On-Line Search Engine for the National Gallery of the Spoken Word. [Online]. Available: http://SpeechFind.colorado.edu/
32. TIMIT (recorded at Texas Instruments, transcribed at Mass. Inst. Technol.) Acoustic-Phonetic Continuous Speech Corpus. [Online]. Available: http://www.ldc.upenn.edu/
33. G. Tzanetakis and P. Cook, "Multifeature audio segmentation for browsing and annotation," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, NY, Oct. 17-20, 1999, pp. w99-1-w99-4.
34. S. Wegmann, P. Zhan, and L. Gillick, "Progress in broadcast news transcription at dragon systems," Proc. ICASSP, vol. 1, pp. 33-36, Mar. 1999.
35. E. Wold, T. Blum, D. Keislar, and J. Wheaton, "Content-based classification, search and retrieval of audio," IEEE Multimedia Mag., vol. 3, no. 3, pp. 27-36, 1996.
36. U. Yapanel and S. Dharanipragada, "Perceptual MVDR-based cepstral coefficients (PMCCs) for noise-robust speech recognition," in Proc. ICASSP, vol. I, Hong Kong, China, Apr. 2003, pp. 6-10.
37. U. Yapanel and J. H. L. Hansen, "A new perspective on feature extraction for robust in-vehicle speech recognition," in Proc. EuroSpeech, Geneva, Switzerland, Sep. 2003, pp. 1281-1284.
38. T. Zhang and C.-C. J. Kuo, "Audio content analysis for online audiovisual data segmentation and classification," IEEE Trans. Speech Audio Process., vol. 9, no. 4, pp. 441-457, Jul. 2001.
39. B. Zhou and J. H. L. Hansen, "Unsupervised audio stream segmentation and clustering via the Baysian information criterion," in Proc. ICSLP 2000, vol. 1, Beijing, China, Oct. 2000, pp. 714-717.
40. B. Zhou and J. H. L. Hansen, "Spcechfind: an experimental on-line spoken document retrieval system for historical audio archives," in Proc. ICSLP, vol. 3, Denver, CO, Sep. 2002, pp. 1969-1972.
41. G. Zhou, J. H. L. Hansen, and J. F. Kaiser, "Nonlinear feature based classification of speech under stress," IEEE Trans. Speech Audio Process., vol. 9. no. 3, pp. 201-216, May 2001.