SpeechFind: Advances in Spoken Document Retrieval for a National Gallery of the Spoken Word

IEEE Transactions on Speech and Audio Processing

Volumn 13, Issue 5, 2005, Pages 712-730

  Hansen, John H L ^a,b   Huang, Rongqing ^a,b   Zhou, Bowen ^b,c   Seadle, Michael ^d   Deller, J R ^e   Gurijala, Aparna R ^e   Kurimo, Mikko ^f   Angkititrakul, Pongtep ^a,g  

^a UNIVERSITY OF COLORADO   (United States)

^b UNIVERSITY OF TEXAS AT DALLAS   (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

^d MICHIGAN STATE UNIVERSITY   (United States)

^e Michigan State University   (United States)

^f AALTO UNIVERSITY   (Finland)

^g Eliza Corporation   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85008020310     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.852088     Document Type: Article

References (104)

1. [Online]. Available: http://www.ngsw.org
2. [Online]. Available: (Original website) http://speechfind.colorado.edu/; http://speechfind.utdallas.edu/
3. B. Zhou and J. H. L. Hansen, “SPEECHFIND: An experimental on-line spoken document retrieval system for historical audio archives,” in Proc. Int. Conf. Spoken Language Process., vol. 3, Denver, CO, Sep. 2002, pp. 1969–1972.
4. J. H. L. Hansen, B. Zhou, M. Akbacak, R. Sarikaya, and B. Pellom, “Audio stream phrase recognition for a National Gallery of the Spoken Word: 'One small step’,” in Proc. Int. Conf. Spoken Lang. Process., vol. 3, Beijing, China, Oct. 2000, pp. 1089–1092.
5. J. H. L. Hansen, J. Deller, and M. Seadle, “Engineering challenges in the creation of a National Gallery of the Spoken Word: Transcript-free search of audio archives,” in Proc. IEEE ACM Joint Conf. Digital Libraries, Roanoke, VA, Jun. 2001, pp. 235–236.
6. A. Gurijala, J. R. Deller Jr., M. S. Seadle, and J. H. L. Hansen, “Speech watermarking through parametric modeling,” in Proc. Int. Conf. Spoken Lang. Process., Denver, CO, Sep. 2002, pp. 621–624.
7. M. S. Seadle, J. R. Deller Jr., and A. Gurijala, “Why watermark? The copyright need for an engineering solution,” in Proc. Second ACM/IEEE Joint Conf. Digital Libraries, Portland, OR, Jun. 2002.
8. A. Adami, S. Kajarekar, and H. Hermansky, “A new speaker change detection method for two-speaker segmentation,” in Proc. ICASSP, 2002.
9. L. Lu and H. Zhang, “Speaker change detection and tracking in real-time news broadcasting analysis,” in Proc. ACM Multimedia, Paris, France, Dec. 2002.
10. U. Yapanel and J. H. L. Hansen, “A new perspective on feature extraction for robust in-vehicle speech recognition,” in Proc. Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 1281–1284.
11. M. Siegler, U. Jain, B. Raj, and R. M. Stern, “Automatic segmentation, classification and clustering of broadcast news audio,” in Proc. DARPA Speech Recog. Workshop, Chantilly, VA, 1997, pp. 97–99.
12. S. Chen and P. Gopalakrishnan, “Speaker, environment and channel change detection and clustering via the Bayesian information criterion,” in Proc. Broadcast News Trans. Under. Workshop, 1998.
13. S. Dharanipragada and B. Rao, “MVDR-based feature extraction for robust speech recognition,” in ICASSP, Salt Lake City, UT, 2001.
14. T. Hain, S. Johnson, A. Tuerk, P. Woodland, and S. Young, “Segment generation and clustering in the HTK: Broadcast news transcription system,” in DARPA Broadcast News Workshop, Herndon, VA, 1998.
15. R. Huang and J. H. L. Hansen, “Unsupervised audio segmentation and classification for robust spoken document retrieval,” in Proc. IEEE ICASSP, vol. 1, Montreal, QC, Canada, May 2004, pp. 741–744.
16. B. Zhou and J. H. L. Hansen, “Efficient audio stream segmentation via T2 statistic based Bayesian information criterion (T2-BIC),” IEEE Trans. Speech Audio Process., vol. 13, no. 4, Jul. 2005.
17. I. H. Witten, A. Moffat, and T. C. Bell, Managing Gigabytes: Compressing and Indexing Documents and Images. San Francisco, CA: Morgan Kaufmann, 1999.
18. T. Landauer, P. Foltz, and D. Laham, “Introduction to latent semantic analysis,” Discourse Processes, vol. 25, pp. 259–284, 1998.
19. “N. District Court Calif.,” A&M Records, Inc. v. Napster, Inc., 99–5183, 2000.
20. “11th Circuit Court of Appeals,” Estate of Martin Luther King v. CBS, 98–9079, 1999.
21. M. Seadle, “Copyright in the networked world: New rules for images,” Library Hi Tech., vol. 20, no. 2, 2002.
22. M. Seadle, “Whose rules? Intellectual property, culture, and indigenous communities,” D-Lib Mag., vol. 8, no. 3, Mar. 2002.
23. M. Seadle, “Copyright in the networked world: Multimedia fair use,” Library Hi Tech., vol. 19, no. 4, 2001.
24. M. Seadle, “Spoken words, unspoken meanings: A DLI2 project ethnography,” D-Lib Mag., Nov. 2000.
25. J. H. L. Hansen, “Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition,” Speech Commun., Special Issue on Speech Under Stress, vol. 20, no. 2, pp. 151–170, Nov. 1996.
26. R. Sarikaya and J. H. L. Hansen, “High resolution speech feature parameterization for monophone based stressed speech recognition,” IEEE Signal Process. Lett., vol. 7, no. 7, pp. 182–185, Jul. 2000.
27. S. E. Bou-Ghazale and J. H. L. Hansen, “A comparative study of traditional and newly proposed features for recognition of speech under stress,” IEEE Trans. Speech Audio Process., vol. 8, no. 4, pp. 429–442, Jul. 2000.
28. L. M. Arslan and J. H. L. Hansen, “A study of temporal features and frequency characteristics in American English foreign accent,” J. Acoust. Soc. Amer., vol. 102, no. 1, pp. 28–40, Jul. 1997.
29. P. Angkititrakul and J. H. L. Hansen, “Advances in phone-based modeling for automatic accent classification,” IEEE Trans. Speech Audio Proc., to be published.
30. J. Foote et al., “Talker-Independent keyword spotting for information retrieval,” in Proc. Eurospeech, vol. 3, 1995, pp. 2145–2149.
31. P. C. Woodland et al., “Experiments in broadcast news transcription,” in Proc. IEEE ICASSP, Seattle, WA, 1998, pp. 909–912.
32. [Online]. Available: http://speechbot.research.compaq.com/
33. [Online]. Available: http://www.dragonsys.com/news/pr/audiomine.html
34. B. Arons, “A system for interactively skimming recorded speech,” ACM Trans. Computer-Human Interaction, vol. 4, no. 1, pp. 3–38, 1997.
35. V. Wessel, R. Schluter, K. Macherey, and H. Ney, “Confidence measures for large vocabulary continuous speech recognition,” IEEE Trans. Speech Audio Process., vol. 9, no. 3, pp. 288–298, Mar. 2001.
36. C. Hori, S. Furui, R. Malkin, Y. Hua, and A. Waibel, “Automatic speech summarization applied to English broadcast news speech,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 1, Orlando, FL, May 2002, pp. 9–12.
37. S. Wegmann, Z. P. Zhan, and L. Gillick, “Progress in broadcast news transcription at dragon systems,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 1, Phoenix, AZ, Mar. 1999, pp. 33–36.
38. S. S. Chen, E. M. Eide, M. J. F. Gales, R. A. Gopinath, D. Kanevsky, and P. Olsen, “Recent improvements to IBM's speech recognition system for automatic transcription of broadcast news,” in Proc. Int. Conf. Acoust. Speech, Signal Process., Phoenix, AZ, 1999, pp. 37-40.
39. S. E. Johnson, P. Jourlin, G. L. Moore, K. S. Jones, and P. C. Woodland, “The Cambridge University spoken document retrieval system,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 1, Phoenix, AZ, Mar. 1999, pp. 49–52.
40. R. Hecht, J. Riedler, and G. Backfried, “German broadcast news transcription,” in Proc. Int. Conf. Spoken Lang. Process., Denver, CO, Sep. 2002, pp. 1753–1756.
41. W. Macherey and H. Ney, “Toward automatic corpus preparation for a German broadcast news transcription system,” in Proc. Int. Conf. Spoken Lang. Process., vol. 1, Denver, CO, May 2002, pp. 733–736.
42. F. Brugnara, M. Cettolo, M. Federico, and D. Giuliani, “A baseline for the transcription of Italian broadcast news,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 3, Istanbul, Turkey, Jun. 2000, pp. 1667–1670.
43. Y.-H. Park, D.-H. Ahn, and M. Chung, “Morpheme-based lexical modeling for Korean broadcast news transcription,” in Proc. Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 1129–1132.
44. A. Kobayashi, F. J. Och, and H. Ney, “Named entity extraction from Japanese broadcast news,” in Proc. Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 1125–1128.
45. M. Afify and O. Siohan, “Sequential estimation with optimal forgetting for robust speech recognition,” IEEE Trans. Speech and Audio Processing, vol. 12, no. 1, pp. 19–26, Jan. 2004.
46. L. Nguyen, X. Guo, R. Schwartz, and J. Makhoul, “Japanese broadcast news transcription,” in Proc. Int. Conf. Spoken Lang. Process., Denver, CO, Sep. 2002, pp. 1749–1752.
47. H. Nishizaki and S. Nakagawa, “Comparing isolately spoken keywords with spontaneously spoken queries for Japanese spoken document retrieval,” in Proc. Int. Conf. Spoken Lang. Process., Denver, CO, Sep. 2002, pp. 1505–1508.
48. B. Chen, H.-M. Wang, and L.-S. Lee, “Discriminating capabilities of syllable-based features and approaches of utilizing them for voice retrieval of speech information in Mandarin Chinese,” IEEE Trans. Speech Audio Proc., vol. 10, no. 5, pp. 303–314, Jul. 2002.
49. J.-T. Chien and C.-H. Huang, “Bayesian learning of speech duration models,” IEEE Trans. Speech Audio Process., vol. 11, no. 6, pp. 558–567, Nov. 2003.
50. P.-C. Chang, S.-P. Liao, and L.-S. Lee, “Improved Chinese broadcast news transcription by language modeling with temporally consistent training corpora and iterative phrase extraction,” in Proc. Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 421–424.
51. Y. Liu and P. Fung, “State-dependent phonetic tied mixtures with pronunciation modeling for spontaneous speech recognition,” IEEE Trans. Speech Audio Process., vol. 12, no. 4, pp. 351–364, Jul. 2004.
52. B. Chen, H.-M. Wang, and L.-S. Lee, “Retrieval of broadcast news speech in Mandarin Chinese collected in taiwan using syllable-level statistical characteristics,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 3, Istanbul, Turkey, Jun. 2000, pp. 1771–1774.
53. H. Meinedo and J. Neto, “Audio segmentation, classification and clustering in a broadcast news task,” in Proc. IEEE Inter. Conf. Acoust. Speech, Signal Process., vol. 2, Hong Kong, Apr. 2003, pp. 5–8.
54. J. Billa, M. Noamany, A. Srivastava, D. Liu, R. Stone, J. Xu, J. Makhoul, and F. Kubala, “Audio indexing of Arabic broadcast news,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 1, Orlando, FL, May 2002, pp. 5–8.
55. C. Barras, L. Lamel, and J.-L. Gauvain, “Automatic transcription of compressed broadcast audio,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 1, Salt Lake City, UT, May 2001, pp. 265–268.
56. A. Fujii and K. Itou, “Building a test collection for speech-driven web retrieval,” in Proc. Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 1153–1156.
57. W.-K. Lo, H. M. Meng, and P. C. Ching, “Multi-scale and multi-model integration for improved performance in Chinese spoken document retrieval,” in Proc. Int. Conf. Spoken Lang. Process., Denver, CO, Sep. 2002, pp. 1513–1516.
58. M. Saraclar, M. Riley, E. Bocchieri, and V. Go, “Toward automatic closed captioning :Low latency real time broadcast news transcription,” in Proc. Int. Conf. Spoken Lang. Process., Denver, CO, Sep. 2002, pp. 1741-1744.
59. S. R. Maskey and J. Hirschberg, “Automatic summarization of broadcast news using structural features,” in Proc. Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 1173–1176.
60. C. Hori and S. Furui, “Automatic speech summarization based on word significance and linguistic likelihood,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 3, Istanbul, Turkey, Jun. 2000, pp. 1579–1582.
61. C. Neukirchen, D. Willett, and G. Rigoll, “Experiments in topic indexing of broadcast news using neural networks,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 2, Phoenix, AZ, Mar. 1999, pp. 1093–1096.
62. Y. Moh, P. Nguyen, and J.-C. Junqua, “Toward domain independent speaker clustering,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 2, Hong Kong, Apr. 2003, pp. 85–88.
63. K. Mori and S. Nakagawa, “Speaker change detection and speaker clustering using VQ distortion for broadcast news speech recognition,” in Proc. IEEE Int. Conf. Acoust. Speech, Signal Process., vol. 1, Salt Lake City, UT, May 2001, pp. 413-416.
64. F. Walls, H. Jin, S. Sista, and R. Schwartz, “Probabilistic models for topic detection and tracking,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 1, Phoenix, AZ, Mar. 1999, pp. 521–524.
65. C. Langzhou, J.-L. Gauvain, L. Lamel, and G. Adda, “Unsupervised language model adaptation for broadcast news,” in Proc. Int. Conf. Acoust. Speech, Signal Process., vol. 1, Hong Kong, Apr. 2003, pp. 220–223.
66. M. Kurimo, B. Zhou, R. Huang, and J. H. L. Hansen, “Language modeling structures in audio transcription for retrieval of historical speeches,” in Proc. 12th Eur. Signal Process. Conf, Vienna, Austria, Sep. 6–10, 2004, pp. 557–560.
67. H.-M. Wang, H. Meng, P. Schone, B. Chen, and W.-K. Lo, “Multiscale-audio indexing for translingual spoken document retrieval,” in Proc. IEEE Int. Conf. Acoust. Speech, Signal Process., vol. 1, Salt Lake City, UT, May 2001, pp. 605–608.
68. J. Navratil, “Spoken language recognition-a step toward multilinguality in speech processing,” IEEE Trans. Speech Audio Process., vol. 9, no. 5, pp. 678–685, Sep. 2001.
69. W. Byrne, D. Doermann, M. Franz, S. Gustman, J. Hajic, D. Oard, M. Picheny, J. Psutka, B. Ramabhadran, D. Soergel, T. Ward, and W.-J. Zhu, “Automatic recognition of spontaneous speech for access to multilingual oral history archives,” IEEE Trans. Speech Audio Process., vol. 12, no. 4, pp. 420–435, Jul. 2004.
70. I. J. Cox, M. L. Miller, and J. A. Bloom, Digital Watermarking. San Diego, CA: Academic, 2002.
71. A. Gurijala and J. R. Deller Jr., “Speech watermarking by parametric embedding with an ℓ∞ fidelity criterion,” in Proc. Interspeech/Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 2933–2936.
72. J. R. Deller Jr., J. H. L. Hansen, and J. G. Proakis, Discrete-Time Processing of Speech Signals, Second ed. Piscataway, NJ: IEEE, 2000, ch. 5.
73. A. Gurijala and J. R. Deller Jr., “Speech watermarking with objective fidelity and robustness criterion,” in Proc. Asilomar Conf. Signals, Syst., Comput., Pacific Grove, CA, Nov. 2003.
74. A. Gurijala and J. R. Deller Jr., “Speech watermarking through parametric modeling,”, submitted for publication.
75. S. Gollamudi, S. Nagaraj, S. Kapoor, and Y. F. Huang, “SMART: A toolbox for set-membership filtering,” in Proc. Eur. Conf. Circuit Theory Design, Budapest, Hungary, 1997.
76. S. Nagaraj, S. Gollamudi, S. Kapoor, and Y. F. Huang, “BEACON: An adaptive set-membership filtering technique with sparse updates,” IEEE Trans. Signal Process., vol. 47, no. 11, pp. 2928–2941, Nov. 1999.
77. J. R. Deller Jr. and H. F. Huang, “Set-membership identification and filtering in signal processing,” Circuits, Syst., Signal Process., Special Issue on Signal Process. Applications, Feb. 2002.
78. R. Huang and J. H. L. Hansen, “High-level feature weighted GMM network for audio stream classification,” in Proc. Int. Conf. Spoken Language Process., Jeju Island, Korea, Oct. 2004.
79. T. Anderson, An Introduction to Multivariate Statistical Analysis. New York: Wiley, 1958.
80. S. M. Ahadi and P. C. Woodland, “Combined Bayesian and predictive techniques for rapid speaker adaptation of continuous density hidden Markov models,” Comput. Speech Language, vol. 11, pp. 187–206, 1997.
81. J. L. Gauvain and C. H. Lee, “Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains,” IEEE Trans. Speech Audio Process., vol. 2, no. 2, pp. 291–298, Apr. 1994.
82. C. Leggetter and P. Woodland, “Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models,” Comput. Speech Language, vol. 9, pp. 171–185, 1995.
83. L. R. Neumeyer, A. Sankar, and V. V. Digalakis, “A comparative study of speaker adaptation techniques,” in Proc. Eurospeech, Madrid, Spain, 1995, pp. 1127–1130.
84. K. Shinoda and C. H. Lee, “Structural MAP speaker adaptation using hierarchical priors,” in Proc. IEEE Workshop Automatic Speech Recognition Understanding, Santa Barbara, CA, 1997, pp. 381–388.
85. O. Siohan, T. A. Myrvoll, and C. H. Lee, “Structural maximum a posteriori linear regression for fast HMM adaptation,” Comput. Speech Language, vol. 16, no. 1, pp. 5–24, Jan. 2002.
86. C. Chesta, O. Siohan, and C. H. Lee, “Maximum a posterior linear regression for hidden Markov model adaptation,” in Proc. Eurospeech, Budapest, Hungary, 1999, pp. 203–206.
87. W. Chou, “Maximum a posterior linear regression with elliptically symmetric matrix priors,” in Proc. Eurospeech, Budapest, Hungary, 1999, pp. 1–4.
88. P. C. Woodland, “Speaker adaptation: Techniques and challenges,” in Proc. IEEE Workshop Automatic Speech Recognition Understanding, Keystone, CO, 1999, pp. 85–90.
89. B. Zhou and J. H. L. Hansen, “Rapid discriminative acoustic modeling based on eigenspace mapping for fast speaker adaptation,” IEEE Trans. Speech Audio Process., to be published.
90. S. E. Robertson and S. Walker, “Okapi/Keenbow at TREC-8,” in Proc. TREC-8, 1999.
91. S. E. Robertson and K. S. Jones, ““Simple, Proven Approaches to Text Retrieval,” Tech. Rep., Cambridge Univ., Cambridge, U.K., 1997.
92. A. Singhal and F. Pereira, “Document expansion for speech retrieval,” in Proc. 22nd ACM SIGIR Conf, Berkeley, CA, Aug. 1999.
93. M. Akbacak and J. H. L. Hansen, “Environmental sniffing: Noise knowledge estimation for robust speech systems,” in Proc. Int. Conf. Acoust. Speech Signal Process., vol. 2, Hong Kong, Apr. 2003, pp. 113–116.
94. M. Akbacak and J. H. L. Hansen, “ENVIRONMENTAL SNIFFING: Robust digit recognition for an in-vehicle environment,” in Proc. INTERSPEECH/Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 2177–2180.
95. L. Lu, H. Zhang, and H. Jiang, “Content analysis for audio classification and segmentation,” IEEE Trans. Speech Audio Proc., vol. 10, no. 7, pp. 504–516, Oct. 2002.
96. B. Zhou, “Audio Parsing and Rapid Speaker Adaptation in Speech Recognition for Spoken Document Retrieval,” Ph.D. dissertation, Robust Speech Processing Group, Center for Spoken Language Research, Univ. Colorado, Boulder, CO, 2003.
97. [Online]. Available: http://www.ukans.edu/carrie/docs/am-docs_index.html
98. P. Angkititrakul and J. H. L. Hansen, “Advances in phone-based modeling for automatic accent classification,” IEEE Trans. Speech Audio Proc., to be published.
99. Y. Gong, “Stochastic trajectory modeling and sentences searching for continuous speech recognition,” IEEE Trans. Speech. Audio Proc., vol. 5, no. 1, pp. 33–44, Jan. 1997.
100. P. Angkititrakul and J. H. L. Hansen, “Discriminative in-set/out-of-set speaker recognition,” IEEE Trans. Speech Audio Processing, submitted for publication.
101. M. Saraclar and R. Sproat, “Lattice-based search for spoken utterance retrieval,” in Proc. HLT-NAACL, Boston, MA, May 2004, pp. 129–136.
102. H. Ney, U. Essen, and R. Kneser, “On structuring probabilistic dependencies in stochastic language modeling,” Comput. Speech Language, vol. 8, pp. 1–38, 1994.
103. A. Stolcke, “SRILM - An extensible language modeling toolkit,” in Proc. Int. Conf. Spoken Language Process., Denver, CO, Sep. 2002, pp. 901–904.
104. M. Kurimo, V. Turunen, and I. Ekman, “Speech transcription and spoken document retrieval in Finnish in machine learning for multimodal interaction,” in Revised Selected Papers MLMI 2004 Workshop, vol. 3361, Lecture Notes in Computer Science, 2005, pp. 253–262.