Integrating recognition and retrieval with relevance feedback for spoken term detection

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 7, 2012, Pages 2095-2110

  Lee, Hung Yi ^a   Chen, Chia Ping ^a,b   Lee, Lin Shan ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b MEDIATEK INC   (Taiwan)

Author keywords

Relevance feedback; spoken term detection

Indexed keywords

ACOUSTIC MODEL; AUTOMATIC SPEECH RECOGNITION; CONTENT RETRIEVAL; PSEUDO RELEVANCE FEEDBACK; RELEVANCE FEEDBACK; RETRIEVAL TECHNIQUES; TEXT INFORMATION RETRIEVALS; TEXT RETRIEVAL; TEXT SYMBOLS; USER RELEVANCE FEEDBACKS;

IMAGE RETRIEVAL;

SEARCH ENGINES;

EID: 84862297277     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2196514     Document Type: Article

References (74)

1. L.-S. Lee and B.-L. Chen, "Spoken document understanding and or ganization," IEEE Signal Process. Mag., vol. 22, no. 5, pp. 42-60, Sep. 2005.
2. C. Chelba, T. Hazen, and M. Saraclar, "Retrieval and browsing of spoken content," IEEE Signal Process. Mag., vol. 25, no. 3, pp. 39-49, May 2008. (Pubitemid 351695639)
3. M. Saraclar and R. Sproat, "Lattice-based search for spoken utterance," in Proc. HLT, 2004.
4. C. Chelba, J. Silva, and A. Acero, "Soft indexing of speech content for search in spoken documents," Comput. Speech Lang., vol. 21, pp. 458-478, 2007. (Pubitemid 46367509)
5. C. Chelba and A. Acero, "Position specific posterior lattices for indexing speech," in Proc. ACL, 2005.
6. H.-L. C. Y.-C. Pan and L.-S. Lee, "Analytical comparison between position specific posterior lattices and confusion networks based on words and subword units for spoken document indexing," in Proc. ASRU, 2007.
7. T. Hori, I. Hetherington, T. Hazen, and J. Glass, "Open vocabulary spoken utterance retrieval using confusion networks," in Proc. ICASSP, 2007, pp. 73-76.
8. B. Logan, P. Moreno, J.-M. van Thong, and E. Whittaker, "An experimental study of an audio indexing system for the web," in Proc. ICSLP, 2000.
9. Y.-C. Pan, H.-L. Chang, and L.-S. Lee, "Subword-based position specific posterior lattices (S-PSPL) for indexing speech information," in Proc. Interspeech, 2007.
10. B. Logan, J.-M. Van Thong, and P. Moreno, "Approaches to reduce the effects of OOV queries on indexed spoken audio," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 899-906, Oct. 2005. (Pubitemid 41452518)
11. R. Wallace, R. Vogt, and S. Sridharan, "A phonetic search approach to the 2006 NIST spoken term detection evaluation," in Proc. Interspeech, 2007.
12. V. T. Turunen, "Reducing the effect of OOV query words by using morph-based spoken document retrieval," in Proc. Interspeech, 2008.
13. D. Wang, J. Frankel, J. Tejedor, and S. King, "A comparison of phone and grapheme-based spoken term detection," in Proc. ICASSP, 2008, pp. 4969-4972.
14. Y. Itoh, K. Iwata, K. Kojima, M. Ishigame, K. Tanaka, and S. w. Lee, "An integration method of retrieval results using plural subword models for vocabulary-free spoken document retrieval," in Proc. Interspeech, 2007.
15. A. Garcia and H. Gish, "Keyword spotting of arbitrary words using minimal speech resources," in Proc. ICASSP, 2006, pp. 949-952.
16. S. w. Lee, K. Tanaka, and Y. Itoh, "Combining multiple subword representations for open-vocabulary spoken document retrieval," in Proc. ICASSP, 2005, pp. 505-508.
17. S. Meng, P. Yu, J. Liu, and F. Seide, "Fusing multiple systems into a compact lattice index for Chinese spoken term detection," in ICASSP, 2008, pp. 4345-4348.
18. Y. c. Pan, H. l. Chang, and L. s. Lee, "Type-II dialogue systems for information access from unstructured knowledge sources," in Proc. ASRU, 2007.
19. S.-Y. Kong, M.-R. Wu, C.-K. Lin, Y.-S. Fu, and L.-S. Lee, "Learning on demand-Course lecture distillation by information extraction," in Proc. ICASSP, 2009, pp. 4709-4712.
20. J. Glass, T. Hazen, S. Cyphers, I. Malioutov, D. Huynh, and R. Barzilay, "Recent progress in the MIT spoken lecture processing project," in Proc. Interspeech, 2007.
21. M. Goto, J. Ogata, and K. Eto, "Podcastle: A web 2.0 approach to speech recognition research," in Proc. Interspeech, 2007.
22. C. Alberti, M. Bacchiani, A. Bezman, C. Chelba, A. Drofa, H. Liao, P. Moreno, T. Power, A. Sahuguet, M. Shugrina, and O. Siohan, "An audio indexing system for election video material," in Proc. ICASSP, 2009, pp. 4873-4876.
23. R. Wallace, R. Vogt, B. Baker, and S. Sridharan, "Optimising figure of merit for phonetic spoken term detection," in Proc. ICASSP, 2010, pp. 5298-5301.
24. S. Srinivasan and D. Petkovic, "Phonetic confusion matrix based spoken document retrieval," in Proc. SIGIR, 2000.
25. H. Nanjo and T. Kawahara, "A new ASR evaluation measure and minimum Bayes-risk decoding for open-domain speech understanding," in Proc. ICASSP, 2005, pp. 1053-1056.
26. T. Shichiri, H. Nanjo, and T. Yoshimi, "Minimum Bayes-risk decoding with presumed word significance for speech based information retrieval," in Proc. ICASSP, 2008, pp. 1557-1560.
27. Q. Fu and B.-H. Juang, "Automatic speech recognition based on weighted minimum classification error (W-MCE) training method," in Proc. ASRU, 2007.
28. B.-H. Juang, W. Chou, and C.-H. Lee, "Minimum classification error rate methods for speech recognition," IEEE Trans. Speech Audio Process., vol. 5, no. 3, pp. 257-265, May 1997. (Pubitemid 127745998)
29. J. Shao, R.-P. Yu, Q. Zhao, Y. Yan, and F. Seide, "Towards vocabulary-independent speech indexing for large-scale repositories," in Proc. Interspeech, 2008.
30. J. J. Rocchio, "Relevance feedback in information retrieval," in The SMART System Experiments in Automatic Document Processing. En-glewood Cliffs, NJ: Printice-Hall, 1971.
31. I. Ruthven and M. Lalmas, "A survey on the use of relevance feedback for information access systems," Knowl. Eng. Rev., pp. 95-145, 2003.
32. S. E. Robertson and K. S. Jones, "Relevance weighting of search terms," J. Amer. Soc. Inf. Sci., pp. 129-146, 1976.
33. C. Zhai and J. Lafferty, "Model-based feedback in the language modeling approach to information retrieval," in Proc. 10th Int. Conf. Inf. Knowl. Manage. CIKM '01, New York, 2001, pp. 403-410. (Pubitemid 34974657)
34. P. Hong, Q. Tian, and T. Huang, "Incorporate support vector machines to content-based image retrieval with relevance feedback," in Proc. Int. Conf. Image Process., 2000.
35. S. MacArthur, C. Brodley, and C.-R. Shyu, "Relevance feedback decision trees in content-based image retrieval," in Proc. IEEE Workshop Content-Based Access of Image and Video Libraries, 2000.
36. J. Xin and J. Jin, "Learning from user feedback for image retrieval," in Proc. Joint Conf. 4th Int. Conf. Inf. Commun. Signal Process. and 4th Pacific Rim Conf. Multimedia, 2003.
37. N. Vasconcelos and A. Lippman, "Bayesian relevance feedback for content-based image retrieval," in Proc. IEEE Workshop Content-Based Access of Image and Video Libraries, 2000.
38. R. Yan, A. Hauptmann, and R. Jin, "Negative pseudo-relevance feedback in content-based video retrieval," in Proc. 11th ACM Int. Conf. Multimedia, 2003.
39. R. Yan, A. Hauptmann, and R. Jin, "Multimedia search with pseudo-relevance feedback," in Proc. CIVR, 2003.
40. B. Yang, T. Mei, X.-S. Hua, L. Yang, S.-Q. Yang, and M. Li, "Online video recommendation based on multimodal fusion and relevance feedback," in Proc. 6th ACM Int. Conf. Image Video Retrieval, 2007.
41. H.-Y. Lee, C.-P. Chen, C.-F. Yeh, and L.-S. Lee, "Improved spoken term detection by discriminative training of acoustic models based on user relevance feedback," in Proc. Interspeech, 2010.
42. H.-Y. Lee and L.-S. Lee, "Integrating recognition and retrieval with user feedback: A new framework for spoken term detection," in Proc. ICASSP, 2010, pp. 5290-5293.
43. C.-P. Chen, H.-Y. Lee, C.-F. Yeh, and L.-S. Lee, "Improved spoken term detection by feature space pseudo-relevance feedback," in Proc. Interspeech, 2010.
44. C. Parada, A. Sethy, and B. Ramabhadran, "Query-by-example spoken term detection for OOV terms," in Proc. IEEE Workshop Autom. Speech Recogn. Understanding ASRU'09, 2009.
45. H.-Y. Lee, C.-P. Chen, C.-F. Yeh, and L.-S. Lee, "A framework integrating different relevance feedback scenarios and approaches for spoken term detection," in Proc. SLT, 2010.
46. D. Kelly and J. Teevan, SIGIR Forum, vol. 37, pp. 18-28, 2003.
47. J. Thorsten, "Optimizing search engines using clickthrough data," in Proc. KDD, 2002.
48. D. Kelly and N. J. Belkin, "Display time as implicit feedback: Understanding task effects," in Proc. 27th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retriev., 2004.
49. X. Shen, B. Tan, and C. Zhia, "Context sensitive information retrieval using implicit feedback," in Proc. SIGIR, 2005.
50. X. S. Zhou and T. S. Huang, "Relevance feedback in image retrieval: A comprehensive review," Multimedia Syst., vol. 8, pp. 536-544, 2003.
51. T. J. Hazen, W. Shen, and C. White, "Query-by-example spoken term detection using phonetic posteriorgram templetes," in Proc. ASRU, 2009.
52. S. Yu, D. Cai, J.-R. Wen, and W.-Y. Ma, "Improving pseudo-relevance feedback in web information retrieval using web page segmentation," in Proc. 12th Int. Conf. World Wide Web, 2003.
53. J. Xu and W. B. Croft, "Query expansion using local and global document analysis," in Proc. 19th Annu. Int. ACM SIGIR Conf. Research Develop. Inf. Retrieval, 1996.
54. V. Lavrenko and W. B. Croft, "Relevance based language models," in Proc. 24th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retriev., 2001.
55. O. Kurland, L. Lee, and C. Domshlak, "Better than the real thing?: Iterative pseudo-query processing using cluster-based language models," in Proc. 28th Ann. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2005.
56. T. Tao and C. Zhai, "Regularized estimation of mixture models for robust pseudo-relevance feedback," in Proc. 29th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retriev., 2006.
57. G. Cao, J.-Y. Nie, J. Gao, and S. Robertson, "Selecting good expansion terms for pseudo-relevance feedback," in Proc. 31st Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2008.
58. K. S. Lee, W. B. Croft, and J. Allan, "A cluster-based resampling method for pseudo-relevance feedback," in Proc. 31st Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2008.
59. Y. Lv and C. Zhai, "A comparative study of methods for estimating query language models with pseudo feedback," in Proc. 18th ACM Conf. Inf. Knowl. Manage., 2009.
60. Y. Lv and C. Zhai, "Positional relevance model for pseudo-relevance feedback," in Proc. 33rd Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2010.
61. W.-H. Lin, R. Jin, and A. Hauptmann, "Web image retrieval re-ranking with relevance model," in Proc. IEEE/WIC Int. Conf. Web Intell. WI '03., 2003, pp. 242-248.
62. D. R. H. Miller, M. Kleber, C. l. Kao, O. Kimball, T. Colthurst, S. A. Lowe, R. M. Schwartz, and H. Gish, "Rapid and accurate spoken term detection," in Proc. Interspeech, 2007.
63. D. Vergyri, I. Shafran, A. Stolcke, R. R. Gadde, M. Akbacak, B. Roark, and W. Wang, "The SRI/OGI 2006 spoken term detection system," in Proc. Interspeech, 2007.
64. J. Mamou, B. Ramabhadran, and O. Siohan, "Vocabulary independent spoken term detection," in Proc. 30th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retriev., 2007.
65. P. Yu, K. Chen, L. Lu, and F. Seide, "Searching the audio notebook: Keyword search in recorded conversations," in Proc. Conf. Human Lang. Technol. Empir. Methods Natural Lang. Process., 2005.
66. C. Chelba and A. Acero, "Position specific posterior lattices for indexing speech," in Proc. 43rd Annu. Meeting Assoc. Comput. Linguist., 2005.
67. S. Parlak and M. Saraclar, "Spoken term detection for Turkish broadcast news," in Proc. ICASSP, 2008, pp. 5244-5247.
68. Y. Zhang and J. Glass, "Towards multi-speaker unsupervised speech pattern discovery," in Proc. ICASSP, 2010, pp. 4366-4369.
69. Y. Zhang and J. Glass, "Unsupervised spoken keyword spotting via segmental Dtw on Gaussian posteriorgrams," in Proc. ASRU, 2009.
70. J. Ogata and M. Goto, "Podcastle: Collaborative training of acoustic models on the basis of wisdom of crowds for podcast transcription," in Proc. Interspeech, 2009.
71. J. S. Garofolo, C. G. P. Auzanne, and E. M. Voorhees, "The TREC spoken document retrieval track: A success story," in Proc. Text Retrieval Conf. (TREC), 2000, vol. 8.
72. J.-T. Chien and M.-S. Wu, "Minimum rank error language modeling," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 2, pp. 267-276, Feb. 2009.
73. D. Povey, "Discriminative training for large vocabulary speech recognition," Ph.D. dissertation, Cambridge Univ., Cambridge, U.K., 2003.
74. B.-Y. Liang, "Acoustic models for continuous mandarin speech recognition," M.S. thesis, National Taiwan Univ., Taipei, Taiwan, 1998.