Interactive spoken document retrieval with suggested key terms ranked by a Markov decision process

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 2, 2012, Pages 632-645

  Pan, Yi Cheng ^a   Lee, Hung Yi ^b   Lee, Lin Shan ^b  

^a MEDIATEK INC   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

dialogue system; Spoken document retrieval (SDR)

Indexed keywords

CRUCIAL TECHNOLOGY; DIALOGUE SYSTEMS; INFORMATION NEED; MARKOV DECISION PROCESSES; MULTIMEDIA ACCESS; PROTOTYPE SYSTEM; RECOGNITION ERROR; RETRIEVAL PROCESS; SPOKEN DIALOGUE SYSTEM; SPOKEN DOCUMENT RETRIEVAL; STATE TRANSITIONS; TEXT INFORMATION RETRIEVALS;

CHARACTER RECOGNITION; MARKOV PROCESSES; REINFORCEMENT LEARNING; SPEECH PROCESSING;

INFORMATION RETRIEVAL;

EID: 84255161628     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2163512     Document Type: Article

References (49)

1. L. S. Lee and B. L. Chen, "Spoken document understanding and organization," IEEE Signal Process. Mag., vol. 22, no. 5, pp. 42-60, Sep. 2005.
2. C. Chelba, T. Hazen, and M. Saraclar, "Retrieval and browsing of spoken content," Signal Process. Mag., vol. 25, no. 3, pp. 39-49, May 2008. (Pubitemid 351695639)
3. S.-Y. Kong, M.-R. Wu, C.-K. Lin, Y.-S. Fu, and L.-S. Lee, "Learning on demand-Course lecture distillation by information extraction," in Proc. ICASSP, 2009, pp. 4709-4712.
4. J. Glass, T. Hazen, S. Cyphers, I. Malioutov, D. Huynh, and R. Barzilay, "Recent progress in the MIT spoken lecture processing project," in Proc. Interspeech, 2007, pp. 2553-2556.
5. J. Kilgour, J. Carletta, and S. Renals, "The ambient spotlight: Queryless desktop search from meeting speech," in Proc. SSCS, 2010, pp. 49-52.
6. S. Whittaker, J. Hirschberg, B. Amento, L. Stark, M. Bacchiani, P. Isen-hour, L. Stead, G. Zamchick, and A. Rosenberg, "Scanmail: A voice-mail interface that makes speech browsable, readable and searchable," in Proc. CHI, 2002, pp. 275-282.
7. M. Goto, J. Ogata, and K. Eto, "Podcastle: A web 2.0 approach to speech recognition research," in Proc. Interspeech, 2007, pp. 2397-2400.
8. C. Alberti, M. Bacchiani, A. Bezman, C. Chelba, A. Drofa, H. Liao, P. Moreno, T. Power, A. Sahuguet, M. Shugrina, and O. Siohan, "An audio indexing system for election video material," in Proc. ICASSP, 2009, pp. 4873-4876.
9. J.-M. Van Thong, P. Moreno, B. Logan, B. Fidler, K. Maffey, and M. Moores, "Speechbot: An experimental speech-based search engine for multimedia content on the web," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 88-96, Mar. 2002. (Pubitemid 34291531)
10. J. Hansen, R. Huang, B. Zhou, M. Seadle, J. Deller, A. Gurijala, M. Kurimo, and P. Angkititrakul, "Speechfind: Advances in spoken document retrieval for a national gallery of the spoken word," IEEE Trans. Speech Audio Process., vol. 5, no. 1, pp. 712-730, Jan. 2005.
11. S. W. Lee, K. Tanaka, and Y. Itoh, "Combining multiple subword representations for open-vocabulary spoken document retrieval," in Proc. ICASSP, 2005, pp. 505-508.
12. S. Meng, P. Yu, J. Liu, and F. Seide, "Fusing multiple systems into a compact lattice index for Chinese spoken term detection," in Proc. ICASSP, 2008, pp. 4345-4548.
13. M. Saraclar and R. Sproat, "Lattice-based search for spoken utterance," in Proc. HLT, 2004.
14. H. L. Chang, Y. C. Pan, and L. S. Lee, "Latent semantic retrieval of spoken documents over position specific posterior lattices," in Proc. SLT, 2008, pp. 285-288.
15. Y. C. Hsieh, Y. T. Huang, C. C. Wang, and L. S. Lee, "Improved spoken document retrieval with dynamic key term lexicon and probabilistic latent semantic analysis (PLSA)," in Proc. ICASSP, 2006, pp. 961-964.
16. L. Molgaard, K. Jorgensen, and L. Hansen, "Castsearch-Context based spoken document retrieval," in Proc. ICASSP, 2007, pp. 93-96.
17. I. Ruthven, Interactive Information Retrieval. New York: Wiley, 2008, vol. 42, no. 1.
18. J. Lu, Z. Xie, R. Li, Y. Zhang, and J. Wang, "A framework of CBIR system based on relevance feedback," in Proc. 2007 Workshop Intell. Inf. Technol. Applicat., 2009, pp. 175-178.
19. J. Cui, F. Wen, and X. Tang, "IntentSearch: Interactive on-line image search re-ranking," in Proc. MM'08: 16th ACM Int. Conf. Multimedia, 2008, pp. 997-998.
20. C. G. M. Snoek, M. Worring, D. C. Koelma, and A. W. M. Smeulders, "A learned lexicon-driven paradigm for interactive video retrieval," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 280-292, Feb. 2007. (Pubitemid 46183099)
21. A. Diriye, S. Zagorac, S. Little, and S. Rüger, "NewsRoom: An information-seeking support system for news videos," in Proc. Int. Conf. Multimedia Inf. Retrieval MIR'10, 2010, pp. 377-380.
22. G. Geisler, G. Marchionini, B. M. Wildemuth, A. Hughes, M. Yang, T. Wilkens, and R. Spinks, "Video browsing interfaces for the open video project," in Proc. CHI'02: CHI'02 Extended Abstracts on Human Factors in Comput. Syst., 2002, pp. 514-515.
23. T. Misu and T. Kawahara, "Bayes risk-based dialogue management for document retrieval system with speech interface," , vol. 52, no. 1, pp. 61-71, 2010.
24. T. Kawahara, "New perspectives on spoken language understanding: Does machine need to fully understand speech?," in Proc. ASRU, 2009, pp. 46-50.
25. N. Gupta, G. Tur, D. Hakkani-Tür, S. Bangalore, G. Riccardi, and M. Gilbert, "The AT&T spoken language understanding system," IEEE Trans. Speech Audio Process., vol. 14, no. 1, pp. 213-222, Jan. 2006.
26. S. Young, "Talking to machines (statistically speaking)," in Proc. ICSLP, 2002, pp. 9-16.
27. Y.-Y. Wang, L. Deng, and A. Acero, "Spoken language understanding," IEEE Signal Process. Mag., vol. 22, no. 5, pp. 16-31, Sep. 2005. (Pubitemid 41488518)
28. J. Williams and S. Young, "Partially observable Markov decision processes for spoken dialogue systems," Comput. Speech Lang., vol. 21, no. 2, pp. 393-242, 2007.
29. E. Levin, R. Pieraccini, and W. Eckert, "A stochastic model of human-machine interaction for learning dialogue strategies," IEEE Trans. Speech Audio Process., vol. 8, no. 1, pp. 11-23, Jan. 2000. (Pubitemid 30540744)
30. Y. C. Pan, C. C. Wang, Y. C. Hsieh,T. H. Lee, Y. S. Lee, Y. S. Fu, Y. T. Huang, and L. S. Lee, "A multi-modal dialogue system for information navigation and retrieval across spoken document archives with topic hierarchies," in Proc. ASRU, 2005, pp. 375-380.
31. Y. C. Pan, J. Y. Chen, Y. S. Lee, Y. S. Fu, and L. S. Lee, "Efficient interactive retrieval of spoken documents with key terms ranked by reinforcement learning," in Proc. Interspeech, 2006, pp. 1577-1580.
32. Y. C. Pan and L. S. Lee, "Simulation analysis for interactive retrieval of spoken documents," in Proc. SLT, 2006.
33. Y. C. Pan, H. L. Chang, and L. S. Lee, "Type-II dialogue systems for information access from unstructured knowledge sources," in Proc. ASRU, 2007, pp. 544-549.
34. B. Billerbeck, "Efficient query expansion," Ph.D. dissertation, RMIT Univ., Melbourne, Australia, 2005.
35. C.-K. Huang, L.-F. Chien, and Y.-J. Oyang, "Relevant term suggestion in interactive web search based on contextual information in query session logs," J. Amer. Soc. Inf. Sci. Technol., pp. 638-649, 2003.
36. M. Magennis and C. van Rijsbergen, "The potential and actual effectiveness of interactive query expansion," in Proc. SIGIR, 1997, pp. 324-332. (Pubitemid 127720333)
37. I. Ruthven, "Re-examining the potential effectiveness of interactive query expansion," in Proc. SIGIR, 2003, pp. 213-220.
38. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
39. S.-C. Chen and L.-S. Lee, "Automatic title generation for Chinese spoken documents using an adaptive k nearest-neighbor approach," in Proc. Eurospeech, 2003, pp. 2813-2816.
40. L. S. Lee, Y. Ho, J. F. Chen, and S. C. Chen, "Why is the special structure of the language important for Chinese spoken language pro-cessing?-Examples on spoken document retrieval, segmentation and summarization," in Proc. Eurospeech, 2003, pp. 49-52.
41. S.L. Chuang and L. F. Chien, "Taxonomy generation for text segments: A practical web-based approach," ACM Trans. Inf. Syst., vol. 23, no. 4, pp. 363-396, 2005.
42. Y.-N. Chen, Y. Huang, S.-Y. Kong, and L.-S. Lee, "Automatic key term extraction from spoken course lectures using branching entropy and prosodic/semantic features," in Proc. SLT, 2010.
43. F. Liu, D. Pennell, F. Liu, and Y. Liu, "Unsupervised approaches for automatic keyword extraction using meeting transcripts," in Proc. NAACL, 2009, pp. 620-628.
44. T. Hofmann, "Probabilistic latent semantic indexing," in Proc. SIGIR, 1999, pp. 50-57.
45. R. V. Hogg and A. T. Craig, Introduction to Mathematical Statistics, 4th ed. New York: Macmillan, 1978.
46. H. Cui, J.-R. Wen, J.-Y. Nie, and W.-Y. Ma, "Query expansion by mining user logs," IEEE Trans. Knowl. Data Eng., vol. 15, no. 4, pp. 829-839, Jul.-Aug. 2003.
47. S. E. Robertson, "On term selection for query expansion," J. Docu-mentat., vol. 46, pp. 129-146, 1990.
48. J. Xu and W. B. Croft, "Improving the effectiveness of information retrieval with local context analysis," ACM Trans. Inf. Syst. (TOIS), vol. 18, no. 1, pp. 79-112, 2000.
49. S. Yu, D. Cai, J.-R. Wen, and W.-Y. Ma, "Improving pseudo-relevance feedbackin web information retrieval using web page segmentation," in Proc. 12th Int. Conf. World Wide Web (WWW'03), Budapest, Hungary, 2003, pp. 11-18.