Speech retrieval from unsegmented finnish audio using statistical morpheme-like units for segmentation, recognition, and retrieval

ACM Transactions on Speech and Language Processing

Volumn 8, Issue 1, 2011, Pages

  Turunen, Ville T ^a   Kurimo, Mikko ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Confusion networks; Lattices; Morphemes; Spoken document retrieval; Story segmentation; Subword indexing; Topic segmentation

Indexed keywords

CONFUSION NETWORKS; MORPHEMES; SPOKEN DOCUMENT RETRIEVAL; STORY SEGMENTATION; SUBWORDS; TOPIC SEGMENTATION;

COMPUTATIONAL LINGUISTICS; INFORMATION RETRIEVAL; NATURAL LANGUAGE PROCESSING SYSTEMS; QUERY PROCESSING; RADIO BROADCASTING;

SPEECH RECOGNITION;

EID: 80455130027     PISSN: 15504875     EISSN: 15504883     Source Type: Journal    
DOI: 10.1145/2036916.2036917     Document Type: Article

References (63)

1. AGIRRE, E., NUNZIO, G. M. D., FERRO, N.,MANDL, T., AND PETERS, C. 2008. CLEF 2008: Ad hoc track overview. In Working Notes for the CLEF Workshop.
2. ALKULA, R. 2001. From plain character strings to meaningful words: Producing better full text databases for inflectional and compounding languages with morphological analysis software. Inform. Retrieval 4, 195-208. (Pubitemid 33642148)
3. ARISOY, E., KURIMO, M., SARAĆLAR, M., HIRSIMÄKI, T., PYLKKÖNEN, J., ALUMÄE, T., AND SAK, H. 2008. Statistical language modeling for automatic speech recognition of agglutinative languages. In Speech Recognition, Technologies and Applications, F. Mihelic and J. Zibert, Eds., I-Tech, 193-204.
4. BEEFERMAN, D., BERGER, A., AND LAFFERTY, J. 1999. Statistical models for text segmentation. Machine Learn. 34, 1, 177-210.
5. BLEI, D. M. AND MORENO, P. J. 2001. Topic segmentation with an aspect hidden markov model. In Proceedings of SIGIR. ACM, New York, NY, 343-348. (Pubitemid 32951088)
6. CHELBA, C. AND ACERO, A. 2005. Position specific posterior lattices for indexing speech. In Proceedings of the Association for Computational Linguishes (ACL'05). ACL, 443-450.
7. CHELBA, C., SILVA, J., AND ACERO, A. 2007. Soft indexing of speech content for search in spoken documents. Comput. Speech Lang. 21, 3, 458-478. (Pubitemid 46367509)
8. CHIA, T. K., SIM, K. C., LI, H., AND NG, H. T. 2010. Statistical lattice-based spoken document retrieval. ACM Trans. Inf. Syst. 28, 1, 1-30.
9. CREUTZ, M., HIRSIMÄKI, T., KURIMO, M., PUURULA, A., PYLKKÖNEN, J., SIIVOLA, V., VARJOKALLIO, M., ARISOY, E., SARAĆLAR, M., AND STOLCKE, A. 2007. Morph-based speech recognition and modeling of out-of-vocabulary words across languages. ACM Trans. Speech Lang. Process. 5, 1, 1-29.
10. CREUTZ, M. AND LAGUS, K. 2005. Unsupervised morpheme segmentation and morphology induction from text corpora using Morfessor 1.0. Tech. rep. A81, Publications in Computer and Information Science, Helsinki University of Technology. http://www.cis.hut.fi/projects/morpho/.
11. CSC TIETEELLINEN LASKENTA OY. 2007. Finnish language text bank. http://www.csc.fi/kielipankki/.
12. GALLEY, M., MCKEOWN, K., FOSLER-LUSSIER, E., AND JING, H. 2003. Discourse segmentation of multi-party conversation. In Proceedings of the Association for Computational Linguishes (ACL'04). ACL, 562-569.
13. GAROFOLO, J. S., AUZANNE, C. G. P., AND VOORHEES, E. M. 2000. The TREC spoken document retrieval track: A success story. In Proceedings of the International Conference on Computer-Assisted Information Retrieval (RIAO). 1-20.
14. HACIOGLU, K., PELLOM, B., CILOGLU, T., OZTURK, O., KURIMO, M., AND CREUTZ, M. 2003. On lexicon creation for turkish LVCSR. In Proceedings of Interspeech. 1165-1168.
15. HEARST, M. A. 1997. TextTiling: segmenting text into multi-paragraph subtopic passages. Comput. Linguist. 23, 1, 33-64. (Pubitemid 127458657)
16. HIRSIMÄKI, T., CREUTZ, M., SIIVOLA, V., KURIMO, M., VIRPIOJA, S., AND PYLKKÖNEN, J. 2006. Unlimited vocabulary speech recognition with morph language models applied to Finnish. Computer Speech Lang. 20, 4, 515-541. (Pubitemid 44142005)
17. HIRSIMÄKI, T., PYLKKÖNEN, J., AND KURIMO, M. 2009. Importance of high-order n-gram models in morph-based speech recognition. IEEE Trans. Audio, Speech Lang. Proces. 17, 4, 724-732.
18. HORI, T.,HETHERINGTON, I. L.,HAZEN, T. J., AND GLASS, J. R. 2007. Open-vocabulary spoken utterance retrieval using confusion networks. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP).
19. HULL, D. A. 1993. Using statistical testing in the evaluation of retrieval experiments. In Proceedings of SIGIR. ACM Press, New York, NY, 329-338.
20. ISKRA, D., GROSSKOPF, B., MARASEK, K., VAN DEN HEUVEL, H., DIEHL, F., AND KIESSLING, A. 2002. SPEECON-speech databases for consumer devices: Database specification and validation. In Proceedings of the International Conference on Language Resources and Evaluation (LREC). 329-333.
21. JAMES, D. 1995. The application of classical information retrieval techniques to spoken documents. Ph.D. thesis, University of Cambridge, UK.
22. JAMES, D. A.,YOUNG, S., AND PZ,C. 1994. Afast lattice-based approach to vocabulary independentwordspotting. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 377-380.
23. JOHNSON, S. E., JOURLIN, P., JONES, K. S., AND WOODLAND, P. C. 2001. Information retrieval from unsegmented broadcast news audio. Int. J. Speech Technol. 4, 3, 251-268. (Pubitemid 32968804)
24. KAZEMIAN, S., RUDZICZ, F., PENN, G., AND MUNTEANU, C. 2008. A critical assessment of spoken utterance retrieval through approximate lattice representations. In Proceedings of the International Conference on Multimedia Information Retrieval (MIR'08). ACM, New York, NY, 83-88.
25. KEKÄLÄINEN, J. AND JÄRVELIN, K. 2002. Using graded relevance assessments in IR evaluation. J. Amer. Soc. Inf. Sci. Technol. 53, 13, 1120-1129. (Pubitemid 35359181)
26. KOSKENNIEMI, K. 1983. Two-level morphology: A general computational model for word-form recognition and production. Ph.D. thesis, Department of General Linguistics, University of Helsinki.
27. KOZIMA, H. 1993. Text segmentation based on similarity between words. In Proceedings of the Association for Computational Linguistier (ACL'93). 286-288.
28. KURIMO, M., CREUTZ, M., AND VARJOKALLIO, M. 2008. Morpho Challenge evaluation using a linguistic gold standard. In Proceedings of the 8th Workshop of the Cross-Language Evaluation Forum (CLEF'07). (Revised Selected Papers). Lecture Notes in Computer Science, Vol. 5152, Springer, Berlin, 864-873.
29. KURIMO, M. AND TURUNEN, V. 2005. To recover from speech recognition errors in spoken document retrieval. In Proceedings of Interspeech. 605-608. (Pubitemid 43908135)
30. KURIMO, M., TURUNEN, V., AND EKMAN, I. 2004. An evaluation of a spoken document retrieval baseline system in Finnish. In Proceedings of Interspeech.
31. KURIMO, M.,VIRPIOJA, S.,TURUNEN, V. T.,BLACKWOOD, G. W., AND BYRNE,W. 2010. Overview of Morpho Challenge 2009. In Proceedings of the 10thWorkshop of the Cross-Language Evaluation Forum (CLEF'09). (Revised Selected Papers). Lecture Notes in Computer Science. Springer, Berlin.
32. LINGSOFT, INC. 2007. FINTWOL: Finnish morphological analyser [computer software]. http://www.lingsoft.fi/.
33. LIU, B. AND OARD, D. W. 2006. One-sided measures for evaluating ranked retrieval effectiveness with spontaneous conversational speech. In Proceedings of SIGIR. ACM, New York, NY, 673-674.
34. LOGAN, B., MORENO, P., AND DESHMUKH, O. 2002. Word and sub-word indexing approaches for reducing the effects of OOV queries on spoken audio. In Proceedings of the Human Language Technology Conference (HLT'02).
35. LOGAN, B. AND THONG, J. V. 2002. Confusion-based query expansion for oov words in spoken document retrieval. In Proceedings of the International Conference on Spoken Language Processing (ICSLP).
36. MAMOU, J., CARMEL, D., AND HOORY, R. 2006. Spoken document retrieval from call-center conversations. In Proceedings of SIGIR. ACM Press, New York, NY, 51-58.
37. MANGU, L.,BRILL, E., AND STOLCKE, A. 2000. Finding consensus in speech recognition: word errorminimization and other applications of confusion networks. Comput. Speech Lang. 14, 373-400.
38. MULBREGT, P. V., CARP, I., GILLICK, L., LOWE, S., AND YAMRON, J. 1998. Text segmentation and topic tracking on broadcast news via a hidden markov model approach. In Proceedings of the International Conference on Spoken Language Processing (ICSLP). 2519-2522.
39. NG,K. 2000. Subword-based approaches for spoken document retrieval. Ph.D. thesis,Massachusetts Institute of Technology.
40. OGILVIE, P. AND CALLAN, J. 2002. Experiments using the lemur toolkit. In Proceedings of TREC. National Institute of Standards and Technology. 103-108.
41. PAN, Y. C., CHANG, H. L., AND LEE, L. S. 2007. Analytical comparison between position specific posterior lattices and confusion networks based on words and subword units for spoken document indexing. In Proceedings of the Workshop on Automatic Speech Recognition and Understanding (ASRU). 677-682.
42. PASSONNEAU, R. J. AND LITMAN, D. J. 1997. Discourse segmentation by human and automated means. Comput. Linguist. 23, 1, 103-139. (Pubitemid 127458659)
43. PECINA, P.,HOFFMANNOVÁ, P., JONES, G. J., ZHANG, Y., AND OARD, D. W. 2007. Overview of the CLEF-2007 Cross Language Speech Retrieval Track. In Working Notes for the CLEF'07 Workshop, A. Nardi and C. Peters, Eds.
44. PIRKOLA, A. 2001. Morphological typology of languages for IR. J. Document. 57, 3, 330-348. (Pubitemid 33259201)
45. PONTE, J. M. AND CROFT, W. B. 1998. A language modeling approach to information retrieval. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, New York, NY, 275-281.
46. RENALS, S. AND ELLIS, D. 2003. Audio information access from meeting rooms. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing, (ICASSP'03). 744-7.
47. SARAĆLAR, M. AND SPROAT, R. 2004. Lattice-based search for spoken utterance retrieval. In Proceedings of HTL-NAACL. 129-136.
48. SHRIBERG, E., STOLCKE, A., HAKKANI-TÜR, D., AND TÜR, G. 2000. Prosody-based automatic segmentation of speech into sentences and topics. Speech Comm. 32, 1-2, 127-154.
49. SIEGLER, M. A. 1999. Integration of continuous speech recognition and information retrieval for mutually optimal performance. Ph.D. thesis, Carnegie Mellon University.
50. SIIVOLA, V., CREUTZ, M., AND KURIMO, M. 2007. Morfessor and VariKN machine learning tools for speech and language technology. In Proceedings of Interspeech.
51. SIIVOLA, V. AND PELLOM, B. 2005. Growing an n-gram model. In Proceedings of Interspeech. 183-188.
52. SPINK, A.,BUILDING, R. I.,WOLFRAM, D., AND SARACEVIC, T. 2001. Searching the web: the public and their queries. J. Amer. Soc. Inform. Science Technol. 52, 52, 226-234.
53. STOKES, N. 2004. Select: a lexical cohesion based news story segmentation system. AI Comm. 17, 1, 3-12.
54. STOLCKE, A. 2002. SRILM-an extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing (ICSLP). 901-904.
55. TÜR, G., HAKKANI-TÜR, D., STOLCKE, A., AND SHRIBERG, E. 2001. Integrating prosodic and lexical cues for automatic topic segmentation. Computat. Ling. 27, 1, 31-57. (Pubitemid 33597441)
56. TURUNEN, V. T. 2008. Reducing the effect of OOV query words by using morph-based spoken document retrieval. In Proceedings of Interspeech. 2158-2161.
57. TURUNEN, V. T. AND KURIMO, M. 2006. Using latent semantic indexing for morph-based spoken document retrieval. In Proceedings of Interspeech. 341-344.
58. TURUNEN, V. T. ANDKURIMO,M. 2007. Indexing confusion networks formorph-based spoken document retrieval. In Proceedings of SIGIR. ACM, New York, NY, 631-638. (Pubitemid 350165013)
59. WOODLAND, P. C., JOHNSON, S. E., JOURLIN, P., AND SPÄRCK JONES, K. 2000. Effects of out of vocabulary words in spoken document retrieval. In Proceedings of SIGIR. 372-374.
60. XIE, L., ZENG, J., AND FENG, W. 2008. Multi-Scale TextTiling for automatic story segmentation in chinese broadcast news. In Information Retrieval Technology, Springer, Berlin, 345-355.
61. YU, P., CHEN, K., LU, L., AND SEIDE, F. 2005. Searching the audio notebook: keyword search in recorded conversations. In Proceedings of the Human Language Technology Conference (HLT'05). ACL, 947-954.
62. YU, P. AND SEIDE, F. 2004. A hybrid-word/phoneme-based approach for improved vocabulary-independent search in spontaneous speech. In Proceedings of Interspeech. 293-296.
63. ZHOU, Z., YU, P., CHELBA, C., AND SEIDE, F. 2006. Towards spoken-document retrieval for the internet: lattice indexing for large-scale web-search architectures. In Proceedings of HLT-NAACL. ACL, New York, New York, 415-422