Web text data mining for building large scale language modelling corpus

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6836 LNAI, Issue , 2011, Pages 356-363

  Švec, Jan ^a   Hoidekr, Jan ^a   Soutner, Daniel ^a   Vavruška, Jan ^a  

^a UNIVERSITY OF WEST BOHEMIA   (Czech Republic)

Author keywords

duplicity detection; Internet; language modelling; topic identification

Indexed keywords

DETECTION ALGORITHM; DUPLICITY DETECTION; LANGUAGE MODELLING; TEXT CORPORA; TEXT PREPROCESSING; TOPIC IDENTIFICATION; WEB TEXT DATA;

INTERNET; TELECOMMUNICATION NETWORKS; USER INTERFACES;

ALGORITHMS;

EID: 80052762570     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-23538-2_45     Document Type: Conference Paper

References (11)

1. Müller, L., Psutka, J., Šmídl, L.: Design of speech recognition engine. In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2000. LNCS (LNAI), vol. 1902, pp. 259-264. Springer, Heidelberg (2000)
2. Seymore, K., Rosenfeld, R.: Using story topics for language model adaptation. In: Proc. Eurospeech, vol. 97, pp. 1987-1990 (1997)
3. Bulyko, I., Ostendorf, M., Siu,M., Ng, T., Stolcke, A., Çetin, O.:Web resources for language modeling in conversational speech recognition. ACM Trans. Speech Lang. Process. 5 (2007)
4. Matoušek, J., Romportl, J.: Recording and annotation of speech corpus for Czech unit selection speech synthesis. In: Matoušek, V., Mautner, P. (eds.) TSD 2007. LNCS (LNAI), vol. 4629, pp. 326-333. Springer, Heidelberg (2007)
5. Spoustová, D., Spousta, M., Pecina, P.: Building a Web Corpus of Czech. In: Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC 2010), Valletta, Malta (2010)
6. Trmal, J., Pražák, A., Loose, Z., Psutka, J.: Online TV Captioning of Czech Parliamentary Sessions. In: Sojka, P., Horák, A., Kopeček, I., Pala, K. (eds.) TSD 2010. LNCS, vol. 6231, pp. 416-422. Springer, Heidelberg (2010)
7. Zelinka, J., Kanis, J., Müller, L.: Automatic transcription of numerals in inflectional languages. In:Matoušek, V.,Mautner, P., Pavelka, T. (eds.) TSD2005. LNCS (LNAI), vol. 3658, pp. 326-333. Springer, Heidelberg (2005)
8. Broder, A.Z., Glassman, S.C., Manasse, M.S., Zweig, G.: Syntactic clustering of the web. Computer Networks and ISDN Systems 29(8-13), 1157-1166 (1997)
9. Malkin,M., Venkatesan, R.: Comparison of texts streams in the presence of mild adversaries. In: Proceedings of the 2005 Australasian Workshop on Grid Computing and e-research, ACSWFrontiers 2005, vol. 44, pp. 179-186. Australian Computer Society, Inc. (2005)
10. Skorkovská, L., Ircing, P., Pražák, A., Lehečka, J.: Automatic topic identification for large scale language modeling data filtering. In: Habernal, I., Matoušek, V. (eds.) TDS 2011. LNCS(LNAI), vol. 6836, pp. 64-71. Springer, Heidelberg (2011)
11. Kilgarriff, A.: Comparing corpora. International journal of corpus linguistics 6(1), 97-133 (2001)