Language identification in web documents using discrete HMMs

Pattern Recognition

Volumn 37, Issue 3, 2004, Pages 583-594

  Xafopoulos, A ^a   Kotropoulos, C ^a   Almpanidis, G ^a   Pitas, I ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Discrete hidden Markov models (DHMMs); Language tracking; Statistical language identification; Tourism domain; Web documents

Indexed keywords

COMPUTER PROGRAMMING LANGUAGES; HYPERTEXT SYSTEMS; MARKOV PROCESSES; WORLD WIDE WEB;

LANGUAGE IDENTIFICATION;

PATTERN RECOGNITION;

WORLD WIDE WEB;

EID: 0348108142     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2003.05.001     Document Type: Article

References (18)

1. P. Sibun, J. Reynar, Language identification: examining the issues, in: Proceedings of the 5th Annual Symposium on Document Analysis and Information Retrieval (SDAIR'96), Las Vegas, NV, 1996, pp. 125-135.
2. Muthusamy Y. Barnard E. Cole R. Reviewing automatic language identification IEEE Signal Process. Mag. 11 4 1994 33-41
3. M. Zissman, Automatic language identification using Gaussian mixture and hidden Markov models, in: Proceedings of IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP'93), Minneapolis, MN, Vol. 2, 1993, pp. 399-402.
4. G. Grefenstette, Comparing two language identification schemes, in: Proceedings of the Third International Conference on Statistical Analysis of Textual Data (JADT'95), Rome, Italy, 1995.
5. H. Combrinck, E. Botha, Text-based automatic language identification, in: Proceedings of the 6th Annual South African Workshop on Pattern Recognition, Gateng, South Africa, 1995.
6. W. Cavnar, J. Trenkle, N-gram-based text categorization, in: Proceedings of the Third Annual Symposium on Document Analysis and Information Retrieval (SDAIR'94), Las Vegas, NV, 1994, pp. 161-175.
7. J. Prager, Linguini: Language identification for multilingual documents, in: Proceedings of the 32nd Annual Hawaii International Conference on System Sciences (HICSS-32), Hawaii, HI, 1999.
8. Benedetto D. Caglioti E. Loreto V. Language trees and zipping APS Phys. Rev. Lett. 88 4 2002 048702
9. T. Dunning, Statistical identification of language, Technical Report CRL MCCS-94-273, New Mexico State University, Las Cruces, NM, 1994.
10. J. Häkkinen, J. Tian, N-gram and decision tree based language identification for written words, in: Proceedings of Automatic Speech Recognition and Understanding Workshop (ASRU'01), Trento, Italy, 2001.
11. Rabiner L. Juang B.-H. Fundamentals of Speech Recognition 1993 Prentice-Hall Englewood Cliffs, NJ
12. S. Young, D. Kershaw, J. Odell, D. Ollason, V. Valtchev, P. Woodland, The HTK Book (for HTK version 3.0), Microsoft Corporation, 2000.
13. G. Potamianos, H. Graf, Discriminative training of HMM stream exponents for audio-visual speech recognition, in: Proceedings of IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP'98), Seattle, WA, Vol. 6, 1998, pp. 3733-3736.
14. I. Rogina, A. Waibel, Learning state-dependent stream weights for multi-codebook HMM speech recognition systems, in: Proceedings of IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP'94), Vol. 1, 1994, pp. 217-220.
15. J. Hernando, Maximum likelihood weighting of dynamic speech features for CDHMM speech recognition, in: Proceedings of IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP'97), Munich, Germany, Vol. 2, 1997, pp. 1267-1270.
16. Y.-L. Chow, Maximum mutual information estimation of HMM parameters for continuous speech recognition using the N-best algorithm, in: Proceedings of IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP'90), Istanbul, Turkey, Vol. 2, 1990, pp. 701-704.
17. Jain A. Duin R. Mao J. Statistical pattern recognition: A review IEEE Trans. Pattern Anal. Mach. Intell. 22 1 2000 4-37
18. T. Ho, G. Nagy, Multiple classifier combination: Lessons and next steps, in: A. Kandel, H. Bunke (Eds.), Hybrid Methods in Pattern Recognition, World Scientific, Singapore, 2002.