Long distance bigram models applied to word clustering

Pattern Recognition

Volumn 44, Issue 1, 2011, Pages 145-158

  Bassiou, Nikoletta ^a   Kotropoulos, Constantine ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Cluster dispersion; Cluster sense precision; Cluster sense recall; Distance bigrams; Language modeling; Probabilistic latent semantic analysis; Relative cluster validity indices; Spectral clustering; Trigger pairs; Word clustering; WordNet

Indexed keywords

BIGRAMS; CLUSTER DISPERSION; CLUSTER SENSE PRECISION; CLUSTER SENSE RECALL; CLUSTER VALIDITY INDICES; LANGUAGE MODELING; PROBABILISTIC LATENT SEMANTIC ANALYSIS; SPECTRAL CLUSTERING; TRIGGER-PAIRS; WORD CLUSTERING; WORDNET;

CLUSTER ANALYSIS; COMPUTATIONAL LINGUISTICS; DISPERSIONS; MERGING; ONTOLOGY; QUERY LANGUAGES; SEMANTIC WEB; SEMANTICS;

CLUSTERING ALGORITHMS;

EID: 77956479325     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.07.006     Document Type: Article

References (46)

1. A.K. Jain, M.N. Murty, and P.J. Flynn Data clustering: a review ACM Computing Surveys 31 1999 264 323
2. J.T. Goodman A bit of progress in language modeling Computer Speech and Language 15 2001 403 434
3. H. Yamamoto, S. Isogai, and Y. Sagisaka Multi-class composite N-gram language model Elsevier Speech Communication 41 2003 369 379
4. R. Rosenfeld, Adaptive statistical language modeling: a maximum entropy approach, Ph.D. Thesis, Carnegie Mellon University, School of Computer Science, Pittsburgh, PA, 1994.
5. X. Huang, F. Alleva, H.-W. Hon, M.-Y. Hwang, K.-F. Lee, and R. Rosenfeld The SPHINX-II speech recognition system: an overview Computer Speech and Language 2 1993 137 148
6. M. Simons, H. Ney, S.C. Martin, Distant bigram language modeling using maximum entropy, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 1997, pp. 787790.
7. D. Klakow, Log-linear interpolation of language models, in: Proceedings of the IEEE International Conference on Spoken Language Processing, 1998, pp. 16951698.
8. C. Beccetti, and L.P. Ricotti Speech Recognition Systems: Theory and C Implementation second ed. 1999 Wiley Chichester, England
9. T. Hofmann Unsupervised learning by probabilistic latent semantic analysis Machine Learning 42 2001 177 196
10. N. Bassiou, C. Kotropoulos, Interpolated distanced bigram language models for robust word clustering, in: Proceedings of the Nonlinear Signal and Image Processing, Sapporo, Japan, 2005, pp. 1215.
11. D. Graff, J. Kong, K. Chen, and K. Maeda English Gigaword second ed. 2005 Linguistic Data Consortium Pennsylvania
12. C. Fellbaum WordNet: An Electronic Lexical Database 1998 MIT Press Cambridge, MA
13. Y.C. Park, and K.S. Choi Automatic thesaurus construction using Bayesian networks Information Processing Management 32 1996 543 553
14. V.J. Hodge, and J. Austin Hierarchical word clusteringautomatic thesaurus generation Neurocomputing 48 2002 819 846
15. G. Grefenstette Explorations in Automatic Thesaurus Discovery first ed. 1994 Kluwer Academic Publishers Dordrecht, The Netherlands
16. D. Lin, and P. Pantel Induction of semantic classes from natural language text Proceedings of the Seventh ACM International Conference on Knowledge Discovery and Data Mining 2001 ACM Press New York 317 322
17. D. Yarowsky, Unsupervised word sense disambiguation rivaling supervised methods, in: Proceedings of the 33rd Annual Meeting Association for Computational Linguistics, 1995, pp. 189196.
18. D. Lin, Using syntactic dependency as local context to resolve word sense ambiguity, in: Proceedings of the 35th Annual Meeting Association for Computational Linguistics, 1997, pp. 6471.
19. T. Pedersen, A simple approach to building ensembles of Naive Bayesian classifiers for word sense disambiguation, in: Proceedings of the Conference on Applied Natural Language Processing, Seattle, WA, 2000, pp. 6369.
20. P. Pantel, and D. Lin Discovering word senses from text Proceedings of the Eighth ACM International Conference on Knowledge Discovery and Data Mining 2002 ACM Press New York 613 619
21. H. Li Word clustering and disambiguation based on co-occurrence data Natural Language Engineering 8 2002 25 42
22. S. Bordag Word sense induction: triplet-based clustering and automatic Proceedings of the 11th Conference on European Chapter of the Association for Computational Linguistics, The Association for Computer Linguistics 2006
23. S. Brody, M. Lapata, Bayesian word sense induction, in: Proceedings of the 11th Conference on European Chapter of the Association for Computational Linguistics, Athens, Greece, 2009, pp. 103111.
24. P.F. Brown, V.J.D. Pietra, P.V. deSouza, J.C. Lai, and R.L. Mercer Class-based n-gram models of natural language Computational Linguistics 18 1992 467 479
25. J. McMahon, and F. Smith Improving statistical language model performance with automatically generated word hierarchies Computational Linguistics 22 1996 217 247
26. S. Martin, J. Liermann, and H. Ney Algorithms for bigram and trigram word clustering Speech Communication 24 1998 19 37
27. J. Uszkoreit, T. Brants, Distributed word clustering for large scale class-based language modeling in machine translation, in: Proceedings of the 46th Annual Meeting Association for Computational Linguistics: Human Language Technologies, 2008, pp. 755762.
28. A. Emami, F. Jelinek, Random clusterings for language modeling, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Process, vol. 1, 2005, pp. 581584.
29. J. Gao, J.T. Goodman, G. Cao, H. Li, Exploring asymmetric clustering for statistical language modeling, in: Proceedings of the 40th Annual Meeting Association for Computational Linguistics, 2002, pp. 183190.
30. J.R. Bellegarda A multispan language modeling framework for large vocabulary speech recognition IEEE Transactions on Speech Audio Processing 6 1998 456 467
31. L.D. Baker, and A.K. McCallum Distributional clustering of words for text classification W.B. Croft, A. Moffat, C.J. van Rijsbergen, R. Wilkinson, J. Zobel, Proceedings of the 21st ACM International Conference on Research and Development Information Retrieval 1998 ACM Press New York 96 103
32. C. Wenliang, C. Xingzhi, W. Huizhen, Z. Jingbo, and Y. Tianshun Automatic word clustering for text categorization using global information Information Retrieval Technology, Lecture Notes in Computer Science vol. 3411 2005 Springer Berlin 1 11
33. N. Slonim, N. Tishby, The power of word clusters for text classification, in: Proceedings of the 23rd European Colloquium on Information Retrieval Research, 2001.
34. F. Pereira, N. Tishby, L. Lee, Distributional clustering of English words, in: Proceedings of the Annual Meeting Association for Computational Linguistics, 1993, pp. 183190.
35. I.S. Dhillon, S. Mallela, and R. Kumar Enhanced word clustering for hierarchical text classification Proceedings of the Eighth ACM International Conference on Knowledge Discovery and Data mining 2002 ACM Press New York 191 200
36. A. Stolcke Entropy-based pruning of backoff language models Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop 1998 Morgan Kaufmann Publishers Lansdowne, Virginia 270 274
37. F. Jelinek Statistical Methods for Speech Recognition 1998 MIT Press Cambridge, MA
38. H. Ney, S. Martin, and F. Wessel Statistical language modeling using leaving-one-out S. Young, G. Bloothooft, Corpus-based Methods in Language and Speech Processing 1997 Kluwer Academic Publishers Dordrecht, The Netherlands 174 207
39. A. Papoulis Probability, Random Variables, and Stochastic Processes third ed. 1991 McGraw-Hill New York
40. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm (with discussion) Journal Royal Statistical Society, Series B 39 1977 1 38
41. A.Y. Ng, M.I. Jordan, Y. Weiss, On spectral clustering: analysis and an algorithm, in: Proceedings of the of NIPS, 2002, pp. 849856.
42. M. Halkidi, M. Vazirirgiannis, Clustering validity assessment: finding the optimal partitioning of a data set, in: Proceedings of the IEEE International Conference on Data Mining, 2001, pp. 187194.
43. J.C. Bezdek, Mathematical models for systematics and taxonomy, in: G. Estabrook (Ed.), Proceedings of the Eighth International Conference on Numerical Taxonomy, Freeman, San Francisco, CA, 1975, pp. 143166.
44. M.F. Porter An algorithm for suffix stripping Program 14 1980 130 137
45. C. Tillmann, H. Ney, Word trigger and the EM algorithm, in: Proceedings of the Workshop Computational Natural Language Learning, 1997, pp. 117124.
46. W.-Y. Chen, Y. Song, H. Bai, C.-J. Lin, E.Y. Chang, Parallel spectral clustering in distributed systems, IEEE Transactions of Pattern Analysis and Machine Intelligence doi: 10.1109/TPAMI.2010.88, 2010, to appear