The method of N-grams in large-scale clustering of DNA texts

Pattern Recognition

Volumn 38, Issue 11, 2005, Pages 1902-1912

  Volkovich, Z ^a   Kirzhner, V ^b   Bolshoy, A ^b,c,d,e,f   Nevo, E ^b   Korol, A ^b  

^a ORT BRAUDE COLLEGE   (Israel)

^b UNIVERSITY OF HAIFA   (Israel)

^c NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^d TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

^e NCBI/NLM/NIH   (United States)

^f INDIANA UNIVERSITY   (United States)

Author keywords

Clustering; Compositional spectra; Genome comparisons; N grams; Strings mismatching

Indexed keywords

CLUSTERING; COMPOSITIONAL SPECTRA; GENOME COMPARISONS; N-GRAMS; STRINGS MISMATCHING;

DNA; IMAGE QUALITY;

PATTERN RECOGNITION;

EID: 24044518181     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2005.05.002     Document Type: Article

References (32)

1. M.W. Berry, M. Browne, Understanding Search Engines: Mathematical Modeling and Text Retrieval, SIAM Book Series: Software, Environments and Tools, 1999.
2. J. Kogan, C. Nicholas, and V. Volkovich Text mining with information-theoretical clustering Comput. Sci. Eng. 5 6 2003 52 59
3. E. Forgy Cluster analysis of multivariate data: efficiency vs. interpretability of classifications Biometrics 21 3 1965 768 769
4. L. Kaufman, and P.J. Rousseeuw Finding Groups in Data: An Introduction to Cluster Analysis 1990 Wiley New York
5. C.E. Shannon, A mathematical theory of communication, Bell System Tech. J. 27 (1948) 379-423, 623-656.
6. T. De Heer Experiments with syntactic traces in information retrieval Inform. Storage Retrieval 10 1974
7. E.S. Adams, A.C. Meltzer, Trigrams as index elements in full text retrieval, observations and experimental results, ACM Composite Science Conference, 1993.
8. W.B. Cavnar, Using an N -gram-based document representation with a vector processing retrieval model, The Fourth Text Retrieval Conference (TREC-3), 1995.
9. J.D. Cohen Highlights: language- and domain-independent automatic indexing terms for abstracting J. Am. Soc. Inform. Sci. 46 3 1995
10. M. Damashek Gauging Similarity with N -grams: language-independent categorization of text Science 267 1995
11. A.M. Robertson, P. Willett, Searching for historical word-forms in a database of 17th century english text using spelling-correction methods, 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1992.
12. S. Huffman, M. Damashek, Acquaintance: a novel vector-space N -gram technique for document categorization, The Third Text REtrieval Conference (TREC-3), 1995.
13. S. Huffman, Acquaintance: language-independent document categorization by N -grams, The Fourth Text REtrieval Conference (TREC-4), 1996.
14. J.H. Lee, J.S. Ahn, Using N -grams for Korean text retrieval, 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1996.
15. A.K. Jain, and R.C. Dubes Algorithms for Clustering Data 1988 Prentice-Hall Englewood Cliffs, New York
16. R. Douglass, D.R. Cutting, J. Karger, O. Pedersen, J.W. Tukey, Scatter/gather: a cluster-based approach to browsing large document collections, SIGIR '92, 1992, pp. 318-329.
17. A. Bolshoy DNA sequence analysis linguistic tools Rev. Appl. Bioinform. 2 2003 103 112
18. S. Pietrokovski, J. Hirshon, and E.N. Trifonov Linguistic measure of taxonomic and functional relatedness of nucleotide sequences J. Biomol. Struct. Dynamics 7 1990 1251 1268
19. S. Karlin, I. Ladunga, and BE. Blaisdell Heterogeneity of genomes - measures and values Proc. Natl. Acad. Sci. USA 91 1994 12837 12841
20. S. Karlin, and C. Burge Dinucleotide relative abundance extremes: a genomic signature Trends Genet. 11 1995 283 290
21. V. Kirzhner, A. Korol, A. Bolshoy, and E. Nevo Compositional spectrum - revealing patterns for genomic sequence characterization and comparison Physics A 312 2002 447 457
22. V. Kirzhner, E. Nevo, A. Korol, and A. Bolshoy One promising approach to a large-scale comparison of genomic sequences Acta Biotheor. 51 2 2003 73 89
23. S.A. Heath, F.P. Preparata, J. Young, Sequencing by hybridization using direct and reverse cooperating spectra, Proceedings of the Sixth Annual International Conference on Computational Biology, 2002, pp. 186-193.
24. F. Preparata, A. Frieze, and E. Upfal Optimal reconstruction of a sequence from its probes J. Comput. Biol. 6 1999 361 368
25. F.P. Preparata Sequencing-by-hybridization revisited: the analog-spectrum proposal Comput. Biol. Bioinform. 1 2004 47 52
26. N.N. Aprausheva, A new approach for the cluster detection, Computer Center of the Russian Academy of Science, Moscow, 1993 (in Russian).
27. L.J. Latecki, R. Venugopal, M. Sobel, S. Horvath, Tree-structured partitioning based on splitting histograms of distances, IEEE International Conference on Data Mining (ICDM'03), Melbourne, FL, USA, 2003.
28. R.R. Sokal, and C.D. Michener A statistical method for evaluating systematic relationships Univ. Kansas Sci. Bull. 38 1958 1409 1438
29. V. Roth, V. Lange, M. Braun, J. Buhmann, A resampling approach to cluster validation, COMPSTAT 2002, available at http://www.cs.unibonn.De/ ∼ braunm.
30. W.M. Rand Objective criteria for the evaluation of clustering methods J. Am. Stat. Assoc. 66 1971 846 850
31. E.B. Fowlkes, and C.L. Mallows A method for comparing two hierarchical clustering J. Am. Stat. Assoc. 78 1983 553 584
32. G. Deckert, P.V. Warren, T. Gaasterland, W.G. Young, A.L. Lenox, D.E. Graham, R. Overbeek, M.A. Snead, M. Keller, M. Aujay, R. Huber, R.A. Feldman, J.M. Short, G.J. Olsen, and R.V. Swanson The complete genome of the hyperthermophilic bacterium Aquifex aeolicus Nature 392 1998 353 358