Clustering near-identical sequences for fast homology search

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3909 LNBI, Issue , 2006, Pages 175-189

  Cameron, Michael ^a   Bernstein, Yaniv ^a   Williams, Hugh E ^b  

^a RMIT UNIVERSITY   (Australia)

^b MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE SYSTEMS; ELECTRONIC DOCUMENT EXCHANGE; INFORMATION RETRIEVAL; PROTEINS; QUERY LANGUAGES; REDUNDANCY; SEARCH ENGINES;

FINGERPRINTING; GENBANK; HOMOLOGY; PROTEIN DATABASE;

GENES;

EID: 33745767924     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11732990_16     Document Type: Conference Paper

References (40)

1. Altschul, S., Madden, T., Schaffer, A., Zhang, J., Zhang, Z., Miller, W., Lipman, D.: Gapped BLAST and PSI-BLAST: A new generation of protein database search programs. Nucleic Acids Research 25 (1997) 3389-3402
2. Li, W., Jaroszewski, L., Godzik, A.: Sequence clustering strategies improve remote homology recognitions while reducing search times. Protein Engineering 15 (2002) 643-649
3. Park, J., Holm, L., Heger, A., Chothia, C.: RSDB: representative sequence databases have high information content. Bioinformatics 16 (2000) 458-464
4. Altschul, S., Gish, W., Miller, W., Myers, E., Lipman, D.: Basic local alignment search tool. Journal of Molecular Biology 215 (1990) 403-410
5. Pearson, W., Lipman, D.: Improved tools for biological sequence comparison. Proceedings of the National Academy of Sciences USA 85 (1988) 2444-2448
6. Pearson, W., Lipman, D.: Rapid and sensitive protein similarity searches. Science 227 (1985) 1435-1441
7. Li, W., Jaroszewski, L., Godzik, A.: Tolerating some redundancy significantly speeds up clustering of large protein databases. Bioinformatics 18 (2001) 77-82
8. Smith, T., Waterman, M.: Identification of common molecular subsequences. Journal of Molecular Biology 147 (1981) 195-197
9. Burke, J., Davison, D., Hide, W.: d2-cluster: A validated method for clustering EST and full-length DNA sequences. Genome Research 9 (1999) 1135-1142
10. Bleasby, A.J., Wootton, J.C.: Construction of validated, non-redundant composite protein sequence databases. Protein Engineering 3 (1990) 153-159
11. Kallberg, Y., Persson, B.: KIND - a non-redundant protein database. Bioinformatics 15 (1999) 260-261
12. Grille, G., Attimonelli, M., Liuni, S., Pesole, G.: CLEANUP: a fast computer program for removing redundancies from nucleotide sequence databases. Computer Applications in the Biosciences 12 (1996) 1-8
13. Holm, L., Sander, C.: Removing near-neighbour redundancy from large protein sequence collections. Bioinformatics 14 (1998) 423-429
14. Li, W., Jaroszewski, L., Godzik, A.: Clustering of highly homologous sequences to reduce the size of large protein databases. Bioinformatics 17 (2001) 282-283
15. Malde, K., Coward, E., Jonassen, I.: Fast sequence clustering using a suffix array algorithm. Bioinformatics 19 (2003) 1221-1226
16. Gracy, J., Argos, P.: Automated protein sequence database classification, i. integration of compositional similarity search, local similarity search, and multiple sequence alignment. Bioinformatics 14 (1998) 164-173
17. Gusfield, D.: Algorithms on Strings, Trees, and Sequences. Cambridge University Press (1997)
18. Manber, U., Myers, G.: Suffix arrays: a new method for on-line string searches. SIAM Journal on Computing 22 (1993) 935-948
19. Cheung, C.F., Yu, J.X., Lu, H.: Constructing suffix tree for gigabyte sequences with megabyte memory. IEEE Transactions on Knowledge and Data Engineering 17 (2005) 90-105
20. Lee, C., Grasso, C., Sharlow, M.F.: Multiple sequence alignment using partial order graphs. Bioinformatics 18 (2002) 452-464
21. Bernstein, Y., Cameron, M.: Fast discovery of similar sequences in large genomic collections. In: Proc. European Conference on Information Retrieval. (2006) To appear.
22. Manber, U.: Finding similar files in a large file system. In: Proceedings of the USENIX Winter 1994 Technical Conference, San Fransisco, CA, USA (1994) 1-10
23. Heintze, N.: Scalable document fingerprinting. In: 1996 USENIX Workshop on Electronic Commerce, Oakland, California, USA (1996) 191-200
24. Brin, S., Davis, J., García-Molina, H.: Copy detection mechanisms for digital documents. In Carey, M., Schneider, D., eds.: Proceedings of the ACM SIGMOD Annual Conference, San Jose, California, United States, ACM Press (1995) 398-409
25. Broder, A.Z., Glassman, S.C., Manasse, M.S., Zweig, G.: Syntactic clustering of the web. Computer Networks and ISDN Systems 29 (1997) 1157-1166
26. Bernstein, Y., Zobel, J.: A scalable system for identifying co-derivative documents. In Apostolico, A., Melucci, M., eds.: Proc. String Processing and Information Retrieval Symposium (SPIRE), Padova, Italy, Springer (2004) 55-67
27. Bernstein, Y., Zobel, J.: Redundant documents and search effectiveness. In: CIKM '05: Proceedings of the 14th ACM international conference on Information and knowledge management, New York, NY, USA, ACM Press (2005) 736-743
28. Johnson, S.: Hierarchical clustering schemes. Psychometrika 32 (1967) 241-254
29. Robinson, A., Robinson, L.: Distribution of glutamine and asparagine residues and their near neighbors in peptides and proteins. Proceedings of the National Academy of Sciences USA 88 (1991) 8880-8884
30. Henikoff, S., Henikoff, J.: Amino acid substitution matrices from protein blocks. Proceedings of the National Academy of Sciences USA 89 (1992) 10915-10919
31. Taylor, W.: The classification of amino-acid conservation. Journal of Theoretical Biology 119 (1986) 205-218
32. Murzin, A., Brenner, S., Hubbard, T., Chothia, C.: SCOP: a structural classification of proteins database for the investigation of sequences and structures. Journal of Molecular Biology 247 (1995) 536-540
33. Andreeva, A., Howorth, D., Brenner, S., Hubbard, T., Chothia, C., Murzin, A.: SCOP database in 2004: refinements integrate structure and sequence family data. Nucleic Acids Research 32 (2004) D226-D229
34. Brenner, S., Chothia, C., Hubbard, T.: Assessing sequence comparison methods with reliable structurally identified distant evolutionary relationships. Proceedings of the National Academy of Sciences USA 95 (1998) 6073-6078
35. Park, J., Karplus, K., Barrett, C., Hughey, R., Haussler, D., Hubbard, T., Chothia, C.: Sequence comparisons using multiple sequences detect three times as many remote homologues as pairwise methods. Journal of Molecular Biology 284 (1998) 1201-1210
36. Chandonia, J., Hon, G., Walker, N., Conte, L.L., Koehl, P., Levitt, M., Brenner, S.: The ASTRAL compendium in 2004. Nucleic Acids Research 32 (2004) D189-D192
37. Gribskov, M., Robinson, N.: Use of receiver operating characteristic (ROC) analysis to evaluate sequence matching. Computers & Chemistry 20 (1996) 25-33
38. Karlin, S., Altschul, S.: Methods for assessing the statistical significance of molecular sequence features by using general scoring schemes. Proceedings of the National Academy of Sciences USA 87 (1990) 2264-2268
39. Cameron, M., Williams, H.E., Cannane, A.: Improved gapped alignment in BLAST. IEEE Transactions on Computational Biology and Bioinformatics 1 (2004) 116-129
40. Cameron, M., Williams, H.E., Cannane, A.: A deterministic finite automaton for faster protein hit detection in BLAST. Journal of Computational Biology (2005) To appear.