Speeding up chemical searches using the inverted index: The convergence of chemoinformatics and text search methods

Journal of Chemical Information and Modeling

Volumn 52, Issue 4, 2012, Pages 891-900

  Nasr, Ramzi ^a,b   Vernica, Rares ^a   Li, Chen ^a,b   Baldi, Pierre ^a,b  

^a Irvine   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INDEXING (OF INFORMATION); INFORMATION RETRIEVAL;

CHEMICAL SEARCHES; MATHEMATICAL ANALYSIS; MOLECULAR DATABASE; SIMILARITY MEASURE; SIMILARITY SEARCH; STATE OF THE ART; TEXT SEARCH METHODS; THRESHOLD SEARCHES;

MOLECULES;

MOLECULAR LIBRARY;

ALGORITHM; CHEMICAL DATABASE; CHEMICAL STRUCTURE; CHEMISTRY; CLASSIFICATION; COMPUTER INTERFACE; HIGH THROUGHPUT SCREENING; INFORMATION SCIENCE; MOLECULAR LIBRARY; PROCEDURES; STATISTICAL MODEL; STATISTICS AND NUMERICAL DATA;

ALGORITHMS; DATABASES, CHEMICAL; HIGH-THROUGHPUT SCREENING ASSAYS; INFORMATICS; LIKELIHOOD FUNCTIONS; MOLECULAR STRUCTURE; SMALL MOLECULE LIBRARIES; USER-COMPUTER INTERFACE;

EID: 84862022229     PISSN: 15499596     EISSN: 1549960X     Source Type: Journal    
DOI: 10.1021/ci200552r     Document Type: Article

References (35)

1. Wang, Q.; Ng, D.; Mannan, M. S. Study on the Reaction Mechanism and Kinetics of the Thermal Decomposition of Nitroethane. Ind. Eng. Chem. Res. 2009, 48, 8745-8751.
2. Chen, J.; Swamidass, S. J.; Dou, Y.; Bruand, J.; Baldi, P. ChemDB: a Public Database of Small Molecules and Related Chemoinformatics Resources. Bioinformatics 2005, 21, 4133-4139. (Pubitemid 41672103)
3. Tabei, Y.; Tsuda, K. SketchSort: Fast All Pairs Similarity Search for Large Databases of Molecular Fingerprints. Mol. Inf. 2011, 30, 801-807.
4. Leach, A. R.; Gillet, V. J. An Introduction to Chemoinformatics; Springer: Berlin, 2005.
5. Fligner, M. A.; Verducci, J. S.; Blower, P. E. A Modification of the Jaccard/Tanimoto Similarity Index for Diverse Selection of Chemical Compounds Using Binary Strings. Technometrics 2002, 44, 110-119. (Pubitemid 34537163)
6. Flower, D. R. On the Properties of Bit String-Based Measures of Chemical Similarity. J. Chem. Inf. Comput. Sci. 1998, 38, 379-386. (Pubitemid 128594448)
7. James, C. A.; Weininger, D.; Delany, J. Daylight Theory Manual. 2004; Available at http://www.daylight.com/dayhtml/doc/theory/index.html (accessed 1/28/2012).
8. Xue, L.; Godden, J. F.; Stahura, F. L.; Bajorath, J. Profile Scaling Increases the Similarity Search Performance of Molecular Fingerprints Containing Numerical Descriptors and Structural Keys. J. Chem. Inf. Comput. Sci. 2003, 43, 1218-1225.
9. Xue, L.; Stahura, F. L.; Bajorath, J. Similarity Search Profiling Reveals Effects of Fingerprint Scaling in Virtual Screening. J. Chem. Inf. Comput. Sci. 2004, 44, 2032-2039.
10. Baldi, P.; Benz, R. W.; Hirschberg, D.; Swamidass, S. Lossless Compression of Chemical Fingerprints Using Integer Entropy Codes Improves Storage and Retrieval. J. Chem. Inf. Model. 2007, 47, 2098-2109. (Pubitemid 350275076)
11. Holliday, J. D.; Hu, C. Y.; Willett, P. Grouping of Coefficients for the Calculation of Inter-Molecular Similarity and Dissimilarity Using 2D Fragment Bit-Strings. Comb. Chem. High. Throughput Screen. 2002, 5, 155-66. (Pubitemid 34475167)
12. Nasr, R.; Swamidass, S. J.; Baldi, P. Large Scale Study of Multiple-Molecule Queries. J. Cheminf. [online] 2009, 1, No. article 7, http://www.jcheminf.com/content/1/1/7 (accessed Apr. 2012).
13. Swamidass, S. J.; Baldi, P. Mathematical Correction for Fingerprint Similarity Measures to Improve Chemical Retrieval. J. Chem. Inf. Model. 2007, 47, 952-964. (Pubitemid 46973710)
14. Baldi, P.; Hirschberg, D. S.; Nasr, R. J. Speeding up Chemical Database Searches Using a Proximity Filter Based on the Logical Exclusive OR. J. Chem. Inf. Model. 2008, 48, 1367-1378.
15. Swamidass, S. J.; Baldi, P. Bounds and Algorithms for Fast Exact Searches of Chemical Fingerprints in Linear and Sublinear Time. J. Chem. Inf. Model. 2007, 47, 302-317. (Pubitemid 46615935)
16. Burkhard, W.; Keller, R. Some Approaches to Best-Match File Searching. Commun. ACM 1973, 16, 230-236.
17. Shapiro, M. The choice of Reference Points in Best-Match File Searching. Commun. ACM 1977, 20, 339-343.
18. Baldi, P.; Hirschberg, D. S. An Intersection Inequality Sharper than the Tanimoto Triangle Inequality for Efficiently Searching Large Databases. J. Chem. Inf. Model. 2009, 49, 1866-1870.
19. Nasr, R.; Hirschberg, D. S.; Baldi, P. Hashing Algorithms and Data Structures for Rapid Searches of Fingerprint Vectors. J. Chem. Inf. Model. 2010, 50, 1358-1368.
20. Nasr, R.; Kristensen, T.; Baldi, P. Tree and Hashing Data Structures to Speed up Chemical Searches: Analysis and Experiments. Mol. Inf. 2011, 30, 791-800.
21. Zobel, J.; Moffat, A. Inverted Files for Text Search Engines. ACM Comput. Surveys (CSUR) 2006, 38, 6.
22. Manning, C.; Raghavan, P.; Schutze, H. Introduction to Information Retrieval; Cambridge University Press: Cambridge, UK, 2008; Vol. 1.
23. King, D. The Binary Vector as the Basis of an Inverted Index File. J. Libr. Autom. 1974, 7, 307-14.
24. Matthews, F. Searching X-Ray Diffraction Powder Data with an Inverted Coordinate Index. J. Chem. Doc. 1963, 3, 213-216.
25. Thomson, L. H.; Hyde, E.; Matthews, F. W. Organic Search and Display using a Connectivity Matrix Derived from Wiswesser Notation. J. Chem. Doc. 1967, 7, 204-209.
26. Hoffman, W. S. An Integrated Chemical Structure Storage and Search System Operating at Du Pont. J. Chem. Doc. 1968, 8, 3-13.
27. Willett, P.; Winterman, V.; Bawden, D. Implementation of Nearest-Neighbor Searching in an Online Chemical Structure Search System. J. Chem. Inf. Comput. Sci. 1986, 26, 36-41.
28. Kristensen, T. G.; Nielsen, J.; Pedersen, C. N. S. Using Inverted Indices for Accelerating LINGO Calculations. J. Chem. Inf. Model. 2011, 51, 597-600.
29. Li, C.; Lu, J.; Lu, Y. Efficient Merging and Filtering Algorithms for Approximate String Searches. Proceedings of the 24th International IEEE Conference on Data Engineering (ICDE 2008); 2008; pp 257-266.
30. Vernica, R.; Li, C. Efficient Top-k Algorithms for Fuzzy Search in String Collections. Proceedings of the First International Workshop on Keyword Search on Structured Data; 2009; pp 9-14.
31. Baldi, P.; Nasr, R. When is Chemical Similarity Significant? The Statistical Distribution of Chemical Similarity Scores and Its Extreme Values. J. Chem. Inf. Model. 2010, 50, 1205-1222.
32. Rogers, D.; Hahn, M. Extended-Connectivity Fingerprints. J. Chem. Inf. Model. 2010, 50, 742-754.
33. Hassan, M.; Brown, R. D.; Varma-O'Brien, S.; Rogers, D. Cheminformatics Analysis and Learning in a Data Pipelining Environment. Mol. Diversity 2006, 10, 283-299. (Pubitemid 44546683)
34. Cavnar, W. B.; Trenkle, J. M. N-Gram-Based Text Categorization. Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval; 1994; pp 161-175.
35. Benz, R. W.; Swamidass, S. J.; Baldi, P. Discovery of Power-Laws in Chemical Space. J. Chem. Inf. Model. 2008, 48, 1138-1151.