Performance and scalability of a large-scale N-gram based information retrieval system

Journal of Digital Information

Volumn 1, Issue 5, 2000, Pages

  Miller, Ethan ^a   Shen, Dan ^a   Liu, Junli ^a   Nicholas, Charles ^a  

^a UNIVERSITY OF MARYLAND BALTIMORE COUNTY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CENTROID SUBTRACTION; GAMMA COMPRESSION; PROBABILISTIC MODELS;

ARTIFICIAL INTELLIGENCE; COMPUTER PROGRAMMING LANGUAGES; DATA PROCESSING; ERROR ANALYSIS; ERRORS; INDEXING (OF INFORMATION); PROBABILITY; QUERY LANGUAGES; WORLD WIDE WEB;

INFORMATION RETRIEVAL;

EID: 0003268207     PISSN: 13687506     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (19)

1. Steve Lawrence and C. Lee Giles, "Searching the World Wide Web," Science 280(3), 3 April 1998, pages 98-100.
2. Claudia Pearce and Ethan Miller, "The TELLTALE Dynamic Hypertext Environment: Approaches to Scalability," in Advances in Intelligent Hypertext, J. Mayfield and C. Nicholas, eds. Lecture Notes in Computer Science 1326, Springer-Verlag, October 1997, pages 109-130.
3. Ricardo Baeza-Yates and Berthier Ribeiro-Neto, Modern Information Retrieval, ACM Press, 1999.
4. Ian H. Witten, Alistair Moffat, and Timothy C. Bell, Managing Gigabytes, second edition, Morgan Kaufmann, 1999.
5. James P. Callan, W. Bruce Croft, and John Broglio, "TREC and Tipster experiments with INQERY," Information Processing and Management 31(3), 1995, pages 327-343.
6. D. Heckerman, "A tutorial on learning with Bayesian networks," Technical Report MSR-TR-95-06, Microsoft Research, March 1995 (revised November, 1996).
7. G. Salton and M.J. McGill, "The SMART and SIRE Experimental Retrieval Systems," in Readings in Information Retrieval, Karen Sparck Jones and Peter Willett, eds., Morgan Kaufmann, 1997, pages 381-399.
8. Claudia Pearce and Charles Nicholas, "TELLTALE: Experiments in a Dynamic Hypertext Environment for Degraded and Multilingual Data," Journal of the American Society for Information Science, April 1996, pages 263-275.
9. Marc Damashek, "Gauging Similarity with n-grams: Language-Independent Categorization of Text," Science 267, 10 February 1995, pages 843-848.
10. C. E. Shannon, "Prediction and entropy of printed English," Bell System Technical Journal 30, pages 50-64.
11. F. Cuna Ekmekcioglu, Michael F. Lynch, and Peter Willett, "Stemming and N-gram Matching For Term Conflation In Turkish Texts," available at http://www.shef.ac.uk/uni/academic/I-M/is/lecturer/paper13.html#lovi68.
12. The Unicode Consortium, The Unicode Standard: World Wide Character Encoding, Addison-Wesley, Redwood City, CA, 1992.
13. Brent B. Welch, Practical Programming in Tcl and Tk, 2nd edition, Prentice Hall, 1997.
14. Donna Harman, "The DARPA TIPSTER project," ACM SIGIR Forum 26(2), Fall 1992, pages 26-28.
15. The Text Retrieval Conference. Information available at http://trec.nist.gov.
16. R. L. Rivest, "The MD5 Message-Digest Algorithm," RFC 1321, Network Working Group, April 1992.
17. Secure Hash Standard, FIPS-180-1, National Institute of Standards and Technologies, U.S. Department of Commerce, April 1995.
18. Adam Sweeney, Doug Doucette, Wei Hu, Curtis Anderson, Mike Nishimoto, and Geoff Peck, "Scalability in the XFS File System," Proceedings of the Winter 1996 USENIX Conference, San Diego, CA, pages 1-14.
19. James Mayfield and Paul McNamee. "N-gram vs. Words as Indexing Terms," available at URL http://www.csee.umbc.edu/~mayfield/pubs/APL- TREC97prelim.ps.