Efficiency considerations for scalable information retrieval servers

Journal of Digital Information

Volumn 1, Issue 5, 2000, Pages

  Frieder, Ophir ^a   Grossman, David A ^a   Chowdhury, Abdur ^a   Frieder, Gideon ^b  

^a Illinois Institute of Technology   (United States)

^b GEORGE WASHINGTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPRESSION ALGORITHMS; COMPUTATIONAL RESOURCES; INDEX PROCESSING;

COMPUTER SCIENCE; DATA REDUCTION; DISTRIBUTED COMPUTER SYSTEMS; OPTIMIZATION; PARALLEL ALGORITHMS; PARALLEL PROCESSING SYSTEMS; PROBLEM SOLVING; RELATIONAL DATABASE SYSTEMS; SERVERS; STATISTICAL METHODS; TEXT PROCESSING;

INFORMATION RETRIEVAL;

EID: 0010248759     PISSN: 13687506     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (51)

1. N. Asokan, S. Ranka, and O. Frieder. A parallel free text search system with indexing. In Proceedings of the International Conference on Databases, Parallel Architectures, and their Applications (PARBASE-90), pages 519-534, 1990.
2. D.C. Blair and M.E. Maron. An evaluation of retrieval effectiveness for a full-text document-retrieval system. Communications of the ACM, 28(3):289-299, 1985.
3. N. Bond and S. Reddaway. A massively parallel indexing engine using DAP. Cambridge Parallel Processing. Technical Report., 1993.
4. J.R Callan. Passage-level evidence in document retrieval. In Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 302-310, 1994.
5. S. Ceri and G. Pelagatti. Distributed Databases: Principles and Systems. McGraw-Hill, 1984.
6. J. Cringean, R. England, G. Manson, and P. Willett. Parallel text searching in serial files using a processor farm. In Proceedings of the Thirteenth Annual ACM SIGIR Conference on Research and Development in Information Retrieval, pages 429-445, September 1990.
7. M. Damashek. Gauging similarity via n-grams: Language independent categorization of text. Science, 267(5199):843-848, 1995.
8. C. Date. An Introduction to Database Systems. Addison-Wesley, 1994.
9. A. Duda and M. Sheldon. Content routing in a network of WAIS servers. In Proceedings of the IEEE Fourteenth International Conference on Distributed Computing Systems, pages 124-132, 1994.
10. P. Elias. Universal codeword sets and representations of the integers. IEEE Transactions on Information Theory, IT-21(2): 194-203, 1975.
11. R. Elmasri and S. Navathe. Fundamentals of Database Systems. Addison-Wesley, 1994.
12. M.J. Flynn. Some computer organizations and their effectiveness. IEEE Transactions on Computers, 21(9):948-960, 1972.
13. O. Frieder, D. Grossman, A. Chowdhury, and G. Frieder. Phrase processing with the relational model and IDF update effects on precision/recall. Technical report, IBM Technical Report 05.500, April 1997.
14. M. Gordon. It's 10 a.m. do you know where your documents are? The nature and scope of information retrieval problems in business. Information Processing and Management, 33(1):107-121, 1997.
15. L. Gravano and H. Garcia-Molina. Generalizing GIOSS to vector-space databases and broker hierarchies. In Proceedings of the 21st International Conference on Very Large Database Conference, pages 78-89, 1995.
16. D. Grossman. Integrating Structured Data and Text: A Relational Approach. PhD thesis, George Mason University, 1995.
17. D. Grossman and O. Frieder. Information Retrieval: Algorithms and Heuristics. Kluwer Academic Press, 1998.
18. D. Grossman, O. Frieder, D. Holmes, and D. Roberts. Integrating structured data and text: A relational approach. Journal of the American Society for Information Science, 48(2): 122-132, Feb 1997.
19. D. Grossman, D. Holmes, and O. Frieder. A parallel DBMS approach to IR. In Proceedings of the Third Text REtrieval Conference, pages 279-288, 1994.
20. D. Harman. The TREC conferences. In Proceedings of the Hypertext - Information Retrieval - Multimedia: Synergieeffekte Elektronischer Informationssysteme (HIM'95), pages 9-28, 1995.
21. D. Lee and L. Ren. Document ranking on weight-partitioned signature files. ACM Transactions on Information Systems, 14(2):109-137, April 1996.
22. Y. Liu, P. Dantzig, C. Wu, J. Challenger, and L. Ni. A distributed web server and its performance analysis on multiple platforms. In Proceedings of the Sixteenth IEEE International Conference on Distributed Computing Systems, pages 665-672, 1996.
23. C. Lundquist. Relational Information Retrieval: Using Relevance Feedback and Parallelism to Improve Accuracy and Performance. PhD thesis, George Mason University, 1997.
24. G. Lundquist, O. Frieder, D. Holmes, and D. Grossman. A parallel relational database management system approach to relevance feedback in information retrieval, to appear in Journal of the American Society for Information Science, April 1999.
25. I. Macleod. A relational approach to modular information retrieval systems design. In Proceedings of the ASIS Annual Meeting, pages 83-85, 1978.
26. I. Macleod. SEQUEL as a language for document retrieval. Journal of the American Society for Information Science, 30(5):243-249, September 1979.
27. T. Martin, I. Macleod, and J. Russell. A case study of caching strategies for a distributed full text retrieval system. Information Processing and Management, 26(2):227-247, 1990.
28. A. Moffat and J. Zobel. Fast ranking in limited space. In Proceedings of the Tenth IEEE International Conference on Data Engineering, pages 428-437, 1994.
29. A. Moffat and J. Zobel. Self-indexing inverted files for fast text retrieval. ACM Transactions on Information Systems, 14(4):349-379, October 1996.
30. K. Obraczka, P. Dantzig, D. DeLucia, and E. Tsai. A tool for massively replicating internet archives: Design, implementation, and experience. In Proceedings of the Sixteenth IEEE International Conference on Distributed Computing Systems, pages 657-664, 1996.
31. J. O'Connor. Some independent agreements and resolved disagreements about answer-providing documents. American Documentation, 20(4):311-319, 1969.
32. T. Oszu and P. Valduriez. Principles of Distributed Database Systems. Prentice-Hall, 1991.
33. C.A. Pogue and P. Willett. Use of text signatures for document retrieval in a highly parallel environment. Parallel Computing, 4(3):259-268, 1987.
34. S. Reddaway. High speed text retrieval from large databases on a massively parallel processor. Information Processing and Management, 27(4):311-316, 1991.
35. J. J. Rocchio. The SMART Retrieval System Experiments in Automatic Document Processing, chapter Relevance Feedback in Information Retrieval, pages 313-323. Prentice Hall, 1971.
36. A. Ruocco and O. Frieder. Clustering and classification of large document bases in a parallel environment. Journal of the American Society for Information Science, 48(10):932-943, October 1997.
37. G. Salton. An evaluation of term dependence models in information retrieval. Lecture Notes in Computer Science: Research and Development in Information Retrieval, pages 151-165, May 1983.
38. H. Schutze and C. Silverstein. Projections for efficient document clustering. In Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 74-81, 1997.
39. Web searches fall short. Science News, 153:286, 1998.
40. K. Sparck Jones and P. Willett. Readings in Information Retrieval. Morgan Kaufmann Publishers, Inc., 1997.
41. G. Spencer, D. Cutting, and J. Xu, 1998. Personal Communication with D. Grossman.
42. C. Stanfill and B. Kahle. Parallel free-text search on the connection machine system. Communications of the ACM, 29 (12):1229-1239, 1986.
43. C. Stanfill and R. Thau. Information retrieval on the connection machine: 1 to 8192 gigabytes. Information Processing and Management, 27(4):285-310, 1991.
44. C. Stanfill, R. Thau, and D. Waltz. A parallel indexed algorithm for information retrieval. In Proceedings of the Twelfth Annual ACM SIGIR Conference on Research and Development in Information Retrieval, pages 88-97, June 1989.
45. H. Stone. Parallel querying of large databases: A case study. Computer, 20(10):11-21, 1987.
46. A. Tomasic and Hector Garcia-Molina. Performance of inverted indices in shared-nothing distributed text document information retrieval systems. In Proceedings of the Second International Conference on Parallel and Distributed Information Systems, pages 8-17, 1993.
47. C. Viles and J. French. On the update of term weights in dynamic information retrieval systems. In Proceedings of the Fourth Annual Conference on Information and Knowledge Management (CIKM95), 1995.
48. I. Witten, A. Moffat, and T. Bell. Managing Gigabytes. Van Nostrand Reinhold, 1994.
49. W. Yee, P. Wong, and D. Lee. Implementations of partial document ranking using inverted files. Information Processing and Management, 29(5):647-689, 1993.
50. G.K. Zipf. Human Behaviour and the Principle of Least Effort. Addison-Wessley, 1949.
51. J. Zobel, A. Moffat, and R. Sacks-Davis. An efficient indexing technique for full-text database systems. In Proceedings of the Eighteenth International Conference on Very Large Databases, pages 352-362, 1992.