Shortest-substring retrieval and ranking

ACM Transactions on Information Systems

Volumn 18, Issue 1, 2000, Pages 44-78

  Clarke, Charles L A ^a   Cormack, Gordon V ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Algorithms; Boolean retrieval model; H.3.3 Information Storage and Retrieval : Information Search and Retrieval; H.3.4 Information Storage and Retrieval : Systems and Software Performance evaluation (efficiency and effectiveness); Passage; Performance

Indexed keywords

EID: 0002977272     PISSN: 10468188     EISSN: None     Source Type: Journal    
DOI: 10.1145/333135.333137     Document Type: Article

References (60)

1. ALLAN, J. 1995. Relevance feedback with too much data. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '95, Seattle, WA, July 9-13), E. A. Fox, P. Ingwersen, and R. Fidel, Eds. ACM Press, New York, NY, 337-343.
2. ATTAR, R. AND FRAENKEL, A. S. 1977. Local feedback in full-text retrieval systems. J. ACM 24, 3 (July), 397-417.
3. BOOKSTEIN, A. 1978. On the perils of merging Boolean and weighted retrieval systems. J. Am. Soc. Inf. Sci. 29, 3, 156-158.
4. BOOKSTEIN, A. 1980. Fuzzy requests: An approach to weighted Boolean searches. J. Am. Soc. Inf. Sci. 31, 4 (July), 240-247.
5. BRENNER, E. H. 1996. Beyond boolean - New approaches to information retrieval. National Federation of Abstracting and Information Services, Philadelphia, PA.
6. BUELL, D. A. AND KRAFT, D. H. 1981. Threshold values and Boolean retrieval systems. Inf. Process. Manage. 17, 3, 127-136.
7. BURKOWSKI, F. J. 1992. An algebra for hierarchically organized text-dominated databases. Inf. Process. Manage. 28, 3 (1992), 333-348.
8. CALLAN, J. P. 1994. Passage-level evidence in document retrieval. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 302-310.
9. CALLAN, J. P., LU, Z., AND CROFT, W. B. 1995. Searching distributed collections with inference networks. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '95, Seattle, WA, July 9-13), E. A. Fox, P. Ingwersen, and R. Fidel, Eds. ACM Press, New York, NY, 21-28.
10. CLARKE, C. L. A. AND CORMACK, G. V. 1996. Interactive substring retrieval. In Proceedings of the 5th Text Retrieval Conference (TREC-5, Gaithersburg, MD, Nov.), E. M. Voorhees and D. K. Harman, Eds. National Institute of Standards and Technology, Gaithersburg, MD 267-277.
11. CLARKE, C. L. A., CORMACK, G. V., AND BURKOWSKI, F. J. 1994. Fast inverted indexes with on-line update. Tech. Rep. CS-94-40. Computer Science Dept., University of Waterloo, Waterloo, Canada.
12. CLARKE, C. L. A., CORMACK, G. V., AND BURKOWSKI, F. J. 1995a. An algebra for structured text search and a framework for its implementation. Comput. J. 38, 1, 43-56.
13. CLARKE, C. L. A., CORMACK, G. V., AND BURKOWSKI, F. J. 1995b. Schema-independent retrieval from heterogeneous structured text. In Proceedings of the 4th Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV), 279-289.
14. CLARKE, C. L. A., CORMACK, G. V., AND BURKOWSKI, F. J. 1995c. Shortest substring ranking MultiText experiments for TREC-4. In Proceedings of the 4th Text Retrieval Conference (TREC-4, Washington, D.C., Nov.), D. K. Harman, Ed. National Institute of Standards and Technology, Gaithersburg, MD, 295-304.
15. COOPER, W. S. 1988. Getting beyond Boole. Inf. Process. Manage. 24, 3 (May 1988), 243-248.
16. CORMACK, G. V., CLARKE, C. L. A., PALMER, C. R., AND TO, S. S.-L. 1997. Passage based refinement. In Proceedings of the 6th Text Retreival Conference (TREC-6, Nov.), E. Voorhees and D. Harman, Eds. 303-319.
17. CORMACK, G., PALMER, C., VAN BIESBROUCK, M., AND CLARKE, C. 1998. Deriving very short queries for high precision and recall. In Proceedings of the 7th Text Retreival Conference (TREC-7),
18. GREIFF, W. R., CROFT, W. B., AND TURTLE, H. 1997. Computationally tractable probabilistic modeling of Boolean operators. In Proceedings of the 20th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '97, Philadelphia, PA, July 27-31), N. J. Belkin, A. D. Narasimhalu, P. Willett, W. Hersh, F. Can, and E. Voorhees, Eds, ACM Press, New York, NY, 119-128.
19. HARMAN, D. K., Ed. 1995. Proceedings of the 4th Text Retrieval Conference. (TREC-4, Washington, D.C., Nov.). National Institute of Standards and Technology, Gaithersburg, MD.
20. HAWKING, D. AND THISTLEWAITE, P. 1995. Proximity operators - So near and yet so far. In Proceedings of the 4th Text Retrieval Conference (TREC-4, Washington, D.C., Nov.), D. K. Harman, Ed. National Institute of Standards and Technology, Gaithersburg, MD, 131-143.
21. HAWKING, D. AND THISTLEWAITE, P. 1996. Relevance weighting using distance between term occurrences. Tech. Rep. TR-CS-96-08. Department of Computer Science, Australian National Univ., Canberra, Australia. Available via http://cs.anu.edu.au/techreports/1996/ index.html.
22. HAWKING, D. AND THISTLEWAITE, P. 1997. Overview of the TREC-6 very large collection track. In Proceedings of the 6th Text Retreival Conference (TREC-6, Nov.), E. Voorhees and D. Harman, Eds.
23. HAWKING, D., CRASWELL, N., AND THISTLEWAITE, P. 1998. Overview of TREC-7 very large collection track. In Proceedings of the 7th Text Retrieval Conference (TREC-7),
24. HEARST, M. A. 1996. Improving full-text precision on short queries using simple constraints. In Proceedings of the 5th Annual Symposium on Document Analysis and Information Retrieval (Las Vegas, NV, Apr.),
25. HEARST, M. A. AND PLAUNT, C. 1993. Subtopic structuring for full-length document access. In Proceedings of the 16th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '93, Pittsburgh, PA, June 27-July), R. Korfhage, E. Rasmussen, and P. Willett, Eds. ACM Press, New York, NY, 59-68.
26. JING, Y. AND CROFT, W. B. 1994. An association thesaurus for information retrieval. In Proceedings of the Intelligent Multimedia Information Retrieval Systems (RIAO '94, New York, NY), 146-160.
27. KASZKIEL, M. AND ZOBEL, J. 1997. Passage retrieval revisited. In Proceedings of the 20th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '97, Philadelphia, PA, July 27-31), N. J. Belkin, A. D. Narasimhalu, P. Willett, W. Hersh, F. Can, and E. Voorhees, Eds, ACM Press, New York, NY, 178-185.
28. KEEN, E. M. 1991. The use of term position devices in ranked output experiments. J. Doc. 47, 1 (Mar.), 1-22.
29. KEEN, E. M. 1992a. Some aspects of proximity searching in text retrieval systems. J. Inf. Sci. 18, 2 (1992), 89-98.
30. KEEN, E. M. 1992b. Term position ranking: some new test results. In Proceedings of the 15th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '92, Copenhagen, Denmark, June 21-24), N. Belkin, P. Ingwersen, A. M. Pejtersen, and E. Fox, Eds. ACM Press, New York, NY, 66-76.
31. KERRE, E. E., ZENNER, R. B. R. C., AND DE CALUWE, R. M. M. 1986. The use of fuzzy set theory in information retrieval and databases: A survey. J. Am. Soc. Inf. Sci. 37, 5 (Sept.), 341-345.
32. KIM, M. H., LEE, J. H., AND LEE, Y. J. 1993. Analysis of fuzzy operators for high quality information retrieval. Inf. Process. Lett. 46, 5 (July 9, 1993), 251-256.
33. KNAUS, D., MITTENDORF, E., SCHÄUBLE, P., AND SHERIDAN, P. 1995. Highlighting relevant passages for users of the interactive SPIDER retrieval system. In Proceedings of the 4th Text Retrieval Conference (TREC-4, Washington, D.C., Nov.), D. K. Harman, Ed. National Institute of Standards and Technology, Gaithersburg, MD.
34. LEE, J. H. 1994. Properties of extended Boolean models in information retrieval. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 182-190.
35. LEE, J. H., KIN, W. Y., KIM, M. H., AND LEE, Y. J. 1993. On the evaluation of Boolean operators in the extended Boolean retrieval framework. In Proceedings of the 16th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '93, Pittsburgh, PA, June 27-July), R. Korfhage, E. Rasmussen, and P. Willett, Eds. ACM Press, New York, NY, 291-297.
36. LESK, M. 1997. Practical Digital Libraries: Books, Bytes, and Bucks. Morgan Kaufmann Series in Multimedia Information and Systems. Morgan Kaufmann Publishers Inc., San Francisco, CA.
37. LI, S.-H. AND DANZIG, P. 1997. Boolean similarity measures for resource discovery. IEEE Trans. Knowl. Data Eng. 9, 6 (Nov.-Dec.), 863-876.
38. MACLANE, S. AND BIRKOFF, G. 1967. Algebra. Macmillan, New York, NY.
39. MITRA, M., BUCKLEY, C., SINGHAL, A., AND CARDIE, C. 1997. An analysis of statistical and syntactic phrases. In Proceedings of the 1997 Intelligent Multimedia Information Retrieval Systems Conference (RIAO '97, Montreal, Canada, June), 200-214.
40. MOFFAT, A. AND ZOBEL, J. 1996. Self-indexing inverted files for fast text retrieval. ACM Trans. Inf. Syst. 14, 4 (Oct.), 349-379.
41. NOREAULT, T., KOLL, M., AND MCGILL, M. J. 1977. Automatic ranked output from Boolean searches in SIRE. J. Am. Soc. Inf. Sci. 28, 6, 333-339.
42. RADECKI, T. 1982. Reducing the perils of merging Boolean and weighted retrieval systems. J. Doc. 38, 1 (Sept.), 207-211.
43. ROBERTSON, S. E. 1978. On the nature of fuzz: A diatribe. J. Am. Soc. Inf. Sci. 29, 6, 304-307.
44. ROBERTSON, S. E. AND WALKER, S. 1994. Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 232-241.
45. ROBERTSON, S. E., WALKER, S., JONES, S., HANCOCK-BEAULIEU, M. M., AND GATFORD, M. 1994. Okapi at TREC-3. In Proceedings of the 3rd Text Retrieval Conference (TREC-3, Nov.), 109-126.
46. ROUSSEAU, R. 1990. Extended boolean retrieval: A heuristic approach?. In Proceedings of the 13th International Conference on Research and Development in Information Retrieval (SIGIR '90, Brussels, Belgium, Sept. 5-7), J.-L. Vidick, Ed. ACM Press, New York, NY, 495-508.
47. SALTON, G. AND MCGILL, M. J. 1983. Introduction to Modern Information Retrieval. McGraw-Hill, Inc., Hightstown, NJ.
48. SALTON, G., ALLAN, J., AND BUCKLEY, C. 1993. Approaches to passage retrieval in full text information systems. In Proceedings of the 16th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '93, Pittsburgh, PA, June 27-July), R. Korfhage, E. Rasmussen, and P. Willett, Eds. ACM Press, New York, NY, 49-58.
49. SALTON, G., FOX, E. A., AND WU, H. 1983. Extended Boolean information retrieval. Commun. ACM 26, 12 (Dec.), 1022-1036.
50. SCHIETTECATTE, F. AND FLORANCE, V. 1995. Document retrieval using the MPS information server. In Proceedings of the 4th Text Retrieval Conference (TREC-4, Washington, D.C., Nov.), D. K. Harman, Ed. National Institute of Standards and Technology, Gaithersburg, MD, 401-419.
51. TAHANI, V. 1978. A fuzzy model of document retrieval systems. Inf. Process. Manage. 12, 3, 177-187.
52. TEASDALE, S. 1920. Flame and Shadow. Macmillan, New York, NY.
53. THOMAS, S. W., ALEXANDER, K., AND GUTHRIE, K. 1999. Technology choices for the JSTOR online archive. IEEE Computer 32, 2 (Feb.), 60-65.
54. TURTLE, H. 1994. Natural language vs. Boolean query evaluation: a comparison of retrieval performance. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 212-220.
55. TURTLE, H. AND FLOOD, J. 1995. Query evaluation: Strategies and optimizations. Inf. Process. Manage. 31, 6 (Nov.), 831-850.
56. TURTLE, H. R. AND CROFT, W. B. 1992. A comparison of text retrieval models. Comput. J. 35, 3 (June), 279-290.
57. WALLER, W. G. AND KRAFT, D. H. 1979. A mathematical model for a weighted Boolean retrieval system. Inf. Process. Manage. 15, 5, 235-245.
58. WILKINSON, R. 1994. Effective retrieval of structured documents. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 311-317.
59. WILKINSON, R. AND ZOBEL, J. 1994. Comparison of fragmentation schemes for document retrieval. In Proceedings of the 3rd Text Retrieval Conference (TREC-3, Nov.), 81-84.
60. XU, J. AND CROFT, W. B. 1996. Query expansion using local and global document analysis. In Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '96, Zurich, Switzerland, Aug. 18-22), H.-P. Frei, D. Harman, P. Schaüble, and R. Wilkinson, Eds. ACM Press, New York, NY, 4-11.