Compressed inverted indexes for in-memory search engines

Proceedings of the 10th Workshop on Algorithm Engineering and Experiments and the 5th Workshop on Analytic Algorithmics and Combinatorics

Volumn , Issue , 2008, Pages 3-12

  Transier, Frederik ^a   Sanders, Peter ^b  

^a SAP RESEARCH   (Germany)

^b UNIVERSITY OF KARLSRUHE   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

INDEXING (OF INFORMATION); INFORMATION RETRIEVAL;

ALGORITHMICS; BOOLEAN QUERIES; DATA BASE; DATA COMPRESSION TECHNIQUES; INVERTED INDICES; MEMORY SEARCHES; REAL-WORLD; SUFFIX ARRAYS; SYSTEM USE; TEXT DATA;

SEARCH ENGINES;

EID: 58349086735     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972887.1     Document Type: Conference Paper

References (23)

1. Sanders, P., Transier, F.: Intersection in integer inverted indices. In: Proceedings of the 9th Workshop on Algorithm Engineering and Experiments ALENEX, SIAM (2007) 71-83
2. Golomb, S.: Run-length encodings. IEEE Transactions on Information Theory 12 (1966) 399-401
3. Zobel, J., Moffat, A.: Inverted files for text search engines. ACM Computing Surveys 38 (2006)
4. Culpepper, J.S., Moffat, A.: Compact set representation for information retrieval. In: SPIRE. Lecture Notes in Computer Science, Springer (2007)
5. Zobel, J., Moffat, A., Sacks-Davis, R.: Storage management for files of dynamic records. In: Proceedings of the 4th Australian Database Conference, Brisbane, Australia, World Scientific (1993) 26-38
6. Brown, E.W., Callan, J.P., Croft, W.B., Moss, J.E.B.: Supporting full-text information retrieval with a persistent object store. In: Proceedings of the Fourth Internationl Conference on Extending Database Technology EDBT'94. (1994) 365-378
7. Strohman, T., Croft, W.B.: Efficient document retrieval in main memory. In: Proceedings of the 30th annual international conference on Research and development in information retrieval SIGIR '07, New York, NY, USA, ACM Press (2007) 175-182
8. Luk, R.W.P., Lam, W.: Efficient in-memory extensible inverted file. Information Systems 32 (2007) 733-754
9. Cutting, D., Pedersen, J.: Optimization for dynamic inverted index maintenance. In: Proceedings of the 13th annual international conference on Research and development in information retrieval SIGIR '90, New York, NY, USA, ACM Press (1990) 405-411
10. Gutwin, C., Paynter. G., Witten, I., Nevill-Manning, C., Frank, E.: Improving browsing in digital libraries with keyphrase indexes. Decision Support Systems 27 (1999) 81-104
11. Bahle, D., Williams, H.E., Zobel, J.: Efficient phrase querying with an auxiliary index. In: Proceedings of the 25th annual international conference on Research and development in information retrieval SIGIR '02, New York, NY, USA, ACM Press (2002) 215-221
12. Williams, H.E., Zobel, J., Bahle, D.: Fast phrase querying with combined indexes. ACM Transactions on Information Systems 22 (2004) 573-594
13. Navarro, G., Mäkinen, V.: Compressed full-text indexes. ACM Computing Surveys 39 (2007)
14. González, R., Navarro, G.: Compressed text indexes with fast locate. In: Proceedings of the 18th Annual Symposium on Combinatorial Pattern Matching CPM'07. Lecture Notes in Computer Science, Springer (2007) 216-227
15. Witten, I.H., Moffat, A., Bell, T.C.: Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann (1999)
16. Ferragina, P., Fischer, J.: Suffix arrays on words. In: Proceedings of the 18th Annual Symposium on Combinatorial Pattern Matching CPM'07. Lecture Notes in Computer Science, Springer (2007) 328-339
17. Puglisi, S.J., Smyth, W.F., Turpin, A.: Inverted files versus suffix arrays for locating patterns in primary memory. In: SPIRE. Volume 4209 of Lecture Notes in Computer Science., Springer (2006) 122-133
18. Bast, H., Mortensen, C.W., Weber, I.: Output-sensitive autocompletion search. JIR (2007) to appear, special issue on SPIRE 2006.
19. H. Bast et al.: Seminar: Searching with suffix arrays. http://search.mpi-inf.mpg.de/wiki/IrSeminarWs06 (2007)
20. Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval. Addison-Wesley, New York (1999)
21. Young, R.M.: Euler's constant. The Mathematical Gazette 75 (1991) 187-190
22. Barbay, J., López-Ortiz, A., Lu, T.: Faster adaptive set intersections for text searching. In Àlvarez, C., Serna, M.J., eds.: Experimental Algorithms, 5th International Workshop, WEA. Volume 4007 of LNCS., Springer (2006) 146-157
23. Jansen, B.J., Spink, A., Bateman, J., Saracevic, T.: Real life information retrieval: a study of user queries on the web. SIGIR Forum 32 (1998) 5-17