Language independent ranked retrieval with NeWT

ADCS 2011 - Proceedings of the Sixteenth Australasian Document Computing Symposium

Volumn , Issue , 2011, Pages 18-25

  Culpepper, J Shane ^a   Yasukawa, Michiko ^b   Scholer, Falk ^a  

^a RMIT UNIVERSITY   (Australia)

^b GUNMA UNIVERSITY   (Japan)

Author keywords

Data Compression; Data Storage Representations; Experimentation; Language Independent Text Indexing; Measurement; Performance; Text Indexing

Indexed keywords

DATA STORAGE REPRESENTATION; DOCUMENT RETRIEVAL; EXPERIMENTAL STUDIES; EXPERIMENTATION; LINGUISTIC PROCESSING; MULTI-LINGUAL INFORMATION RETRIEVAL; PERFORMANCE; RANKED RETRIEVAL; SELF-INDEX; TEXT-INDEXING;

DATA COMPRESSION; MEASUREMENTS; SEARCH ENGINES;

INDEXING (OF INFORMATION);

EID: 84866633642     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (35)

1. J. E. Burnett, D. Cooper, M. F. Lynch, P. Willett, and M. Wycherley. Document retrieval experiments using indexing vocabularies of varying size. I. Variety generation symbols assigned to the fronts of index terms. Journal of Documentation, 35(3):197-206, September 1979.
2. S. Büttcher, C. L. A. Clarke, and G. V. Cormack. Information Retrieval: Implementing and evaluating search engines. MIT Press, Cambridge, Massachusetts, 2010.
3. W. B. Croft, D. Metzler, and T. Strohman. Search Engines: Information Retrieval in practice. Addison Wesley, Boston, 2010.
4. J. S. Culpepper, G. Navarro, S. J. Puglisi, and A. Turpin. Top-k ranked document search in general text databases. In ESA, Part II, volume 6347 of LNCS, pages 194-205. Springer, 2010.
5. R. Dale, H. Moisl, and H. Somers. Handbook of Natural Language Processing. CRC Press, New York, NY, 2000.
6. T. de Heer. The application of the concept of homeosemy to natural language information retrieval. Information Processing & Management, 18(5):229-236, 1982.
7. P. Ferragina and G. Manzini. Opportunistic data structures with applications. In FOCS, pages 390-398. IEEE, November 2000.
8. W. B. Frakes. Term conflation for information retrieval. In SIGIR, pages 383-389, August 1984.
9. F. Gey, R. Larson, J. Machado, and M. Yoshioka. NTCIR9-GeoTime overview - evaluating geographic and temporal search: Round 2. In Proceedings of NTCIR-9 Workshop Meeting (in printing), December 2011.
10. R. Grossi, A. Gupta, and J. S. Vitter. Higher-order entropy-compressed text indexes. In SODA, pages 841-850, January 2003.
11. D. Harman. How effective is suffixing? Journal of the American Society for Information Science, 42(1):7-15, 1991.
12. V. Hollink, J. Kamps, C. Monz, and M. de Rijke. Monolingual document retieval for European languages. Information Retrieval, 7(1-2):33-52, 2004.
13. W.-K. Hon, R. Shah, and J. S. Vitter. Space-efficient framework for top-k string retrieval problems. In FOCS, pages 713-722. IEEE, October 2009.
14. W.-K. Hon, R. Shah, and J. S. Vitter. Compression, indexing, and retrieval for massive string data. In CPM, volume 6129 of LNCS, pages 260-274. Springer, June 2010.
15. D. A. Hull. Stemming algorithms: A case study for detailed evaluation. Journal of the American Society for Information Science, 47(1):70-84, 1996.
16. R. Krovetz. Vierwing morphology as an inference process. In SIGIR, pages 191-202, June 1993.
17. K. L. Kwok. Comparing representations in Chinese information retrieval. In SIGIR 1997, pages 34-41. ACM Press, August 1997.
18. J. B. Lovins. Development of a stemming algorithm. Mechanical Translation and Computational Linguistics, 11(1-2):22-31, 1968.
19. R. W. P. Luk and K. L. Kwok. A comparison of Chinese document indexing strategies and retrieval models. ACM Transactions on Asian Language Information Processing, 1(3):225-268, 2002.
20. C. D. Manning, P. Raghavan, and H. Schütze. Introduction to Information Retrieval. Cambridge University Press, Cambridge, UK, 2008.
21. P. McNamee and J. Mayfield. Character n-gram tokenization for European language text retrieval. Information Retrieval, 7(1-2):73-97, 2004.
22. P. McNamee, C. Nicholas, and J. Mayfield. Don't have a stemmer? Be un+concern+ed. In SIGIR, pages 813-814. ACM Press, July 2008.
23. S. Mithukrishnan. Efficient algorithms for document retrieval problems. In SODA, pages 657-666, January 2002.
24. G. Navarro and V. Mäkinen. Compressed full-text indexes. ACM Computing Surveys, 39(1):2-1 - 2-61, 2007.
25. J.-Y. Nie, K. Gao, J. Zhang, and M. Zhou. On the use of words and n-grams for Chinese information retrieval. In IRAL 2000, pages 141-148. ACM Press, 2000.
26. C. D. Paice. Another stemmer. ACM SIGIR Forum, 24(3):56-61, 1990.
27. M. F. Porter. An algorithm for suffix stripping. Program, 14(3):130-137, July 1980.
28. S. E. Robertson, S. Walker, S. Jones, M. Hancock-Beaulieu, and M. Gatford. Okapi at TREC-3. In TREC-3, 1994.
29. R. Song, M. Zhang, T. Sakai, M. Kato, Y. Liu, M. Sugimoto, Q. Wang, and N. Orii. Overview of the NTCIR-9 INTENT tasks. In Proceedings of NTCIR-9 Workshop Meeting (in printing), December 2011.
30. N. Välimäki and V. Mäkinen. Space-efficient algorithms for document retrieval. In CPM, volume 4580 of LNCS, pages 205-215. Springer, July 2007.
31. Ellen M. Voorhees and Donna K. Harman. Overview of the Eighth Text REtrieval Conference (TREC-8). In TREC-8, pages 1-24, 1999.
32. P. Willett. Document retrieval experiments using indexing vocabularies of varying size. II. Hashing, truncation, digram and trigram encoding of index terms. Journal of Documentation, 35(4):296-305, December 1979.
33. I. H. Witten, A. Moffat, and T. C. Bell. Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann, San Francisco, second edition, 1999.
34. M. Yasukawa and H. Yokoo. Composition and decomposition of Japanese katakana and kanji morphemes for decision rule induction from patent documents. In ADCS, pages 28-35, December 2010.
35. J. Zobel and A. Moffat. Inverted files for text search engines. ACM Computing Surveys, 38(2):6-1 - 6-56, 2006.