Revisiting Document Length Hypotheses: A Comparative Study of Japanese Newspaper and Patent Retrieval

ACM Transactions on Asian Language Information Processing

Volumn 4, Issue 2, 2005, Pages 207-235

  Fujita, Sumio ^a  

^a YAHOO JAPAN CORPORATION   (Japan)

Author keywords

Document length hypotheses; Experimentation; Language modeling approach to IR; Test collections

Indexed keywords

EID: 69249227950     PISSN: 15300226     EISSN: 15583430     Source Type: Journal    
DOI: 10.1145/1105696.1105853     Document Type: Article

References (30)

1. Berger, A., and Lafferty, J. 1999. Information retrieval as statistical translation. In Proceedings of the 1999 ACM SIGIR Conference on Research and Development in Information Retrieval, Berkeley, CA, 222-229
2. Callan, J.P., Lu, Z., and Croft, W.B. 1995. Searching distributed collections with inference networks. In Proceedings of the 1995 ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, WA, 21-28
3. Chen, K.H., Chen, H.H., Kishida, K., Kuriyama, K., Kando, N., Lee, S., Myaeng, S.H., Eguchii, K., and Kim, H. 2002. Overview of CLIR task at the third NTCIR workshop. In Working Notes of the Third NTCIR Workshop Meeting, Part I: Overview, 23-60
4. Evans, D.A., and Lefferts, R. 1993. Design and evaluation of the CLARIT-TREC-2 System. In NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC 2), 137-150
5. Fang, H. Tao, T., and Zhai, C. 2003. An exploration of formalized information retrieval heuristics. In Proceedings of the ACM SIGIR 2003 Workshop on Mathematical/Formal Methods in IR, Toronto, Canada
6. Fujii, A., Iwayama, M., and Kando, N. 2004. Overview of Patent Retrieval Task at NTCIR-4. In Working notes of the fourth NTCIR workshop meeting, 225-232
7. Fujita, S. 2000. Reflections on “Aboutness”-TREC-9 Evaluation experiments at Justsystem. In NIST Special Publication 500-249: The Ninth Text REtrieval Conference (TREC 9), 281-288
8. Fujita, S. 2001. More reflections on “Aboutness”-TREC-2001 Evaluation experiments at Justsystem. In NIST Special Publication 500-250: The Tenth Text REtrieval Conference (TREC 2001), 331-338
9. Hiemstra, D., and Kraaij, W. 1998. Twenty-one at TREC-7: Ad-hoc and cross-language track. In NIST Special Publication 500-242: The Seventh Text REtrieval Conference (TREC 7), 227-238
10. Iwayama, M., Fujii, A., Kando, N., and Takano, A. 2002. Overview of Patent Retrieval Task at NTCIR-3. In Working notes of the third NTCIR workshop meeting, Part I: Overview, 67-76
11. Iwayama, M., Fujii, A., Kando, N., and Marukawa, Y. 2003. An empirical study on retrieval models for different document genres: patents and newspaper articles. In Proceedings of the 2003 ACM SIGIR Conference on Research and Development in Information Retrieval, Toronto, Canada, 251-258
12. Kando, N. 2004. Overview of the Fourth NTCIR Workshop. In Working notes of the fourth NTCIR workshop meeting, i-viii
13. Kishida, K., Chen, K.H., Lee, S., Kuriyama, K., Kando, N., Chen, H.H., Myaeng, S.H., and Eguchi, K. 2004. Overview of CLIR Task at the Fourth NTCIR Workshop. In Working notes of the fourth NTCIR workshop meeting, 1-59
14. Kraaij, W., Westerveld, T., and Hiemstra, D. 2002. The importance of prior probabilities for entry page search. In Proceedings of the Twenty-Fifth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2002), Tampere, Finland, 27-34
15. Kwok, K.L., Papadopolous, L., and Kwan, K.Y.Y. 1992. Retrieval experiments with a large collection using PIRCS, NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1), 153-172
16. Lafferty, J., and Zhai, C. 2001. Document language models, query models, and risk minimization for information retrieval. In Proceedings of the 2001 ACM SIGIR Conference on Research and Development in Information Retrieval, New Orleans, LA, 111-119
17. Larkey, L.S. 1999. A patent search and classification system. In Digital Libraries 99 - The Fourth ACM Conference on Digital Libraries, Berkeley, CA, Aug 1999, 79-87
18. Larkey, L.S., Connell, M., and Callan, J. 2000. Collection selection and results merging with topically organized U.S. Patents and TREC Data. In Proceedings of the Ninth International Conference on Information Knowledge and Management, Washington D.C., 2000, 282-289
19. Miller, D.H., Leek, T., and Schwartz, R. 1999. A hidden Markov model information retrieval system, In Proceedings of the 1999 ACM SIGIR Conference on Research and Development in Information Retrieval, Berkeley, CA, 214-221
20. Ogilvie, O., and Callan, J. 2002. Experiments using the lemur toolkit. In NIST Special Publication 500-250: The Tenth Text REtrieval Conference (TREC 2001), 103-108
21. Ponte, J., and Coft, W.B. 1998. A language modeling approach to information retrieval. In Proceedings of the 1998 ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia, 275-281
22. Robertson, S.E., and Walker S. 1994. Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval. In Proceedings of the 1994 ACM SIGIR Conference on Research and Development in Information Retrieval, Dublin, Ireland, 232-241
23. Robertson, S.E., Walker, S., Jones, S.M., Hancock-Beaulieu, M., and Gatford, M. 1995. Okapi at TREC-3. In NIST Special Publication 500-226: Overview of the Third Text REtrieval Conference (TREC-3), 109-126
24. Robertson, S.E., and Walker S. 1997. On relevance weights with little relevance information. In Proceedings of the 1997 ACM SIGIR Conference on Research and Development in Information Retrieval, Philadelphia, PA, 16-24
25. Rocchio, J.J. 1971. Relevance feedback in information retrieval, In The SMART Retrieval System: Experiments in Automatic Document Processing, G. SALTON, ed., Prentice-Hall, Englewood Cliffs, NJ, 313-323
26. Salton, G. 1988. Automatic Text Processing-The Transformation, Analysis, and Retrieval of Information by Computer, Addison-Wesley Publishing Company, Reading, MA
27. Singhal, A., Buckley, C., and Mitra, M. 1996. Pivoted document length normalization. In Proceedings of the 1996 ACM SIGIR Conference on Research and Development in Information Retrieval, Zurich, Switzerland, 21-29
28. Westerveld, T., Kraaij, W., and Hiemstra, D. 2002. Retrieving Web pages using content, links, URLs and anchors. In NIST Special Publication 500-250: The Tenth Text REtrieval Conference (TREC 2001), 663-672
29. Zhai, C., and Lafferty, J. 2001a. Model-based feedback in the KL-divergence retrieval model. In Proceedings of the Tenth International Conference on Information and Knowledge Management (CIKM 2001), Atlanta, GA, 403-410
30. Zhai, C., and Lafferty, J. 2001b. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of the 2001 ACM SIGIR Conference on Research and Development in Information Retrieval, New Orleans, LA, 334-342