Improvement in TF-IDF scheme for web pages based on the contents of their hyperlinked neighboring pages

Systems and Computers in Japan

Volumn 36, Issue 14, 2005, Pages 56-68

  Sugiyama, Kazunari ^a,c,d,e,f,g   Hatano, Kenji ^a,c,e,g   Yoshikawa, Masatoshi ^b,c,e,g   Uemura, Shunsuke ^a,c,e,g  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b NAGOYA UNIVERSITY   (Japan)

^c IPSJ   (Japan)

^d Japanese Society for Artificial Intelligence   (Japan)

^e ASSOCIATION FOR COMPUTING MACHINERY   (United States)

^f American Association for Artificial Intelligence   (United States)

^g IEEE

Author keywords

Hyperlink; Information retrieval; TF IDF scheme; WWW

Indexed keywords

HYPERLINKS; TF-IDF SCHEME; VECTOR SPACE MODEL;

INFORMATION RETRIEVAL; MATHEMATICAL MODELS; VECTORS;

WORLD WIDE WEB;

EID: 27844559171     PISSN: 08821666     EISSN: None     Source Type: Journal    
DOI: 10.1002/scj.20189     Document Type: Article

References (30)

1. Baeza-Yates R, Saint-Jean F, Castillo C. Web structure, dynamics and page quality. Proc 9th International Symposium on String Processing and Information Retrieval (SPIRE 2002), p 117-130.
2. Broder A, Raghavan P. Combining text- and link-based information retrieval on the web. SIGIR'01 Pre-Conference Tutorials.
3. Page L. The PageRank citation ranking: Bringing order to the web. http://google.stanford.edu/~backrub/pageranksub.ps, 1998.
4. Brin S, Page L. The anatomy of a large-scale hypertextual web search engine. Proc 7th International World Wide Web Conference (WWW7), p 107-117, 1998.
5. Kleinberg JM. Authoritative sources in a hyperlinked environment. Proc 9th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA 1998), p 668-677.
6. IBM Almaden Research Center. Clever Searching. http://www.almaden.ibm. com/cs/k53/clever.html
7. Salton G, McGill MJ. Introduction to modern information retrieval. McGraw-Hill; 1983.
8. Tajima K, Mizuuchi Y, Kitagawa M, Tanaka K. Cut as a querying unit for WWW, netnews, e-mail. Proc 9th ACM Conference on Hypertext and Hypermedia (Hypertext '98), p 235-244.
9. Tajima K, Hatano K, Matsukura T, Sano R, Tanaka K. Discovery and retrieval of logical information units in web. Proc 1999 ACM Digital Libraries Workshop on Organizing Web Space (WOWS '99), p 13-23.
10. Li W-S, Selçuk Candan K, Vu Q, Agrawal D. Retrieving and organizing web pages by "Information Unit". Proc 10th International World Wide Web Conference (WWW 10), p 230-244, 2001.
11. Chakrabarti S, Dom B, Raghavan P, Rajagopalan S, Gibson D, Kleinberg J. Automatic resource compilation by analyzing hyperlink structure and associated text. Proc 7th International World Wide Web Conference (WWW7), p 65-74, 1998.
12. Bharat K, Henzinger MR. Improved algorithms for topic distillation in a hyperlinked environment. Proc 21st Annual International ACM SIGIR Conference (SIGIR '98), p 104-111.
13. Li L, Shang Y, Zhang W. Improvement of HITS-based algorithms on web documents. Proc 11th International World Wide Web Conference (WWW2002), p 527-535.
14. Chakrabarti S. Integrating the document object model with hyperlinks for enhanced topic distillation and information extraction. Proc 10th International World Wide Web Conference (WWW 10), p 211-220, 2001.
15. Chakrabarti S, Joshi M, Tawde V. Enhanced topic distillation using text, markup tags, and hyperlinks. Proc 23rd Annual International ACM SIGIR Conference (SIGIR 2001), p 208-216.
16. Rafiei D, Mendelzon AO. What is this page known for? Computing web page reputations. Proc 9th International World Wide Web Conference (WWW9), p 823-835, 2000.
17. Haveliwala TH. Topic-sensitive PageRank. Proc 11th International World Wide Web Conference (WWW2002), p 517-526.
18. MacQueen J. Some methods for classification and analysis of multivariate observations. Proc 5th Berkeley Symposium on Mathematical Statistics and Probability, p 281-297, 1967.
19. Hawking D. Overview of the TREC-9 web track. NIST Special Publication 500-249: The Ninth Text REtrieval Conference (TREC-9), p 87-102, 2001.
20. Porter MF. An algorithm for suffix stripping. Program 1988;14:130-137.
21. Salton G, Buckley C. Term-weighting approaches in automatic text retrieval. Inf Process Manage 1988;24:513-523.
22. Sugiyama K, Hatano K, Yoshikawa M, Uemura S. Refinement of TF-IDF schemes for web pages using their hyperlinked neighboring pages. Proc 14th ACM Conference on HyperText and Hypermedia (HT '03), p 198-207.
23. Chakrabarti S, Gibson DA, McCurley KS. Surfing the web backwards. Proc 8th International World Wide Web Conference, p 1679-1693, 1999.
24. Kraaij W, Westerveld T. TNO/UT at TREC-9: How different are Web documents? http://trec.nist.gov/pubs/trec9/papers/tno-ut.pdf, 2000.
25. Crivellari F, Melucci M. Web document retrieval using passage retrieval, connectivity information, and automatic link weighting-TREC-9 report. http://trec.nist.gov/pubs/trec9/papers/jhuapl.pdf, 2000.
26. Clake CLA, Cormack GV, Kisman DIE, Lynam TR. Question answering by passage selection (MultiText experiments for TREC-9). http://trec.nist.gov/pubs/ trec9/papers/mt9.pdf, 2000.
27. Fujita S. Reflections on "Aboutness" TREC-9 evaluation experiments at Justsystem. http://trec.nist.gov/pubs/trec9/papers/jscbt9w_paper. pdf, 2000.
28. Savoy J, Rasolofo Y. Report on the TREC-9 experiment: Link-based retrieval and distributed collections. http://tree.nist.gov/pubs/trec9/papers/ unine9.pdf, 2000.
29. Singhal A, Kaszkiel M. AT&T at TREC-9. http://trec.nist.gov/pubs/ trec9/papers/att-trec9.pdf, 2000.
30. McNamee P, Mayfield J, Piatko C. The HAIRCUT system at TREC-9. http://trec.nist.gov/pubs/trec9/papers/jhuapl.pdf, 2000.