Towards a unified approach to document similarity search using manifold-ranking of blocks

Information Processing and Management

Volumn 44, Issue 3, 2008, Pages 1032-1048

  Wan, Xiaojun ^a   Yang, Jianwu ^a   Xiao, Jianguo ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

Document segmentation; Document similarity search; Manifold ranking; Web page segmentation; Web similarity search

Indexed keywords

DATA PROCESSING; GRAPH THEORY; INFORMATION RETRIEVAL; LEARNING ALGORITHMS; QUERY PROCESSING;

DOCUMENT SEGMENTATION; DOCUMENT SIMILARITY SEARCH; MANIFOLD RANKING; WEB PAGE SEGMENTATION; WEB SIMILARITY SEARCH;

INFORMATION RETRIEVAL SYSTEMS;

EID: 40649129226     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2007.07.012     Document Type: Article

References (48)

1. Allan, J., Carbonell, J., Doddington, G., Yamron, J. P. & Yang, Y. (1998). Topic detection and tracking pilot study: Final report. In Proceedings of DARPA Broadcast News Transcription and Understanding Workshop (pp. 194-218).
2. Baeza-Yates R., and Ribeiro-Neto B. Modern information retrival (1999), ACM Press and Addison Wesley
3. Cai, D., Yu, S., Wen, J. -R., & Ma, W. -Y. (2003). VIPS: A vision based page segmentation algorithm. Microsoft technical report, MSR-TR-2003-79.
4. Cai, D., He, X., Wen, J. -R., & Ma, W. -Y. (2004). Block-level link analysis. In Proceedings of the 27th annual international ACM SIGIR conference (SIGIR'2004).
5. Callan, J. (1994). Passage-level evidence in document retrieval, In Proceedings of the 17th annual international ACM SIGIR conference on research and development in information retrieval (pp. 302-310).
6. Chen, J., Zhou, B., Shi, J., Zhang, H. -J., & Qiu, F. (2001). Function-based object model towards website adaptation. In Proceedings of the 10th world wide web conference (WWW10).
7. Choi, F. (1999). JTextTile: A free platform independent text segmentation algorithm. http://www.cs.man.ac.uk/~choif.
8. Croft B., and Lafferty J. Language modeling for information retrieval (2003), Kluwer Academic Publishers
9. Cruz, I. F., Borisov, S., Marks, M. A., Webb, T. R. (1998). Measuring structural similarity among web documents: Preliminary results. In Proceedings of the 7th international conference on electronic publishing (pp. 513-524).
10. Dean, J., & Henzinger, M. R. (1999). Finding related pages in the World Wide Web. In Proceedings of the eighth international conference on world wide web (pp. 1467-1479).
11. Diaz, F. (2005). Regularizing ad hoc retrieval scores. In Proceedings of the 14th ACM international conference on information and knowledge management (CIKM'2005).
12. Erkan G., and Radev D. LexRank: Graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research (JAIR) 22 (2004) 457-479
13. Fogaras, D., & Rácz, B. (2004). Scaling link-based similarity search. Technical report.
14. Haveliwala, T.H., Gionis, A., Klein, D., Indyk, P. (2002). Evaluating strategies for similarity search on the Web. In Proceedings of WWW2002 (pp. 432-442).
15. ndP meeting of the association for computational linguistics, Los Cruces, NM.
16. Hearst M.A. TextTiling: Segmenting text into multi-paragraph subtopic passages. Computational Linguistics 23 1 (1997) 33-64
17. Hearst, M. A., & Pedersen, O. (1996). Reexamining the cluster hypothesis: Scatter/Gather on retrieval results. In Proceedings of SIGIR1996 (pp. 76-84).
18. thP annual international ACM/SIGIR conference, Pittsburgh, PA.
19. Iwayama, M., Fujii, A., Kando, N., Marukawa, Y. (2003). An empirical study on retrieval models for different document genres: Patents and newspaper articles. In Proceedings of SIGIR2003.
20. Jeh, G., & Widom, J. (2002). SimRank: A measure of structural-context similarity. In Proceedings of the eighth ACM SIGKDD international conference on knowledge discovery and data mining.
21. Joshi, S., Agrawal, N., Krishnapuram, R., Negi, S. (2003). A bag of paths model for measuring structural similarity in web documents. In Proceedings of the 9th ACM SIGKDD conference (pp. 577-582).
22. Kaszkiel M., and Zobel J. Passage retrieval revisited. ACM SIGIR Forum 31 SI (1997) 178-185
23. Kaufmann, S. (1999). Cohesion and collocation: Using context vectors in text segmentation, In Proceedings of the 37th conference on association for computational linguistics (pp. 591-595).
24. Kleinberg J.M. Authoritative sources in a hyperlinked environment. Journal of the ACM 46 5 (1999) 604-632
25. Kovacevic, M., Diligenti, M., Gori, M., & Milutinovic, V. (2002). Recognition of common areas in a web page using visual information: A possible application in a page classification. In Proceedings of 2002 IEEE international conference on data mining (ICDM'02), Maebashi City, Japan.
26. Kurland, O., Lee, L. (2005). PageRank without hyperlinks: Structural re-ranking using links induced by language models. In Proceedings of SIGIR2005 (pp. 306-313).
27. Kurland, O., Lee, L. (2006). Respect my authority! HITS without hyperlinks: utilizing cluster-based language models. In Proceedings of SIGIR2006.
28. Kurland, O., Lee, L., Domshlak, C. (2005). Better than the real thing? Iterative pseudo-query processing using cluster-based language models. In Proceedings of SIGIR2005.
29. Lin, Z., Lyu, M.R., King, I. (2006). PageSim: A novel link-based measure of web page similarity. In Proceeding of the 15th international world wide web conference.
30. Mihalcea, R., Tarau, P. (2004). Textrank: Bringing order into texts. In Proceedings of EMNLP 2004 (pp. 404-411).
31. Otterbacher, J., Erkan, G., Radev, D. (2005). Using random walks for question-focused sentence retrieval. In Proc. HLT/EMNLP 2005.
32. Page, L., Brin, S., Motwani, R., Winograd, T. (1998). The pagerank citation ranking: Bringing order to the web, Technical report. Stanford, CA: Stanford University.
33. Porter M.F. An algorithm for suffix stripping. Program 14 3 (1980) 130-137
34. Qin, T., Liu, T. -Y., Zhang, X. -D., Chen, Z., Ma, W. -Y. (2005). A study of relevance propagation for web search. In Proceedings of SIGIR2005.
35. Robertson, S., Walker, S. (1994). Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval. In Proc. of the 17th international ACM/SIGIR conference on research and development in information retrieval (pp. 232-241).
36. Robertson, S., Walker, S., Beaulieu, M. (1999) Okapi at TREC-7: Automatic ad hoc, filtering, VLC and filtering tracks. In Proceedings of TREC'99.
37. Salton G. The SMART retrieval system: Experiments in automatic document processing (1991), Prentice-Hall
38. Salton G., Wong A., and Yang C.S. A vector space model for automatic indexing. Communications of the ACM 18 11 (1975) 613-620
39. Singhal, A., Buckley, C., & Mitra, M. (1996). Pivoted document length normalization. In Proceedings of SIGIR'96.
40. Smucker, M.D., & Allan, J. (2006). Find-similar: Similarity browsing as a search tool. In Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR'2006) (pp. 461-468).
41. Song, R., Liu, H., Wen, J. -R., & Ma, W. -Y. (2004). Learning block importance models for web pages. In Proceeding of the thirteenth world wide web conference (WWW 2004) (pp. 203-211).
42. Tombros, A., & Ali, Z. (2005). Factors affecting web page similarity. In Proceedings of ECIR2005.
43. van Rijsbergen C.J. Information retrieval (1979), Butterworths, London
44. Xue, G. -R., Zeng, H. -J., Chen, Z., & Yu, Y. (2004). MRSSA: An iterative algorithm for similarity spreading over interrelated objects. In Proceedings of CIKM2004.
45. Yu, S., Cai, D., Wen, J. -R., Ma, W. -Y. (2003). Improving pseudo-relevance feedback in web information retrieval using web page segmentation. In Proceedings of the twelfth international world wide web conference (WWW2003).
46. Zhang, B., Li, H., Liu, Y., Ji, L., Xi, W., Fan, W., Chen, Z., Ma, W. -Y. (2005). Improving web search results using affinity graph. In Proceedings of SIGIR2005.
47. Zhou, D., Weston, J., Gretton, A., Bousquet, O., Schölkopf, B. (2003). Ranking on data manifolds. In Proceedings of NIPS-2003.
48. Zhou, D., Bousquet, O., Lal, T. N., Weston, J., Schölkopf, B. (2003). Learning with local and global consistency. In Proceedings of NIPS-2003.