An architecture for a focused trend parallel Web crawler with the application of clickstream analysis

Information Sciences

Volumn 184, Issue 1, 2012, Pages 266-281

  Ahmadi Abkenari, Fatemeh ^a   Selamat, Ali ^a  

^a UNIVERSITI TEKNOLOGI MALAYSIA   (Malaysia)

Author keywords

Clickstream analysis; Focused crawlers; Parallel crawlers; Web data management; Web page importance metrics

Indexed keywords

CLICKSTREAMS; FOCUSED CRAWLER; PARALLEL CRAWLERS; WEB DATA MANAGEMENT; WEB PAGE;

INFORMATION MANAGEMENT; NETWORK ARCHITECTURE; SEARCH ENGINES; WEBSITES;

USER INTERFACES;

EID: 80055049887     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2011.08.022     Document Type: Article

References (21)

1. F. Ahmadi-Abkenari, and A. Selamat Application of clickstream analysis in a tailored focused web crawler International Journal of Communications of SIWN-The Systemic and Informatics World Network 10 2010 137 144
2. K. Bharat, M.R. Henzinger, Improved algorithms for topic distillation in a hyperlinked environment, in: Proceedings of the 21st ACM SIGIR Conference on Research and Development in Information Retrieval, 1998, pp. 104-111.
3. S. Brin, and L. Page The anatomy of a large-scale hypertextual web search engine Computer Networks 30 1-7 1998 107 117
4. S. Chakrabarti Mining the Web Discovering Knowledge from Hypertext Data 2003 Morgan Kaufman
5. S. Chackrabarti, Integrating document object model with hyperlinks for enhanced topic distillation and information extraction, in: Proceedings of the 13th international World Wide Web Conference (WWW'01), 2001, pp. 211-220.
6. S. Chackrabarti, B. Dom, D. Gibson, J. Kleinberg, R. Kumar, P. Raghavan, S. Rajagopalan, and A. Tomkins Mining the link structure of the world wide web IEEE Computer 32 8 1999 60 67
7. S Chackrabarti, B. Dom, P. Raghavan, S. Rajagopalan, D. Gibson, J. Kleinberg, Automatic resource compilation by analyzing hyperlink structure and associated text, in: Proceedings of the 7th international World Wide Web Conference (WWW'7), 1998.
8. S. Chakrabarti, M. van den Berg, and B. Dom Focused crawling: a new approach to topic specific web resource discovery Computer Networks 31 11-16 1999 1623 1640
9. J. Cho, H. Garcia-Molina, Parallel crawlers, in: Proceedings of 11th International Conference on World Wide Web, ACM Press, 2002.
10. J. Cho, H. Garcia-Molina, L. Page, Efficient crawling through URL ordering, in: Proceedings of 7th international Conference on World Wide Web, 1998.
11. M. Diligenti, F.M. Coetzee, S. Lawrence, C.L. Giles, M. Gori, Focused crawling using context graph, in: Proceedings of the 26th VLDB Conference, Cairo, Egypt, 2000, pp. 527-534.
12. P. Giudici Applied Data Mining Web Clickstream Analysis 2003 Wiley Press Chapter 8, ISBN:0-470-84678-X
13. J. Kleinberg Authoritative sources in a hyperlinked environment Journal of the ACM 46 5 1999 604 632
14. B. Liu Web Data Mining Information Retrieval and Web Search 2007 Springer Press Chapter 6, ISBN:3-540-37881-2
15. J. Madhavan, D. Ko, L. Kot, V. Ganapathy, A. Rasmussen, A. Halevy, Google's deep web crawl, in: Proceedings of VLDB'08, Auckland, New Zealand, 2008.
16. J. Makhoul, F. Kubala, R. Schwartz, R. Weischedel, Performance measures for information extraction, in: Proceedings of DARPA Broadcast News Workshop Herndon, VA, 1999, pp 49-252.
17. A. McCallum, K. Nigam, A comparison of event models for Naïve Baes text classification, in: Proceedings of the AAAI-98 Workshop on Learning for Text Categorization, 1998.
18. F. Menczer, G. Pant, and P. Srinivasan Topical web crawlers: evaluating adaptive algorithms ACM Transactions on Internet Technology 4 4 2004 378 419 (Pubitemid 40009828)
19. A. Selamat, F. Ahmadi-Abkenari, Application of clickstream analysis as web page importance metric in parallel crawlers, in: Proceedings of the International Symposium on Information Technology (ITSIM'10), Kuala Lumpur, Malaysia, 2010.
20. A. Selamat, F. Ahmadi-Abkenari, Architecture for a parallel focused crawler for clickstream analysis, in: Proceedings of the Third International Conference on Intelligent Information and Database Systems (ACIIDS 2011), Daegu, South Korea, LNAI 6591, 2011, pp. 27-35.
21. P.S. Yu, X. Li, B. Liu. Adding the temporal dimension to search - a case study in publication search, in: Proceedings of Web Intelligence (WI'05), 2005, pp. 543-549. (Pubitemid 44419114)