Performance modeling of a distributed web crawler using stochastic activity networks

Communications in Computer and Information Science

Volumn 6 CCIS, Issue , 2008, Pages 535-542

  Nasri, Mitra ^a   Shariati, Saeed ^a   Abdollahi Azgomi, Mohammad ^a  

^a IRAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Iran)

Author keywords

performance modeling; stochastic activity networks; Web crawler

Indexed keywords

COMMUNICATION OVERHEADS; DISTRIBUTED CRAWLER; FORMAL MODEL; ITS EVALUATION; PERFORMANCE MEASURE; PERFORMANCE MODELING; SAN MODELS; STOCHASTIC ACTIVITY NETWORKS; WEB CRAWLERS; WEB MINING;

COMPUTER SCIENCE; STOCHASTIC SYSTEMS;

STOCHASTIC MODELS;

EID: 78449236991     PISSN: 18650929     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-540-89985-3_66     Document Type: Conference Paper

References (17)

1. Adamic, L.A.: Zipf, Power-Laws, and Pareto - A Ranking Tutorial. White Paper, Information Dynamics Lab, HP Labs, Palo Alto, CA (2000)
2. Avizienis, A., Laprie, C.-J., Randell, B., Landwehr, C.: Basic Concepts and Taxonomy of Dependable and Secure Computing. IEEE Trans. on Dependable And Secure Computing 1(1), 11-33 (2004) (Pubitemid 40134576)
3. Baeza-Yates, R., Castillo, C.: Crawling the Infinite Web. Journal of Web Engineering 6(1), 49-72 (2007)
4. rd IEEE International Conference on Data Eng. (ICDE 2007) (2007)
5. Baeza-Yates, R., Castillo, C., Efthimiadis, E.N.: Characterization of National Web Domains. ACM Transaction on Internet Technology 7(2) (2005)
6. Boldi, P., Codenotti, B., Santini, M., Vigna, S.: UbiCrawler: a Scalable Fully Distributed Web Crawler. Journal of Software, Practice and Experience 34(8), 711-726 (2004)
7. th International Conference on World Wide Web, pp. 107-117 (1998)
8. Castillo, C.: Effective Web Crawling. PhD Thesis, University of Chile (2004)
9. Cho, J., Garcia-Molina, H.: Parallel Crawlers. In: Proc. of the 11th International Conference on World Wide Web, pp. 124-135. ACM Press, Honolulu (2002)
10. Deavours, D.D., et al.: The Möbius Framework and Its Implementation. IEEE Transaction on Software Engineering 28(10), 956-969 (2002)
11. Exposto, J., Macedo, J., Pina, A., Alves, A., Rufino, J.: Geographical Partition for Distributed Web Crawling. In: Proc. of the 2005 Workshop on Geographic Information Retrieval (GIR 2005), pp. 55-60. ACM Press, New York (2005)
12. Gomes, D., Silva, M.J.: The Viuva Negra Crawler. Technical Report (2006)
13. Heydon, A., Najork, M.: Mercator: A Scalable, Extensible Web Crawler. World Wide Web 2(4), 219-229 (1999)
14. Internet Growth and Statistics: Credits and Background, http://www.mit.edu/people/mkgray/net/background.html
15. Kahle, B.: The Internet Archive. RLG Diginews 6(3) (2002)
16. th Annual ACM Symposium on Theory of Computing, El Paso, Texas, pp. 654-663 (1997)
17. Movaghar, A., Meyer, J.F.: Performability Modeling with Stochastic Activity Networks. In: Proc. of the 1984 Real-Time Systems Symposium, Austin, TX, pp. 215-224 (1984)