BioCrawler: An intelligent crawler for the semantic web

Expert Systems with Applications

Volumn 35, Issue 1-2, 2008, Pages 524-530

  Batzios, Alexandros ^a   Dimou, Christos ^a   Symeonidis, Andreas L ^a   Mitkas, Pericles A ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Focused crawling; Multi agent system; Semantic web; Web crawling

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SOFTWARE; ECOLOGY; INFORMATION RETRIEVAL; INFORMATION RETRIEVAL SYSTEMS; INFORMATION SERVICES; INFORMATION THEORY; INTELLIGENT AGENTS; SEARCH ENGINES; SEMANTIC WEB; SEMANTICS; STABILIZERS (AGENTS);

ELSEVIER (CO); EXPERIMENTAL APPROACHES; LEARNING STRATEGIES; SEMANTIC CONTENTS; STATE OF THE ARTS; WEB CRAWLING; WEB SEARCHES;

WORLD WIDE WEB;

EID: 44949162142     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2007.07.054     Document Type: Article

References (35)

1. Bates A.D., and Maxwell A. DNA Topology in Focus series (1993), Springer, New York, NY
2. Bellifemine F., Poggi A., and Rimassa G. Developing multi-agent systems with a FIPA-compliant agent framework. Software, Practice and Experience 31 (2001) 103-128
3. Boldi P., Codenotti B., Santini M., and Vigna S. UbiCrawler: A scalable fully distributed Web crawler. Software, Practice and Experience 34 8 (2004) 711-726
4. Boldi, P., Santini, M., & Vigna, S., (2004). Do your worst to make the best: Paradoxical effects in pagerank incremental computations. In Proceedings of the third Workshop on Web Graphs (WAW), volume 3243 of Lecture Notes in Computer Science (pp. 168-180). Rome, Italy: Springer.
5. Bousquet F., Cambier C., and Morand P. Distributed Artificial Intelligence and Object-Oriented Modelling of a Fishery Mathematical. Computation Modelling 20 8 (1994) 97-107
6. Branden C., and Tooze J. Introduction to Protein Structure. Second ed. (1999), Garland Publishing Inc, New York, NY
7. Brin S., and Page L. The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems 30 1-7 (1998) 107-117
8. Chakrabarti, S., van der Berg, M., & Dom, B., (1999). Focused crawling: a new approach to topic-specific Web resource discovery. In Proceedings of eighth International World Wide Web Conference (pp. 545-562).
9. Cho, J., Garcia-Molina, H., & Page, L., (1998). Efficient crawling through URL ordering. In Proceedings of the seventh conference on World Wide Web.
10. Da Silva, A.S., Veloso, E.A., Golgher, P.B., Ribeiro-Neto, B.A., Laender, A.H.F., & Ziviani, N., (1999). Cobweb a crawler for the Brazilian web. In Proceedings of String Processing and Information Retrieval (SPIRE) (pp. 184-191). Cancun, Mexico: IEEE CS Press.
11. Diligenti, M., Coetzee, F., Lawrence, S., Giles, C.L. & Gori, M., (2000). Focused crawling using context graphs. In Proceedings of 26th International Conference on Very Large Databases (pp. 527-534) VLDB 2000.
12. Edwards, J., McCurley, K.S., & Tomlin, J.A., (2001). An adaptive model for optimizing performance of an incremental web crawler. In Proceedings of the Tenth Conference on World Wide Web (pp. 106-113).
13. Eichmann, D., (1994). The RBSE spider: balancing effective search against Web load. In Proceedings of the First World Wide Web Conference, Geneva, Switzerland (pp. 113-120).
14. Epstein, J.M., & Axtell, R.L., 1996. Growing Artificial Societies: Social Science from the Bottom Up. Washington: The MIT Press.
15. Haefner J.W., and Crist T.O. Spatial model of movement and foraging in harvester ants (Pogonomyrmex) (I): The roles of memory and communication. Journal of Theoretical Biology 166 (1994) 299-313
16. Haile, D.G., & Weidhaas, D.W., (1997). Computer Simulation of Mosquito Populations (Anopheles albimanus) for comparing the effectiveness of control techniques. Journal of Medicine, 553-567.
17. Hersovici, M., Jacovi, M., Maarek, Y.D., Pelleg, D., Shtalhaim, M. & Sigalit Ur., (1998). The shark-search algorithm - An application: Tailored Web site mapping. In Proceedings of the 7th International World-Wide Web Conference.
18. Heydon A., and Najork M. Mercator: A scalable, extensible Web crawler. World Wide Web Conference 2 4 (1999) 219-229
19. Holland J.H. Hidden order: How adaptation builds complexity (1995), Addison-Wesley, Reading, MA
20. Hraber P.T., Jones T., and Forrest S. The Ecology of Echo Artificial Life III. In: Langton C.G. (Ed) (1997), Addison Wesley, Longman 165-190
21. Iyengar S.S. Computer Modeling and Simulations of Complex Biological System (1998), CRC Press
22. Kleinstein, S.H., & Seiden, P.E., (2000). Simulating the Immune System. Computing in Science and Engineering, 69-77.
23. Kobayashi M., and Takeda K. Information retrieval on the web. ACM Computer Survey 32 2 (2000) 144-173
24. McBryan, O.A., (1994). GENVL and WWWW: Tools for taming the web. In Proceedings of the First World Wide Web Conference, Geneva, Switzerland (pp. 1-13).
25. Menczer, F., Pant, G., Srinivasan, P., & Ruiz, M.E., (2001). Evaluating topic-driven web crawlers. In Proceedings of the 24th conference of research and development in information retrieval (SIGIR) (pp. 241-249). ACM Press.
26. Minar, N., Burkhart, R., Langton, C., & Askenazi, M. (1996). The Swarm simulation system: A toolkit for building multi-agent systems. Available: http://wiki.swarm.org.
27. Pecala S.W. Neighborhood models of plant population dynamics. Multispecies models of annuals 29 (1986) 262-292
28. Pinkerton, B., (1994). Finding what people want: Experiences with the WebCrawler. In Proceedings of the First World Wide Web Conference, Geneva, Switzerland.
29. Pollack, M.E., Ringuette, M., 1990. Introducing the Tileworld: Experimentally Evaluating Agent Architectures. In Proceedings of the Eighth National Conference on Artificial Intelligence (pp. 183-189).
30. Ray T.S. An approach to the synthesis of life. In: Langton C.G., Taylor C., Farmer J.D., and Rasmussen S. (Eds). Artificial Life II (1992), Addison-Wesley, Redwood City, CA 371-408
31. Risvik, K.M., & Michelsen, R. (2002). Search Engines and Web Dynamics. Computer Networks, 39, 289-302.
32. Seiden P.E., and Celada F. A Simulation of the Immune System. Experiments in machine (1998), World Scientific Press, Singapore
33. Symeonidis A.L., Valtos V., Seroglou S., and Mitkas P.A. Biotope: an integrated simulation tool for Augmenting the intelligence of multi-agent communities residing in hostile environments. IEEE Transactions on Systems, Man, and Cybernetics, Part A, Special Issue on Self-organization in Distributed Systems Engineering 35 3 (2005) 420-432
34. Thom Blum, Doug Keislar, Jim Wheaton, & Erling Wold: "Writing a Web Crawler in the Java Programming Language. Muscle Fish LLC, Article on Sun Microsystems Website: http://java.sun.com/developer/technicalArticles/ThirdParty/WebCrawler.
35. Zeinalipour-Yazti, D., & Dikaiakos, M.D., (2002). Design and implementation of a distributed crawler and filtering processor. In Proceedings of the Fifth Next Generation Information Technologies and Systems (NGITS), volume 2382 of Lecture Notes in Computer Science (pp. 58-74). Caesarea, Israel: Springer.