Social streams blog crawler

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2009, Pages 1615-1618

  Hurst, Matthew ^a   Maykov, Alexey ^a  

^a MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA QUALITY; LOW LATENCY; SOCIAL MEDIA; WEB CONTENT; WEBLOGS;

EID: 67649635202     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2009.146     Document Type: Conference Paper

References (13)

1. A. Heydon and M. Najork, \Mercator: A Scalable,Extensible Web Crawler," World Wide Web, vol. 2, no. 4,pp. 219{229, Dec. 1999.
2. H.-T. Lee, D. Leonard, X. Wang, and D. Loguinov, "IRLbot: Scaling to 6 Billion Pages and Beyond,'' WWW, April 2008 (best paper award).
3. Ka Cheung Sia, Junghoo Cho, Hyun-Kyu Cho "Efficient Monitoring Algorithm for Fast News Alerts." IEEE Transactions on Knowledge and Data Engineering, 19(7): July 2007
4. Technorati. State of the blogosphere report. http://technorati.com/ blogging/state-of-the-blogosphere/
5. Universal McCann, Power to the people. SOCIAL MEDIA TRACKER wave.3
6. Michael Gamon, Sumit Basu, Dmitriy Belenko, Danyel Fisher, Matthew Hurst, Arnd Christian König: BLEWS: Using Blogs to Provide Context for News Articles. 2008. Proceedings of the International Conference on Weblogs and Social Media (ICWSM), 2008.
7. IRLbot: Scaling to 6 Billion Pages and Beyond Hsin-Tsang Lee, Derek Leonard, Xiaoming Wang, and Dmitri Loguinov Department of Computer Science, Texas A &M
8. N. Glance. Indexing the blogosphere one post at a time. In Third International Workshop on Web Document Analysis (WDA2005), 2005.
9. http://livelabs.com/social-streams/
10. Technorati. State of the Blogosphere Report. 2008
11. Chellapilla, K., Mityagin, A., and Charles, D. 2007. GigaHash: scalable minimal perfect hashing for billions of urls. In Proceedings of the 16th international Conference on World Wide Web (Banff, Alberta, Canada, May 08 - 12, 2007). WWW '07. ACM, New York, NY, 1165- 1166.
12. The Web Robots Pages, http://www.robotstxt.org/
13. Cormen, Thomas H.; Leiserson, Charles E.; Rivest, Ronald L.; Stein, Clifford. Introduction to Algorithms, second edition, MIT Press and McGraw-Hill. ISBN 0-262-53196-8. Chapter 19, Binomial Heaps